RTX A5000
The RTX A5000 is Nvidia’s 24GB graphics card with a 230W board power rating, built on the Ampere GA102 architecture. Below you’ll find what it can run locally, its benchmark scores and its full spec sheet. No shop we track in Canada has a board version in stock right now, but the specs and benchmarks below still apply.
Prices update regularly and may differ at the retailer. This page contains affiliate links.
Benchmarks
Standardized benchmark scores for this chip, each compared to the fastest card we track and linked to its source. They apply to every board version.
Render
Compute & AI
3D graphics
Local AI performance
What the RTX A5000 can run on your own machine, and how fast.
Largest model it can run (8K context)
- Q4 (the usual choice, near-original quality)
- ~32B
- Q8 (closer to original, half the model size)
- ~19B
- FP16 (unquantised, for training and research)
- ~10B
Parameter counts the card holds with room for an 8K conversation, counting the model weights plus its attention cache. A longer conversation needs more memory, so it lowers these figures.
Speed & value
- Speed, 8B model at Q4
- 99-116 tok/s
- Memory bandwidth
- 768 GB/s
- Price per GB of VRAM
- —
Generation speed tracks memory bandwidth, because every word produced reads the whole model from memory. Shown as a range.
Models that fit, at Q4
| Model | Size | Memory needed | Est. speed |
|---|---|---|---|
| Llava 34B | 34.8B | 21.5GB | 25-29 tok/s |
| Yi 34B | 34.4B | 21.5GB | 25-29 tok/s |
| Nous Hermes2 34B | 34.0B | 21.6GB | 25-29 tok/s |
Popular models small enough for this card at Q4, one per family. Speed is left blank for mixture-of-experts models, where a bandwidth estimate is not reliable enough to publish.
Choosing a card for AI? Compare every GPU for local AI, including setups that pool the memory of two or more cards.
RTX A5000 availability
Live retailer stock for this model.
Currently out of stock
None of the board versions of the RTX A5000 are in stock at the shops we track in Canada right now. Prices refresh daily, so check back.
Browse in-stock graphics cards for AISee US prices for this cardBuying a used, refurbished or open-box RTX A5000
None of the shops we track in Canada has a new RTX A5000 in stock right now, so used, refurbished and open-box listings are the main way to buy one.
- Open box:
- unused or returned, sold as new but no longer sealed.
- Refurbished:
- repaired or checked by a seller or the maker, often with a warranty of its own.
- Used:
- sold as the seller describes it. Warranty depends on the brand and the seller.
On eBay
What to check before buying
- The RTX A5000 came out in April 2021, so a used one can be over 5 years old. Ask how long and how hard it was used.
- Ask for photos of the card itself, not stock images. Check the fans, the PCIe connector and the power sockets for damage or scorch marks.
- Run a game or a stress test as soon as it arrives, while you can still return it. eBay's buyer protection covers an item that arrives faulty or doesn't match its listing.
- Ask whether the warranty transfers. Some brands cover a second owner; others cover only the first buyer.
- On a refurbished listing, check who did the work and how long their warranty runs.
More in our guide to buying new vs used PC parts.
Specifications
The reference RTX A5000 measures 267 mm long.
Performance
- Boost clock
- 1695 MHz
- Shader cores
- 8,192
- SM count
- 64
- Texture units (TMUs)
- 256
- Render outputs (ROPs)
- 96
- RT cores
- 64 · 2nd gen
- Tensor / AI cores
- 256 · 3rd gen
Memory
- VRAM
- 24GB GDDR6
- Memory bus
- 384-bit
- Bandwidth
- 768 GB/s
- Memory speed
- 16 Gbps
GPU die
- Architecture
- Ampere GA102
- Process node
- Samsung 8N
- Foundry
- Samsung
- Die size
- 628 mm²
- Transistors
- 28.3 billion
- Generation
- RTX A-series
Power
- TDP
- 230W
Display & outputs
- Max resolution
- 7680 × 4320
- Max displays
- 4
- HDCP
- 2.2
- Outputs
- 4 DisplayPort 1.4a
- PCIe interface
- PCIe 4.0 ×16
APIs & software
- DirectX
- 12 Ultimate (12.2)
- Vulkan
- 1.3
- OpenGL
- 4.6
- OpenCL
- 3.0
- CUDA
- Compute 8.6
- Shader model
- 6.6
Video encoding & decoding
| Codec | Encode | Decode |
|---|---|---|
| H.264 / AVC | Supported | Supported |
| H.265 / HEVC | Supported | Supported |
| AV1 | Not supported | Supported |
| VP9 | Not supported | Supported |
Encoder: NVENC 7th gen · Decoder: NVDEC 5th gen
Features
- Upscaling
- DLSS Super Resolution, Ray Reconstruction
- Also runs
- FSR 3, FSR 3 Frame Generation, XeSS 2, XeSS 2 Frame Generation
- Multi-GPU
- NVLink
- ECC memory
- Yes
Physical
- Reference length
- 267 mm
- Slot width
- 2 slots
- Released
- 2021-04-12
8,192 shader cores feed a 384-bit memory interface delivering 768 GB/s of peak bandwidth. 64 RT cores handle real-time ray tracing; 256 tensor cores accelerate AI workloads and DLSS Super Resolution. Compare the RTX A5000 against consumer and workstation cards on the ranking of graphics cards for AI.
How the RTX A5000 compares
The RTX A5000 has no offer in stock in Canada right now, so these are the closest cards you can buy today, picked on memory, estimated generation speed and live prices. Gaming cards are included wherever they hold as much for less. Open a card for its full spec sheet.
Affiliate disclosure: Some links on this page are affiliate links — MaxMyBuild may earn a commission at no extra cost to you if you buy through them. As an Amazon Associate, MaxMyBuild earns from qualifying purchases. For Amazon, current price and availability are shown on the Amazon product page; product prices and availability are accurate as of the date and time of purchase and are subject to change. Prices shown for other retailers are approximate and may differ at checkout. “Search” links are non-affiliate and provided for convenience only.