RTX A5000
The RTX A5000 is Nvidia’s 24GB graphics card with a 230W board power rating, built on the Ampere GA102 architecture. Below you’ll find what it can run locally, its benchmark scores and its full spec sheet, plus all 1 board version we track, each with its cheapest current price.
Prices update regularly and may differ at the retailer. This page contains affiliate links.
Benchmarks
Standardized benchmark scores for this chip, each compared to the fastest card we track and linked to its source. They apply to every board version.
Render
Compute & AI
3D graphics
Local AI performance
What the RTX A5000 can run on your own machine, and how fast.
Largest model it can run (8K context)
- Q4 (the usual choice, near-original quality)
- ~32B
- Q8 (closer to original, half the model size)
- ~19B
- FP16 (unquantised, for training and research)
- ~10B
Parameter counts the card holds with room for an 8K conversation, counting the model weights plus its attention cache. A longer conversation needs more memory, so it lowers these figures.
Speed & value
- Speed, 8B model at Q4
- 99-116 tok/s
- Memory bandwidth
- 768 GB/s
- Price per GB of VRAM
- $132.04
Generation speed tracks memory bandwidth, because every word produced reads the whole model from memory. Shown as a range.
Models that fit, at Q4
| Model | Size | Memory needed | Est. speed |
|---|---|---|---|
| Llava 34B | 34.8B | 21.5GB | 25-29 tok/s |
| Yi 34B | 34.4B | 21.5GB | 25-29 tok/s |
| Nous Hermes2 34B | 34.0B | 21.6GB | 25-29 tok/s |
Popular models small enough for this card at Q4, one per family. Speed is left blank for mixture-of-experts models, where a bandwidth estimate is not reliable enough to publish.
Choosing a card for AI? Compare every GPU for local AI, including setups that pool the memory of two or more cards.
RTX A5000 versions (1)
Every board version we track, cheapest first.
- PNY RTX A5000267 mm$3,169.00
| Version | Boost Clock | Length | Color | From | Buy | |
|---|---|---|---|---|---|---|
| PNY RTX A5000 | — | 267 mm | — | $3,169.00 | |
1 board version of the RTX A5000 are listed above, starting from $3,169.00. Prices update daily from live retailer stock. Click any version name for its full spec sheet and all current retailer prices.
Specifications
Every RTX A5000 board version we track measures 267 mm long.
Performance
- Boost clock
- 1695 MHz
- Shader cores
- 8,192
- SM count
- 64
- Texture units (TMUs)
- 256
- Render outputs (ROPs)
- 96
- RT cores
- 64 · 2nd gen
- Tensor / AI cores
- 256 · 3rd gen
Memory
- VRAM
- 24GB GDDR6
- Memory bus
- 384-bit
- Bandwidth
- 768 GB/s
- Memory speed
- 16 Gbps
GPU die
- Architecture
- Ampere GA102
- Process node
- Samsung 8N
- Foundry
- Samsung
- Die size
- 628 mm²
- Transistors
- 28.3 billion
- Generation
- RTX A-series
Power
- TDP
- 230W
Display & outputs
- Max resolution
- 7680 × 4320
- Max displays
- 4
- HDCP
- 2.2
- Outputs
- 4 DisplayPort 1.4a
- PCIe interface
- PCIe 4.0 ×16
APIs & software
- DirectX
- 12 Ultimate (12.2)
- Vulkan
- 1.3
- OpenGL
- 4.6
- OpenCL
- 3.0
- CUDA
- Compute 8.6
- Shader model
- 6.6
Video encoding & decoding
| Codec | Encode | Decode |
|---|---|---|
| H.264 / AVC | Supported | Supported |
| H.265 / HEVC | Supported | Supported |
| AV1 | Not supported | Supported |
| VP9 | Not supported | Supported |
Encoder: NVENC 7th gen · Decoder: NVDEC 5th gen
Features
- Upscaling
- DLSS Super Resolution, Ray Reconstruction
- Also runs
- FSR 3, FSR 3 Frame Generation, XeSS 2, XeSS 2 Frame Generation
- Multi-GPU
- NVLink
- ECC memory
- Yes
Physical
- Reference length
- 267 mm
- Slot width
- 2 slots
- Released
- 2021-04-12
8,192 shader cores feed a 384-bit memory interface delivering 768 GB/s of peak bandwidth. 64 RT cores handle real-time ray tracing; 256 tensor cores accelerate AI workloads and DLSS Super Resolution. Compare the RTX A5000 against consumer and workstation cards on the ranking of graphics cards for AI.
How the RTX A5000 compares
Cards worth a look for running AI models, picked on memory, estimated generation speed and live prices. Gaming cards are included wherever they hold as much for less. Open a card for its full spec sheet.
Affiliate disclosure: Some links on this page are affiliate links — MaxMyBuild may earn a commission at no extra cost to you if you buy through them. As an Amazon Associate, MaxMyBuild earns from qualifying purchases. For Amazon, current price and availability are shown on the Amazon product page; product prices and availability are accurate as of the date and time of purchase and are subject to change. Prices shown for other retailers are approximate and may differ at checkout. “Search” links are non-affiliate and provided for convenience only.