RTX A4000
The RTX A4000 is Nvidia’s 16GB graphics card with a 140W board power rating, built on the Ampere GA104 architecture. Below you’ll find what it can run locally, its benchmark scores and its full spec sheet, plus all 1 board version we track, each with its cheapest current price.
Prices update regularly and may differ at the retailer. This page contains affiliate links.
Benchmarks
Standardized benchmark scores for this chip, each compared to the fastest card we track and linked to its source. They apply to every board version.
Render
Compute & AI
3D graphics
Local AI performance
What the RTX A4000 can run on your own machine, and how fast.
Largest model it can run (8K context)
- Q4 (the usual choice, near-original quality)
- ~20B
- Q8 (closer to original, half the model size)
- ~12B
- FP16 (unquantised, for training and research)
- ~6.6B
Parameter counts the card holds with room for an 8K conversation, counting the model weights plus its attention cache. A longer conversation needs more memory, so it lowers these figures.
Speed & value
- Speed, 8B model at Q4
- 68-79 tok/s
- Memory bandwidth
- 448 GB/s
- Price per GB of VRAM
- $90.31
Generation speed tracks memory bandwidth, because every word produced reads the whole model from memory. Shown as a range.
Models that fit, at Q4
| Model | Size | Memory needed | Est. speed |
|---|---|---|---|
| GPT Oss 20B | 20.9B | 13.2GB | — |
| Granite Code 20B | 20.1B | 13.7GB | 29-33 tok/s |
| Starcoder2 15B | 16.0B | 9.7GB | 37-43 tok/s |
Popular models small enough for this card at Q4, one per family. Speed is left blank for mixture-of-experts models, where a bandwidth estimate is not reliable enough to publish.
Choosing a card for AI? Compare every GPU for local AI, including setups that pool the memory of two or more cards.
RTX A4000 versions (1)
Every board version we track, cheapest first.
- PNY RTX A4000241 mm$1,445.00
| Version | Boost Clock | Length | Color | From | Buy | |
|---|---|---|---|---|---|---|
| PNY RTX A4000 | — | 241 mm | — | $1,445.00 | |
1 board version of the RTX A4000 are listed above, starting from $1,445.00. Prices update daily from live retailer stock. Click any version name for its full spec sheet and all current retailer prices.
Specifications
Every RTX A4000 board version we track measures 241 mm long.
Performance
- Boost clock
- 1560 MHz
- Base clock
- 735 MHz
- Shader cores
- 6,144
- SM count
- 48
- Texture units (TMUs)
- 192
- Render outputs (ROPs)
- 96
- RT cores
- 48 · 2nd gen
- Tensor / AI cores
- 192 · 3rd gen
Memory
- VRAM
- 16GB GDDR6
- Memory bus
- 256-bit
- Bandwidth
- 448 GB/s
- Memory speed
- 14 Gbps
- L2 cache
- 4 MB
GPU die
- Architecture
- Ampere GA104
- Process node
- Samsung 8N
- Foundry
- Samsung
- Die size
- 392 mm²
- Transistors
- 17.4 billion
- Generation
- RTX A-series
Power
- TDP
- 140W
- Power connectors
- 1 6-pin
Display & outputs
- Max resolution
- 7680 × 4320
- Max displays
- 4
- HDCP
- 2.2
- Outputs
- 4 DisplayPort 1.4a
- PCIe interface
- PCIe 4.0 ×16
APIs & software
- DirectX
- 12 Ultimate (12.2)
- Vulkan
- 1.3
- OpenGL
- 4.6
- OpenCL
- 3.0
- CUDA
- Compute 8.6
- Shader model
- 6.6
Video encoding & decoding
| Codec | Encode | Decode |
|---|---|---|
| H.264 / AVC | Supported | Supported |
| H.265 / HEVC | Supported | Supported |
| AV1 | Not supported | Supported |
| VP9 | Not supported | Supported |
Encoder: NVENC 7th gen · Decoder: NVDEC 5th gen
Features
- Upscaling
- DLSS Super Resolution, Ray Reconstruction
- Also runs
- FSR 3, FSR 3 Frame Generation, XeSS 2, XeSS 2 Frame Generation
- ECC memory
- Yes
Physical
- Reference length
- 241 mm
- Slot width
- 1 slots
- Released
- 2021-04-12
6,144 shader cores feed a 256-bit memory interface delivering 448 GB/s of peak bandwidth. 48 RT cores handle real-time ray tracing; 192 tensor cores accelerate AI workloads and DLSS Super Resolution. Compare the RTX A4000 against consumer and workstation cards on the ranking of graphics cards for AI.
How the RTX A4000 compares
Cards worth a look for running AI models, picked on memory, estimated generation speed and live prices. Gaming cards are included wherever they hold as much for less. Open a card for its full spec sheet.
Affiliate disclosure: Some links on this page are affiliate links — MaxMyBuild may earn a commission at no extra cost to you if you buy through them. As an Amazon Associate, MaxMyBuild earns from qualifying purchases. For Amazon, current price and availability are shown on the Amazon product page; product prices and availability are accurate as of the date and time of purchase and are subject to change. Prices shown for other retailers are approximate and may differ at checkout. “Search” links are non-affiliate and provided for convenience only.