RTX 6000 Ada Generation
The RTX 6000 Ada Generation is Nvidia’s 48GB graphics card with a 300W board power rating, built on the Ada Lovelace AD102 architecture. Below you’ll find what it can run locally, its benchmark scores and its full spec sheet, plus all 1 board version we track, each with its cheapest current price.
Prices update regularly and may differ at the retailer. This page contains affiliate links.
Benchmarks
Standardized benchmark scores for this chip, each compared to the fastest card we track and linked to its source. They apply to every board version.
Render
Compute & AI
3D graphics
Local AI performance
What the RTX 6000 Ada Generation can run on your own machine, and how fast.
Largest model it can run (8K context)
- Q4 (the usual choice, near-original quality)
- ~68B
- Q8 (closer to original, half the model size)
- ~40B
- FP16 (unquantised, for training and research)
- ~21B
Parameter counts the card holds with room for an 8K conversation, counting the model weights plus its attention cache. A longer conversation needs more memory, so it lowers these figures.
Speed & value
- Speed, 8B model at Q4
- 124-146 tok/s
- Memory bandwidth
- 960 GB/s
- Price per GB of VRAM
- $175.00
Generation speed tracks memory bandwidth, because every word produced reads the whole model from memory. Shown as a range.
Models that fit, at Q4
| Model | Size | Memory needed | Est. speed |
|---|---|---|---|
| Qwen2 Math 72B | 72.7B | 43.9GB | 15-17 tok/s |
| Dolphin Llama3 70B | 71.0B | 42.7GB | 15-18 tok/s |
| Llama3 Chatqa 70B | 71.0B | 42.7GB | 15-18 tok/s |
Popular models small enough for this card at Q4, one per family. Speed is left blank for mixture-of-experts models, where a bandwidth estimate is not reliable enough to publish.
Choosing a card for AI? Compare every GPU for local AI, including setups that pool the memory of two or more cards.
RTX 6000 Ada Generation versions (1)
Every board version we track, cheapest first.
- $8,399.96
| Version | Boost Clock | Length | Color | From | Buy | |
|---|---|---|---|---|---|---|
| PNY RTX 6000 Ada Generation | — | 267 mm | — | $8,399.96 | |
1 board version of the RTX 6000 Ada Generation are listed above, starting from $8,399.96. Prices update daily from live retailer stock. Click any version name for its full spec sheet and all current retailer prices.
Specifications
Every RTX 6000 Ada Generation board version we track measures 267 mm long.
Performance
- Boost clock
- 2505 MHz
- Base clock
- 915 MHz
- Shader cores
- 18,176
- SM count
- 142
- Texture units (TMUs)
- 568
- Render outputs (ROPs)
- 192
- RT cores
- 142 · 3rd gen
- Tensor / AI cores
- 568 · 4th gen
Memory
- VRAM
- 48GB GDDR6
- Memory bus
- 384-bit
- Bandwidth
- 960 GB/s
- Memory speed
- 20 Gbps
- L2 cache
- 96 MB
GPU die
- Architecture
- Ada Lovelace AD102
- Process node
- TSMC 4N
- Foundry
- TSMC
- Die size
- 608 mm²
- Transistors
- 76.3 billion
- Generation
- RTX Ada
Power
- TDP
- 300W
- Power connectors
- 1 16-pin
Display & outputs
- Max resolution
- 7680 × 4320
- Max displays
- 4
- HDCP
- 2.2
- Outputs
- 4 DisplayPort 1.4a
- PCIe interface
- PCIe 4.0 ×16
APIs & software
- DirectX
- 12
- Vulkan
- 1.3
- OpenGL
- 4.6
- OpenCL
- 3.0
- CUDA
- Compute 8.9
- Shader model
- 6.6
Video encoding & decoding
| Codec | Encode | Decode |
|---|---|---|
| H.264 / AVC | Supported | Supported |
| H.265 / HEVC | Supported | Supported |
| AV1 | Supported | Supported |
| VP9 | Not supported | Supported |
Encoder: NVENC 8th gen · Decoder: NVDEC 5th gen
Features
- Upscaling
- DLSS Super Resolution, Ray Reconstruction, Frame Generation
- Also runs
- FSR 3, FSR 3 Frame Generation, XeSS 2, XeSS 2 Frame Generation
- ECC memory
- Yes
Physical
- Reference length
- 267 mm
- Slot width
- 2 slots
- Released
- 2023-01-20
- MSRP
- $6,799.00
18,176 shader cores feed a 384-bit memory interface delivering 960 GB/s of peak bandwidth. 142 RT cores handle real-time ray tracing; 568 tensor cores accelerate AI workloads and DLSS Super Resolution. Compare the RTX 6000 Ada Generation against consumer and workstation cards on the ranking of graphics cards for AI.
How the RTX 6000 Ada Generation compares
Cards worth a look for running AI models, picked on memory, estimated generation speed and live prices. Gaming cards are included wherever they hold as much for less. Open a card for its full spec sheet.
Affiliate disclosure: Some links on this page are affiliate links — MaxMyBuild may earn a commission at no extra cost to you if you buy through them. As an Amazon Associate, MaxMyBuild earns from qualifying purchases. For Amazon, current price and availability are shown on the Amazon product page; product prices and availability are accurate as of the date and time of purchase and are subject to change. Prices shown for other retailers are approximate and may differ at checkout. “Search” links are non-affiliate and provided for convenience only.