The Quadro RTX 3000 Max-Q only has 6GB VRAM. Claude 3.5 Sonnet needs ~96.3GB. Time to rent or upgrade.
Need more VRAM?
Rent cloud GPUs with 96.3GB+ VRAM to run Claude 3.5 Sonnet, or upgrade hardware.
This GPU is short by ~90.3GB VRAM for Claude 3.5 Sonnet at Q4.
We may earn a commission from cloud and hardware partners at no extra cost to you.