The RTX 4090 only has 24GB VRAM. Llama 3.2 90B Vision needs ~49.5GB. Time to rent or upgrade.
Need more VRAM?
Rent cloud GPUs with 49.5GB+ VRAM to run Llama 3.2 90B Vision, or upgrade hardware.
This GPU is short by ~25.5GB VRAM for Llama 3.2 90B Vision at Q4.
We may earn a commission from cloud and hardware partners at no extra cost to you.
MSRP: $1,599