The GB10 only has 128GB VRAM. Qwen3 235B-A22B needs ~143GB (estimate). Time to rent or upgrade.
Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.
Need more VRAM?
Rent cloud GPUs with 143GB+ VRAM to run Qwen3 235B-A22B, or upgrade hardware.
This GPU is short by ~15.0GB VRAM for Qwen3 235B-A22B at Q4.
We may earn a commission from cloud and hardware partners at no extra cost to you.