The Radeon Instinct MI300 packs 128GB VRAM. Qwen3 30B-A3B needs ~18.6GB (estimate). You're good to go.
Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.
If you don't own this GPU yet, check retail prices or rent cloud capacity for a trial run.
We may earn a commission from cloud and hardware partners at no extra cost to you.
ollama run qwen3:30b-a3bRequires Ollama installed on your machine
View on Ollama