The H200 SXM packs 141GB VRAM. Whisper Large v3 needs ~0.9GB (estimate). You're good to go.
Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.
If you don't own this GPU yet, check retail prices or rent cloud capacity for a trial run.
We may earn a commission from cloud and hardware partners at no extra cost to you.
MSRP: $35,000