Can H200 NVL run GPT-4o Mini?

Yes, the H200 NVL has 141GB VRAM and GPT-4o Mini requires approximately 4.4GB VRAM for Q4 quantization. Estimated inference speed: 917 tokens/second.

HardwareHQ

✅ — H200 NVL Can Run GPT-4o Mini

The H200 NVL packs 141GB VRAM. GPT-4o Mini needs ~4.4GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: H200 NVL
VRAM: 141 GB
Bandwidth: 4890 GB/s
MSRP: $0

Model Requirements

Model: GPT-4o Mini
Parameters: 8B
VRAM (Q4): ~4.4 GB
Context: 128,000

Estimated Performance

917 tok/s

Estimated inference speed (Q4 quantization)

GPT-4o Mini Details H200 NVL Specs

Try GPT-4o Mini on a different GPU

Try another model on H200 NVL

Full compatibility matrix

More tools

VRAM Calculator

Check GPU compatibility for any AI model

Cloud GPU Pricing

Compare pricing across 24+ providers

GPU Comparison

Side-by-side GPU specs and benchmarks

Compatibility Lab

GPU × Model compatibility matrix

✅ — H200 NVL Can Run GPT-4o Mini

Hardware Specs

Model Requirements

Estimated Performance

Try GPT-4o Mini on a different GPU

Try another model on H200 NVL

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — H200 NVL Can Run GPT-4o Mini

Hardware Specs

Model Requirements

Estimated Performance

Try GPT-4o Mini on a different GPU

Try another model on H200 NVL

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab