Can GB200 NVL72 run All-MPNet-Base-v2?

Yes, the GB200 NVL72 has 13824GB VRAM and All-MPNet-Base-v2 requires approximately 0.1GB VRAM for Q4 quantization. Estimated inference speed: 46101 tokens/second.

HardwareHQ

✅ — GB200 NVL72 Can Run All-MPNet-Base-v2

The GB200 NVL72 packs 13824GB VRAM. All-MPNet-Base-v2 needs ~0.1GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: GB200 NVL72
VRAM: 13824 GB
Bandwidth: 3350 GB/s
MSRP: $0

Model Requirements

Model: All-MPNet-Base-v2
Parameters: 0.109B
VRAM (Q4): ~0.1 GB
Context: 384

Estimated Performance

46101 tok/s

Estimated inference speed (Q4 quantization)

All-MPNet-Base-v2 Details GB200 NVL72 Specs

Try All-MPNet-Base-v2 on a different GPU

Try another model on GB200 NVL72

Full compatibility matrix

More tools

VRAM Calculator

Check GPU compatibility for any AI model

Cloud GPU Pricing

Compare pricing across 24+ providers

GPU Comparison

Side-by-side GPU specs and benchmarks

Compatibility Lab

GPU × Model compatibility matrix

✅ — GB200 NVL72 Can Run All-MPNet-Base-v2

Hardware Specs

Model Requirements

Estimated Performance

Try All-MPNet-Base-v2 on a different GPU

Try another model on GB200 NVL72

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — GB200 NVL72 Can Run All-MPNet-Base-v2

Hardware Specs

Model Requirements

Estimated Performance

Try All-MPNet-Base-v2 on a different GPU

Try another model on GB200 NVL72

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab