Can Radeon Instinct MI350X run C4AI Command R+ 08-2024 (HF)?

Yes, the Radeon Instinct MI350X has 288GB VRAM and C4AI Command R+ 08-2024 (HF) requires approximately 57.2GB VRAM for Q4 quantization. Estimated inference speed: 118 tokens/second.

✅ — Radeon Instinct MI350X Can Run C4AI Command R+ 08-2024 (HF)

The Radeon Instinct MI350X packs 288GB VRAM. C4AI Command R+ 08-2024 (HF) needs ~57.2GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: Radeon Instinct MI350X
VRAM: 288 GB
Bandwidth: 8189.999999999999 GB/s
MSRP: $0

Model Requirements

Model: C4AI Command R+ 08-2024 (HF)
Parameters: 104B
VRAM (Q4): ~57.2 GB
Context: 8,192

Estimated Performance

118 tok/s

Estimated inference speed (Q4 quantization)

C4AI Command R+ 08-2024 (HF) Details Radeon Instinct MI350X Specs

Try C4AI Command R+ 08-2024 (HF) on a different GPU

Try another model on Radeon Instinct MI350X

Full compatibility matrix

✅ — Radeon Instinct MI350X Can Run C4AI Command R+ 08-2024 (HF)

Hardware Specs

Model Requirements

Estimated Performance

Try C4AI Command R+ 08-2024 (HF) on a different GPU

Try another model on Radeon Instinct MI350X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — Radeon Instinct MI350X Can Run C4AI Command R+ 08-2024 (HF)

Hardware Specs

Model Requirements

Estimated Performance

Try C4AI Command R+ 08-2024 (HF) on a different GPU

Try another model on Radeon Instinct MI350X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab