Can Radeon Instinct MI355X run Llama 3.2 11B Vision Instruct?

Yes, the Radeon Instinct MI355X has 288GB VRAM and Llama 3.2 11B Vision Instruct requires approximately 6.1GB VRAM for Q4 quantization. Estimated inference speed: 1117 tokens/second.

✅ — Radeon Instinct MI355X Can Run Llama 3.2 11B Vision Instruct

The Radeon Instinct MI355X packs 288GB VRAM. Llama 3.2 11B Vision Instruct needs ~6.1GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: Radeon Instinct MI355X
VRAM: 288 GB
Bandwidth: 8189.999999999999 GB/s
MSRP: $0

Model Requirements

Model: Llama 3.2 11B Vision Instruct
Parameters: 11B
VRAM (Q4): ~6.1 GB
Context: 8,192

Estimated Performance

1117 tok/s

Estimated inference speed (Q4 quantization)

Llama 3.2 11B Vision Instruct Details Radeon Instinct MI355X Specs

Try Llama 3.2 11B Vision Instruct on a different GPU

Try another model on Radeon Instinct MI355X

Full compatibility matrix

✅ — Radeon Instinct MI355X Can Run Llama 3.2 11B Vision Instruct

Hardware Specs

Model Requirements

Estimated Performance

Try Llama 3.2 11B Vision Instruct on a different GPU

Try another model on Radeon Instinct MI355X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — Radeon Instinct MI355X Can Run Llama 3.2 11B Vision Instruct

Hardware Specs

Model Requirements

Estimated Performance

Try Llama 3.2 11B Vision Instruct on a different GPU

Try another model on Radeon Instinct MI355X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab