Can Radeon Instinct MI355X run Llama 3.2 90B Vision?

Yes, the Radeon Instinct MI355X has 288GB VRAM and Llama 3.2 90B Vision requires approximately 49.5GB VRAM for Q4 quantization. Estimated inference speed: 136 tokens/second.

✅ — Radeon Instinct MI355X Can Run Llama 3.2 90B Vision

The Radeon Instinct MI355X packs 288GB VRAM. Llama 3.2 90B Vision needs ~49.5GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: Radeon Instinct MI355X
VRAM: 288 GB
Bandwidth: 8189.999999999999 GB/s
MSRP: $0

Model Requirements

Model: Llama 3.2 90B Vision
Parameters: 90B
VRAM (Q4): ~49.5 GB
Context: 128,000

Estimated Performance

136 tok/s

Estimated inference speed (Q4 quantization)

Run it locally with Ollama

ollama run llama3.2-vision:90b

Requires Ollama installed on your machine

View on Ollama

Llama 3.2 90B Vision Details Radeon Instinct MI355X Specs

Try Llama 3.2 90B Vision on a different GPU

Try another model on Radeon Instinct MI355X

Full compatibility matrix

HardwareHQ

✅ — Radeon Instinct MI355X Can Run Llama 3.2 90B Vision

The Radeon Instinct MI355X packs 288GB VRAM. Llama 3.2 90B Vision needs ~49.5GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: Radeon Instinct MI355X
VRAM: 288 GB
Bandwidth: 8189.999999999999 GB/s
MSRP: $0

Model Requirements

Model: Llama 3.2 90B Vision
Parameters: 90B
VRAM (Q4): ~49.5 GB
Context: 128,000

Estimated Performance

136 tok/s

Estimated inference speed (Q4 quantization)

Run it locally with Ollama

ollama run llama3.2-vision:90b

Requires Ollama installed on your machine

View on Ollama

Llama 3.2 90B Vision Details Radeon Instinct MI355X Specs

Try Llama 3.2 90B Vision on a different GPU

Try another model on Radeon Instinct MI355X

Full compatibility matrix

More tools

VRAM Calculator

Check GPU compatibility for any AI model

Cloud GPU Pricing

Compare pricing across 24+ providers

GPU Comparison

Side-by-side GPU specs and benchmarks

Compatibility Lab

GPU × Model compatibility matrix

✅ — Radeon Instinct MI355X Can Run Llama 3.2 90B Vision

Hardware Specs

Model Requirements

Estimated Performance

Run it locally with Ollama

Try Llama 3.2 90B Vision on a different GPU

Try another model on Radeon Instinct MI355X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — Radeon Instinct MI355X Can Run Llama 3.2 90B Vision

Hardware Specs

Model Requirements

Estimated Performance

Run it locally with Ollama

Try Llama 3.2 90B Vision on a different GPU

Try another model on Radeon Instinct MI355X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab