Can Radeon Instinct MI350X run TinyLlama 1.1B?

Yes, the Radeon Instinct MI350X has 288GB VRAM and TinyLlama 1.1B requires approximately 0.6GB VRAM for Q4 quantization. Estimated inference speed: 11168 tokens/second.

✅ — Radeon Instinct MI350X Can Run TinyLlama 1.1B

The Radeon Instinct MI350X packs 288GB VRAM. TinyLlama 1.1B needs ~0.6GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: Radeon Instinct MI350X
VRAM: 288 GB
Bandwidth: 8189.999999999999 GB/s
MSRP: $0

Model Requirements

Model: TinyLlama 1.1B
Parameters: 1.1B
VRAM (Q4): ~0.6 GB
Context: 2,048

Estimated Performance

11168 tok/s

Estimated inference speed (Q4 quantization)

Run it locally with Ollama

ollama run tinyllama:1.1b

Requires Ollama installed on your machine

View on Ollama

TinyLlama 1.1B Details Radeon Instinct MI350X Specs

Try TinyLlama 1.1B on a different GPU

Try another model on Radeon Instinct MI350X

Full compatibility matrix

HardwareHQ

✅ — Radeon Instinct MI350X Can Run TinyLlama 1.1B

The Radeon Instinct MI350X packs 288GB VRAM. TinyLlama 1.1B needs ~0.6GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU: Radeon Instinct MI350X
VRAM: 288 GB
Bandwidth: 8189.999999999999 GB/s
MSRP: $0

Model Requirements

Model: TinyLlama 1.1B
Parameters: 1.1B
VRAM (Q4): ~0.6 GB
Context: 2,048

Estimated Performance

11168 tok/s

Estimated inference speed (Q4 quantization)

Run it locally with Ollama

ollama run tinyllama:1.1b

Requires Ollama installed on your machine

View on Ollama

TinyLlama 1.1B Details Radeon Instinct MI350X Specs

Try TinyLlama 1.1B on a different GPU

Try another model on Radeon Instinct MI350X

Full compatibility matrix

More tools

VRAM Calculator

Check GPU compatibility for any AI model

Cloud GPU Pricing

Compare pricing across 24+ providers

GPU Comparison

Side-by-side GPU specs and benchmarks

Compatibility Lab

GPU × Model compatibility matrix

✅ — Radeon Instinct MI350X Can Run TinyLlama 1.1B

Hardware Specs

Model Requirements

Estimated Performance

Run it locally with Ollama

Try TinyLlama 1.1B on a different GPU

Try another model on Radeon Instinct MI350X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — Radeon Instinct MI350X Can Run TinyLlama 1.1B

Hardware Specs

Model Requirements

Estimated Performance

Run it locally with Ollama

Try TinyLlama 1.1B on a different GPU

Try another model on Radeon Instinct MI350X

Related Checks

More tools

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab