Can Intel Gaudi 3 PCIe (HL-338) run gpt-oss 120B?

Yes, the Intel Gaudi 3 PCIe (HL-338) has 128GB VRAM and gpt-oss 120B requires approximately 71.2GB VRAM for Q4 quantization. Estimated inference speed: 47 tokens/second.

✅ — Intel Gaudi 3 PCIe (HL-338) Can Run gpt-oss 120B

The Intel Gaudi 3 PCIe (HL-338) packs 128GB VRAM. gpt-oss 120B needs ~71.2GB (estimate). You're good to go.

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.

✅ Plenty of headroom

Intel Gaudi 3 PCIe (HL-338) can run it — buy or rent

If you don't own this GPU yet, check retail prices or rent cloud capacity for a trial run.

Amazon eBay Compare cloud prices

We may earn a commission from cloud and hardware partners at no extra cost to you.

Hardware Specs

GPU: Intel Gaudi 3 PCIe (HL-338)
VRAM: 128 GB
Bandwidth: 3700 GB/s
MSRP: $12,500

Model Requirements

Model: gpt-oss 120B
Parameters: 117B total / 5.1B active · load estimate uses total
VRAM (Q4 estimate): ~71.2 GB
Context (estimate default): 4k

Estimated Performance

47 tok/s

Estimated inference speed (Q4 quantization) — bandwidth rule of thumb, not a measured bench

Run it locally with Ollama

ollama run gpt-oss:120b

Requires Ollama installed on your machine

View on Ollama

Pricing

MSRP: $12,500

gpt-oss 120B Details Intel Gaudi 3 PCIe (HL-338) Specs

Try gpt-oss 120B on a different GPU

Try another model on Intel Gaudi 3 PCIe (HL-338)

Full compatibility matrix

HardwareHQ

✅ — Intel Gaudi 3 PCIe (HL-338) Can Run gpt-oss 120B

The Intel Gaudi 3 PCIe (HL-338) packs 128GB VRAM. gpt-oss 120B needs ~71.2GB (estimate). You're good to go.

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.

✅ Plenty of headroom

Intel Gaudi 3 PCIe (HL-338) can run it — buy or rent

If you don't own this GPU yet, check retail prices or rent cloud capacity for a trial run.

Amazon eBay Compare cloud prices

We may earn a commission from cloud and hardware partners at no extra cost to you.

Hardware Specs

GPU: Intel Gaudi 3 PCIe (HL-338)
VRAM: 128 GB
Bandwidth: 3700 GB/s
MSRP: $12,500

Model Requirements

Model: gpt-oss 120B
Parameters: 117B total / 5.1B active · load estimate uses total
VRAM (Q4 estimate): ~71.2 GB
Context (estimate default): 4k

Estimated Performance

47 tok/s

Estimated inference speed (Q4 quantization) — bandwidth rule of thumb, not a measured bench

Run it locally with Ollama

ollama run gpt-oss:120b

Requires Ollama installed on your machine

View on Ollama

Pricing

MSRP: $12,500

gpt-oss 120B Details Intel Gaudi 3 PCIe (HL-338) Specs

Try gpt-oss 120B on a different GPU

Try another model on Intel Gaudi 3 PCIe (HL-338)

Full compatibility matrix

Explore more

✅ — Intel Gaudi 3 PCIe (HL-338) Can Run gpt-oss 120B

Intel Gaudi 3 PCIe (HL-338) can run it — buy or rent

Hardware Specs

Model Requirements

Estimated Performance

Run it locally with Ollama

Pricing

Try gpt-oss 120B on a different GPU

Try another model on Intel Gaudi 3 PCIe (HL-338)

Related Checks

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab

✅ — Intel Gaudi 3 PCIe (HL-338) Can Run gpt-oss 120B

Intel Gaudi 3 PCIe (HL-338) can run it — buy or rent

Hardware Specs

Model Requirements

Estimated Performance

Run it locally with Ollama

Pricing

Try gpt-oss 120B on a different GPU

Try another model on Intel Gaudi 3 PCIe (HL-338)

Related Checks

VRAM Calculator

Cloud GPU Pricing

GPU Comparison

Compatibility Lab