← Back to Models
Mistral AItransformer
Mistral Medium (API)
70B parameters • 42.6GB VRAM (Q4 estimate) • 32,000 context
Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.
Specifications
Parameters
70B
VRAM (Q4 est.)
42.6 GB
VRAM (FP16)
140 GB
Context Window
32,000
Architecture
transformer
License
Mistral API TOS
Finding cloud alternatives...
Run Mistral Medium (API) on Mac Mini M4 Pro 48GB
~42.6GB VRAM needed at Q4. Mac Mini M4 Pro 48GB has 48GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Mistral Medium (API)
Compatibility Lab — check every GPU × quantization combination