← Back to Models
Mistral AItransformer
Mistral Medium (API)
70B parameters • 38.5GB VRAM (Q4) • 32,000 context
Specifications
Parameters
70B
VRAM (Q4)
38.5 GB
VRAM (FP16)
140 GB
Context Window
32,000
Architecture
transformer
License
Mistral API TOS
Finding cloud alternatives...
Run Mistral Medium (API) on NVIDIA A100 40GB PCIe
~38.5GB VRAM needed at Q4. NVIDIA A100 40GB PCIe has 40GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Mistral Medium (API)
Compatibility Lab — check every GPU × quantization combination