Specifications
Parameters
132B
VRAM (Q4)
72.6 GB
VRAM (FP16)
264 GB
Context Window
32,768
Architecture
moe
License
Apache-2.0
Finding cloud alternatives...
Run DBRX Instruct on NVIDIA A100 80GB
~72.6GB VRAM needed at Q4. NVIDIA A100 80GB has 80GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run DBRX Instruct
Compatibility Lab — check every GPU × quantization combination