BigSciencetransformer

BLOOM 176B

176B parameters • 107.1GB VRAM (Q4 estimate) • 2,048 context

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.

Specifications

Parameters

176B

VRAM (Q4 est.)

107.1 GB

VRAM (FP16)

352 GB

Context Window

2,048

Architecture

transformer

License

BigScience RAIL

Finding cloud alternatives...

Run BLOOM 176B on Mac Studio M4 Max 128GB

~107.1GB VRAM needed at Q4. Mac Studio M4 Max 128GB has 128GB — buy hardware or rent cloud.

Amazon eBay Compare cloud prices

We may earn a commission from cloud and hardware partners at no extra cost to you.

Find the cheapest GPU that can run BLOOM 176B

Compatibility Lab — check every GPU × quantization combination

→

Run BLOOM 176B on...

GB200 NVL72✅ Fits Lambda Labs 1-Click Cluster (8x H100)✅ Fits Google Cloud A3 (8x H100)✅ Fits Azure ND H100 v5 (8x H100)✅ Fits AWS EC2 P5 Instance (8x H100)✅ Fits NVIDIA DGX H100✅ Fits

VRAM Calculator→GPU Comparison→Cloud GPU Pricing→

← Back to Models

BigSciencetransformer

BLOOM 176B

176B parameters • 107.1GB VRAM (Q4 estimate) • 2,048 context

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.