DeepSeekmoe

DeepSeek V3 (HF)

671B total / 37B active · load estimate uses total • 408.4GB VRAM (Q4 estimate) • 128,000 context

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.

Specifications

Parameters

671B total / 37B active · load estimate uses total

VRAM (Q4 est.)

408.4 GB

VRAM (FP16)

1342 GB

Context Window

128,000

Architecture

moe

License

Apache-2.0

Finding cloud alternatives...

Run DeepSeek V3 (HF) on Lambda Labs 1-Click Cluster (8x H100)

~408.4GB VRAM needed at Q4. Lambda Labs 1-Click Cluster (8x H100) has 640GB — buy hardware or rent cloud.

Amazon eBay Compare cloud prices

We may earn a commission from cloud and hardware partners at no extra cost to you.

Find the cheapest GPU that can run DeepSeek V3 (HF)

Compatibility Lab — check every GPU × quantization combination

→

Run DeepSeek V3 (HF) on...

GB200 NVL72✅ Fits Lambda Labs 1-Click Cluster (8x H100)✅ Fits Google Cloud A3 (8x H100)✅ Fits Azure ND H100 v5 (8x H100)✅ Fits AWS EC2 P5 Instance (8x H100)✅ Fits NVIDIA DGX H100✅ Fits

VRAM Calculator→GPU Comparison→Cloud GPU Pricing→

← Back to Models

DeepSeekmoe

DeepSeek V3 (HF)

671B total / 37B active · load estimate uses total • 408.4GB VRAM (Q4 estimate) • 128,000 context

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.