Google Cloud A3 (8x H100) Can Run Gemma 2 9B

The Google Cloud A3 (8x H100) packs 640GB VRAM. Gemma 2 9B needs ~5GB. You're good to go.

✅ Plenty of headroom

Hardware Specs

GPU
Google Cloud A3 (8x H100)
VRAM
640 GB
Bandwidth
26400 GB/s
MSRP
$0

Model Requirements

Model
Gemma 2 9B
Parameters
9B
VRAM (Q4)
~5 GB
Context
N/A

Estimated Performance

4400 tok/s
Estimated inference speed (Q4 quantization)
0