Skip to content
HQ
HardwareHQ
Live PricingPro

Inference Calculator

Export PDFPro

Estimate tokens/second, latency, and cost for LLM inference on any GPU.

VRAM Required

3.9of 24GB (16%)

Throughput

114tokens/sec

Cost per 1K Tokens

N/ANo cloud price available

Monthly Cost

N/ANo cloud price available

Performance Metrics

9ms
Latency per token
122.9K
Tokens/minute
86,400
Daily requests

Recommendations

Good Fit
Model fits well in GPU memory with room for batching.
Normal Load
Current load is manageable for single GPU deployment.

Cost Analysis

Tokens per Hour411,429

Cloud pricing not available for Select a GPU. Check the Cloud Compute Tracker for live rental prices.

HQ
HardwareHQ

AI infrastructure decision engine. Track the GPU market, simulate workloads, and find the most cost-effective setup for any AI project.

Market & Pricing

  • Cloud GPU Pricing
  • Buy vs Rent Calculator
  • GPU Comparison
  • AI Benchmarks
  • Inference Calculator
  • Training Calculator

Planning Studios

  • Research Studio
  • RAG Studio
  • Creative Studio
  • Coding Studio
  • Edge AI Studio
  • Hardware Architect
  • Topology Lab

Reference & Guides

  • VRAM Calculator
  • Model Finder
  • Compatibility Lab
  • LLM Requirements
  • Quantization Guide
  • Best GPU for LLaMA
  • Best GPU for DeepSeek

Company

  • About
  • Contact
  • Privacy Policy
  • Terms of Service

© 2026 HardwareHQ. All rights reserved.

@HardwareHQio