Independent reference · Est. dataset v1.0.0

The independent directory of AI inference providers

TL;DR — extractable factssource: tokenmeter dataset
  • 20 inference providers indexed across 8 categories, from frontier labs to specialist-hardware and GPU clouds.
  • 17 of 20 expose an OpenAI-compatible API; 18 offer open-weight model access.
  • Median blended price is $0.88 per 1M tokens; the lowest listed is cheapestinference at $0.30.
  • Lowest reference time-to-first-token: Cerebras Inference (110 ms). Highest reference throughput: Cerebras Inference (520 tok/s).
  • All figures are seed/approximate reference points per the confidence legend — not SLAs or quotes.

Provider comparison

Full table & filters →

Click any column header to sort. Blended $/1M is the mean of input and output price for the provider's reference model; "—" marks providers billed by GPU-time rather than per token.

Ranked by composite reputation index —see Methodology. Click any header to re-sort.

Comparison of AI inference providers by price, latency, throughput, uptime and reputation.
OpenAI/openaiFrontier lab$6.254809099.891
Anthropic/anthropicFrontier lab$9.005207899.8·90
OpenRouter/openrouterRouter$0.9040012099.688
Groq/groqSpecialist hardware$0.6912048099.687
Together AI/together-aiAggregator$0.8834013099.786
Fireworks AI/fireworks-aiAggregator$0.9030014599.785
Modal/modalGPU cloud70010099.7·85
Google Vertex AI/google-vertexHyperscaler$3.136108599.984
Baseten/basetenGPU cloud$0.8028014099.684
Mistral La Plateforme/mistralFrontier lab$4.004309599.683
cheapestinference/cheapestinferenceSubscription (flat-rate)$0.3034012099.583
Cerebras Inference/cerebrasSpecialist hardware$0.7011052099.582
Perplexity API/perplexitySpecialist app$1.006508099.582
DeepInfra/deepinfraAggregator$0.3836011099.581
Replicate/replicateAggregator$1.709006099.3·80
SambaNova Cloud/sambanovaSpecialist hardware$0.9013040099.479
Nebius AI Studio/nebiusGPU cloud$0.5037011899.579
Lepton AI/lepton-aiGPU cloud$0.5033012599.478
Novita AI/novita-aiAggregator$0.3538010599.477
Hyperbolic/hyperbolicGPU cloud$0.4035011599.376