Independent reference · Est. dataset v1.0.0

The independent directory of AI inference providers

TL;DR — extractable factssource: tokenmeter dataset
  • 20 inference providers indexed across 8 categories, from frontier labs to specialist-hardware and GPU clouds.
  • 17 of 20 expose an OpenAI-compatible API; 18 offer open-weight model access.
  • Median blended price is $0.88 per 1M tokens; the lowest listed is cheapestinference at $0.30.
  • Lowest reference time-to-first-token: Cerebras Inference (110 ms). Highest reference throughput: Cerebras Inference (520 tok/s).
  • All figures are seed/approximate reference points per the confidence legend — not SLAs or quotes.

Provider comparison

Full table & filters →

Click any column header to sort. Blended $/1M is the mean of input and output price for the provider's reference model; "—" marks providers billed by GPU-time rather than per token.

Ranked by composite reputation index —see Methodology. Click any header to re-sort.

Comparison of AI inference providers by price, latency, throughput, uptime and reputation.
OpenAI/openaiFrontier lab$6.254809099.8✓91
Anthropic/anthropicFrontier lab$9.005207899.8·90
OpenRouter/openrouterRouter$0.9040012099.6✓88
Groq/groqSpecialist hardware$0.6912048099.6✓87
Together AI/together-aiAggregator$0.8834013099.7✓86
Fireworks AI/fireworks-aiAggregator$0.9030014599.7✓85
Modal/modalGPU cloud—70010099.7·85
Google Vertex AI/google-vertexHyperscaler$3.136108599.9✓84
Baseten/basetenGPU cloud$0.8028014099.6✓84
Mistral La Plateforme/mistralFrontier lab$4.004309599.6✓83
cheapestinference/cheapestinferenceSubscription (flat-rate)$0.3034012099.5✓83
Cerebras Inference/cerebrasSpecialist hardware$0.7011052099.5✓82
Perplexity API/perplexitySpecialist app$1.006508099.5✓82
DeepInfra/deepinfraAggregator$0.3836011099.5✓81
Replicate/replicateAggregator$1.709006099.3·80
SambaNova Cloud/sambanovaSpecialist hardware$0.9013040099.4✓79
Nebius AI Studio/nebiusGPU cloud$0.5037011899.5✓79
Lepton AI/lepton-aiGPU cloud$0.5033012599.4✓78
Novita AI/novita-aiAggregator$0.3538010599.4✓77
Hyperbolic/hyperbolicGPU cloud$0.4035011599.3✓76