Home › Best AI tools › AI inference and GPU platforms
AI inference and GPU platforms
21 platforms for running AI models through an API or on cloud GPUs. Hosted inference APIs, serverless GPU services and GPU clouds for running open and proprietary models. Compare model selection, how compute is billed and where data is processed.
How to read this page. The tools are grouped by category and are not ranked. Pricing labels come from vendors' own pages when we could confirm them. Always verify plans and limits on the vendor's site.
LLM APIs & Model Providers (20)
| Tool | What it does | Pricing | Link |
|---|---|---|---|
| Amazon Bedrock | AWS service offering foundation models from multiple providers through one API. | See site | Official site |
| Anyscale | Managed platform for running Ray-based AI workloads. | See site | Official site |
| Azure AI Foundry | Microsoft's platform for building and managing AI apps and agents with a catalog of models. | See site | Official site |
| Baseten | Inference platform for deploying and serving AI models. | See site | Official site |
| Cerebras | AI hardware company offering high-speed inference for open models. | See site | Official site |
| Cloudflare Workers AI | Run AI models on Cloudflare's network via serverless APIs. | See site | Official site |
| DeepInfra | Hosted inference for open-source models via API. | See site | Official site |
| fal | Generative media platform with API access to image, video and audio models plus serverless GPUs. | See site | Official site |
| Fireworks AI | Inference platform for open and fine-tuned generative models. | See site | Official site |
| Groq | Fast inference platform that runs open models on custom LPU hardware. | See site | Official site |
| Hugging Face | Hub for open models, datasets and apps, with hosted inference. | See site | Official site |
| Modal | Serverless cloud for running AI workloads and model inference. | Freemium | Official site |
| Nebius | AI cloud with GPU infrastructure and managed inference. | See site | Official site |
| Novita AI | Cloud platform offering model APIs and GPU instances. | See site | Official site |
| NVIDIA NIM | NVIDIA's catalog of model endpoints and microservices for inference. | See site | Official site |
| OpenRouter | Unified API that routes requests to many model providers. | See site | Official site |
| Replicate | Run and deploy machine learning models through a simple API. | See site | Official site |
| SambaNova | AI infrastructure and inference cloud for open and custom models. | See site | Official site |
| Together AI | Cloud for running, fine-tuning and deploying open-source models. | See site | Official site |
| Vertex AI | Google Cloud's platform for building and deploying generative AI and ML models. | See site | Official site |
AI Developer Tools (1)
| Tool | What it does | Pricing | Link |
|---|---|---|---|
| Runpod | GPU cloud with on-demand pods and serverless compute for AI training, inference and batch jobs. | See site | Official site |