Home › LLM APIs & Model Providers › ExLlamaV2
ExLlamaV2
Open-source inference library for running LLMs on consumer GPUs.
- Category
- LLM APIs & Model Providers
- Pricing model
- Free Free to use. Not confirmed here; check the vendor's site.
- Official site
- https://github.com/turboderp-org/exllamav2
- Link checked
- 2026-11-06. Added 2026-11-06.
This entry gives the product's category, the pricing model as shown on the vendor's own pages when we could confirm it, and a link to the official site. It is not a review or an endorsement. Plans and prices change, so confirm on the vendor's site. Is this your product? Get a "Listed on AI Tool Index" badge.
Other LLM APIs & Model Providers tools
| Tool | What it does | Pricing | Link |
|---|---|---|---|
| fal | Generative media platform with API access to image, video and audio models plus serverless GPUs. | See site | Official site |
| Featherless | Serverless inference for a large catalog of open models on Hugging Face. | See site | Official site |
| Fireworks AI | Inference platform for open and fine-tuned generative models. | See site | Official site |
| Fluidstack | AI cloud provider of large GPU clusters for training and inference. | See site | Official site |
| FriendliAI | Inference platform for serving open and custom generative models. | See site | Official site |
| Google AI Studio | Google's web tool and API gateway for prototyping with Gemini models. | See site | Official site |
| Groq | Fast inference platform that runs open models on custom LPU hardware. | See site | Official site |
| Hugging Face | Hub for open models, datasets and apps, with hosted inference. | See site | Official site |
All LLM APIs & Model Providers tools · Best AI tools for building with LLM APIs