Home › Best AI tools › Open-source LLM runtimes and APIs
Open-source LLM runtimes and APIs
5 open-source llm apis & model providers tools. LLM APIs & Model Providers tools listed as Free because they are open-source projects you can download and run. Check each project's license, and note that hosting and model costs may still apply.
How to read this page. The tools are grouped by category and are not ranked. Pricing labels come from vendors' own pages when we could confirm them. Always verify plans and limits on the vendor's site.
LLM APIs & Model Providers (5)
| Tool | What it does | Pricing | Link |
|---|---|---|---|
| ExLlamaV2 | Open-source inference library for running LLMs on consumer GPUs. | Free | Official site |
| Llamafile | Mozilla project that packages LLMs into single-file executables. | Free | Official site |
| LocalAI | Open-source, OpenAI-compatible API for running models locally. | Free | Official site |
| MLC LLM | Universal LLM deployment engine for running models on many devices. | Free | Official site |
| TensorRT-LLM | NVIDIA open library for high-performance large language model inference. | Free | Official site |