AI Developer Tools
Observability, evaluation, data and fine-tuning tools for AI applications. 29 tools listed. See also the guide to the best AI Developer Tools tools.
Your tool could be here
Featured spots are labeled "Sponsored" and sit at the top of the directory and your category.
Get featured →-
Arize Phoenix
Open-source observability and evaluation tool for LLM apps.
-
Axolotl
Open-source tool for fine-tuning language models.
-
Braintrust
Evaluation and observability platform for AI products.
-
Docling
Open-source toolkit for converting documents into structured formats for AI.
-
E2B
Secure cloud sandboxes for running code produced by AI agents.
-
Firecrawl
API that crawls websites and returns clean, LLM-ready data.
-
Gradio
Python library for building and sharing web demos of machine learning models.
-
Guardrails AI
Framework for validating and guarding LLM outputs.
-
Helicone
Open-source LLM observability and gateway platform.
-
Instructor
Library for getting structured outputs from language models.
-
Jina AI
Embeddings, reranker and web reader models and APIs for search.
-
Label Studio
Open-source data labeling tool for many data types.
-
Lakera
Security platform for protecting generative AI applications.
-
Langfuse
Open-source LLM engineering platform for tracing, evaluation and prompt management.
-
LangSmith
Observability, evaluation and deployment platform for LLM applications.
-
llama.cpp
Open-source C/C++ library for running language models efficiently on local hardware.
-
MLflow
Open-source platform for managing the machine learning and GenAI lifecycle.
-
Opik
Open-source platform from Comet for evaluating and monitoring LLM applications.
-
Outlines
Library for constraining language model output to defined structures.
-
Promptfoo
Open-source tool for testing and red-teaming prompts, models and agents.
-
Ragas
Open-source toolkit for evaluating retrieval-augmented generation applications.
-
Ray
Open-source framework for scaling Python and AI workloads.
-
Roboflow
Computer vision platform for labeling, training and deploying models.
-
Streamlit
Python framework for building data and AI web apps.
-
Unsloth
Open-source library for faster, lower-memory fine-tuning of language models.
-
Unstructured
Turns documents into structured data for LLM pipelines.
-
vLLM
Open-source high-throughput inference engine for large language models.
-
Voyage AI
Embedding and reranking models for retrieval.
-
Weave
Weights & Biases toolkit for tracking and evaluating LLM applications.