Observability and evaluation tooling for AI agents.
Alternatives · updated from live directory data
Best Portkey alternatives
Portkey is a freemium developer tools project. These alternatives share its category or tags such as API, Research.
| Project | Pricing | Votes | Saves | Features documented | Compare |
|---|---|---|---|---|---|
| Portkey | Freemium | 0 | 0 | 3 | Current choice |
| AgentOps | Freemium | 0 | 0 | 3 | Side by side → |
| Braintrust | Freemium | 0 | 0 | 3 | Side by side → |
| Galileo | Paid | 0 | 0 | 3 | Side by side → |
| Helicone | Open source | 0 | 0 | 3 | Side by side → |
| Langfuse | Open source | 0 | 0 | 3 | Side by side → |
| LlamaIndex | Freemium | 0 | 0 | 2 | Side by side → |
| Patronus AI | Paid | 0 | 0 | 3 | Side by side → |
| Weights & Biases | Freemium | 0 | 0 | 3 | Side by side → |
| AI SDK | Open source | 0 | 0 | 2 | Side by side → |
| CrewAI | Freemium | 0 | 0 | 2 | Side by side → |
| Dify | Open source | 0 | 0 | 2 | Side by side → |
| DSPy | Open source | 0 | 0 | 2 | Side by side → |
Explore each alternative
Back to Portkey → 
Evaluation, prompt management, and observability for AI products.
Evaluation and observability for generative AI applications.
Open-source observability and gateway tooling for LLM applications.
Open-source tracing, prompt management, and evaluation for LLM apps.
A framework and managed platform for document ingestion, retrieval, workflows, and knowledge agents.
Automated evaluation and security testing for AI systems.
Experiment tracking, evaluation, and observability for machine learning.
Vercel's open-source TypeScript toolkit for building streaming, multi-provider AI applications and agents.
A framework and platform for coordinating role-based AI agents and workflows.
An open-source platform for building and operating generative AI applications.
An open-source framework for programming and optimizing language-model pipelines.