Weights & Biases
Track, evaluate and monitor machine learning work
Developer ToolsMonitoringDataFreemium
evaluation tools
20 tools tagged evaluation.
Optuna
A hyperparameter optimization framework
Developer ToolsDataOpen SourceOpen sourceFree
DataRobot
Enterprise AI platform to develop and govern AI solutions
AIAnalyticsDataContact
Scale AI
Reliable AI systems and data for critical decisions
AIDataProductivityContact
Confident AI
Enterprise AI evaluation and observability platform
Developer ToolsAnalyticsMonitoringFreemium
Traceloop
LLM reliability and observability platform
Developer ToolsMonitoringAIOpen sourceFreemium
Langfuse
Open source LLM engineering and observability platform
Developer ToolsAnalyticsOpen SourceOpen sourceFreemium
Respan
LLM engineering platform for observability and evals
Developer ToolsAnalyticsMonitoringFreemium
LiveBench
Contamination-free LLM benchmark
AnalyticsDeveloper ToolsOpen sourceFree
Giskard
AI security and red teaming platform for LLM agents
SecurityDeveloper ToolsContact
TruLens
Evals and tracing for AI agents
Developer ToolsAnalyticsOpen SourceOpen sourceFree
ZenML
The unified layer for ML and AI
Developer ToolsDevOpsAIOpen sourceFreemium
Agenta
The open-source workspace for your agents
Developer ToolsProductivityOpen SourceOpen sourceFreemium
Tracking AI
Monitor AI model IQ scores and political biases
AnalyticsMonitoringSearchFree
Arena AI
Chat, compare, and vote on AI models
AISearchProductivityFree
Kiln AI
The AI workbench for building and optimizing systems
Developer ToolsOpen SourceProductivityOpen sourceFreemium
Artificial Analysis
Independent AI model and API provider benchmarks
AnalyticsSearchFreemium
Mastra
TypeScript AI framework for agents and apps
Developer ToolsProductivityOpen SourceOpen sourceFree
Maxim AI
GenAI evaluation and observability platform
Developer ToolsAnalyticsMonitoringFreemium
PromptHub
AI prompt management and collaboration for teams
Developer ToolsProductivityAIFreemium