LLM evaluation platforms — tools, comparisons and guidance · QA Tool Atlas

Part of AI & LLM testing

LLM evaluation platforms

Dataset-driven scoring of model and prompt versions.

LangSmith
Editors’ pick
AI & LLM testing · LLM evaluation platforms
not
scoredLangSmith editorial score
Evaluation, tracing and prompt management platform from the LangChain team.
- TypeScript
- Python
- GitHub Actions
Free planVendor researchPricing may have changed — not yet verified
Langfuse
AI & LLM testing · LLM evaluation platforms
not
scoredLangfuse editorial score
Open-source LLM engineering platform: traces, evals and cost analytics.
- TypeScript
- Python
- Docker
- Kubernetes
Open sourceVendor researchPricing may have changed — not yet verified