Eval & LLMOps ★ 11.0k

Ragas

Metric suite for RAG: faithfulness, context precision, recall — the numbers you need before a go-live review.

Ragas turns 'it feels better' into measurable scores for retrieval quality and answer faithfulness. Its synthetic test-set generation is the fastest way to get a regression suite when you have no labelled data.

Best for: RAG regression testing and go-live metrics

Deploy: Self-hostable

#Evaluation #Retrieval #Open Source

Related tools

Eval & LLMOps ★ 34.7k

Open Code Review

Hybrid code review that puts deterministic rules first and the LLM second — the only ordering that survives an enterprise security review.

Teams that need AI code review to pass a security review, not just look impressive in a demo Read more →

Eval & LLMOps

Guardrails AI

Validates model output against a schema instead of hoping — and re-asks when validation fails.

Structured output that must parse reliably, and PII or policy checks before content reaches a user Read more →

Eval & LLMOps ★ 9.0k

Arize Phoenix

Notebook-first observability with clustering that surfaces failure modes you did not think to test.

Local debugging and failure-mode discovery Read more →

Eval & LLMOps

OpenLLMetry

LLM traces as standard OpenTelemetry spans — so they land in the observability stack you already pay for.

Organisations with an existing OpenTelemetry stack who do not want a second observability silo Read more →