LLM Engineering9 min read
LLM-as-a-judge: production evaluation framework for agents
How to build an LLM-as-a-judge evaluation framework for agentic AI. The prompt, the rubric, the bias controls, and the loop that catches regressions.
Loading...
Loading...
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatExplore our latest articles and insights about Evaluation.
17 posts in total
LLM Engineering9 min read
How to build an LLM-as-a-judge evaluation framework for agentic AI. The prompt, the rubric, the bias controls, and the loop that catches regressions.
LLM Engineering11 min read
How to add chain-of-thought reasoning to a RAG pipeline. The prompt, the parsing, and the cases where CoT beats a straight answer by a wide margin.
LLM Engineering11 min read
How to use RAGAS to evaluate RAG pipelines. The 4 metrics that matter, the eval loop, and the trap that makes most RAG evals dishonest.
AI Engineering7 min read
Learn how to quantitatively measure RAG system quality using the RAG Triad: context relevance, recall, faithfulness, and answer relevancy. Understand LL...
AI Engineering7 min read
Learn how to evaluate RAG systems quantitatively using RAGAs framework. Measure context relevance, faithfulness, answer correctness, and prove optimizat...