LLM Engineering9 min read
LLM-as-a-judge: production evaluation framework for agents
How to build an LLM-as-a-judge evaluation framework for agentic AI. The prompt, the rubric, the bias controls, and the loop that catches regressions.
Loading...
Loading...
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatExplore our latest articles and insights about AI Agents.
86 posts in total
LLM Engineering9 min read
How to build an LLM-as-a-judge evaluation framework for agentic AI. The prompt, the rubric, the bias controls, and the loop that catches regressions.
AI Engineering in Practice8 min read
How to run your entire agent stack locally with Docker Compose. Postgres, Redis, the agent service, Langfuse, and the network rules that just work.
AI Engineering in Practice8 min read
How to inject API keys and secrets into agent containers without baking them into the image. BuildKit secrets, runtime injection, and the 3 bad patterns.
AI Engineering in Practice8 min read
How to fix the 5 common Docker build errors in AI service Dockerfiles. apt-get failures, wheel builds, layer cache misses, and the silent bugs.
AI Engineering in Practice7 min read
How to configure CORS for a production agentic API without wildcard origins. The allowlist, the credentials flag, and the preflight that breaks SSE.
AI Engineering in Practice8 min read
Why FastAPI lifespan is the only right place for agent startup code. Per-worker initialization, ordered teardown, and the bugs it kills.
AI Engineering in Practice9 min read
How async context managers prevent connection leaks in Python AI services. The lifespan, contextvars, and middleware patterns that survive load.
AI Engineering in Practice8 min read
How to wire LangGraph into a FastAPI chatbot API with streaming, persistence, and per-user threads. The production pattern that scales past demos.
AI Engineering in Practice9 min read
How FastAPI Depends makes agent auth testable and composable. The pattern, the chain, and why module-level globals break at scale.
AI Engineering in Practice9 min read
How to persist agent state in Postgres so conversations survive restarts. The schema, the session writer, and the idempotency rule that prevents loss.
AI Engineering in Practice9 min read
How a service layer in an AI agent codebase decouples business logic from HTTP routes. The pattern, the tests, and the refactor from a fat route.
AI Engineering in Practice9 min read
How to Dockerize a production AI service with multi-stage builds, layer caching, and a 150 MB runtime image. The pattern that survives real deploys.