LLM Engineering11 min read
Chain-of-thought reasoning in RAG: a practical guide
How to add chain-of-thought reasoning to a RAG pipeline. The prompt, the parsing, and the cases where CoT beats a straight answer by a wide margin.
Loading...
Loading...
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatExplore our latest articles and insights about AI Engineering.
40 posts in total
LLM Engineering11 min read
How to add chain-of-thought reasoning to a RAG pipeline. The prompt, the parsing, and the cases where CoT beats a straight answer by a wide margin.
LLM Engineering11 min read
How to pick an embedding model for production RAG. The 5 criteria that matter, the benchmarks that lie, and the migration cost nobody warns you about.
LLM Engineering11 min read
How RecursiveCharacterTextSplitter works, why it beats naive chunking, and the separator order that makes or breaks retrieval quality.
AI Engineering11 min read
How coding agents remember context across sessions. The memory store, the recall pattern, and the 3 kinds of memory every agent should keep.
AI Engineering12 min read
How to design custom tools for coding agents that are not read, edit, or bash. The naming rules, the schema patterns, and the 3 custom tools that pay off.
AI Engineering10 min read
Why ripgrep is the right code search tool for coding agents. The speed, the flags, and the wrapper that turns rg into a safe agent tool.
AI Engineering11 min read
How to design an edit tool a coding agent can use without wrecking files. The string-match rule, the dry-run pattern, and the 50-line safe edit function.
AI Engineering in Practice11 min read
How to cut Docker build time for agentic AI images from 8 minutes to 40 seconds. The layer order rule, the cache mount, and the trap beginners hit.
AI Engineering12 min read
How to structure tool integrations so an agent stays clean as it grows. The registry pattern, schema-first design, and the 80-line dispatcher that scales.
LLM Engineering11 min read
How hybrid retrieval combines vector search and graph traversal in RAG. The when, the why, and the 60-line fusion that beats either alone.
AI Engineering11 min read
How coding agents run shell commands safely. The bash tool design, the denylist trap, and the sandbox that keeps rm -rf away from your home directory.
LLM Engineering11 min read
How to use RAGAS to evaluate RAG pipelines. The 4 metrics that matter, the eval loop, and the trap that makes most RAG evals dishonest.