LLM Engineering11 min read
Chain-of-thought reasoning in RAG: a practical guide
How to add chain-of-thought reasoning to a RAG pipeline. The prompt, the parsing, and the cases where CoT beats a straight answer by a wide margin.
Loading...
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatBlogDaily bytes of
Daily bytes of
AI engineering.
Bite-sized insights for building production AI systems. Expert guides, real-world patterns, and practical engineering wisdom.
Explore posts
136 posts in total
LLM Engineering11 min read
Choosing an embedding model for RAG
How to pick an embedding model for production RAG. The 5 criteria that matter, the benchmarks that lie, and the migration cost nobody warns you about.
LLM Engineering11 min read
RecursiveCharacterTextSplitter: a deep dive for RAG
How RecursiveCharacterTextSplitter works, why it beats naive chunking, and the separator order that makes or breaks retrieval quality.
AI Engineering11 min read
Persistent memory for coding agents: cross-session context
How coding agents remember context across sessions. The memory store, the recall pattern, and the 3 kinds of memory every agent should keep.
AI Engineering12 min read
Custom tools for coding agents: beyond the built-ins
How to design custom tools for coding agents that are not read, edit, or bash. The naming rules, the schema patterns, and the 3 custom tools that pay off.
AI Engineering10 min read
ripgrep for coding agents: fast code search at scale
Why ripgrep is the right code search tool for coding agents. The speed, the flags, and the wrapper that turns rg into a safe agent tool.
AI Engineering11 min read
Edit tool design: how coding agents modify files safely
How to design an edit tool a coding agent can use without wrecking files. The string-match rule, the dry-run pattern, and the 50-line safe edit function.
AI Engineering in Practice11 min read
Docker layer caching: faster agent image builds
How to cut Docker build time for agentic AI images from 8 minutes to 40 seconds. The layer order rule, the cache mount, and the trap beginners hit.
AI Engineering12 min read
Designing modular tool integrations for coding agents
How to structure tool integrations so an agent stays clean as it grows. The registry pattern, schema-first design, and the 80-line dispatcher that scales.
AI Engineering in Practice11 min read
JWT authentication for agentic APIs
How to use JWTs for agentic API auth. The claims that matter, the refresh rotation pattern, and the middleware that keeps long-running agents logged in.
AI Engineering in Practice11 min read
Rate limiting FastAPI agents: token buckets in production
How to rate limit a FastAPI agent service. Token buckets per user, burst control, and the Redis pattern that survives multi-worker deployments.
AI Engineering in Practice10 min read
API schemas: separating db models from API responses
Why exposing DB models as API responses leaks sensitive fields. The Pydantic separation pattern, the 3 schema layers, and the safe FastAPI response.
Your Instructor
Built by Param Harrison
Cofounder of AEOsome.com and Chief Mentor at learnwithparam.com with 14+ years building production systems. I've trained 50+ engineers on AI engineering - these programs distill what actually works into structured paths you can follow at your own pace.
Ready to go deeper?
Go beyond articles. Build production AI systems with hands-on courses, or join a live cohort.