LLM Engineering11 min read
Choosing an embedding model for RAG
How to pick an embedding model for production RAG. The 5 criteria that matter, the benchmarks that lie, and the migration cost nobody warns you about.
Loading...
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatExplore our latest articles and insights about LLM.
28 posts in total
LLM Engineering11 min read
How to pick an embedding model for production RAG. The 5 criteria that matter, the benchmarks that lie, and the migration cost nobody warns you about.
LLM Engineering11 min read
How RecursiveCharacterTextSplitter works, why it beats naive chunking, and the separator order that makes or breaks retrieval quality.
LLM Engineering11 min read
How hybrid retrieval combines vector search and graph traversal in RAG. The when, the why, and the 60-line fusion that beats either alone.
LLM Engineering11 min read
How to use RAGAS to evaluate RAG pipelines. The 4 metrics that matter, the eval loop, and the trap that makes most RAG evals dishonest.
LLM Engineering12 min read
How agentic RAG uses LangGraph to plan, rewrite queries, and call tools. The graph, the state, and the nodes that turn single-pass RAG into reasoning.
LLM Engineering11 min read
How JSON output parsing grounds RAG answers in retrieved context. The Pydantic schema, the prompt, and the validation that kills hallucinations.
LLM Engineering11 min read
Stuff, Map Reduce, or Refine? How to pick the right LangChain chain type for RAG summarization, and the cost and quality trade-offs that decide it.
LLM Engineering11 min read
How quote extraction shrinks RAG context by 80% without losing answer quality. The pattern, the prompt, and the code that ships in production pipelines.
AI Engineering7 min read
Learn how to manage conversation memory in voice AI systems. Explore sliding windows, async summarization, and structured state extraction to balance co...
AI Engineering in Practice8 min read
Learn how to build asymmetric AI systems by choosing the right model for each task. Master the spectrum from Nano LLMs for routing to MoE models for gen...
AI Engineering in Practice18 min read
How engineering works in production. Learn to build a complete AI Bedtime Story Generator from scratch. A practical tutorial covering FastAPI, streaming re
AI Engineering8 min read
Learn how to get reliable, structured outputs from LLMs using JSON mode and Pydantic tool calling. Transform LLMs from text generators into application-...