Backend Engineering11 min read
Which language should you build Redis in?
Honest comparison of building a Redis clone in Python, Go, Node, Rust, Ruby, and Elixir: concurrency, idioms, throughput, and where each language wins.
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatTopic
System Design
Explore our latest articles and insights about System Design.
Explore posts
68 posts in total
AI Engineering in Practice9 min read
pip vs uv vs poetry for Python AI services
Which Python dependency manager for production agent services? Install speed, lockfiles, and Docker build times of pip, uv, and poetry compared.
LLM Engineering8 min read
Testing and evaluating RAG pipelines end to end
How to test a RAG pipeline like real software. Unit, integration, and eval tests that catch regressions before they ship. The 3-layer test strategy.
AI Engineering in Practice8 min read
Real-time agent debugging with Langfuse traces
How to debug a live agent incident using Langfuse traces. The search patterns, the 5-minute workflow, and the post-mortem that catches the root cause.
AI Engineering in Practice8 min read
Langfuse + Grafana: agentic AI monitoring
How to combine Langfuse traces with Grafana dashboards for agent monitoring. The integration, the panels, and the alerting that catches real problems.
AI Engineering in Practice8 min read
Prometheus performance analysis for agentic AI systems
How Prometheus metrics surface performance bottlenecks in agentic AI. The 3 queries, the alert rules, and the dashboard that finds hot loops fast.
AI Engineering in Practice8 min read
Stress testing agentic AI systems beyond the laptop
How to stress test an agentic AI service before it ships. Concurrency, tokens, latency budgets, and the load profile that simulates real traffic.
LLM Engineering8 min read
Automated evaluation pipelines for agentic AI systems
How to wire eval pipelines into CI so every agent change is scored automatically. The nightly job, the regression gate, and the dashboard that matters.
AI Engineering in Practice8 min read
Docker Compose for the full AI agent stack
How to run your entire agent stack locally with Docker Compose. Postgres, Redis, the agent service, Langfuse, and the network rules that just work.
AI Engineering in Practice8 min read
Docker secrets management for agentic AI services
How to inject API keys and secrets into agent containers without baking them into the image. BuildKit secrets, runtime injection, and the 3 bad patterns.
AI Engineering in Practice8 min read
Docker build errors: troubleshooting AI service Dockerfiles
How to fix the 5 common Docker build errors in AI service Dockerfiles. apt-get failures, wheel builds, layer cache misses, and the silent bugs.
AI Engineering in Practice7 min read
FastAPI CORS for production agentic APIs
How to configure CORS for a production agentic API without wildcard origins. The allowlist, the credentials flag, and the preflight that breaks SSE.