AI Engineering in Practice8 min read
FastAPI lifespan for agentic services: startup and shutdown
Why FastAPI lifespan is the only right place for agent startup code. Per-worker initialization, ordered teardown, and the bugs it kills.
Loading...
Loading...
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatExplore our latest articles and insights about System Design.
68 posts in total
AI Engineering in Practice8 min read
Why FastAPI lifespan is the only right place for agent startup code. Per-worker initialization, ordered teardown, and the bugs it kills.
AI Engineering in Practice9 min read
How async context managers prevent connection leaks in Python AI services. The lifespan, contextvars, and middleware patterns that survive load.
AI Engineering in Practice9 min read
How FastAPI Depends makes agent auth testable and composable. The pattern, the chain, and why module-level globals break at scale.
AI Engineering in Practice9 min read
How to persist agent state in Postgres so conversations survive restarts. The schema, the session writer, and the idempotency rule that prevents loss.
AI Engineering in Practice9 min read
How a service layer in an AI agent codebase decouples business logic from HTTP routes. The pattern, the tests, and the refactor from a fat route.
AI Engineering in Practice9 min read
How to Dockerize a production AI service with multi-stage builds, layer caching, and a 150 MB runtime image. The pattern that survives real deploys.
AI Engineering in Practice10 min read
How to structure an agentic AI codebase so it survives growth. The 4-layer pattern, the cut lines, and the refactor that keeps a project shippable.
AI Engineering in Practice10 min read
How to instrument an agentic AI service with Prometheus. The 4 metrics that matter, the histogram trap, and the dashboard that surfaces regressions.
AI Engineering11 min read
How circuit breakers prevent LLM outages from cascading through your agent. The 3 states, the failure window, and the 50-line implementation.
AI Engineering in Practice11 min read
How to version an agentic API without breaking clients. The URL prefix pattern, the deprecation playbook, and when to ship v2.
AI Engineering in Practice10 min read
Why uv replaces pip, pip-tools, and poetry for production agentic AI services. The speed, the lockfile, and the 5-minute migration.
LLM Engineering11 min read
How to use sub-graphs in LangGraph to keep complex RAG pipelines sane. The composition pattern, the state isolation rule, and when to split.