AI Engineering in Practice9 min read
pip vs uv vs poetry for Python AI services
Which Python dependency manager for production agent services? Install speed, lockfiles, and Docker build times of pip, uv, and poetry compared.
Build Your First Software Factory Execution Harness live Thursday, Oct 1, 12:00 PM ET
Oct 1, Reserve a seatTopic
Python
Explore our latest articles and insights about Python.
Explore posts
45 posts in total
AI Engineering in Practice8 min read
Retry patterns for LLM API errors in production
How to build retry logic that handles rate limits, timeouts, and transient failures without burning money. The backoff rules and the 3 errors you must not retry.
LLM Engineering8 min read
Pydantic output structuring for RAG agent plans
How to use Pydantic models to force your RAG planner LLM to return structured steps. The schema, the retry loop, and why plain JSON prompts break in production.
AI Engineering in Practice8 min read
Stress testing agentic AI systems beyond the laptop
How to stress test an agentic AI service before it ships. Concurrency, tokens, latency budgets, and the load profile that simulates real traffic.
LLM Engineering8 min read
Dynamic evaluation metric loading in Python
How to load evaluation metrics dynamically in a Python eval pipeline. The registry pattern, entry points, and the test override that makes CI fast.
AI Engineering in Practice8 min read
Docker Compose for the full AI agent stack
How to run your entire agent stack locally with Docker Compose. Postgres, Redis, the agent service, Langfuse, and the network rules that just work.
AI Engineering in Practice8 min read
Docker build errors: troubleshooting AI service Dockerfiles
How to fix the 5 common Docker build errors in AI service Dockerfiles. apt-get failures, wheel builds, layer cache misses, and the silent bugs.
AI Engineering in Practice7 min read
FastAPI CORS for production agentic APIs
How to configure CORS for a production agentic API without wildcard origins. The allowlist, the credentials flag, and the preflight that breaks SSE.
AI Engineering in Practice8 min read
FastAPI lifespan for agentic services: startup and shutdown
Why FastAPI lifespan is the only right place for agent startup code. Per-worker initialization, ordered teardown, and the bugs it kills.
AI Engineering in Practice9 min read
Async context management in Python AI services
How async context managers prevent connection leaks in Python AI services. The lifespan, contextvars, and middleware patterns that survive load.
AI Engineering in Practice8 min read
FastAPI + LangGraph: production chatbot API pattern
How to wire LangGraph into a FastAPI chatbot API with streaming, persistence, and per-user threads. The production pattern that scales past demos.
AI Engineering in Practice9 min read
FastAPI dependency injection for agentic API auth
How FastAPI Depends makes agent auth testable and composable. The pattern, the chain, and why module-level globals break at scale.