Test an agent like software
Prompts change every week. We put assertions and adversarial tests around an agent so a bad change fails in CI, not in front of a customer.
More builders labs
- BuildersSystem design
Pick the right architecture: single agent, workflow or multi-agent
A decision table and a measured comparison of two designs for one real task.
2 hours - BuildersSystem design
Design a production agent from a blank page
A written architecture for one agent: components, failure modes and a cost estimate, reviewed by peers.
3 hours - BuildersEvals
Add evals and tracing to an agent
Traces, a dataset built from real failures, and an experiment that proves a prompt change helped.
3 hours