Observability is how you debug and operate agents: without traces, tool calls and context assembly become invisible.
What to Capture
- Model inputs/outputs
- Tool invocations and parameters
- Retrieved documents and citations
- Latency and cost per step
- Structured “decision” events (routing, stopping)
Emerging Standardization
OpenTelemetry conventions for GenAI are converging on common span shapes for agent steps.