Not-so-hot take: you need to measure your agent's performance in production.

Maybe-a-little-hotter-take: you should be using production data for evaluation rather than synthetic events.

Enter Online and offline evals; one measures performance in real time. The other, off the execution path, either before deployment, or after the agent run has happened. When to use both is explained in our latest guide!