Inside DigitalOcean Simulations: how user simulation, execution, and validation work

· DigitalOcean · Oct. 29, 2026, 6:02 p.m.
Summary
This article details the workings of DigitalOcean's Simulations feature for evaluating AI agents, focusing on the process of conducting user simulations to improve code upgrade recommendations. It explains the roles of simulated users and judges in scoring agent conversations based on specific metrics, providing insights into how the evaluations are structured and how scenarios are created and executed.
AUTHOR