The Importance of A/B Testing in Robotics

Arnab Bose and Yuheng Kuang, Staff Software Engineers, Robotics at Google Disciplines in the natural sciences, social sciences, and medicine all have to grapple with how to evaluate and compare results within the context of the continually changing real world. In contrast, a significant body of machine learning (ML) research uses a different method that relies on the assumption of a fixed world: measure the performance of a baseline model on fixed data sets, then build a new model aimed at impro...

Submit