Google Research

ML Testing @Scale

Abstract

Machine Learning is infused in all walks of life including a lot of Google products such as Google Home, Search, Gmail, and more, as well as in systems such as those used by self-driving cars and fraud detection systems. Tremendous amount of effort is being made to improve people’s experiences using products throughout the industry, where products are powered by ML/AI. However, developing and deploying high-quality, robust ML systems at Google's scale is hard. This can be due to many factors including but not limited to distributed ownership, training serving skew, maintaining privacy and proper access controls of data, model freshness and compatibility. In this talk, we will discuss what is ML Testing and what factors impact challenges for doing this right at scale.

Research Areas

Learn more about how we do research

We maintain a portfolio of research projects, providing individuals and teams the freedom to emphasize specific types of work