ML Testing @Scale

Machine Learning is infused in all walks of life including a lot of Google products such as Google Home, Search, Gmail, and more, as well as in systems such as those used by self-driving cars and fraud detection systems. Tremendous amount of effort is being made to improve people’s experiences using products throughout the industry, where products are powered by ML/AI. However, developing and deploying high-quality, robust ML systems at Google's scale is hard. This can be due to many factors including but not limited to distributed ownership, training serving skew, maintaining privacy and proper access controls of data, model freshness and compatibility. In this talk, we will discuss what is ML Testing and what factors impact challenges for doing this right at scale.

• Machine Intelligence