Google Research

Anytime Tail Averaging

arXiv (2019)

Abstract

We propose a technique with a low constant memory cost to perform tail averaging with access to the average at every time step. We also show how one can improve the accuracy of that average at the cost of increased memory consumption.

Research Areas

Learn more about how we do research

We maintain a portfolio of research projects, providing individuals and teams the freedom to emphasize specific types of work