Dan Dennison
Dan Dennison has been a Site Reliability Engineer at Google for the past eight years, working on various large pipelines in Ads Quality across all ad networks, including Search, Content, and Display.
The Ads Quality team at Google improves, expands, and supports one of the world’s largest machine learning deployments. Ads Quality also crawls and indexes all advertisements, and enforces policies on new and existing ads.
Authored Publications
Google Publications
Other Publications
Sort By
Data Processing Pipelines
Preview
Tim Harvey
Site Reliability Engineering: How Google Runs Production Systems, O'Reilly (2016)
Continuous Pipelines at Google
SRECon Europe 2015, USENIX, Dublin, Ireland, pp. 12
Preview abstract
This article focuses on the real life challenges of managing data processing pipelines of depth and complexity. It considers the frequency continuum between periodic pipelines that run very infrequently through continuous pipelines that never stop running, and discusses the discontinuities that can produce significant operational problems. A fresh take on the masterslave model is presented as a more reliable and better scaling alternative to the periodic pipeline for processing Big Data.
View details
Hidden Technical Debt in Machine Learning Systems
Gary Holt
Eugene Davydov
Dietmar Ebner
Vinay Chaudhary
Michael Young
Jean-François Crespo
NIPS (2015), pp. 2503-2511
InvaderBot: A Portable Network Extension to Invader, a Program that Plays The Game of the Amazons
Ph.D. Thesis, CSU Northridge (2006), pp. 50