Dan Dennison
Dan Dennison has been a Site Reliability Engineer at Google for the past eight years, working on various large pipelines in Ads Quality across all ad networks, including Search, Content, and Display.
The Ads Quality team at Google improves, expands, and supports one of the world’s largest machine learning deployments. Ads Quality also crawls and indexes all advertisements, and enforces policies on new and existing ads.
Authored Publications
Sort By
Data Processing Pipelines
Preview
Tim Harvey
Site Reliability Engineering: How Google Runs Production Systems, O'Reilly (2016)
Continuous Pipelines at Google
SRECon Europe 2015, USENIX, Dublin, Ireland, pp. 12
Preview abstract
This article focuses on the real life challenges of managing data processing pipelines of depth and complexity. It considers the frequency continuum between periodic pipelines that run very infrequently through continuous pipelines that never stop running, and discusses the discontinuities that can produce significant operational problems. A fresh take on the masterslave model is presented as a more reliable and better scaling alternative to the periodic pipeline for processing Big Data.
View details
