BigQuery for Data Warehousing: Managed Data Analysis in the Google Cloud

© Mark Mucchetti 2020

M. MucchettiBigQuery for Data Warehousinghttps://doi.org/10.1007/978-1-4842-6186-6_10

10. Scheduling Jobs

Mark Mucchetti¹ 

(1)

Santa Monica, CA, USA

 

Configuring tasks to run at a scheduled time or on a recurring basis is a conceptually simple idea. Ken Thompson wrote the original cron at Bell Labs sometime in the mid-1970s, and we use it mostly the same way today. It’s only recently that cloud technology has taken upon itself the improvement of this most venerable of basic task schedulers. Google’s foray into the area came startlingly late, only reaching general availability in March 2019. (Microsoft Azure had scheduling as early as 2015; Amazon Web Services has had it in Lambda nearly since inception, and the Batch service has ...