Learn Python by Building Data Science Applications

Scheduling with cron

We have mentioned scheduling multiple times already—but how do we do it? For better or worse, this is not something Luigi is capable of on its own. But fear not—this is a proper task for your operating system. On Windows, it can be done using the Schtasks utility. On macOS and Linux, scheduling is managed by the cron tool, via so-called crontabs.

Crontab has its own mini-language for scheduling: every command starts with five symbols, representing the specific minute, hour, day, month, and day of the week (an asterisk can be used when we have no specific value). For example, if we want to run a task every day at 05:00, we'll use the following command:

0 5 * * * <our command>

Crontab supports multiple values, as well. ...