Google Cloud Platform for Developers

Google provided pipeline templates

There are several very common data processing tasks that teams need to perform in GCP, such as piping Cloud Pub/Sub messages to BigQuery or bulk-compressing files in Cloud Storage. Because pipeline templates are simply stored in Cloud Storage buckets, they can be made publicly available for use across organizations and teams. For several of these very common processing tasks, Google provides ready-made templates. By using the Google-provided pipeline templates (offered in beta at time of writing), teams can accomplish these common tasks without ever developing a pipeline. For more information on Google-provided pipeline templates, see https://cloud.google.com/dataflow/docs/templates/provided-templates.