March 2019
Beginner to intermediate
778 pages
34h 20m
English
Another common pattern for loading data into BigQuery is through the use of batch file uploads. BigQuery is capable of loading files in several formats, including CSV, Avro, ORC, and JSON. This represents an incredibly simple method for landing data into BigQuery from external systems, and is often an ideal strategy for traditional lift-and-shift database migrations. File uploads are performed as load jobs using the BigQuery Jobs API, which can be initiated from client libraries, direct API calls, or through the BigQuery UI.
BigQuery is capable of loading files up to 4GB if compressed, and up to 5 TB if uncompressed, depending on the file format. Note that when performing large file uploads, data will ...
Read now
Unlock full access