Chapter 6. Design Principles: Business Use Cases and Trade-Offs
I was asked one time to help an organization troubleshoot cost overruns with BigQuery. BigQuery is a very successful tool in the Google Cloud space and it does its job, running SQL queries over big tables of information, really well. The company asking for help was thrilled with the performance they were seeing, so BigQuery was meeting all their goals there, but it was doing so at a higher cost point than my client would have preferred.
When I came in, my first move was to get access to the billing information. I was curious about where my client’s BigQuery dollars were going. It didn’t take me long before I saw a major suspect. The company was spending $5,000+ a month on streaming data inserts.
The next day, I had a sit down with the client and I said, “I see you’re doing a lot of streaming inserts into BigQuery.”
“Oh yeah, our old system was so slow getting in new ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access