Chapter 10: Creating and Managing SQL Scripts

In This Chapter

  • Design concepts
  • Working with SQL scripts
  • Indexing and performance considerations
  • SQL solutions to common analytics problems

Analytics systems must procure data from various sources, often in formats that are not necessarily suited for analytics. These data feeds have to be integrated and manipulated to make the output suitable for analytics consumption. In this chapter we go over key concepts and tools to guide you in building an analytics system that is scalable and maintainable.

Design Concepts

Building a successful analytics system requires careful design that stems from experience and lessons learned from prior mistakes. Luckily the industry has now a couple of decades of experience in building these systems. This had led to established best practices to help you avoid the mistakes of the past. In this section we summarize these best practices and give you a foundation to start off on the right foot.

note.eps The concepts in this section become important as your system complexity and data volumes grow. When you start your design, you have to assess the scope of your system and decide the level of design sophistication that is necessary to meet your needs.

Stay organized

The most common mistake beginners make when building an analytics system is not being organized. Preparing your data for analytics should be divided into ...

Get Microsoft Business Intelligence Tools for Excel Analysts now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.