book

Amazon Redshift Cookbook

by Shruti Worlikar, Thiyagarajan Arumugam, Harshida Patel

July 2021

Intermediate to advanced

384 pages

6h 48m

English

Packt Publishing

Read now

Unlock full access

ForewordContributorsAbout the authorsAbout the reviewers
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchShare Your Thoughts
Technical requirementsCreating an Amazon Redshift cluster using the AWS ConsoleGetting readyHow to do it…Creating an Amazon Redshift cluster using the AWS CLIGetting readyHow to do it…How it works…Creating an Amazon Redshift cluster using an AWS CloudFormation templateGetting readyHow to do it…How it works…Connecting to an Amazon Redshift cluster using the Query EditorGetting readyHow to do it…Connecting to an Amazon Redshift cluster using the SQL Workbench/J clientGetting readyHow to do it…Connecting to an Amazon Redshift Cluster using a Jupyter NotebookGetting readyHow to do it…Connecting to an Amazon Redshift cluster using PythonGetting readyHow to do it…Connecting to an Amazon Redshift cluster programmatically using JavaGetting readyHow to do it…Connecting to an Amazon Redshift cluster programmatically using .NETGetting readyHow to do it…Connecting to an Amazon Redshift cluster using the command lineGetting readyHow to do it…
Technical requirementsManaging a database in an Amazon Redshift clusterGetting readyHow to do it…Managing a schema in a databaseGetting readyHow to do it…Managing tablesGetting readyHow to do it…How it works…Managing viewsGetting readyHow to do it…Managing materialized viewsGetting readyHow to do it…How it works…Managing stored proceduresGetting readyHow to do it…How it works…Managing UDFsGetting readyHow to do it…How it works…
Technical requirementsLoading data from Amazon S3 using COPYGetting readyHow to do it…How it works…Loading data from Amazon EMRGetting readyHow to do it…Loading data from Amazon DynamoDBGetting readyHow to do it…How it works…Loading data from remote hostsGetting readyHow to do it…Updating and inserting dataGetting readyHow to do it…Unloading data to Amazon S3Getting readyHow to do it…
Technical requirementsIngesting data from transactional sources using AWS DMSGetting readyHow to do it…How it works…Streaming data to Amazon Redshift via Amazon Kinesis FirehoseGetting readyHow to do it…How it works…Cataloging and ingesting data using AWS GlueHow to do it…How it works…
Technical requirementsScheduling queries using the Amazon Redshift query editorGetting readyHow to do it…How it works…Event-driven applications using Amazon EventBridge and the Amazon Redshift Data APIGetting readyHow to do it…How it works…Event-driven applications using AWS LambdaGetting readyHow to do it…How it works…Orchestrating using AWS Step FunctionsGetting readyHow to do it…How it works…Orchestrating using Amazon MWAAGetting readyHow to do it…How it works…
Technical requirements Managing infrastructure securityGetting readyHow to do itData encryption at restGetting readyHow to do itData encryption in transitGetting readyHow to do itColumn-level securityGetting readyHow to do itHow it worksLoading and unloading encrypted dataGetting readyHow to do itManaging superusersGetting readyHow to do itManaging users and groupsGetting readyHow to do itManaging federated authenticationGetting readyHow to do itHow it worksUsing IAM authentication to generate database user credentialsGetting readyHow to do itManaging audit logsGetting readyHow to do itHow it worksMonitoring Amazon RedshiftGetting readyHow to do itHow it works
Technical requirementsAmazon Redshift AdvisorGetting readyHow to do it…How it works…Managing column compressionGetting readyHow to do it…How it works…Managing data distribution Getting readyHow to do it…How it works…Managing sort keys Getting readyHow to do it…How it works…Analyzing and improving queriesGetting readyHow to do it…How it works…Configuring workload management (WLM)Getting readyHow to do it…How it works…Utilizing Concurrency ScalingGetting readyHow to do it…How it works…Optimizing Spectrum queriesGetting readyHow to do it…How it works…
Technical requirementsAWS Trusted AdvisorGetting readyHow to do it…How it works…Amazon Redshift Reserved Instance pricingGetting readyHow to do it…Configuring pause and resume for an Amazon Redshift clusterGetting readyHow to do it…Scheduling pause and resumeGetting readyHow to do it…How it works…Configuring Elastic Resize for an Amazon Redshift cluster Getting readyHow to do it…Scheduling Elastic Resizing Getting readyHow to do it…How it works…Using cost controls to set actions for Redshift SpectrumGetting readyHow to do it…Using cost controls to set actions for Concurrency ScalingGetting readyHow to do it…

Technical requirementsBuilding a data lake catalog using AWS Lake FormationGetting readyHow to do it…How it works…Exporting a data lake from Amazon RedshiftGetting readyHow to do it…Extending a data warehouse using Amazon Redshift SpectrumGetting readyHow to do it… Data sharing across multiple Amazon Redshift clustersGetting readyHow to do it…How it works…Querying operational sources using Federated QueryGetting readyHow to do it…
Technical requirementsManaging Amazon Redshift ML Getting readyHow to do it…How it works…Visualizing data using Amazon QuickSightGetting readyHow to do it…How it works…AppFlow for ingesting SaaS data in RedshiftGetting readyHow to do it…How it works…Data wrangling using DataBrewGetting readyHow to do it…How it works…Utilizing ElastiCache for sub-second latencyGetting readyHow to do it…How it works…Subscribing to third-party data using AWS Data Exchange Getting readyHow to do it…How it works…
Recipe 1 – Creating an IAM userRecipe 2 – Storing database credentials using Amazon Secrets ManagerRecipe 3 – Creating an IAM role for an AWS serviceRecipe 4 – Attaching an IAM role to the Amazon Redshift cluster
Other Books You May EnjoyPackt is searching for authors like youShare Your Thoughts

Content preview from Amazon Redshift Cookbook

Chapter 5: Scalable Data Orchestration for Automation

Amazon Web Services (AWS) provides a rich set of native services to integrate a workflow. These workflows may involve multiple tasks that can be managed independently, thereby taking advantage of purpose-built services and decoupling them.

In this chapter, we will primarily focus on workflows such as extract, transform, load (ETL) processes that are used to refresh a data warehouse. We will illustrate different options that are available using the individual recipes, but these are interchangeable depending on your use case. For example, in your workflow, you can call an AWS Python shell (https://docs.aws.amazon.com/glue/latest/dg/add-job-python.html) instead of the Amazon Redshift Data