We will focus on the Kinesis Firehose service, which offers two important features: data received can be fed to an AWS Lambda function for extra processing, and the resulting data can be stored on S3 or on a Redshift database.
We will start by setting up a Kinesis Firehose delivery stream that stores data on S3 without any Lambda functionality:
- Go to the Kinesis Firehose dashboard at https://console.aws.amazon.com/firehose/ and click on Create Delivery Stream.
- Fill in the following fields:
- Destination: Amazon S3
- Delivery stream name: veggieTweets (or choose your own name)
- S3 bucket: aml.packt
- S3 prefix: veggies
- Click on Next:
Note that the S3 prefix field corresponds to a folder in your S3 bucket. You should ...