Now, things start to get exciting because we are going to read the real file and the crawler will map the schema for the data in the file—that's the structs, arrays, columns, and data types. Sounds good! The following screenshot shows that we don't have any data in our tables yet:
Tables in our new database
We need to add a crawler to populate that for us:
- To do so, click on Add tables using a crawler. The Glue console will launch a wizard that will guide you through the process of creating a crawler.
- Enter the crawler name—I've chosen rawDataWeatherCrawler—and expand the Tags, description, security configuration, and classifiers ...
