Chapter 9. Using Apache Sedona with Cloud Data Providers
You can use Apache Sedona with many software-as-a-service (SaaS) and platform-as-a-service (PaaS) products from different cloud providers. In this chapter, we focus on integrating Sedona with the most common providers, including Databricks, AWS EMR and Glue, Microsoft Fabric, GCP Dataproc, and Wherobots Cloud. This chapter focuses on how to install and use Apache Sedona with different systems, but we can divide them into three groups based on the main system used:
-
Apache Spark
-
Apache Flink
-
Snowflake (SedonaSnow)
We have covered Apache Sedona Spark from the ground up during this book, so for Apache Spark–based products, we focus primarily on installation. We also provide some examples and feature comparisons for SedonaSnow and Wherobots. If you use a system based on Apache Spark or Flink and can’t find the installation process, please review the official Apache Sedona documentation. If the installation process is still missing in the official documentation, you can create an issue on the Apache Sedona repository or follow your system’s official documentation.
Prerequisites
The only constant is change. Every system evolves over time. To make sure you are using the same version as we are, we use the following versions for the examples in this chapter:
-
Apache Spark 3.5.x
-
Scala 2.12
-
Python 3.11
-
Apache Sedona 1.8.0
-
GeoTools 33.1
-
Apache Flink 1.19.1
-
Databricks runtime 16.4 LTS
If you haven’t already, you ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access