Beginning Azure Synapse Analytics: Transition from Data Warehouse to Data Lakehouse

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2021

B. ShiyalBeginning Azure Synapse Analyticshttps://doi.org/10.1007/978-1-4842-7061-5_6

6. Synapse Spark

Bhadresh Shiyal¹  

(1)

Mumbai, India

 

Azure Synapse Analytics provides three compute engine options to choose from. There are two Synapse SQL engines, namely Serverless Synapse SQL and Provisioned Synapse SQL; the third option is Synapse Spark, which is based on Apache Spark. We discussed Synapse SQL in detail in the previous chapter. Now, let us discuss Apache Spark, or Synapse Spark, in detail in this chapter.

Big Data analytics requires a robust data analytics engine that can support petabyte-size processing with fast processing power. Apache Spark fits the ...