OverviewKey FeaturesIdeal ApplicationsHigh-level ArchitectureWorkersCluster ManagersDriver ProgramsExecutorsTasksApplication ExecutionTerminologyHow an Application WorksData SourcesApplication Programming Interface (API)SparkContextResilient Distributed Datasets (RDD)Creating an RDDRDD OperationsSaving an RDDLazy OperationsAction Triggers ComputationCachingRDD Caching MethodsRDD Caching Is Fault TolerantCache Memory ManagementSpark JobsShared VariablesBroadcast VariablesAccumulatorsSummary