Errata

"format is optional because by default, Spark will use the arquet format." should read "format is optional because by default, Spark will use the parquet format.".

Note from the Author or Editor:
This fix is correc!

In the start of the paragraph "Lazy evaulation" the word "evaluation" has a typo.

Note from the Author or Editor:
Yup, it does! Please correct the spelling.

'[...] combine motif finding with DataFarme queries [...]' should read '[...] combine motif finding with DataFrame queries [...]'

Note from the Author or Editor:
You are correct! We will make this change!

'descriubed' should read 'described'

Note from the Author or Editor:
It should!

'[...] output of the dream [...]' is a lovely metaphor, but should probably read '[...] output of the stream [...]'

Note from the Author or Editor:
I almost want to leave it because it makes me smile. But yes, we should change this.

'The first section if this chapter [...]' should read 'The first section of this chapter [...]'

Note from the Author or Editor:
Indeed!

'[...] (all of its the windowing operators [...]' should read '[...] (all of its windowing operators [...]' or '[...] (all of the windowing operators [...]'

Note from the Author or Editor:
Let's change to "all of its windowing operators"

'[...] require deep expertise to be develop and maintain.' should read '[...] require deep expertise to be developed and maintained.'

Note from the Author or Editor:
Yes, let's make this change.

The last word 'fradulent' should read 'fraudulent'

Note from the Author or Editor:
Yes, it should!

The code block should be below the 2nd paragraph, not above, so the last sentence 'The example that follows [...]' becomes correct

Note from the Author or Editor:
Please change this to "The previous example configures..."

'When submitting applciations, [...]' should read 'When submitting applications, [...]'

Note from the Author or Editor:
Yes, please fix.

'communtiy' should read 'community'

Note from the Author or Editor:
Yes, please fix.

'Appication' should read 'Application'

Note from the Author or Editor:
Yes, it should!

'In this example, you we will add [...]' should contain either 'you' or 'we', not both

Note from the Author or Editor:
Thanks for this feedback, we'll make the change!

'We'll do these in the context of a key, but the same basic principles apply to the groupBy and reduce methods' should read 'We'll do these in the context of a key, but the same basic principles apply to the groupByValue and reduceValue methods'

Note from the Author or Editor:
This is probably a fair criticism if we're referring explicitly to the "method calls" instead of just the "method of implementation". We should clean these up to make sure they're consistent and your rewrite is probably a great start.

'You get the both of best worlds.' I think the incorrect is order.

Note from the Author or Editor:
Absolutely. :)

'When we declare [...] not having a null time [...]' should read 'When we declare [...] not having a null type [...]'

Note from the Author or Editor:
We should make this change.

'Although Spark will do read dates or times on a best-effort basis' should read 'Spark will read dates or times on a best-effort basis'

Note from the Author or Editor:
Read/do should be "parse" in the future. This is good feedback.

'The only difference will by syntax' should read 'The only difference will be syntax'

Note from the Author or Editor:
Yes, this is correct. We should change this.

Last word of the paragraph contains a typo: "langauge". It should be "language":

"Spark Core consists of two APIs. The Unstructured and Structured APIs. The Unstructured API is Spark’s lower level set of APIs including Resilient Distributed Datasets (RDDs), Accumulators, and Broadcast variables. The Structured API consists of DataFrames, Datasets, Spark SQL and is the interface that most users should use. The difference between the two is that one is optimized to work with structured data in a spreadsheet-like interface while the other is meant for manipulation of raw java objects. Outside of Spark Core sit a variety of tools, libraries, and languages like MLlib for performing machine learning, the GraphX module for performing graph processing, and SparkR for working with Spark clusters from the R langauge."

Note from the Author or Editor:
Fixed for first release.

There is a typo of "efficienly". The correct word is "efficiently".

Note from the Author or Editor:
Fixed for first release.

repeated.
A cube takes the rollup *takes a rollup* to a level deeper.

Note from the Author or Editor:
Fixed for first release.

Probably should be "encounter" instead of "encourage".
"With these three tools, you should be able to solve the vast majority of transformation challenges that you may encourage in DataFrames."

Note from the Author or Editor:
Fixed for first release.

The seems to be a typo in Chapter 3 subsection Columns, Paragraph 2....."this column may or may not exist in our of our DataFrames." probably should be
"this column may or may not exist in our DataFrames." instead.

Note from the Author or Editor:
Fixed for first release.

Chapter 1: Paragraph 8: This is from ebook
* "The last piece relevant piece for us is the cluster manager." Looks like grammer mistake piece repeated twice.
* Typo on "appliications"

Note from the Author or Editor:
Fixed for first release

Hi,

There is a Typo error in the first line on Pg-61 under section "Creating Rows".

Original:
You can create rows by manually instantiating a Row object with the values that below in each column.

Rectified:
You can create rows by manually instantiating a Row object with the values that belong in each column.

Thanks,
Manish Bahrani

Note from the Author or Editor:
This typo was fixed for the first release.

PDF has "ight" instead of "might" in the paragraph describing Lazy Evaluation.

5th sentence has ---
An example of this ight be “predicate pushdown”

I suppose it should be ---
An example of this might be “predicate pushdown”

Note from the Author or Editor:
Fixed for first release.

Hi,

Comma-separated values misspelt as "comma seperated value".

Paragraph:
"Now hopefully you have grasped the basics but let’s just reinforce some of the core concepts with another data pipeline. We’re going to be using the same flight data used except that this time we’ll be using a copy of the data in comma seperated value (CSV) format."

Note from the Author or Editor:
Fixed for first release.

Hi,

Thank you for such a great resource on Spark.

There is just a little typo on the first chapter, under the "Spark Applications" header, just before Figure 1-1 (read on Safari Books Online), where applications is misspelt as "appliications" (see below, last sentence).

"The last piece relevant piece for us is the cluster manager. The cluster manager controls physical machines and allocates resources to Spark applications. This can be one of several core cluster managers: Spark’s standalone cluster manager, YARN, or Mesos. This means that there can be multiple Spark appliications running on a cluster at the same time."

Best,

Simon Bensoussan

Note from the Author or Editor:
Fixed for first release.