Scala and Spark for Big Data Analytics

Variance

Variance is the average of the squared differences of each of the values from the mean.

The var API has several implementations, as follows. The exact API used depends on the specific use case:

def var_pop(columnName: String): ColumnAggregate function: returns the population variance of the values in a group.def var_pop(e: Column): ColumnAggregate function: returns the population variance of the values in a group.def var_samp(columnName: String): ColumnAggregate function: returns the unbiased variance of the values in a group.def var_samp(e: Column): ColumnAggregate function: returns the unbiased variance of the values in a group.

Now, let's look at an example of invoking var_pop on the DataFrame measuring variance of Population ...