O'Reilly logo

Practical Predictive Analytics by Ralph Winters

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Running pairwise correlations directly on a Spark dataframe

Correlation and covariance functions are available which operate directly on Spark dataframes. The following example shows that, for patients with diabetes, there is an 11% correlation between age and glucose level:

corr <- corr(out_sd1, "glucose", "age", method = "pearson") corr  

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required