Apache Spark 2.x Cookbook

Getting ready

In this recipe, we are going to use the Pima Indians Diabetes Database. This database is owned by the National Institute of Diabetes and Digestive and Kidney Diseases. The original CSV files contain features in the following order:

• Number of times pregnant
• Plasma glucose concentration at 2 hours in an oral glucose tolerance test
• Diastolic blood pressure (mmHg)
• Triceps skinfold thickness (mm)
• 2-hour serum insulin (mu U/ml)
• Body mass index (weight in kg/(height in m² )
• Diabetes pedigree function
• Age (years)
• Class variable (0 or 1)

The ninth value here is the label that tells whether the given person has diabetes or not. For your convenience, the CSV file is loaded in the following public s3 location: http://sparkcookbook.s3.amazonaws.com/medicaldata/diabetes.csv ...