July 2017
Beginner to intermediate
378 pages
10h 26m
English
Content preview from Analytics for the Internet of Things (IoT)
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Reducing the number of fields
As you get to know your IoT data, you will find some fields are more valuable than others. Through your discoveries using techniques from Chapter 6, Getting to Know Your Data - Exploring IoT Data, and Chapter 10, Data Science for IoT Analytics, you will find fields (features) that keep coming up as statistically significant, and some that just never seem to matter.
For older files, you can follow some methods to keep the useful fields, while getting rid of the ones that do not seem to have an impact:
- Transform older data to only keep useful fields: Move older data to either a new file or table but only keep those useful fields. Then, delete the old records.
- Split out useful fields and treat them differently ...