Appendix E. A history of enterprise data

I got my first computer when I was 12. It was an exciting Atari 800XL, and I loved coding in BASIC without any GO TO . Soon after I got it, I started thinking of a project that would be considered a big data/IoT project nowadays: connecting traffic lights, cameras, parking meters, and other city devices. To understand a little better how we can now imagine smart cities, beyond my childhood’s wandering thoughts, let me share (a personal interpretation of) the history of data storage in the context of the enterprise.

E.1 The enterprise problem

A lot of the data in enterprises comes from transactional systems. When you shop at your local grocery store, for instance, you perform a transaction . The register ...

Get Spark in Action, Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.