© Matt Wiley and Joshua F. Wiley 2020
M. Wiley, J. F. WileyAdvanced R 4 Data Programming and the Cloudhttps://doi.org/10.1007/978-1-4842-5973-3_10

10. Reading Big Data

Matt Wiley1  and Joshua F. Wiley2
(1)
Victoria College, Victoria, TX, USA
(2)
Monash University, Melbourne, VIC, Australia
 

With your ability to understand manipulating data, it is now worth taking a moment to consider where data live. R works in memory, random access memory (RAM), not hard drives. A quick check of your system settings should reveal the amount of memory you have. We, the authors, use between 16 and 128 GB in our real-world systems, with the larger number being an expensive yet convenient habit. R cannot analyze data larger than available RAM. This becomes important when ...

Get Advanced R 4 Data Programming and the Cloud: Using PostgreSQL, AWS, and Shiny now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.