Skip to Main Content
Large Scale and Big Data
book

Large Scale and Big Data

by Sherif Sakr, Mohamed Gaber
June 2014
Intermediate to advanced content levelIntermediate to advanced
636 pages
23h 13m
English
Auerbach Publications
Content preview from Large Scale and Big Data
142 Large Scale and Big Data
This overhead becomes more visible for the smallest skip offset of 20 MB. This
was expected since the Rabin ngerprint needs to be computed for a larger fraction
of the data. Somewhat more surprising was the reduction in throughput for the larg-
est skip offset of 60 MB. This is due to the fact that increasing the skip offset leads to
an increase in the average chunk size, which in turn leads to decreasing the amount
of parallelism toward the end of the data upload. We therefore found 40 MB to be a
reasonable compromise between these two negative factors.
4.6.5 work anD time sPeeDuP
We report the speedup of Incoop ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Reinventing the Organization for GenAI and LLMs

Reinventing the Organization for GenAI and LLMs

Ethan Mollick
Big Data Analytics for Internet of Things

Big Data Analytics for Internet of Things

Tausifa Jan Saleem, Mohammad Ahsan Chishti
Scala:Applied Machine Learning

Scala:Applied Machine Learning

Pascal Bugnion, Patrick R. Nicolas, Alex Kozlov
Topics in Parallel and Distributed Computing

Topics in Parallel and Distributed Computing

Sushil K Prasad, Anshul Gupta, Arnold L Rosenberg, Alan Sussman, Charles C Weems

Publisher Resources

ISBN: 9781466581500