July 2017
Beginner to intermediate
312 pages
7h 27m
English
Software like Celery is great for distributing relatively simple tasks, and especially great for scheduling asynchronous tasks. However, Celery is not the right choice for complicated tasks, for example, handling big data volumes for text analysis problems. For such problems we need a more advanced tool, like Spark.
Spark was inspired when Google developed the famous Hadoop. Hadoop is an open source software framework used for distributed storage and processing big data using the MapReduce programming model. However, we soon realized that the MapReduce pattern is very limiting for data analysis, and this realization gave birth to Spark.
Spark is an open source cluster-computing framework. Originally developed ...
Read now
Unlock full access