Book description
Discover the capabilities of PySpark and its application in the realm of data science. This comprehensive guide with hand-picked examples of daily use cases will walk you through the end-to-end predictive model-building cycle with the latest techniques and tricks of the trade.
Applied Data Science Using PySpark is divided unto six sections which walk you through the book. In section 1, you start with the basics of PySpark focusing on data manipulation. We make you comfortable with the language and then build upon it to introduce you to the mathematical functions available off the shelf. In section 2, you will dive into the art of variable selection where we demonstrate various selection techniques available in PySpark. In section 3, we take you on a journey through machine learning algorithms, implementations, and fine-tuning techniques. We will also talk about different validation metrics and how to use them for picking the best models. Sections 4 and 5 go through machine learning pipelines and various methods available to operationalize the model and serve it through Docker/an API. In the final section, you will cover reusable objects for easy experimentation and learn some tricks that can help you optimize your programs and machine learning pipelines.
By the end of this book, you will have seen the flexibility and advantages of PySpark in data science applications. This book is recommended to those who want to unleash the power of parallel computing by simultaneously working with big datasets.
What You Will Learn
- Build an end-to-end predictive model
- Implement multiple variable selection techniques
- Operationalize models
- Master multiple algorithms and implementations
Who This Book is For
Data scientists and machine learning and deep learning engineers who want to learn and use PySpark for real-time analysis of streamingdata.Table of contents
- Cover
- Front Matter
- 1. Setting Up the PySpark Environment
- 2. PySpark Basics
- 3. Utility Functions and Visualizations
- 4. Variable Selection
- 5. Supervised Learning Algorithms
- 6. Model Evaluation
- 7. Unsupervised Learning and Recommendation Algorithms
- 8. Machine Learning Flow and Automated Pipelines
- 9. Deploying Machine Learning Models
- Back Matter
Product information
- Title: Applied Data Science Using PySpark: Learn the End-to-End Predictive Model-Building Cycle
- Author(s):
- Release date: December 2020
- Publisher(s): Apress
- ISBN: 9781484265000
You might also like
book
Adaptive Machine Learning Algorithms with Python: Solve Data Analytics and Machine Learning Problems on Edge Devices
Learn to use adaptive algorithms to solve real-world streaming data problems. This book covers a multitude …
book
Practical Data Science with Python 3: Synthesizing Actionable Insights from Data
Gain insight into essential data science skills in a holistic manner using data engineering and associated …
book
Next-Generation Machine Learning with Spark: Covers XGBoost, LightGBM, Spark NLP, Distributed Deep Learning with Keras, and More
Access real-world documentation and examples for the Spark platform for building large-scale, enterprise-grade machine learning applications. …
book
Learn PySpark: Build Python-based Machine Learning and Deep Learning Models
Leverage machine and deep learning models to build applications on real-time data using PySpark. This book …