book

Machine Learning with LightGBM and Python

Name: Machine Learning with LightGBM and Python
Author: Andrich van Wyk
ISBN: 9781800564749

by Andrich van Wyk

September 2023

Intermediate to advanced

252 pages

6h 26m

English

Packt Publishing

Read now

Unlock full access

Machine Learning with LightGBM and Python
ContributorsAbout the authorAbout the reviewers
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesConventions usedGet in touchShare Your ThoughtsDownload a free PDF copy of this book
Part 1: Gradient Boosting and LightGBM Fundamentals
Chapter 1: Introducing Machine Learning
Technical requirementsWhat is machine learning?Machine learning paradigmsIntroducing models, datasets, and supervised learningModelsHyperparametersDatasetsOverfitting and generalizationSupervised learningModel performance metricsA modeling exampleDecision tree learningEntropy and information gainBuilding a decision tree using C4.5Overfitting in decision treesBuilding decision trees with scikit-learnDecision tree hyperparametersSummaryReferences
Chapter 2: Ensemble Learning – Bagging and Boosting
Technical requirementsEnsemble learningBagging and random forestsRandom forestGradient-boosted decision treesGradient descentGradient boostingGradient-boosted decision tree hyperparametersGradient boosting in scikit-learnAdvanced boosting algorithm – DARTSummaryReferences
Chapter 3: An Overview of LightGBM in Python
Technical requirementsIntroducing LightGBMLightGBM optimizationsHyperparametersLimitations of LightGBMGetting started with LightGBM in PythonLightGBM Python APILightGBM scikit-learn APIBuilding LightGBM modelsCross-validationParameter optimizationPredicting student academic successSummaryReferences
Chapter 4: Comparing LightGBM, XGBoost, and Deep Learning
Technical requirementsAn overview of XGBoostComparing XGBoost and LightGBMPython XGBoost exampleDeep learning and TabTransformersWhat is deep learning?Introducing TabTransformersComparing LightGBM, XGBoost, and TabTransformersPredicting census incomeDetecting credit card fraudSummaryReferences
Part 2: Practical Machine Learning with LightGBM
Chapter 5: LightGBM Parameter Optimization with Optuna
Technical requirementsOptuna and optimization algorithmsIntroducing OptunaOptimization algorithmsPruning strategiesOptimizing LightGBM with OptunaAdvanced Optuna featuresSummaryReferences
Chapter 6: Solving Real-World Data Science Problems with LightGBM
Technical requirementsThe data science life cycleDefining the data science life cyclePredicting wind turbine power generation with LightGBMProblem definitionData collectionData preparationEDAModelingModel deploymentCommunicating resultsClassifying individual credit scores with LightGBMProblem definitionData collectionData preparationEDAModelingModel deployment and resultsSummaryReferences

Chapter 7: AutoML with LightGBM and FLAML
Technical requirementsAutomated machine learningAutomating feature engineeringAutomating model selection and tuningRisks of using AutoML systemsIntroducing FLAMLCost Frugal OptimizationBlendSearchFLAML limitationsCase study – using FLAML with LightGBMFeature engineeringFLAML AutoMLZero-shot AutoMLSummaryReferences
Part 3: Production-ready Machine Learning with LightGBM
Chapter 8: Machine Learning Pipelines and MLOps with LightGBM
Technical requirementsIntroducing machine learning pipelinesScikit-learn pipelinesUnderstanding MLOpsDeploying an ML pipeline for customer churnBuilding an ML pipeline using scikit-learnBuilding an ML API using FastAPIContainerizing our APIDeploying LightGBM to Google CloudSummary
Chapter 9: LightGBM MLOps with AWS SageMaker
Technical requirementsAn introduction to AWS and SageMakerAWSSageMakerSageMaker ClarifyBuilding a LightGBM ML pipeline with Amazon SageMakerSetting up a SageMaker sessionPreprocessing stepModel training and tuningEvaluation, bias, and explainabilityDeploying and monitoring the LightGBM modelResultsSummaryReferences
Chapter 10: LightGBM Models with PostgresML
Technical requirementsIntroducing PostgresMLLatency and round tripsGetting started with PostgresMLTraining modelsDeploying and predictionPostgresML dashboardCase study – customer churn with PostgresMLData loading and preprocessingTraining and hyperparameter optimizationPredictionsSummaryReferences
Chapter 11: Distributed and GPU-Based Learning with LightGBM
Technical requirementsDistributed learning with LightGBM and DaskGPU training for LightGBMSetting up LightGBM for the GPURunning LightGBM on the GPUSummaryReferences
Index
Why subscribe?
Other Books You May EnjoyPackt is searching for authors like youShare Your ThoughtsDownload a free PDF copy of this book

Content preview from Machine Learning with LightGBM and Python

Preface

Welcome to Machine Learning with LightGBM and Python: A Practitioner’s Guide to Developing Production-Ready Machine Learning Systems. In this book, you’ll embark on a rich journey, taking you from the foundational principles of machine learning to the advanced realms of MLOps. The cornerstone of our exploration is LightGBM, a powerful and flexible gradient-boosting framework that can be harnessed for a wide range of machine-learning challenges.

This book is tailor-made for anyone passionate about transforming raw data into actionable insights using the power of Machine Learning (ML). Whether you’re an ML novice eager to get your hands dirty or an experienced data scientist seeking to master the intricacies of LightGBM, there’s something ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Machine Learning Engineering with Python

Publisher Resources

ISBN: 9781800564749

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Machine Learning with LightGBM and Python

by Andrich van Wyk

Preface

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.