Book description
Stochastic Optimization for Large-scale Machine Learning identifies different areas of improvement and recent research directions to tackle the challenge. Developed optimisation techniques are also explored to improve machine learning algorithms based on data access and on first and second order optimisation methods.
Table of contents
- Cover Page
- Half-Title Page
- Title Page
- Copyright Page
- Dedication Page
- Contents
- List of Figures
- List of Tables
- Preface
-
SECTION I BACKGROUND
- CHAPTER 1 ◾ Introduction
-
CHAPTER 2 ◾ Optimization Problem, Solvers, Challenges and Research Directions
- 2.1 INTRODUCTION
- 2.2 LITERATURE
-
2.3 PROBLEM FORMULATIONS
- 2.3.1 Hard Margin SVM (1992)
- 2.3.2 Soft Margin SVM (1995)
- 2.3.3 One-versus-Rest (1998)
- 2.3.4 One-versus-One (1999)
- 2.3.5 Least Squares SVM (1999)
- 2.3.6 ν-SVM (2000)
- 2.3.7 Smooth SVM (2001)
- 2.3.8 Proximal SVM (2001)
- 2.3.9 Crammer Singer SVM (2002)
- 2.3.10 Eν-SVM (2003)
- 2.3.11 Twin SVM (2007)
- 2.3.12 Capped lp-norm SVM (2017)
-
2.4 PROBLEM SOLVERS
- 2.4.1 Exact Line Search Method
- 2.4.2 Backtracking Line Search
- 2.4.3 Constant Step Size
- 2.4.4 Lipschitz and Strong Convexity Constants
- 2.4.5 Trust Region Method
- 2.4.6 Gradient Descent Method
- 2.4.7 Newton Method
- 2.4.8 Gauss-Newton Method
- 2.4.9 Levenberg-Marquardt Method
- 2.4.10 Quasi-Newton Method
- 2.4.11 Subgradient Method
- 2.4.12 Conjugate Gradient Method
- 2.4.13 Truncated Newton Method
- 2.4.14 Proximal Gradient Method
- 2.4.15 Recent Algorithms
- 2.5 COMPARATIVE STUDY
- 2.6 CURRENT CHALLENGES AND RESEARCH DIRECTIONS
- 2.7 CONCLUSION
-
SECTION II FIRST ORDER METHODS
- CHAPTER 3 ◾ Mini-batch and Block-coordinate Approach
- CHAPTER 4 ◾ Variance Reduction Methods
- CHAPTER 5 ◾ Learning and Data Access
- SECTION III SECOND ORDER METHODS
- SECTION IV CONCLUSION
- Bibliography
- Index
Product information
- Title: Stochastic Optimization for Large-scale Machine Learning
- Author(s):
- Release date: November 2021
- Publisher(s): CRC Press
- ISBN: 9781000505610
You might also like
book
Data Science Revealed: With Feature Engineering, Data Visualization, Pipeline Development, and Hyperparameter Tuning
Get insight into data science techniques such as data engineering and visualization, statistical modeling, machine learning, …
article
Run Llama-2 Models Locally with llama.cpp
Llama is Meta’s answer to the growing demand for LLMs. Unlike its well-known technological relative, ChatGPT, …
article
Why So Many Data Science Projects Fail to Deliver
Many companies are unable to consistently gain business value from their investments in big data, artificial …
book
Bayesian Inverse Problems
This book is devoted to a special class of engineering problems called Bayesian inverse problems. These …