Parameters of gradient boosting

There are different parameters to consider before applying gradient boosting for the breast cancer use case:

  • Min_samples_split: The minimum number of samples required in a node to be considered for splitting is termed min_samples_split.
  • Min_samples_leaf: The minimum number of samples required at the terminal or leaf node is termed min_samples_leaf.
  • Max_depth: This is the maximum number of nodes allowed from the root to the farthest leaf of a tree. Deeper trees can model more complex relationships, however, causing the model to overfit.
  • Max_leaf_nodes: The maximum number of nodes at the leaves in a tree. Since binary trees are created, a depth of n would produce a maximum of 2 leaves. Hence, either max_depth ...

Get Machine Learning Quick Reference now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.