Parameters of gradient boosting

There are different parameters to consider before applying gradient boosting for the breast cancer use case:

  • Min_samples_split: The minimum number of samples required in a node to be considered for splitting is termed min_samples_split.
  • Min_samples_leaf: The minimum number of samples required at the terminal or leaf node is termed min_samples_leaf.
  • Max_depth: This is the maximum number of nodes allowed from the root to the farthest leaf of a tree. Deeper trees can model more complex relationships, however, causing the model to overfit.
  • Max_leaf_nodes: The maximum number of nodes at the leaves in a tree. Since binary trees are created, a depth of n would produce a maximum of 2 leaves. Hence, either max_depth ...

Get Machine Learning Quick Reference now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.