There are different parameters to consider before applying gradient boosting for the breast cancer use case:
- Min_samples_split: The minimum number of samples required in a node to be considered for splitting is termed min_samples_split.
- Min_samples_leaf: The minimum number of samples required at the terminal or leaf node is termed min_samples_leaf.
- Max_depth: This is the maximum number of nodes allowed from the root to the farthest leaf of a tree. Deeper trees can model more complex relationships, however, causing the model to overfit.
- Max_leaf_nodes: The maximum number of nodes at the leaves in a tree. Since binary trees are created, a depth of n would produce a maximum of 2n leaves. Hence, either max_depth ...