Hands-On Ensemble Learning with Python

Extra trees regression

Finally, we present the regression implementation of Extra Trees, implemented in ExtraTreesRegressor. In the following code, we repeat the previously presented example of modeling the diabetes dataset, using the regression version of Extra Trees:

# --- SECTION 1 ---# Libraries and data loadingfrom copy import deepcopyfrom sklearn.datasets import load_diabetesfrom sklearn.ensemble import ExtraTreesRegressorfrom sklearn import metricsimport numpy as npdiabetes = load_diabetes()train_size = 400train_x, train_y = diabetes.data[:train_size], diabetes.target[:train_size]test_x, test_y = diabetes.data[train_size:], diabetes.target[train_size:]np.random.seed(123456)# --- SECTION 2 ---# Create the ensembleensemble_size = 100 ...