Question 1

Why does bagging reduce variance?

Accepted Answer

Students can: explain bagging vs boosting, train and tune sklearn RandomForest and GradientBoosting, compare against a baseline model, reason about overfitting, leakage, and feature importance.

Question 2

Why do trees have high variance?

Accepted Answer

Students can: explain bagging vs boosting, train and tune sklearn RandomForest and GradientBoosting, compare against a baseline model, reason about overfitting, leakage, and feature importance.

Question 3

Why can boosting overfit if you use too many estimators?

Accepted Answer

Students can: explain bagging vs boosting, train and tune sklearn RandomForest and GradientBoosting, compare against a baseline model, reason about overfitting, leakage, and feature importance.

Ensemble Methods & Boosting