Question 1

Why is logistic regression a “high bias / low variance” baseline?

Accepted Answer

Students can: diagnose bias vs variance from learning curves, choose regularization knobs and justify them, explain L1 vs L2 and their effects on weights/features, reason about model capacity and data size.

Question 2

What pattern indicates high variance?

Accepted Answer

Students can: diagnose bias vs variance from learning curves, choose regularization knobs and justify them, explain L1 vs L2 and their effects on weights/features, reason about model capacity and data size.

Question 3

What pattern indicates high bias?

Accepted Answer

Students can: diagnose bias vs variance from learning curves, choose regularization knobs and justify them, explain L1 vs L2 and their effects on weights/features, reason about model capacity and data size.

Bias, Variance & Regularization