Question 1

Why prefer solve over explicit inverse?

Accepted Answer

Students can implement linear regression from scratch (closed form + GD), reason about bias/variance + regularization, and connect GLMs to real ML problems.

Question 2

When is X^T X singular or ill conditioned?

Accepted Answer

Students can implement linear regression from scratch (closed form + GD), reason about bias/variance + regularization, and connect GLMs to real ML problems.

Question 3

What controls convergence speed?

Accepted Answer

Students can implement linear regression from scratch (closed form + GD), reason about bias/variance + regularization, and connect GLMs to real ML problems.

Linear Regression & GLMs