Derivation of the Ordinary Least Squares (OLS) Estimators for Simple Linear Regression
Students frequently mistake the vertical residuals minimized in OLS for the perpendicular distances used in orthogonal regression. Additionally, many overlook the requirement that the sum of residuals must equal zero at the OLS solution, which is a direct consequence of the first-order condition for the intercept.
Institutional Reference: Applied Statistics
View Full Proof →