Finite Termination of Conjugate Gradient Method for Quadratic Functions
Students frequently conflate 'conjugacy' with 'orthogonality.' While orthogonal vectors satisfy , conjugate vectors satisfy . Without the matrix in the inner product, the directions would not adapt to the specific curvature of the quadratic surface.
Institutional Reference: Fundamentals of Optimization
View Full Proof →