Orthogonality of Conjugate Directions
Students often conflate -conjugacy with Euclidean orthogonality. They are fundamentally different: while orthogonal vectors are perpendicular in the standard sense (), conjugate vectors are perpendicular only under the inner product defined by the operator , effectively warping the geometry to the function's curvature.
Institutional Reference: Fundamentals of Optimization
View Full Proof →