Linear Algebra and Its Applications (5th Edition)

Published by Pearson
ISBN 10: 032198238X
ISBN 13: 978-0-32198-238-4

Chapter 6 - Orthogonality and Least Squares - 6.5 Exercises - Page 369: 23

Answer

$\hat{b}=A(A^TA)^{-1}A^Tb$

Work Step by Step

Let us suppose $\hat{x}$ satisfies $A\hat{x}=\hat{b}$ Because $\hat{b}$ is the orthogonal projection of b onto Col A, $b-\hat{b}=b-A\hat{x}$ is orthogonal to the columns of A. This means $A^T(b-A\hat{x})=\vec{0}$. This means $A^Tb-A^TA\hat{x}=\vec{0}$. From here, we can see that $A^Tb=A^TA\hat{x}$ and $\hat{x}=(A^TA)^{-1}A^Tb$. Therefore, $\hat{b}=A(A^TA)^{-1}A^Tb$
Update this answer!

You can help us out by revising, improving and updating this answer.

Update this answer

After you claim an answer you’ll have 24 hours to send in a draft. An editor will review the submission and either publish your submission or provide feedback.