Projection theorem

Since a subspace of an inner product space may itself be considered as an inner product space, the theorem of the preceding section may be applied. The following result, called the projection theorem , is the most important application.

Theorem 1. If is any subspace of a finite-dimensional inner product space , then is the direct sum of and , and .

Proof. Let be an orthonormal set that is complete in , and let be any vector in . We write , where ; it follows from Section: Completeness , Theorem 1, that is in , so that is the sum of two vectors, , with in and in . That and are disjoint is clear; if belonged to both, then we should have . It follows from the theorem of Section: Direct sums that .

We observe that in the decomposition , we have and, similarly, Hence, if is in , so that , then , so that ( ) is in ; in other words, is contained in . Since we already know that is contained in , the proof of the theorem is complete. ◻

This kind of direct sum decomposition of an inner product space (via a subspace and its orthogonal complement) is of considerable geometric interest. We shall study the associated projections a little later; they turn out to be an interesting and important subclass of the class of all projections. At present we remark only on the connection with the Pythagorean theorem; since and , we have In other words, the square of the hypotenuse is the sum of the squares of the sides. More generally, if are pairwise orthogonal subspaces in an inner product space , and if , with in for , then