Spectral theorem

We are now ready to prove the main theorem of this book, the theorem of which many of the other results of this chapter are immediate corollaries. To some extent what we have been doing up to now was a matter of sport (useful, however, for generalizations); we wanted to show how much can conveniently be done with spectral theory before proving the spectral theorem. In the complex case, incidentally, the spectral theorem can be made to follow from the triangularization process we have already described; because of the importance of the theorem we prefer to give below its (quite easy) direct proof. The reader may find it profitable to adapt the method of proof (not the result) of Section: Triangular form , Theorem 2, to prove as much as he can of the spectral theorem and its consequences.

Theorem 1. To every self-adjoint linear transformation on a finite-dimensional inner product space there correspond real numbers and perpendicular projections (where is a strictly positive integer, not greater than the dimension of the space) so that

the are pairwise distinct,
the are pairwise orthogonal and different from ,
,
.

Proof. Let be the distinct proper values of , and let be the perpendicular projection on the subspace consisting of all solutions of ( ). Condition (1) is then satisfied by definition; the fact that the ’s are real follows from Section: Characterization of spectra , Theorem 1. Condition (2) follows from Section: Characterization of spectra , Theorem 4. From the orthogonality of the we infer that if , then is a perpendicular projection. The dimension of the range of is the sum of the dimensions of the ranges of the , and consequently, by Section: Characterization of spectra , Theorem 6, the dimension of the range of is equal to the dimension of the entire space; this implies (3). (Alternatively, if , then considered on the range of would be a self-adjoint transformation with no proper values.) To prove (4), take any vector and write ; it follows that and hence that This completes the proof of the spectral theorem. ◻

The representation (where the ’s and the ’s satisfy the conditions (1)-(3) of Theorem 1) is called a spectral form of ; the main effect of the following result is to prove the uniqueness of the spectral form.

Theorem 2. If is the spectral form of a self-adjoint transformation on a finite-dimensional inner product space, then the ’s are all the distinct proper values of . If, moreover, , then there exist polynomials , with real coefficients, such that whenever and such that ; for every such polynomial .

Proof. Since , there exists a vector in the range of . Since and whenever , it follows that so that each is a proper value of . If, conversely, is any proper value of , say with , then we write and we see that and so that . Since the are pairwise orthogonal, those among them that are not zero form a linearly independent set. It follows that, for each , either or else . Since , we must have for some , and consequently is indeed equal to one of the ’s.

Since if , and , it follows that Similarly for every positive integer (in case , use (3)), and hence for every polynomial . To conclude the proof of the theorem, all we need to do is to exhibit a (real) polynomial such that whenever and such that . If we write then is a polynomial with all the required properties. ◻

Theorem 3. If is the spectral form of a self-adjoint transformation on a finite-dimensional inner product space, then a necessary and sufficient condition that a linear transformation commute with is that it commute with each .

Proof. The sufficiency of the condition is trivial; if and for all , then . Necessity follows from Theorem 2; if commutes with , then commutes with every polynomial in , and therefore commutes with each . ◻

Before exploiting the spectral theorem any further, we remark on its matricial interpretation. If we choose an orthonormal basis in the range of each , then the totality of the vectors in these little bases is a basis for the whole space; expressed in this basis the matrix of will be diagonal. The fact that by a suitable choice of an orthonormal basis the matrix of a self-adjoint transformation can be made diagonal, or, equivalently, that any self-adjoint matrix can be isometrically transformed (that is, replaced by , where is an isometry) into a diagonal matrix, already follows (in the complex case) from the theory of the triangular form. We gave the algebraic version for two reasons. First, it is this version that generalizes easily to the infinite-dimensional case, and, second, even in the finite-dimensional case, writing often has great notational and typographical advantages over the matrix notation.

We shall make use of the fact that a not necessarily self-adjoint transformation is isometrically diagonable (that is, that its matrix with respect to a suitable orthonormal basis is diagonal) if and only if conditions (1)-(4) of Theorem 1 hold for it. Indeed, if we have (1)-(4), then the proof of diagonability, given for self-adjoint transformations, applies; the converse we leave as an exercise for the reader.

EXERCISES

Exercise 1. Suppose that is a linear transformation on a complex inner product space. Prove that if is Hermitian, then the linear factors of the minimal polynomial of are distinct. Is the converse true?

Exercise 2.

Two linear transformations and on a unitary space are unitarily equivalent if there exists a unitary transformation such that . (The corresponding concept in the real case is called orthogonal equivalence .) Prove that unitary equivalence is an equivalence relation.
Are and always unitarily equivalent?
Are and always unitarily equivalent?

Exercise 3. Which of the following pairs of matrices are unitarily equivalent?

and .
and .
and .
and .

Exercise 4. If two linear transformations are unitarily equivalent, then they are similar, and they are congruent; if two linear transformations are either similar or congruent, then they are equivalent. Show by examples that these implication relations are the only ones that hold among these concepts.

EXERCISES

Quick Links

Social Media