Self-adjoint transformations of rank one

We have already seen ( Section: Transformations of rank one , Theorem 2) that every linear transformation A of rank ρ is the sum of ρ linear transformations of rank one. It is easy to see (using the spectral theorem) that if A is self-adjoint, or positive, then the summands may also be taken self-adjoint, or positive, respectively. We know ( Section: Transformations of rank one , Theorem 1) what the matrix of transformation of rank one has to be; what more can we say if the transformation is self-adjoint or positive?

Theorem 1. If A has rank one and is self-adjoint (or positive), then in every orthonormal coordinate system the matrix ( α i j ) of A is given by α i j = κ β i β ¯ j with a real κ (or by α i j = γ i γ ¯ j ). If, conversely, [ A ] has this form in some orthonormal coordinate system, then A has rank one and is self-adjoint (or positive).

Proof. We know that the matrix ( α i j ) of a transformation A of rank one, in any orthonormal coordinate system 𝒳 = { x 1 , , x n } , is given by α i j = β i γ j . If A is self-adjoint, we must also have α i j = α ¯ j i , whence β i γ j = β j γ i . If β i = 0 and γ i 0 for some i , then β ¯ j = β i γ j / γ ¯ i = 0 for all j , whence A = 0 . Since we assumed that the rank of A is one (and not zero), this is impossible. Similarly β i 0 and γ i = 0 is impossible; that is, we can find an i for which β i γ i 0 . Using this i , we have β ¯ j = ( β i / γ ¯ i ) γ j = κ γ j with some non-zero constant κ , independent of j . Since the diagonal elements α j j = ( A x j , x j ) = β j γ j of a self-adjoint matrix are real, we can even conclude that α i j = κ β i β ¯ j with a real κ .

If, moreover, A is positive, then we even know that κ β j β ¯ j = α j j = ( A x j , x j ) is positive, and therefore so is κ . In this case we write λ = κ ; the relation κ β i β ¯ j = ( λ β i ) ( λ β ¯ j ) shows that α i j is given by α i j = γ i γ ¯ j .

It is easy to see that these necessary conditions are also sufficient. If α i j = κ β i β ¯ j with a real κ , then A is self-adjoint. If α i j = γ i γ ¯ j , and x = i ξ i x i , then \begin{align} (A x, x) &= \sum_{i} \sum_{j} \alpha_{i j} \bar{\xi}_{i} \xi_{j}\\ &= \sum_{i} \sum_{j} \gamma_{i} \bar{\gamma}_{j} \bar{\xi}_{i} \xi_{j} \\ &= \Big(\sum_{i} \gamma_{i} \bar{\xi}_{i}\Big) \overline{\Big(\sum_{j} \gamma_{j} \bar{\xi}_{j}\Big)}\\ &= |\sum_{i} \gamma_{i} \bar{\xi}_{i}|^{2}\\ &\geq 0, \end{align}so that A is positive. ◻

As a consequence of Theorem 1 it is very easy to prove a remarkable theorem on positive matrices.

Theorem 2. If A and B are positive linear transformations whose matrices in some orthonormal coordinate system are ( α i j ) and ( β i j ) respectively, then the linear transformation C , whose matrix ( γ i j ) in the same coordinate system is given by γ i j = α i j β i j for all i and j , is also positive.

Proof. Since we may write both A and B as sums of positive transformations of rank one, so that α i j = p α i p α ¯ j p and β i j = q β i q β ¯ j q , it follows that γ i j = p q α i p β i q ( α j p β j q ) . (The superscripts here are not exponents.) Since a sum of positive matrices is positive, it will be sufficient to prove that, for each fixed p and q , the matrix ( ( α i p β i q ) ( α j p β j q ) ) is positive, and this follows from Theorem 1. ◻

The proof shows, by the way, that Theorem 2 remains valid if we replace "positive" by "self-adjoint" in both hypothesis and conclusion; in most applications, however, it is only the actually stated version that is useful. The matrix ( γ i j ) described in Theorem 2 is called the Hadamard product of ( α i j ) and ( β i j ) .

EXERCISES

Exercise 1. Suppose that 𝒰 and 𝒱 are finite-dimensional inner product spaces (both real or both complex).

  1. There is a unique inner product on the vector space of all bilinear forms on 𝒰 𝒱 such that if w 1 ( x , y ) = ( x , x 1 ) ( y , y 1 ) and w 2 ( x , y ) = ( x , x 2 ) ( y , y 2 ) , then ( w 1 , w 2 ) = ( x 2 , x 1 ) ( y 2 , y 1 ) .
  2. There is a unique inner product on the tensor product 𝒰 𝒱 such that if z 1 = x 1 y 1 and z 2 = x 2 y 2 , then ( z 1 , z 2 ) = ( x 1 , x 2 ) ( y 1 , y 2 ) .
  3. If { x i } and { y p } are orthonormal bases in 𝒰 and 𝒱 , respectively, then the vectors x i y p form an orthonormal basis in 𝒰 𝒱 .

Exercise 2. Is the tensor product of two Hermitian transformations necessarily Hermitian? What about unitary transformations? What about normal transformations?