Inner products

Let us now get our feet back on the ground. We started in Chapter I by pointing out that we wish to generalize certain elementary properties of certain elementary spaces such as . In our study so far we have done this, but we have entirely omitted from consideration one aspect of . We have studied the qualitative concept of linearity; what we have entirely ignored are the usual quantitative concepts of angle and length. In the present chapter we shall fill this gap; we shall superimpose on the vector spaces to be studied certain numerical functions, corresponding to the ordinary notions of angle and length, and we shall study the new structure (vector space plus given numerical function) so obtained. For the added depth of geometric insight we gain in this way, we must sacrifice some generality; throughout the rest of this book we shall have to assume that the underlying field of scalars is either the field of real numbers or the field of complex numbers.

For a clue as to how to proceed, we first inspect . If and are any two points in , the usual formula for the distance between and , or the length of the segment joining and , is . It is convenient to introduce the notation for the distance from to the origin ; in this notation the distance between and becomes .

So much, for the present, for lengths and distances; what about angles? It turns out that it is much more convenient to study, in the general case, not any of the usual measures of angles but rather their cosines. (Roughly speaking, the reason for this is that the angle, in the usual picture in the circle of radius one, is the length of a certain circular arc, whereas the cosine of the angle is the length of a line segment; the latter is much easier to relate to our preceding study of linear functions.) Suppose then that we let be the angle between the segment from to and the positive axis, and let be the angle between the segment from to and the same axis; the angle between the two vectors and is , so that its cosine is

Consider the expression ; by means of it we can express both angle and length by very simple formulas. We have already seen that if we know the distance between and for all , then we can compute the distance between any and ; we assert now that if for every pair of vectors and we are given the value of , then in terms of this value we may compute all distances and all angles. Indeed, if we take , then becomes , and this takes care of lengths; the cosine formula above gives us the angle in terms of and the two lengths and . To have a concise notation, let us write, for and , what we said above is summarized by the relations The important properties of , considered as a numerical function of the pair of vectors and , are the following: it is symmetric in and , it depends linearly on each of its two variables, and (unless ) the value of is always strictly positive. (The notational conflict between the use of parentheses in and in is only apparent. It could arise in two-dimensional spaces only, and even there confusion is easily avoided.)

Observe for a moment the much more trivial picture in . For and we should have, in this case, (and it is for this reason that is known as the inner product or scalar product of and ). The angle between any two vectors is either or , so that its cosine is either or . This shows up the much greater sensitivity of the function given by , which takes on all possible numerical values.