Inner Product Space
An inner product space is a special type of vector space that has a mechanism for computing a version of "dot product" between vectors. An inner product is a generalized version of the dot product that can be defined in any real or complex vector space, as long as it satisfies a few conditions.
Inner products are used to help better understand vector spaces of infinite dimension and to add structure to vector spaces. Inner products are often related to a notion of "distance" within the space, due to their positive-definite property. This relation to distance allows a norm to be imposed on the space, turning it into a metric space.
Contents
Definition
Like most elements of linear algebra, an inner product must be linear to be meaningful. It also must support some interpretation of "distance" and return meaningful values in the complex case.
A vector space with underlying field or is known as an inner product space when equipped with an operation that satisfies the following:
- (Conjugate) symmetry. For all vectors and , .
- Linearity. For any scalar and all vectors , , and , and .
- Positive-definiteness. For any vector , and implies that .
Note that in the case of a real vector space, conjugate symmetry is just symmetry. In the complex case, it is necessary for symmetry to be conjugate symmetry so that is always a real number.
What happens if conjugate symmetry is relaxed to symmetry?
Consider the vector spaces and .
More generally, positive-definiteness requires that the field's underlying vector space be ordered, and since finite fields cannot be ordered, the most common (and useful) examples of ordered fields are the real and complex numbers. So it makes sense that inner product spaces are defined only over them.
The length (or norm) of a vector is then defined to be Note that the length of a vector is not linear; it does satisfy linear in scalar multiplication though. For any vectors and , the Triangle Inequality holds:
Examples
The simplest, and primary, example of an inner product is the common one used in , the dot product.