Definite quadratic form
In mathematics, a definite quadratic form is a quadratic form over some real vector space V that has the same sign (always positive or always negative) for every nonzero vector of V. According to that sign, the quadratic form is called positive definite or negative definite.
A semidefinite (or semi-definite) quadratic form is defined in the same way, except that "positive" and "negative" are replaced by "not negative" and "not positive", respectively. An indefinite quadratic form is one that takes on both positive and negative values.
More generally, the definition applies to a vector space over an ordered field.^{[1]}
Contents
Associated symmetric bilinear form
Quadratic forms correspond one-to-one to symmetric bilinear forms over the same space.^{[2]} A symmetric bilinear form is also described as definite, semidefinite, etc. according to its associated quadratic form. A quadratic form Q and its associated symmetric bilinear form B are related by the following equations:
Examples
As an example, let , and consider the quadratic form
where x = (x_{1}, x_{2}) and c_{1} and c_{2} are constants. If c_{1} > 0 and c_{2} > 0, the quadratic form Q is positive definite, so Q evaluates to a positive number whenever If one of the constants is positive and the other is 0, then Q is positive semidefinite and always evaluates to either 0 or a positive number. If c_{1} > 0 and c_{2} < 0, or vice versa, then Q is indefinite and sometimes evaluates to a positive number and sometimes to a negative number. If c_{1} < 0 and c_{2} < 0, the quadratic form is negative definite and always evaluates to a negative number whenever And if one of the constants is negative and the other is 0, then Q is negative semidefinite and always evaluates to either 0 or a negative number.
In general a quadratic form in two variables will also involve a cross-product term in x_{1}x_{2}:
This quadratic form is positive definite if and negative definite if and and indefinite if It is positive or negative semidefinite if with the sign of the semidefiniteness coinciding with the sign of
This bivariate quadratic form appears in the context of conic sections centered on the origin. If the general quadratic form above is equated to 0, the resulting equation is that of an ellipse if the quadratic form is positive or negative definite, a hyperbola if it is indefinite, and a parabola if
The square of the Euclidean norm in n-dimensional space, the most commonly used measure of distance, is
In two dimensions this means that the distance between two points is the square root of the sum of the squared distances along the axis and the axis.
Matrix form
A quadratic form can be written in terms of matrices as
where x is any n×1 Cartesian vector in which not all elements are 0, superscript ^{T} denotes a transpose, and A is an n×n symmetric matrix. If A is diagonal this is equivalent to a non-matrix form containing solely terms involving squared variables; but if A has any non-zero off-diagonal elements, the non-matrix form will also contain some terms involving products of two different variables.
Positive or negative definiteness or semi-definiteness, or indefiniteness, of this quadratic form is equivalent to the same property of A, which can be checked by considering all eigenvalues of A or by checking the signs of all of its principal minors.
Optimization
Definite quadratic forms lend themselves readily to optimization problems. Suppose the matrix quadratic form is augmented with linear terms, as
where b is an n×1 vector of constants. The first-order conditions for a maximum or minimum are found by setting the matrix derivative to the zero vector:
giving
assuming A is nonsingular. If the quadratic form, and hence A, is positive definite, the second-order conditions for a minimum are met at this point. If the quadratic form is negative definite, the second-order conditions for a maximum are met.
An important example of such an optimization arises in multiple regression, in which a vector of estimated parameters is sought which minimizes the sum of squared deviations from a perfect fit within the dataset.
See also
- Anisotropic quadratic form
- Positive definite function
- Positive definite matrix
- Polarization identity
References
- ^ Milnor & Husemoller (1973) p. 61
- ^ This is true only over a field of characteristic other than 2, but here we consider only ordered fields, which necessarily have characteristic 0.
- Kitaoka, Yoshiyuki (1993). Arithmetic of quadratic forms. Cambridge Tracts in Mathematics. 106. Cambridge University Press. ISBN 0-521-40475-4. Zbl 0785.11021.
- Lang, Serge (2004), Algebra, Graduate Texts in Mathematics, 211 (Corrected fourth printing, revised third ed.), New York: Springer-Verlag, p. 578, ISBN 978-0-387-95385-4
- Milnor, J.; Husemoller, D. (1973). Symmetric Bilinear Forms. Ergebnisse der Mathematik und ihrer Grenzgebiete. 73. Springer-Verlag. ISBN 3-540-06009-X. Zbl 0292.10016.
This algebra-related article is a stub. You can help Wikipedia by expanding it. |