Covariant derivative
In mathematics, the covariant derivative is a way of specifying a derivative along tangent vectors of a manifold. Alternatively, the covariant derivative is a way of introducing and working with a connection on a manifold by means of a differential operator, to be contrasted with the approach given by a principal connection on the frame bundle – see affine connection. In the special case of a manifold isometrically embedded into a higherdimensional Euclidean space, the covariant derivative can be viewed as the orthogonal projection of the Euclidean derivative along a tangent vector onto the manifold's tangent space. In this case the Euclidean derivative is broken into two parts, the extrinsic normal component and the intrinsic covariant derivative component.
In physics, the covariant derivative is the derivative that under a general coordinate transformation transforms covariantly, that is, linearly via the Jacobian matrix of the coordinate transformation.^{[1]}
This article presents an introduction to the covariant derivative of a vector field with respect to a vector field, both in a coordinate free language and using a local coordinate system and the traditional index notation. The covariant derivative of a tensor field is presented as an extension of the same concept. The covariant derivative generalizes straightforwardly to a notion of differentiation associated to a connection on a vector bundle, also known as a Koszul connection.
Contents
History
Historically, at the turn of the 20th century, the covariant derivative was introduced by Gregorio RicciCurbastro and Tullio LeviCivita in the theory of Riemannian and pseudoRiemannian geometry.^{[2]} Ricci and LeviCivita (following ideas of Elwin Bruno Christoffel) observed that the Christoffel symbols used to define the curvature could also provide a notion of differentiation which generalized the classical directional derivative of vector fields on a manifold.^{[3]}^{[4]} This new derivative – the LeviCivita connection – was covariant in the sense that it satisfied Riemann's requirement that objects in geometry should be independent of their description in a particular coordinate system.
It was soon noted by other mathematicians, prominent among these being Hermann Weyl, Jan Arnoldus Schouten, and Élie Cartan,^{[5]} that a covariant derivative could be defined abstractly without the presence of a metric. The crucial feature was not a particular dependence on the metric, but that the Christoffel symbols satisfied a certain precise second order transformation law. This transformation law could serve as a starting point for defining the derivative in a covariant manner. Thus the theory of covariant differentiation forked off from the strictly Riemannian context to include a wider range of possible geometries.
In the 1940s, practitioners of differential geometry began introducing other notions of covariant differentiation in general vector bundles which were, in contrast to the classical bundles of interest to geometers, not part of the tensor analysis of the manifold. By and large, these generalized covariant derivatives had to be specified ad hoc by some version of the connection concept. In 1950, JeanLouis Koszul unified these new ideas of covariant differentiation in a vector bundle by means of what is known today as a Koszul connection or a connection on a vector bundle.^{[6]} Using ideas from Lie algebra cohomology, Koszul successfully converted many of the analytic features of covariant differentiation into algebraic ones. In particular, Koszul connections eliminated the need for awkward manipulations of Christoffel symbols (and other analogous nontensorial) objects in differential geometry. Thus they quickly supplanted the classical notion of covariant derivative in many post1950 treatments of the subject.
Motivation
The covariant derivative is a generalization of the directional derivative from vector calculus. As with the directional derivative, the covariant derivative is a rule, , which takes as its inputs: (1) a vector, u, defined at a point P, and (2) a vector field, v, defined in a neighborhood of P.^{[7]} The output is the vector , also at the point P. The primary difference from the usual directional derivative is that must, in a certain precise sense, be independent of the manner in which it is expressed in a coordinate system.
A vector may be described as a list of numbers in terms of a basis, but as a geometrical object a vector retains its own identity regardless of how one chooses to describe it in a basis. This persistence of identity is reflected in the fact that when a vector is written in one basis, and then the basis is changed, the components of the vector transform according to a change of basis formula. Such a transformation law is known as a covariant transformation. The covariant derivative is required to transform, under a change in coordinates, in the same way as a basis does: the covariant derivative must change by a covariant transformation (hence the name).
In the case of Euclidean space, one tends to define the derivative of a vector field in terms of the difference between two vectors at two nearby points. In such a system one translates one of the vectors to the origin of the other, keeping it parallel. With a Cartesian (fixed orthonormal) coordinate system "keeping it parallel" amounts to keeping the components constant. Thus is obtained the simplest example: a covariant derivative which is obtained by taking the ordinary directional derivative of the components in the direction of the displacement vector between the two nearby points.
In the general case, however, one must take into account the change of the coordinate system. For example, if the same covariant derivative is written in polar coordinates in a two dimensional Euclidean plane, then it contains extra terms that describe how the coordinate grid itself "rotates". In other cases the extra terms describe how the coordinate grid expands, contracts, twists, interweaves, etc. In this case "keeping it parallel" does not amount to keeping components constant under translation.
Consider the example of moving along a curve γ(t) in the Euclidean plane. In polar coordinates, γ may be written in terms of its radial and angular coordinates by γ(t) = (r(t), θ(t)). A vector at a particular time t^{[8]} (for instance, the acceleration of the curve) is expressed in terms of , where and are unit tangent vectors for the polar coordinates, serving as a basis to decompose a vector in terms of radial and tangential components. At a slightly later time, the new basis in polar coordinates appears slightly rotated with respect to the first set. The covariant derivative of the basis vectors (the Christoffel symbols) serve to express this change.
In a curved space, such as the surface of the Earth (regarded as a sphere), the translation is not well defined and its analog, parallel transport, depends on the path along which the vector is translated.
A vector e on a globe on the equator at point Q is directed to the north. Suppose we parallel transport the vector first along the equator until at point P and then (keeping it parallel to itself) drag it along a meridian to the pole N and (keeping the direction there) subsequently transport it along another meridian back to Q. Then we notice that the paralleltransported vector along a closed circuit does not return as the same vector; instead, it has another orientation. This would not happen in Euclidean space and is caused by the curvature of the surface of the globe. The same effect can be noticed if we drag the vector along an infinitesimally small closed surface subsequently along two directions and then back. The infinitesimal change of the vector is a measure of the curvature.
Remarks
 The definition of the covariant derivative does not use the metric in space. However, for each metric there is a unique torsionfree covariant derivative called the LeviCivita connection such that the covariant derivative of the metric is zero.
 The properties of a derivative imply that depends on an arbitrarily small neighborhood of a point p in the same way as e.g. the derivative of a scalar function along a curve at a given point p depends on an arbitrarily small neighborhood of p.
 The information on the neighborhood of a point p in the covariant derivative can be used to define parallel transport of a vector. Also the curvature, torsion, and geodesics may be defined only in terms of the covariant derivative or other related variation on the idea of a linear connection.
Informal definition using an embedding into Euclidean space
Suppose a (pseudo) Riemann manifold , is embedded into Euclidean space via a twice continuouslydifferentiable (C^{2}) mapping such that the tangent space at is spanned by the vectors
and the scalar product on is compatible with the metric on M:
(Since the manifold metric is always assumed to be regular, the compatibility condition implies linear independence of the partial derivative tangent vectors.)
For a tangent vector field, , one has
 .
The last term is not tangential to M, but can be expressed as a linear combination of the tangent space base vectors using the Christoffel symbols as linear factors plus a vector normal to the tangent space:
 .
The covariant derivative , also written , is defined as just a tangential portion of the usual derivative:
In the case of the LeviCivita connection, is required to be orthogonal to tangent space, so
 .
On the other hand,
implies (using the symmetry of the scalar product and swapping the order of partial differentiations)
and yields the Christoffel symbols for the LeviCivita connection in terms of the metric:
For a very simple example that captures the essence of the description above, draw a circle on a flat sheet of paper. Travel around the circle at a constant speed. The derivative of your velocity, your acceleration vector, always points radially inward. Roll this sheet of paper into a cylinder. Now the (Euclidean) derivative of your velocity has a component that sometimes points inward toward the axis of the cylinder depending on whether you're near a solstice or an equinox. (At the point of the circle when you are moving parallel to the axis, there is no inward acceleration. At the point, the velocity is along the cylinder's bend, the inward acceleration is maximum.) This is the (Euclidean) normal component. The covariant derivative component is the component parallel to the cylinder's surface, and is the same as that before you rolled the sheet into a cylinder.
Formal definition
A covariant derivative is a (Koszul) connection on the tangent bundle and other tensor bundles. Thus it has a certain behavior on vector fields that extends that of the usual differential on functions. It also extends in a unique way to the duals of vector fields (i.e., covector fields), and to arbitrary tensor fields, that ensures compatibility with the tensor product and trace operations (tensor contraction).
Functions
Given a point p of the manifold, a real function f on the manifold, and a tangent vector v at p, the covariant derivative of f at p along v is the scalar at p, denoted , that represents the principal part of the change in the value of f when the argument of f is changed by the infinitesimal displacement vector v. (This is the differential of f evaluated against the vector v.) Formally, there is a differentiable curve such that and , and the covariant derivative of f at p is defined by
When v is a vector field, the covariant derivative is the function that associates with each point p in the common domain of f and v the scalar . This coincides with the usual Lie derivative of f along the vector field v.
Vector fields
A covariant derivative at a point p in a smooth manifold assigns a tangent vector to each pair , consisting of a tangent vector v at p and vector field u defined in a neighborhood of p, such that the following properties hold (for any vectors v, x and y at p, vector fields u and w defined in a neighborhood of p, scalar values g and h at p, and scalar function f defined in a neighborhood of p):

is linear in so

is additive in so:

obeys the product rule; i.e., where is defined above,
 .
If u and v are both vector fields defined over a common domain, then denotes the vector field whose value at each point p of the domain is the tangent vector . Note that depends not only on the value of v at p but also on values of u in an infinitesimal neighbourhood of p because of the last property, the product rule.
Covector fields
Given a field of covectors (or oneform) defined in a neighborhood of p, its covariant derivative is defined in a way to make the resulting operation compatible with tensor contraction and the product rule. That is, is defined as the unique oneform at p such that the following identity is satisfied for all vector fields u in a neighborhood of p
The covariant derivative of a covector field along a vector field v is again a covector field.
Tensor fields
Once the covariant derivative is defined for fields of vectors and covectors it can be defined for arbitrary tensor fields by imposing the following identities for every pair of tensor fields and in a neighborhood of the point p:
and for and of the same valence
The covariant derivative of a tensor field along a vector field v is again a tensor field of the same type.
Explicitly, let T be a tensor field of type (p, q). Consider T to be a differentiable multilinear map of smooth sections α^{1}, α^{2}, ..., α^{q} of the cotangent bundle T^{∗}M and of sections X_{1}, X_{2}, ... X_{p} of the tangent bundle TM, written T(α^{1}, α^{2}, ..., X_{1}, X_{2}, ...) into R. The covariant derivative of T along Y is given by the formula
Coordinate description
Given coordinate functions
 ,
any tangent vector can be described by its components in the basis
 .
The covariant derivative of a basis vector along a basis vector is again a vector and so can be expressed as a linear combination . To specify the covariant derivative it is enough to specify the covariant derivative of each basis vector field along .
the coefficients are called Christoffel symbols of the second kind.
Then using the rules in the definition, we find that for general vector fields and we get
so
The first term in this formula is responsible for "twisting" the coordinate system with respect to the covariant derivative and the second for changes of components of the vector field u. In particular
In words: the covariant derivative is the usual derivative along the coordinates with correction terms which tell how the coordinates change.
For covectors similarly we have
where .
The covariant derivative of a type (r, s) tensor field along is given by the expression:
Or, in words: take the partial derivative of the tensor and add: for every upper index , and for every lower index .
If instead of a tensor, one is trying to differentiate a tensor density (of weight +1), then you also add a term
If it is a tensor density of weight W, then multiply that term by W. For example, is a scalar density (of weight +1), so we get:
where semicolon ";" indicates covariant differentiation and comma "," indicates partial differentiation. Incidentally, this particular expression is equal to zero, because the covariant derivative of a function solely of the metric is always zero.
Examples
For a scalar field , covariant differentiation is simply partial differentiation:
For a contravariant vector field , we have:
For a covariant vector field , we have:
For a type (2,0) tensor field , we have:
For a type (0,2) tensor field , we have:
For a type (1,1) tensor field , we have:
The notation above is meant in the sense
Covariant derivatives do not commute; i.e. . It can be shown that:
where is the Riemann tensor. Similarly,
and
The latter can be shown by taking (without loss of generality) that .
Notation
In textbooks on physics, the covariant derivative is sometimes simply stated in terms of its components in this equation.
Often a notation is used in which the covariant derivative is given with a semicolon, while a normal partial derivative is indicated by a comma. In this notation we write the same as:
Once again this shows that the covariant derivative of a vector field is not just simply obtained by differentiating to the coordinates , but also depends on the vector v itself through .
In some older texts (notably Adler, Bazin & Schiffer, Introduction to General Relativity), the covariant derivative is denoted by a double pipe:
Derivative along curve
Since the covariant derivative of a tensor field at a point depends only on the value of the vector field at one can define the covariant derivative along a smooth curve in a manifold:
Note that the tensor field only needs to be defined on the curve for this definition to make sense.
In particular, is a vector field along the curve itself. If vanishes then the curve is called a geodesic of the covariant derivative. If the covariant derivative is the LeviCivita connection of a certain metric then the geodesics for the connection are precisely the geodesics of the metric that are parametrised by arc length.
The derivative along a curve is also used to define the parallel transport along the curve.
Sometimes the covariant derivative along a curve is called absolute or intrinsic derivative.
Relation to Lie derivative
A covariant derivative introduces an extra geometric structure on a manifold that allows vectors in neighboring tangent spaces to be compared. This extra structure is necessary because there is no canonical way to compare vectors from different vector spaces, as is necessary for this generalization of the directional derivative. There is however another generalization of directional derivatives which is canonical: the Lie derivative. The Lie derivative evaluates the change of one vector field along the flow of another vector field. Thus, one must know both vector fields in an open neighborhood. The covariant derivative on the other hand introduces its own change for vectors in a given direction, and it only depends on the vector direction at a single point, rather than a vector field in an open neighborhood of a point. In other words, the covariant derivative is linear (over C^{∞}(M)) in the direction argument, while the Lie derivative is linear in neither argument.
Note that the antisymmetrized covariant derivative ∇_{u}v − ∇_{v}u, and the Lie derivative L_{u}v differ by the torsion of the connection, so that if a connection is torsion free, then its antisymmetrization is the Lie derivative.
See also
 Affine connection
 Christoffel symbols
 Connection (algebraic framework)
 Connection (mathematics)
 Connection (vector bundle)
 Connection form
 Exterior covariant derivative
 Gauge covariant derivative
 Introduction to mathematics of general relativity
 LeviCivita connection
 Parallel transport
 Ricci calculus
 Tensor derivative (continuum mechanics)
 List of formulas in Riemannian geometry
Notes
 ^ Einstein, Albert (1922). "The General Theory of Relativity". The Meaning of Relativity.
 ^ Ricci, G.; LeviCivita, T. (1901). "Méthodes de calcul différential absolu et leurs applications". Mathematische Annalen. 54: 125–201. doi:10.1007/bf01454201.
 ^ Riemann, G. F. B. (1866). "Über die Hypothesen, welche der Geometrie zu Grunde liegen". Gesammelte Mathematische Werke.; reprint, ed. Weber, H. (1953), New York: Dover.
 ^ Christoffel, E. B. (1869). "Über die Transformation der homogenen Differentialausdrücke zweiten Grades". Journal für die reine und angewandte Mathematik. 70: 46–70.
 ^ cf. with Cartan, É (1923). "Sur les variétés à connexion affine et la theorie de la relativité généralisée". Annales, École Normale. 40: 325–412.
 ^ Koszul, J. L. (1950). "Homologie et cohomologie des algebres de Lie". Bulletin de la Société Mathématique. 78: 65–127.
 ^ The covariant derivative is also denoted variously by _{v}u, D_{v}u, or other notations.
 ^ In many applications, it may be better not to think of t as corresponding to time, at least for applications in general relativity. It is simply regarded as an abstract parameter varying smoothly and monotonically along the path.
References
 Kobayashi, Shoshichi; Nomizu, Katsumi (1996). Foundations of Differential Geometry, Vol. 1 (New ed.). Wiley Interscience. ISBN 0471157333.
 I.Kh. Sabitov (2001) [1994], "Covariant differentiation", in Hazewinkel, Michiel, Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 9781556080104
 Sternberg, Shlomo (1964). Lectures on Differential Geometry. PrenticeHall.
 Spivak, Michael (1999). A Comprehensive Introduction to Differential Geometry (Volume Two). Publish or Perish, Inc.