Partial correlation
In probability theory and statistics, partial correlation measures the degree of association between two random variables, with the effect of a set of controlling random variables removed. If we are interested in finding whether or to what extent there is a numerical relationship between two variables of interest, using their correlation coefficient will give misleading results if there is another, confounding, variable that is numerically related to both variables of interest. This misleading information can be avoided by controlling for the confounding variable, which is done by computing the partial correlation coefficient. This is precisely the motivation for including other rightside variables in a multiple regression.
For example, if we have economic data on the consumption, income, and wealth of various individuals and we wish to see if there is a relationship between consumption and income, failing to control for wealth when computing a correlation coefficient between consumption and income would give a misleading result, since income might be numerically related to wealth which in turn might be numerically related to consumption; a measured correlation between consumption and income might actually be contaminated by these other correlations. The use of a partial correlation avoids this problem.
Like the correlation coefficient, the partial correlation coefficient takes on a value in the range from –1 to 1. The value –1 conveys a perfect negative correlation controlling for some variables (that is, an exact linear relationship in which higher values of one variable are associated with lower values of the other); the value 1 conveys a perfect positive linear relationship, and the value 0 conveys that there is no linear relationship.
The partial correlation coincides with the conditional correlation if the random variables are jointly distributed as the multivariate normal, other elliptical, multivariate hypergeometric, multivariate negative hypergeometric, multinomial or Dirichlet distribution, but not in general otherwise.^{[1]}
Contents
Example
Suppose we have the following data on three variables, X, Y, and Z:
X  Y  Z 

2  1  0 
4  2  0 
15  3  1 
20  4  1 
These data have the feature that whenever Z = 0, X equals exactly twice Y, and whenever Z = 1, X is exactly 5 times Y. Thus, contingent on the value of Z, there is an exact relationship between X and Y; but the relationship cannot be said to be exact without reference to the value of Z.
In fact, if we compute the Pearson correlation coefficient between variables X and Y, the result is approximately 0.969, while if we compute the partial correlation between X and Y, using the formula given below, we find a partial correlation of 0.919. The computations were done using R with the following code.
> X = c(2,4,15,20)
> Y = c(1,2,3,4)
> Z = c(0,0,1,1)
> mm1 = lm(X~Z)
> res1 = mm1$residuals
> mm2 = lm(Y~Z)
> res2 = mm2$residuals
> cor(res1,res2)
[1] 0.919145
> cor(X,Y)
[1] 0.9695016
Formal definition
Formally, the partial correlation between X and Y given a set of n controlling variables Z = {Z_{1}, Z_{2}, ..., Z_{n}}, written ρ_{XY·Z}, is the correlation between the residuals e_{X} and e_{Y} resulting from the linear regression of X with Z and of Y with Z, respectively. The firstorder partial correlation (i.e., when n = 1) is the difference between a correlation and the product of the removable correlations divided by the product of the coefficients of alienation of the removable correlations. The coefficient of alienation, and its relation with joint variance through correlation are available in Guilford (1973, pp. 344–345).^{[2]}
Computation
Using linear regression
A simple way to compute the sample partial correlation for some data is to solve the two associated linear regression problems, get the residuals, and calculate the correlation between the residuals. Let X and Y be, as above, random variables taking real values, and let Z be the ndimensional vectorvalued random variable. We write x_{i}, y_{i} and z_{i} to denote the ith of N i.i.d. observations from some joint probability distribution over real random variables X, Y and Z, with z_{i} having been augmented with a 1 to allow for a constant term in the regression. Solving the linear regression problem amounts to finding (n+1)dimensional regression coefficient vectors and such that
with N being the number of observations and the scalar product between the vectors w and v.
The residuals are then
and the sample partial correlation is then given by the usual formula for sample correlation , but between these new derived values:
Here the three terms after minus signs all equal 0 since each is the sum of residuals from an ordinary least squares regression.
Using recursive formula
It can be computationally expensive to solve the linear regression problems. Actually, the nthorder partial correlation (i.e., with Z = n) can be easily computed from three (n  1)thorder partial correlations. The zerothorder partial correlation ρ_{XY·Ø} is defined to be the regular correlation coefficient ρ_{XY}.
It holds, for any that
Naïvely implementing this computation as a recursive algorithm yields an exponential time complexity. However, this computation has the overlapping subproblems property, such that using dynamic programming or simply caching the results of the recursive calls yields a complexity of .
Note in the case where Z is a single variable, this reduces to:
Using matrix inversion
In time, another approach allows all partial correlations to be computed between any two variables X_{i} and X_{j} of a set V of cardinality n, given all others, i.e., , if the correlation matrix (or alternatively covariance matrix) Ω = (ω_{ij}), where ω_{ij} = ρ_{XiXj}, is positive definite and therefore invertible. If we define P = (p_{ij})_{ij} = Ω^{−1}, we have:
Interpretation
Geometrical
Let three variables X, Y, Z (where Z is the "control" or "extra variable") be chosen from a joint probability distribution over n variables V. Further let v_{i}, 1 ≤ i ≤ N, be N ndimensional i.i.d. observations taken from the joint probability distribution over V. We then consider the Ndimensional vectors x (formed by the successive values of X over the observations), y (formed by the values of Y) and z (formed by the values of Z).
It can be shown that the residuals e_{X,i} coming from the linear regression of X on Z, if also considered as an Ndimensional vector e_{X}, have a zero scalar product with the vector z generated by Z. This means that the residuals vector lies on an (N–1)dimensional hyperplane S_{z} that is perpendicular to z.
The same also applies to the residuals e_{Y,i} generating a vector e_{Y}. The desired partial correlation is then the cosine of the angle φ between the projections e_{X} and e_{Y} of x and y, respectively, onto the hyperplane perpendicular to z.^{[3]}^{:ch. 7}
As conditional independence test
With the assumption that all involved variables are multivariate Gaussian, the partial correlation ρ_{XY·Z} is zero if and only if X is conditionally independent from Y given Z.^{[1]} This property does not hold in the general case.
To test if a sample partial correlation implies a true population partial correlation of 0, Fisher's ztransform of the partial correlation can be used:
The null hypothesis is , to be tested against the twotail alternative . We reject H_{0} with significance level α if:
where Φ(·) is the cumulative distribution function of a Gaussian distribution with zero mean and unit standard deviation, and N is the sample size. This ztransform is approximate and that the actual distribution of the sample (partial) correlation coefficient is not straightforward. However, an exact ttest based on a combination of the partial regression coefficient, the partial correlation coefficient and the partial variances is available.^{[4]}
The distribution of the sample partial correlation was described by Fisher.^{[5]}
Semipartial correlation (part correlation)
The semipartial (or part) correlation statistic is similar to the partial correlation statistic. Both compare variations of two variables after certain factors are controlled for, but to calculate the semipartial correlation one holds the third variable constant for either X or Y but not both, whereas for the partial correlation one holds the third variable constant for both.^{[6]} The semipartial correlation compares the unique variation of one variable (having removed variation associated with the Z variable(s)), with the unfiltered variation of the other, while the partial correlation compares the unique variation of one variable to the unique variation of the other.
The semipartial (or part) correlation can be viewed as more practically relevant "because it is scaled to (i.e., relative to) the total variability in the dependent (response) variable." ^{[7]} Conversely, it is less theoretically useful because it is less precise about the role of the unique contribution of the independent variable.
The absolute value of the semipartial correlation of X with Y is always less than or equal to that of the partial correlation of X with Y. The reason is this: Suppose the correlation of X with Z has been removed from X, giving the residual vector e_{x} . In computing the semipartial correlation, Y still contains both unique variance and variance due to its association with Z. But e_{x} , being uncorrelated with Z, can only explain some of the unique part of the variance of Y and not the part related to Z. In contrast, with the partial correlation, only e_{y} (the part of the variance of Y that is unrelated to Z) is to be explained, so there is less variance of the type that e_{x} cannot explain.
Use in time series analysis
In time series analysis, the partial autocorrelation function (sometimes "partial correlation function") of a time series is defined, for lag h, as
This function is used to determine the appropriate lag length for an autoregression.
See also
References
 ^ ^{a} ^{b} Baba, Kunihiro; Ritei Shibata; Masaaki Sibuya (2004). "Partial correlation and conditional correlation as measures of conditional independence". Australian and New Zealand Journal of Statistics. 46 (4): 657–664. doi:10.1111/j.1467842X.2004.00360.x.
 ^ Guilford J. P., Fruchter B. (1973). Fundamental statistics in psychology and education. Tokyo: McGrawHill Kogakusha, LTD.
 ^ Rummel, R. J. (1976). "Understanding Correlation".
 ^ Kendall MG, Stuart A. (1973) The Advanced Theory of Statistics, Volume 2 (3rd Edition), ISBN 0852642156, Section 27.22
 ^ Fisher, R.A. (1924). "The distribution of the partial correlation coefficient". Metron. 3 (3–4): 329–332.

^ https://web.archive.org/web/20140206182503/http://luna.cas.usf.edu/~mbrannic/files/regression/Partial.html. Archived from the original on 20140206. Missing or empty
title=
(help)  ^ StatSoft, Inc. (2010). "SemiPartial (or Part) Correlation", Electronic Statistics Textbook. Tulsa, OK: StatSoft, accessed January 15, 2011.
External links
Wikiversity has learning resources about Partial correlation 
 Prokhorov, A.V. (2001) [1994], "Partial correlation coefficient", in Hazewinkel, Michiel, Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 9781556080104
 What is a partial correlation?
 Mathematical formulae in the "Description" section of the IMSL Numerical Library PCORR routine
 A threevariable example