Spearman's rank correlation coefficient

The Spearman correlation coefficient is defined as the Pearson correlation coefficient between the rank variables.[3]

For a sample of size n, the n raw scores ${\displaystyle X_{i},Y_{i}}$ are converted to ranks ${\displaystyle \operatorname {rg} X_{i},\operatorname {rg} Y_{i}}$, and ${\displaystyle r_{s}}$ is computed as

${\displaystyle r_{s}=\rho _{\operatorname {rg} _{X},\operatorname {rg} _{Y}}={\frac {\operatorname {cov} (\operatorname {rg} _{X},\operatorname {rg} _{Y})}{\sigma _{\operatorname {rg} _{X}}\sigma _{\operatorname {rg} _{Y}}}},}$

where

${\displaystyle \rho }$ denotes the usual Pearson correlation coefficient, but applied to the rank variables,

${\displaystyle \operatorname {cov} (\operatorname {rg} _{X},\operatorname {rg} _{Y})}$ is the covariance of the rank variables,

${\displaystyle \sigma _{\operatorname {rg} _{X}}}$ and ${\displaystyle \sigma _{\operatorname {rg} _{Y}}}$ are the standard deviations of the rank variables.

Only if all n ranks are distinct integers, it can be computed using the popular formula

${\displaystyle r_{s}=1-{\frac {6\sum d_{i}^{2}}{n(n^{2}-1)}},}$

where

${\displaystyle d_{i}=\operatorname {rg} (X_{i})-\operatorname {rg} (Y_{i})}$ is the difference between the two ranks of each observation,

n is the number of observations.

Identical values are usually[4] each assigned fractional ranks equal to the average of their positions in the ascending order of the values, which is equivalent to averaging over all possible permutations.

If ties are present in the data set, the simplified formula above yields incorrect results: Only if in both variables all ranks are distinct, then ${\displaystyle \sigma _{\operatorname {rg} _{X}}\sigma _{\operatorname {rg} _{Y}}=\operatorname {Var} {\operatorname {rg} _{X}}=\operatorname {Var} {\operatorname {rg} _{Y}}=(n^{2}-1)/12}$ (calculated according to biased variance). The first equation — normalizing by the standard deviation — may be used even when ranks are normalized to [0, 1] ("relative ranks") because it is insensitive both to translation and linear scaling.

The simplified method should also not be used in cases where the data set is truncated; that is, when the Spearman's correlation coefficient is desired for the top X records (whether by pre-change rank or post-change rank, or both), the user should use the Pearson correlation coefficient formula given above.[5]

The standard error of the coefficient (σ) was determined by Pearson in 1907 and Gosset in 1920. It is

${\displaystyle \sigma _{r_{s}}={\frac {0.6325}{\sqrt {n-1}}}.}$

There are several other numerical measures that quantify the extent of statistical dependence between pairs of observations. The most common of these is the Pearson product-moment correlation coefficient, which is a similar correlation method to Spearman's rank, that measures the “linear” relationships between the raw numbers rather than between their ranks.

An alternative name for the Spearman rank correlation is the “grade correlation”;[6] in this, the “rank” of an observation is replaced by the “grade”. In continuous distributions, the grade of an observation is, by convention, always one half less than the rank, and hence the grade and rank correlations are the same in this case. More generally, the “grade” of an observation is proportional to an estimate of the fraction of a population less than a given value, with the half-observation adjustment at observed values. Thus this corresponds to one possible treatment of tied ranks. While unusual, the term “grade correlation” is still in use.[7]

Positive and negative Spearman rank correlations

A positive Spearman correlation coefficient corresponds to an increasing monotonic trend between X and Y.

A negative Spearman correlation coefficient corresponds to a decreasing monotonic trend between X and Y.

The sign of the Spearman correlation indicates the direction of association between X (the independent variable) and Y (the dependent variable). If Y tends to increase when X increases, the Spearman correlation coefficient is positive. If Y tends to decrease when X increases, the Spearman correlation coefficient is negative. A Spearman correlation of zero indicates that there is no tendency for Y to either increase or decrease when X increases. The Spearman correlation increases in magnitude as X and Y become closer to being perfectly monotone functions of each other. When X and Y are perfectly monotonically related, the Spearman correlation coefficient becomes 1. A perfectly monotone increasing relationship implies that for any two pairs of data values X_i, Y_i and X_j, Y_j, that X_i − X_j and Y_i − Y_j always have the same sign. A perfectly monotone decreasing relationship implies that these differences always have opposite signs.

The Spearman correlation coefficient is often described as being "nonparametric". This can have two meanings. First, a perfect Spearman correlation results when X and Y are related by any monotonic function. Contrast this with the Pearson correlation, which only gives a perfect value when X and Y are related by a linear function. The other sense in which the Spearman correlation is nonparametric in that its exact sampling distribution can be obtained without requiring knowledge (i.e., knowing the parameters) of the joint probability distribution of X and Y.

In this examples, the raw data in the table below is used to calculate the correlation between the IQ of a person with the number of hours spent in front of TV per week.

IQ, ${\displaystyle X_{i}}$	Hours of TV per week, ${\displaystyle Y_{i}}$
106	7
100	27
86	2
101	50
99	28
103	29
97	20
113	12
112	6
110	17

Firstly, evaluate ${\displaystyle d_{i}^{2}}$. To do so use the following steps, reflected in the table below.

1. Sort the data by the first column (${\displaystyle X_{i}}$). Create a new column ${\displaystyle x_{i}}$ and assign it the ranked values 1, 2, 3, ..., n.
2. Next, sort the data by the second column (${\displaystyle Y_{i}}$). Create a fourth column ${\displaystyle y_{i}}$ and similarly assign it the ranked values 1, 2, 3, ..., n.
3. Create a fifth column ${\displaystyle d_{i}}$ to hold the differences between the two rank columns (${\displaystyle x_{i}}$ and ${\displaystyle y_{i}}$).
4. Create one final column ${\displaystyle d_{i}^{2}}$ to hold the value of column ${\displaystyle d_{i}}$ squared.

IQ, ${\displaystyle X_{i}}$	Hours of TV per week, ${\displaystyle Y_{i}}$	rank ${\displaystyle x_{i}}$	rank ${\displaystyle y_{i}}$	${\displaystyle d_{i}}$	${\displaystyle d_{i}^{2}}$
86	2	1	1	0	0
97	20	2	6	−4	16
99	28	3	8	−5	25
100	27	4	7	−3	9
101	50	5	10	−5	25
103	29	6	9	−3	9
106	7	7	3	4	16
110	17	8	5	3	9
112	6	9	2	7	49
113	12	10	4	6	36

With ${\displaystyle d_{i}^{2}}$ found, add them to find ${\displaystyle \sum d_{i}^{2}=194}$. The value of n is 10. These values can now be substituted back into the equation

${\displaystyle \rho =1-{\frac {6\sum d_{i}^{2}}{n(n^{2}-1)}}}$

to give

${\displaystyle \rho =1-{\frac {6\times 194}{10(10^{2}-1)}},}$

which evaluates to ρ = −29/165 = −0.175757575... with a p-value = 0.627188 (using the t-distribution).

Chart of the data presented. It can be seen that there might be a negative correlation, but that the relationship does not appear definitive.

That the value is close to zero shows that the correlation between IQ and hours spent watching TV is very low, although the negative value suggests that the longer the time spent watching television the lower the IQ. In the case of ties in the original values, this formula should not be used; instead, the Pearson correlation coefficient should be calculated on the ranks (where ties are given ranks, as described above ).

One approach to test whether an observed value of ρ is significantly different from zero (r will always maintain −1 ≤ r ≤ 1) is to calculate the probability that it would be greater than or equal to the observed r, given the null hypothesis, by using a permutation test. An advantage of this approach is that it automatically takes into account the number of tied data values in the sample and the way they are treated in computing the rank correlation.

Another approach parallels the use of the Fisher transformation in the case of the Pearson product-moment correlation coefficient. That is, confidence intervals and hypothesis tests relating to the population value ρ can be carried out using the Fisher transformation:

${\displaystyle F(r)={\frac {1}{2}}\ln {\frac {1+r}{1-r}}=\operatorname {arctanh} r.}$

If F(r) is the Fisher transformation of r, the sample Spearman rank correlation coefficient, and n is the sample size, then

${\displaystyle z={\sqrt {\frac {n-3}{1.06}}}F(r)}$

is a z-score for r, which approximately follows a standard normal distribution under the null hypothesis of statistical independence (ρ = 0).[8][9]

One can also test for significance using

${\displaystyle t=r{\sqrt {\frac {n-2}{1-r^{2}}}},}$

which is distributed approximately as Student's t-distribution with n − 2 degrees of freedom under the null hypothesis.[10] A justification for this result relies on a permutation argument.[11]

A generalization of the Spearman coefficient is useful in the situation where there are three or more conditions, a number of subjects are all observed in each of them, and it is predicted that the observations will have a particular order. For example, a number of subjects might each be given three trials at the same task, and it is predicted that performance will improve from trial to trial. A test of the significance of the trend between conditions in this situation was developed by E. B. Page[12] and is usually referred to as Page's trend test for ordered alternatives.

Classic correspondence analysis is a statistical method that gives a score to every value of two nominal variables. In this way the Pearson correlation coefficient between them is maximized.

There exists an equivalent of this method, called grade correspondence analysis, which maximizes Spearman's ρ or Kendall's τ.[13]

• R's statistics base-package implements the test cor.test(x, y, method = "spearman") in its "stats" package (also cor(x, y, method = "spearman") will work, but without returning the p-value).
• MATLAB implementation: [r,p] = corr(x,y,'Type','Spearman') where r is the Spearman's rank correlation coefficient, p is the p-value, and x and y are vectors. [14]

• Kendall tau rank correlation coefficient
• Chebyshev's sum inequality, rearrangement inequality (These two articles may shed light on the mathematical properties of Spearman's ρ.)
• Distance correlation
• Polychoric correlation

• Corder, G. W. & Foreman, D. I. (2014). Nonparametric Statistics: A Step-by-Step Approach, Wiley. ISBN 978-1118840313.
• Daniel, Wayne W. (1990). "Spearman rank correlation coefficient". Applied Nonparametric Statistics (2nd ed.). Boston: PWS-Kent. pp. 358–365. ISBN 978-0-534-91976-4.
• Spearman C. (1904). "The proof and measurement of association between two things". American Journal of Psychology. 15 (1): 72–101. doi:10.2307/1412159. JSTOR 1412159.
• Bonett D. G., Wright, T. A. (2000). "Sample size requirements for Pearson, Kendall, and Spearman correlations". Psychometrika. 65: 23–28. doi:10.1007/bf02294183.CS1 maint: multiple names: authors list (link)
• Kendall M. G. (1970). Rank correlation methods (4th ed.). London: Griffin. ISBN 978-0-852-6419-96. OCLC 136868.
• Hollander M., Wolfe D. A. (1973). Nonparametric statistical methods. New York: Wiley. ISBN 978-0-471-40635-8. OCLC 520735.
• Caruso J. C., Cliff N. (1997). "Empirical size, coverage, and power of confidence intervals for Spearman's Rho". Educational and Psychological Measurement. 57 (4): 637–654. doi:10.1177/0013164497057004009.

Wikiversity has learning resources about Spearman's rank correlation coefficient

• Table of critical values of ρ for significance with small samples
• Spearman’s Rank Correlation Coefficient – Excel Guide: sample data and formulae for Excel, developed by the Royal Geographical Society.