Welch's ''t''-test

In statistics, Welch's t-test, or unequal variances t-test, is a two-sample location test which is used to test the hypothesis that two populations have equal means. Welch's t-test is an adaptation of Student's t-test,[1] and is more reliable when the two samples have unequal variances and unequal sample sizes.[2][3] These tests are often referred to as "unpaired" or "independent samples" t-tests, as they are typically applied when the statistical units underlying the two samples being compared are non-overlapping. Given that Welch's t-test has been less popular than Student's t-test[2] and may be less familiar to readers, a more informative name is "Welch's unequal variances t-test" or "unequal variances t-test" for brevity.[3]

Assumptions

Student's t-test assumes that the two populations have normal distributions and with equal variances. Welch's t-test is designed for unequal variances, but the assumption of normality is maintained.[1] Welch's t-test is an approximate solution to the Behrens–Fisher problem.

Calculations

Welch's t-test defines the statistic t by the following formula:

where , and are the 1st sample mean, sample variance and sample size, respectively. Unlike in Student's t-test, the denominator is not based on a pooled variance estimate.

The degrees of freedom   associated with this variance estimate is approximated using the Welch–Satterthwaite equation:

Here , the degrees of freedom associated with the first variance estimate. , the degrees of freedom associated with the 2nd variance estimate.

Welch's t-test can also be calculated for ranked data and might then be named Welch's U-test.[4]

Statistical test

Once t and have been computed, these statistics can be used with the t-distribution to test the null hypothesis that the two population means are equal (using a two-tailed test), or the alternative hypothesis that one of the population means is greater than or equal to the other (using a one-tailed test). The approximate degrees of freedom are rounded down to the nearest integer.

Advantages and limitations

Welch's t-test is more robust than Student's t-test and maintains type I error rates close to nominal for unequal variances and for unequal sample sizes under normality. Furthermore, the power of Welch's t-test comes close to that of Student's t-test, even when the population variances are equal and sample sizes are balanced.[2] Welch's t-test can be generalized to more than 2-samples,[5] which is more robust than one-way analysis of variance (ANOVA).

It is not recommended to pre-test for equal variances and then choose between Student's t-test or Welch's t-test.[6] Rather, Welch's t-test can be applied directly and without any substantial disadvantages to Student's t-test as noted above. Welch's t-test remains robust for skewed distributions and large sample sizes.[7] Reliability decreases for skewed distributions and smaller samples, where one could possibly perform Welch's t-test on ranked data.[4]

Examples

The following three examples compare Welch's t-test and Student's t-test. Samples are from random normal distributions using the R programming language.

For all three examples, the population means were and .

The first example is for equal variances ( ) and equal sample sizes ( ). Let A1 and A2 denote two random samples:

The second example is for unequal variances ( , ) and unequal sample sizes ( , ). The smaller sample has the larger variance:

The third example is for unequal variances ( , ) and unequal sample sizes ( , ). The larger sample has the larger variance:

Reference p-values were obtained by simulating the distributions of the t statistics for the null hypothesis of equal population means ( ). Results are summarised in the table below, with two-tailed p-values:

Sample A1 Sample A2 Student's t-test Welch's t-test
Example
11520.87.91523.03.8−2.46280.0210.021−2.4625.00.0210.017
21020.69.02022.10.9−2.10280.0450.150−1.579.90.1490.144
31019.41.42021.617.1−1.64280.1100.036−2.2224.50.0360.042

Welch's t-test and Student's t-test gave identical results when the two samples have identical variances and sample sizes (Example 1). But note that if you sample data from populations with identical variances, the sample variances will differ, as will the results of the two t-tests. So with actual data, the two tests will almost always give somewhat different results.

For unequal variances, Student's t-test gave a low p-value when the smaller sample had a larger variance (Example 2) and a high p-value when the larger sample had a larger variance (Example 3). For unequal variances, Welch's t-test gave p-values close to simulated p-values.

Software implementations

Language/ProgramFunctionNotes
LibreOfficeTTEST(Data1; Data2; Mode; Type)See
MATLABttest2(data1, data2, 'Vartype', 'unequal')See
Microsoft Excel pre 2010TTEST(array1, array2, tails, type)See
Microsoft Excel 2010 and laterT.TEST(array1, array2, tails, type)See
SAS (Software)default output from proc ttest (labeled "Satterthwaite")
Pythonscipy.stats.ttest_ind(a, b, axis=0, equal_var=False)See
Rt.test(data1, data2, alternative="two.sided", var.equal=FALSE)See
JMP Oneway( Y( YColumn), X( XColumn), Unequal Variances( 1 ) );See
Julia UnequalVarianceTTest(data1, data2)See
Stata ttest varname1 == varname2, welch See
Google Sheets TTEST(range1, range2, tails, type) See
GraphPad Prism It is a choice on the t test dialog.

See also

References

  1. 1 2 Welch, B. L. (1947). "The generalization of "Student's" problem when several different population variances are involved". Biometrika. 34 (1–2): 28–35. doi:10.1093/biomet/34.1-2.28. MR 0019277.
  2. 1 2 3 Ruxton, G. D. (2006). "The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U test". Behavioral Ecology. 17: 688–690. doi:10.1093/beheco/ark016.
  3. 1 2 Derrick, B; Toher, D; White, P (2016). "Why Welchs test is Type I error robust". The Quantitative Methods for Psychology. 12 (1): 30–38. doi:10.20982/tqmp.12.1.p030.
  4. 1 2 Fagerland, M. W.; Sandvik, L. (2009). "Performance of five two-sample location tests for skewed distributions with unequal variances". Contemporary Clinical Trials. 30: 490–496. doi:10.1016/j.cct.2009.06.007.
  5. Welch, B. L. (1951). "On the Comparison of Several Mean Values: An Alternative Approach". Biometrika. 38: 330–336. doi:10.2307/2332579. JSTOR 2332579.
  6. Zimmerman, D. W. (2004). "A note on preliminary tests of equality of variances". British Journal of Mathematical and Statistical Psychology. 57: 173–181. doi:10.1348/000711004849222.
  7. Fagerland, M. W. (2012). "t-tests, non-parametric tests, and large studies—a paradox of statistical practice?". BioMed Central Medical Research Methodology. 12: 78. doi:10.1186/1471-2288-12-78.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.