Binomial test

In statistics, the binomial test is an exact test of the statistical significance of deviations from a theoretically expected distribution of observations into two categories.

Common use

One common use of the binomial test is in the case where the null hypothesis is that two categories are equally likely to occur (such as a coin toss). Tables are widely available to give the significance observed numbers of observations in the categories for this case. However, as the example below shows, the binomial test is not restricted to this case.

Where there are more than two categories, and an exact test is required, the multinomial test, based on the multinomial distribution, must be used instead of the binomial test.[1]

Large samples

For large samples such as the example below, the binomial distribution is well approximated by convenient continuous distributions, and these are used as the basis for alternative tests that are much quicker to compute, Pearson's chi-squared test and the G-test. However, for small samples these approximations break down, and there is no alternative to the binomial test.

Example binomial test

Suppose we have a board game that depends on the roll of one die and attaches special importance to rolling a 6. In a particular game, the die is rolled 235 times, and 6 comes up 51 times. If the die is fair, we would expect 6 to come up 235/6 = 39.17 times. Is the proportion of 6s significantly higher than would be expected by chance, on the null hypothesis of a fair die?

To find an answer to this question using the binomial test, we use the binomial distribution B(N=235, p=1/6) to calculate the probability of 51 or more 6s in a sample of 235 if the true probability of rolling a 6 on each trial is 1/6. This is done by adding up the probability of getting exactly 51 6s, exactly 52 6s, and so on up to 235.

In this case, the probability of getting 51 or more 6s on a fair die is 0.02654. If we were looking for significance at the 5% level, this result indicates that the die is loaded to give many 6s (one-tailed test).

The above test looks at whether the die rolls too many 6s. We could also use a two-tailed test which could tell us if the die is biased to produce either too few or too many 6s. Note that to do this we cannot simply double the one-tailed p-value unless the probability of the event is 1/2. This is because the binomial distribution becomes asymmetric as that probability deviates from 1/2. There are two methods to define the two tailed p-value. One method is to sum the probability that the total deviation in numbers of events in either direction from the expected value is either more than or less than the expected value. The probability of that occurring in our example is 0.0437. The second method involves computing the probability that the deviation from the expected value is as unlikely or more unlikely than the observed value, i.e. from a comparison of the probability density functions. This can create a subtle difference, but in this example yields the same probability of 0.0437. In both cases, the two-sided test reveals significance at the 5% level, indicating that the number of 6s observed was significantly different for this die than the expected number at the 5% level.

In statistical software packages

Binomial tests are available in most software used for statistical purposes. E.g.

  • In R the above example could be calculated with the following code:
    • binom.test(51,235,(1/6),alternative="less") (one-tailed test)
    • binom.test(51,235,(1/6),alternative="greater") (one-tailed test)
    • binom.test(51,235,(1/6),alternative="two.sided") (two-tailed test)
  • In SAS the test is available in the Frequency procedure
    PROC FREQ DATA=DiceRoll ;
	TABLES Roll / BINOMIAL (P=0.166667) ALPHA=0.05 ;
	EXACT  BINOMIAL ;
	WEIGHT Freq ;
RUN;
  • In SPSS the test can be utilized through the menu Analyze > Nonparametric test > Binomial
  • In Python, use SciPy:
    • scipy.stats.binom_test(51, 235, 1.0/6, alternative='greater') (one-tailed test)
    • scipy.stats.binom_test(51, 235, 1.0/6, alternative='two-sided') (two-tailed test)
  • In MATLAB, use myBinomTest, which is available via Mathworks' community File Exchange website. myBinomTest will directly calculate the p-value for the observations given the hypothesized probability of a success. [pout]=myBinomTest(51, 235, 1/6) (generally two-tailed, but can optionally perform a one-tailed test).
  • In Stata, use bitest.
  • In Microsoft Excel, use Binom.Dist. The function takes parameters (Number of successes, Trials, Probability of Success, Cumulative). The "Cumulative" parameter takes a boolean True or False, with True giving the Cumulative probability of finding this many successes (a left-tailed test), and False the exact probability of finding this many successes.

See also

References

  1. ↑ Howell, David C. (2007). Statistical methods for psychology (6. ed.). Belmont, Calif.: Thomson. ISBN 978-0495012870.
  • "The binomial test". www.graphpad.com.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.