Randomization Tests

Randomization tests use a large number of random permutations of given data to determine the probability that the actual empirical test result might have occurred by chance. Contrary to traditional parametric tests, they do not rely on the properties of known distribution, such as the Gaussian, for determining error probability, but construct the probability according to the actual distribution of the data. In parametric statistics, it is assumed that all potential sampled scores follow a theoretical distribution that is mathematically describable and well known. By transforming and locating an empirical score on the respective distribution, one can calculate a density function, which then gives the position of this score within this density function. This position can be interpreted as a p value. Most researchers know ...