# Hypothesis Testing

A **hypothesis test** is a statistical inference method used to test the significance of a proposed (hypothesized) relation between population statistics (parameters) and their corresponding sample estimators. In other words, hypothesis tests are used to determine if there is enough evidence in a sample to prove a hypothesis true for the entire population.

The test considers two hypotheses: the **null hypothesis**, which is a statement meant to be tested, usually something like "there is no effect" with the intention of proving this false, and the **alternate hypothesis**, which is the statement meant to stand after the test is performed. The two hypotheses must be mutually exclusive; moreover, in most applications, the two are complementary (one being the negation of the other). The test works by comparing the $p$-value to the level of significance (a chosen target). If the $p$-value is less than or equal to the level of significance, then the null hypothesis is rejected.

When analyzing data, only samples of a certain size might be manageable as efficient computations. In some situations the error terms follow a continuous or infinite distribution, hence the use of samples to suggest accuracy of the chosen test statistics. The method of hypothesis testing gives an advantage over guessing what distribution or which parameters the data follows.

## Definitions and Methodology

In statistical inference, properties (parameters) of a population are analyzed by sampling data sets. Given assumptions on the distribution, i.e. a statistical model of the data, certain hypotheses can be deduced from the known behavior of the model. These hypotheses must be tested against sampled data from the population.

The

null hypothesis$($denoted $H_0)$ is a statement that is assumed to be true. If the null hypothesis is rejected, then there is enough evidence (statistical significance) to accept thealternate hypothesis$($denoted $H_1).$ Before doing any test for significance, both hypotheses must be clearly stated and non-conflictive, i.e. mutually exclusive, statements.Rejecting the null hypothesis, given that it is true, is called a

type I errorand it is denoted $\alpha$, which is also its probability of occurrence. Failing to reject the null hypothesis, given that it is false, is called atype II errorand it is denoted $\beta$, which is also its probability of occurrence. Also, $\alpha$ is known as thesignificance level, and $1-\beta$ is known as thepowerof the test.

$H_0$ $\textbf{is true}$$\hspace{15mm}$ $H_0$ $\textbf{is false}$ $\textbf{Reject}$ $H_0$$\hspace{10mm}$ Type I error Correct Decision $\textbf{Reject}$ $H_1$ Correct Decision Type II error The

test statisticis the standardized value following the sampled data under the assumption that the null hypothesis is true, and a chosen particular test. These tests depend on the statistic to be studied and the assumed distribution it follows, e.g. the population mean following a normal distribution. The$p$-valueis the probability of observing an extreme test statistic in the direction of the alternate hypothesis, given that the null hypothesis is true. Thecritical valueis the value of the assumed distribution of the test statistic such that the probability of making a type I error is small.

Methodologies:Given an estimator $\hat \theta$ of a population statistic $\theta$, following a probability distribution $P(T)$, computed from a sample $\mathcal{S},$ and given a significance level $\alpha$ and test statistic $t^*,$

- define $H_0$ and $H_1;$
- compute the test statistic $t^*.$

$p$-value Approach (most prevalent):

- Find the $p$-value using $t^*$ (right-tailed).
- If the $p$-value is at most $\alpha,$ reject $H_0$. Otherwise, reject $H_1$.

Critical Value Approach:

- Find the critical value solving the equation $P(T\geq t_\alpha)=\alpha$ (right-tailed).
- If $t^*>t_\alpha$, reject $H_0$. Otherwise, reject $H_1$.
Note: Failing to reject $H_0$ only means inability to accept $H_1$, and it does not mean to accept $H_0$.

## Examples

Assume a normally distributed population has recorded cholesterol levels with various statistics computed. From a sample of 100 subjects in the population, the sample mean was 214.12 mg/dL (milligrams per deciliter), with a sample standard deviation of 45.71 mg/dL.

Perform a hypothesis test, with significance level 0.05, to test if there is enough evidence to conclude that the population mean is larger than 200 mg/dL.

Hypothesis TestWe will perform a hypothesis test using the $p$-value approach with significance level $\alpha=0.05:$

- Define $H_0$: $\mu=200$.
- Define $H_1$: $\mu>200$.
- Since our values are normally distributed, the test statistic is $z^*=\frac{\bar X - \mu_0}{\frac{s}{\sqrt{n}}}=\frac{214.12 - 200}{\frac{45.71}{\sqrt{100}}}\approx 3.09$.
- Using a standard normal distribution, we find that our $p$-value is approximately $0.001$.
- Since the $p$-value is at most $\alpha=0.05,$ we reject $H_0$.
Therefore, we can conclude that the test shows sufficient evidence to support the claim that $\mu$ is larger than $200$ mg/dL.

If the sample size was smaller, the normal and $t$-distributions behave differently. Also, the question itself must be managed by a double-tail test instead.

Assume a population's cholesterol levels are recorded and various statistics are computed. From a sample of 25 subjects, the sample mean was 214.12 mg/dL (milligrams per deciliter), with a sample standard deviation of 45.71 mg/dL.

Perform a hypothesis test, with significance level 0.05, to test if there is enough evidence to conclude that the population mean is not equal to 200 mg/dL.

Hypothesis TestWe will perform a hypothesis test using the $p$-value approach with significance level $\alpha=0.05$ and the $t$-distribution with 24 degrees of freedom:

- Define $H_0$: $\mu=200$.
- Define $H_1$: $\mu\neq 200$.
- Using the $t$-distribution, the test statistic is $t^*=\frac{\bar X - \mu_0}{\frac{s}{\sqrt{n}}}=\frac{214.12 - 200}{\frac{45.71}{\sqrt{25}}}\approx 1.54$.
- Using a $t$-distribution with 24 degrees of freedom, we find that our $p$-value is approximately $2(0.068)=0.136$. We have multiplied by two since this is a two-tailed argument, i.e. the mean can be smaller than or larger than.
- Since the $p$-value is larger than $\alpha=0.05,$ we fail to reject $H_0$.
Therefore, the test does not show sufficient evidence to support the claim that $\mu$ is not equal to $200$ mg/dL.

## Hypothesis Test and Confidence Intervals

The complement of the rejection on a two-tailed hypothesis test (with significance level $\alpha$) for a population parameter $\theta$ is equivalent to finding a confidence interval $($with confidence level $1-\alpha)$ for the population parameter $\theta$. If the assumption on the parameter $\theta$ falls inside the confidence interval, then the test has failed to reject the null hypothesis $($with $p$-value greater than $\alpha).$ Otherwise, if $\theta$ does not fall in the confidence interval, then the null hypothesis is rejected in favor of the alternate $($with $p$-value at most $\alpha).$

## See Also

**Cite as:**Hypothesis Testing.

*Brilliant.org*. Retrieved from https://brilliant.org/wiki/hypothesis-testing/