Understanding Hypothesis Testing Concepts

Hypothesis testing is a statistical method used to make decisions about a population parameter based on sample data. It involves setting up two competing hypotheses: the null hypothesis (H₀) and the alternative hypothesis (H₁).

• Null Hypothesis (H₀): This is a statement of no effect or no difference. It's the hypothesis that the researcher is trying to reject.
• Alternative Hypothesis (H₁ or H_a): This is a statement that contradicts the null hypothesis. It often represents the effect or difference the researcher is trying to find evidence for.

Based on the sample data, we decide whether to reject the null hypothesis or fail to reject it.

Analyzing Statement I: Level of Significance

Statement I says: "Level of significance is the probability of rejecting null hypothesis (H0) when it is true."

The level of significance, denoted by $\alpha$ (alpha), is a threshold probability that helps us decide whether to reject the null hypothesis. It represents the maximum probability of making a Type-I error that we are willing to accept. A Type-I error occurs when we reject the null hypothesis (H₀) even though it is actually true.

Therefore, the level of significance ($\alpha$) is defined as the probability of rejecting the null hypothesis when the null hypothesis is true. Mathematically:

$\alpha = P(\text{Reject } H_0 \mid H_0 \text{ is true})$

This is exactly what Statement I describes. So, Statement I is true.

Analyzing Statement II: Type-I Error Definition

Statement II says: "Accepting null hypothesis (H0) when it is not true is called Type-I error."

Let's look at the definitions of Type-I and Type-II errors in hypothesis testing:

• Type-I Error: Rejecting the null hypothesis (H₀) when it is actually true. The probability of a Type-I error is $\alpha$, the level of significance.
• Type-II Error: Failing to reject the null hypothesis (H₀) when it is actually false (meaning the alternative hypothesis, H₁, is true). The probability of a Type-II error is denoted by $\beta$ (beta).

Statement II describes "Accepting null hypothesis (H0) when it is not true". "Not true" for H0 means H0 is false, or H1 is true. Accepting H0 when it is false is the definition of a Type-II error, not a Type-I error.

Therefore, Statement II is false.

Summary of Hypothesis Testing Outcomes and Errors

We can summarize the possible outcomes of a hypothesis test in a table:

Based on this table, accepting H₀ when H₀ is false is indeed a Type-II error.

Conclusion

Statement I is true because the level of significance is the probability of rejecting the null hypothesis when it is true (Type-I error). Statement II is false because accepting the null hypothesis when it is not true (false) is called a Type-II error, not a Type-I error.

Revision Table: Key Hypothesis Testing Terms

Additional Information on Statistical Errors

Understanding Type-I and Type-II errors is crucial in hypothesis testing. The choice of the significance level ($\alpha$) directly impacts the probability of making a Type-I error. A smaller $\alpha$ reduces the chance of a Type-I error but increases the chance of a Type-II error (for a fixed sample size).

The power of a statistical test ($1 - \beta$) is the probability of correctly rejecting a false null hypothesis. Researchers aim for tests with high power. Factors influencing power include sample size, the significance level ($\alpha$), and the effect size (the magnitude of the true difference or effect).

There is a trade-off between Type-I and Type-II errors. Reducing the probability of one type of error often increases the probability of the other, assuming the sample size is fixed. Increasing the sample size is one way to potentially reduce both types of errors.