20 October 2023

Null Hypothesis

 

    The null hypothesis is a fundamental concept in statistics, particularly in the realm of hypothesis testing.

1. What is a Hypothesis?

A hypothesis is a claim or statement about a property of a population. For example, a hypothesis might claim that the average age of the students in a university is 22 years.

2. The Null Hypothesis ( H_0 )

The null hypothesis, often denoted as H0​, is a statement that there is no effect or no difference. It is the default or status quo statement that we aim to test against. For instance, if we are testing whether a new drug is effective, the null hypothesis might state that the drug has no effect.

Examples:

  1. If testing whether a coin is fair, H_0​ might state that the coin is fair, and the probability of landing heads is 0.50.5.
  2. If testing whether a training program improves performance, H_0​ might state that the average improvement is zero.

3. The Alternative Hypothesis (H1​ or Ha​)

This is what you might want to prove or establish. The alternative hypothesis is the opposite of the null. It is a statement that indicates the presence of an effect or difference.

Examples:

  1. The coin is biased toward heads (i.e., the probability of heads is not 0.50.5).
  2. The training program does have an effect on performance.

4. Why the Null Hypothesis?

One might wonder why we don't directly test the statement we're interested in. The reason lies in the logic of empirical research. It's challenging to "prove" something is true. Instead, we take an indirect approach: we start by assuming the null hypothesis is true. If our data strongly contradict this assumption, then we have evidence against the null hypothesis, and by extension, in favor of the alternative.

5. Decision Making in Hypothesis Testing

When we collect data and conduct a statistical test, we'll end up with a test statistic and a p-value. Based on the p-value, we decide whether to "reject" or "fail to reject" the null hypothesis:

  • Low p-value (typically less than 0.05): Evidence against the null hypothesis is strong. We reject H_0​ in favor of H_1​.
  • High p-value: There's insufficient evidence against the null hypothesis. We fail to reject H0​.

6. Errors in Hypothesis Testing

Even with a rigorous approach, there's always a possibility of making errors:

  1. Type I Error (False Positive): Rejecting H_0​ when it's true. The probability of this error is denoted by α, also known as the significance level.
  2. Type II Error (False Negative): Failing to reject H_0​ when H1​ is true. The probability of this error is denoted by β. The power of a test (1 - β) is the probability of correctly rejecting H0​ when H1​ is true.

7. Important Considerations:

  1. Failing to reject H_0​ doesn't prove it's true. It merely suggests we didn't find strong evidence against it.
  2. P-values should be interpreted with caution. A smaller p-value doesn't mean a result is "more true." It merely indicates that the observed data (or something more extreme) is less likely under the assumption of the null hypothesis.
  3. Effect Size: Statistical significance doesn’t necessarily mean practical significance. It's crucial to consider the size of the effect in addition to its significance.

To summarize, the null hypothesis is a foundational idea in statistics that serves as a starting point for hypothesis testing. It allows us to frame our investigations in a way that facilitates logical and empirical evaluation.


Thank you

No comments:

Post a Comment

Measures of Skewness and Measures of Kurtosis

  Measures of Skewness     To say, skewness means 'lack of symmetry'. We study skewness to have an idea about the shape of the curve...