Estimation And Hypothesis Testing
Section titled “Estimation And Hypothesis Testing”Statistical inference uses sample data to make conclusions about a population parameter. For proportions, the parameter is usually:
- : one population proportion.
- : difference between two population proportions.
A confidence interval estimates a plausible range of values for a parameter. A hypothesis test evaluates whether sample data provide convincing evidence against a null hypothesis.
Estimators and Sampling Distributions
Section titled “Estimators and Sampling Distributions”An estimator is a statistic used to estimate a population parameter. For categorical data, the most common estimators are:
- for a population proportion .
- for a difference in population proportions .
A good estimator is usually unbiased and has low variability. For one sample proportion,
and
The normal approximation is appropriate when the large-counts condition is met:
For two independent sample proportions,
and
Confidence Intervals
Section titled “Confidence Intervals”A confidence interval has the form
The confidence level describes the long-run capture rate of the method. A 95% confidence interval does not mean there is a 95% probability that the fixed parameter is in this particular interval. It means that if we repeatedly sampled and built intervals the same way, about 95% of those intervals would contain the true parameter.
One-Proportion z-Interval
Section titled “One-Proportion z-Interval”Use a one-proportion z-interval to estimate one population proportion :
Common critical values:
| Confidence level | |
|---|---|
| 90% | 1.645 |
| 95% | 1.960 |
| 99% | 2.576 |
Margin Of Error
Section titled “Margin Of Error”The margin of error for a one-proportion interval is
For planning sample size, use
where is a planning estimate. If no estimate is given, use because it gives the most conservative, largest required sample size.
Always round required sample size up.
Hypothesis Tests
Section titled “Hypothesis Tests”A hypothesis test begins with:
- Null hypothesis : the default claim, usually “no difference” or “equals a stated value.”
- Alternative hypothesis : the claim we seek evidence for.
For one proportion:
The alternative may be
The p-value is the probability, assuming is true, of getting a test statistic as extreme as or more extreme than the observed result in the direction of .
Decision rule:
- If p-value , reject .
- If p-value , fail to reject .
One-Proportion z-Test
Section titled “One-Proportion z-Test”Use a one-proportion z-test for a claim about one population proportion:
Use in the standard error because the test assumes the null hypothesis is true.
Two-Proportion z-Interval
Section titled “Two-Proportion z-Interval”Use a two-proportion z-interval to estimate :
Interpret the interval in context: “We are ___% confident that the true difference in population proportions is between ___ and ___.”
Two-Proportion z-Test
Section titled “Two-Proportion z-Test”For a test of
we pool the sample proportions because the null says the two population proportions are equal:
The test statistic is
Use the pooled proportion only for the hypothesis test, not for the confidence interval.
Errors And Power
Section titled “Errors And Power”A Type I error occurs when we reject a true null hypothesis. Its probability is , the significance level.
A Type II error occurs when we fail to reject a false null hypothesis. Its probability is .
Power is the probability of correctly rejecting a false null hypothesis:
Power increases when:
- The true parameter is farther from the null value.
- Sample size increases.
- Significance level increases.
- Variability decreases.
Chi-Square Tests for Homogeneity and Independence
Section titled “Chi-Square Tests for Homogeneity and Independence”Chi-square procedures compare observed counts to expected counts. The test statistic is
Here is an observed count and is an expected count. Large values of indicate that the observed counts are far from what the null hypothesis predicts, so chi-square tests are right-tailed.
The chi-square distribution is right-skewed and indexed by degrees of freedom. Chi-square values are always nonnegative because the statistic is built from squared differences. As degrees of freedom increase, the distribution becomes less skewed.
Homogeneity
Section titled “Homogeneity”A chi-square test for homogeneity compares the distribution of one categorical variable across two or more populations or treatment groups.
- : The category distribution is the same for all populations or treatments.
- : At least one population or treatment has a different category distribution.
Independence
Section titled “Independence”A chi-square test of independence checks whether two categorical variables are associated in one population.
- : The two variables are independent in the population.
- : The two variables are associated in the population.
For both homogeneity and independence, the expected count for a cell is
The degrees of freedom are
where is the number of rows and is the number of columns.
Contributions
Section titled “Contributions”Each cell’s contribution is
The largest contributions show which cells are most responsible for the overall chi-square statistic. A cell with occurred more often than expected under the null; a cell with occurred less often than expected.
Calculator Notes
Section titled “Calculator Notes”Common calculator tools:
1-PropZInt: one-proportion confidence interval.1-PropZTest: one-proportion hypothesis test.2-PropZInt: two-proportion confidence interval.2-PropZTest: two-proportion hypothesis test.X2-Test: chi-square test for homogeneity or independence using a matrix of observed counts.
Calculator output does not replace communication. You still need hypotheses, conditions, p-value or interval, and a conclusion in context.