Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

One-Way ANOVA
Chapter 11
Revised by Jeffrey B. Henriques, Ph.D.
University of Wisconsin-Madison

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

t tests are great but

How often are we only interested in 2

groups?

Male Vs. Female

Young Vs. Old
Sick Vs. Healthy
Alcoholic Vs. Non-Alcoholic

How would you analyze more groups?

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Analysis of Variance (ANOVA)

When to use an F distribution

Working with more than two samples

ANOVA

Used with two or more nominal

independent variables and an interval
dependent variable

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Why Not Use Multiple t Tests?

The problem of too many t tests

Fishing for a finding
Problem of Type I error

bad
worst

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

The F Distribution

Analyzing variability to compare means

F = variance between groups
variance within groups

That is, the difference among the

sample means divided by the average

of the sample variances

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Types of Variance

Between-groups variance

Estimate of the population variance based

on differences among the means

Within-groups variance

Estimate of population variance based on

differences within (3 or more) sample
distributions

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition

Partitioning Variance in the

Between-Groups ANOVA
Heinzen

Total
Variance
BetweenGroups
Variance

WithinGroups
Variance

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Types of ANOVA

One-way ANOVA: Hypothesis test

including one nominal variable with

more than two levels and a scale DV

Between-groups: more than two samples,

with different participants in each sample
Within-groups: more than two samples,
with the same participants; also called
repeated-measures

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Check Your Learning

Can you come up with an example of a

one-way between-groups ANOVA and

an example of a one-way within-groups
ANOVA?

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Assumptions of ANOVAs

Random selection of samples

Normally distributed sample
Homoscedasticity: samples come from
populations with the same variance
Homogeneity of variance

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition

Everything About ANOVA

but the Calculations
Heinzen

Step 1: Identify the populations,

distribution, and assumptions

Step 2: State the null and research
hypotheses
H0: n

H1: n

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Step 3: Characteristics of the

comparison distribution
df between N groups 1
df within df1 df 2 df 3 ...df last

df1 n1 1

What are the degrees of freedom?

If there are three levels of the independent

variable?
If there are a total of 20 participants in each of
the three levels?

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition

Heinzen

Step 4: Determine the critical value

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Determine Cutoffs for an F

Distribution

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Logic Behind the F Statistic

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Logic Behind the F Statistic

Quantifies overlap
Two ways to estimate population
variance

Between-groups variability
Within-groups variability

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

The Source Table

MS between
F
MS within

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Formulae
SS total ( X GM ) 2
SS within ( X M ) 2

SS between ( X GM ) 2
SStotal SS within SSbetween

MS between
F
MS within

SS within
MS within
df within
MS between

SS between

df between

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Making a Decision

What is the ANOVA telling us to do

about the null hypothesis?

Do we reject or accept the null hypothesis?

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

An F Distribution
Here the F statistic is 8.27 while the cutoff is 3.86. So we
can reject the null hypothesis.

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Going Beyond Hypothesis Testing

Effect size
Post hoc tests

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Calculating Effect Size

R2 is a common measure of effect size

for ANOVAs

SSbetween
R
SStotal
2

461.643
R
0.73
629.084
2

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Post Hoc Tests to Determine

Which Groups Are Different

When you have three groups, and F is

significant, how do you know where the

difference(s) are?
Tukey HSD
Bonferonni
Scheff

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Tukey HSD Test

Widely used post hoc test that uses

means and standard error

M1 M 2
HSD
sM
sM

MS within
N

N
N
1 N
'

groups

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

One-Way Within-Groups ANOVA

Similar to paired-samples t tests

Same participants do something multiple

(more than 2) times

Are used when we have one IV with at

least 3 levels, a scale DV, and the
same participants in each group

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition

Partitioning Variance in the WithinGroups ANOVA

Heinzen

Total
Variance
Within
Variance

Between-Groups
Variance

Subjects

WithinGroups

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Steps of Hypothesis Testing

Step 1: Identify the populations,
distribution, and assumptions
Step 2: State the null and research
hypotheses
Step 3: Determine the characteristics of
the comparison distribution
Step 4: Determine the critical value, or
cutoff
Step 5: Calculate the test statistic
Step 6: Make a decision

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Step 3: Characteristics of the comparison

distribution
df between N groups 1
df subjects n 1

df within (df between )( df subjects )

df total N total 1

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Step 4: Determine the critical values, or

cutoffs
Critical F(2,8) = 4.46, for = .05

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Formulae
SS total ( X GM )

SSbetween ( M GM )

MS between

SS subjects ( M participant GM )

MS subjects
2

SS within SS total SSbetween SS subjects

Fbetween

MS between

MS within

SS between
df between
SS subjects

df subjects
SS within
MS within
df within

Fsubjects

MS subjects
MS within

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

SSwithin SStotal SSbetween SSsubjects 2117.732 1092.130 729.738 295.864

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Step 6: Make a decision

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Effect Size

R2 can be calculated for this type of

ANOVA, too

SSbetween
R
( SStotal SS subjects )
2

Essentials of Statistics for the Behavioral Sciences, 2nd

Susan A. Nolan
Thomas E.
Edition
Heinzen

Tukey HSD

Post hoc test to identify where you have

differences if your F is significant
You need to calculate the standard
error before using the Tukey HSD test

MSwithin
sM
N

(M1 M 2 )
HSD
sM