MPC 006 ANOVA




CLICK HERE FOR

ANSWERS 👉 1-5   6-10   11-17   18-27   NUMERICAL QUESTIONS    

 (Analysis of Variance)

ANOVA is a parametric statistical test used to compare three or more group means at the same time.

Definition

ANOVA is a statistical technique that compares the means of three or more independent groups to see if there is a significant difference among them, by analyzing the variation between groups and within groups.


Why Not Use Multiple t-tests?

If you compare groups using many t-tests:

  • Type-I error increases
  • ANOVA controls Type-I error
  • So ANOVA is the correct method for 3 or more groups

Basic Idea of ANOVA

ANOVA divides total variability into:

  1. Between-group variance → difference due to treatment
  2. Within-group variance → difference due to chance

If between-group variance > within-group variance, groups differ significantly.


Types of ANOVA

  1. One-Way ANOVA – One independent variable (factor)
  2. Two-Way ANOVA – Two independent variables
  3. Repeated Measures ANOVA – Same subjects tested repeatedly

ONE-WAY ANOVA – Step-by-Step Explanation

Example

A psychologist wants to compare stress levels of employees in three departments:

  • Group A
  • Group B
  • Group C

Scores:

Group A Group B Group C
12 18 22
10 20 25
14 17 24

Step 1: State Hypotheses

  • H₀: μ₁ = μ₂ = μ₃ (all means are equal)
  • H₁: At least one mean is different

Step 2: Compute Group Means

  • Mean A = (12 + 10 + 14) / 3 = 12
  • Mean B = (18 + 20 + 17) / 3 = 18.33
  • Mean C = (22 + 25 + 24) / 3 = 23.67

Grand Mean (GM) = (Sum of all 9 values) / 9
Sum = 162 → GM = 162 / 9 = 18


Step 3: Calculate Between-Group Sum of Squares (SSB)

Formula:
SSB = n(MeanA – GM)² + n(MeanB – GM)² + n(MeanC – GM)²
Here n = 3

  • For A: 3(12 – 18)² = 3(36) = 108
  • For B: 3(18.33 – 18)² ≈ 3(0.11) = 0.33
  • For C: 3(23.67 – 18)² = 3(32.11) ≈ 96.33

SSB = 108 + 0.33 + 96.33 = 204.66


Step 4: Calculate Within-Group Sum of Squares (SSW)

Compute deviations within each group:

Group A

(12–12)² + (10–12)² + (14–12)² = 0 + 4 + 4 = 8

Group B

(18–18.33)² + (20–18.33)² + (17–18.33)²
≈ 0.11 + 2.78 + 1.78 = 4.67

Group C

(22–23.67)² + (25–23.67)² + (24–23.67)²
≈ 2.78 + 1.78 + 0.11 = 4.67

SSW = 8 + 4.67 + 4.67 = 17.34


Step 5: Compute Degrees of Freedom

  • df(Between) = k – 1 = 3 – 1 = 2
  • df(Within) = N – k = 9 – 3 = 6

Step 6: Compute Mean Squares

  • MSB = SSB / df(B) = 204.66 / 2 = 102.33
  • MSW = SSW / df(W) = 17.34 / 6 = 2.89

Step 7: Compute F-ratio


F = \frac{MSB}{MSW} = \frac{102.33}{2.89} = 35.4

Step 8: Compare with Critical F

At df(2,6) and α = 0.05, F-critical ≈ 5.14.

Since estimated F = 35.4 > 5.14,
Reject H₀


Interpretation

There is a significant difference in stress levels among the three departments.
At least one group mean differs significantly.


Simple Interpretation for Exams

ANOVA showed F(2,6) = 35.4, p < .05.
Therefore, there is a significant difference between the group means.


When to Use ANOVA?

Use ANOVA when:
✔ Data are quantitative
✔ Groups ≥ 3
✔ Independent samples
✔ Data follow normal distribution
✔ Homogeneity of variance


Very Short Answer Summary (3–4 lines)

ANOVA is a statistical test used to compare the means of three or more groups. It divides total variance into between-group and within-group variance. A significant F-ratio indicates that group means differ. It prevents Type-I error inflation compared to multiple t-tests.


STEPS OF ANOVA

  1. State the hypotheses (H₀: all group means are equal; H₁: at least one mean differs).
  2. Compute the group means and the grand mean (GM).
  3. Calculate the Sum of Squares Between groups (SSB).
  4. Calculate the Sum of Squares Within groups (SSW).
  5. Compute degrees of freedom (df Between, df Within, df Total).
  6. Calculate Mean Squares:
    • MSB = SSB / df Between
    • MSW = SSW / df Within
  7. Compute the F-ratio:
   F = \frac{MSB}{MSW}
  1. Make a decision (reject or fail to reject H₀).
  2. Interpret the result (significant or not significant).

Two-way ANOVA 

Two-way ANOVA is used when there are:

  • Two independent variables (factors)
  • One dependent variable
  • Groups are formed by combining the levels of both factors

It helps to find:

  1. Main Effect of Factor A
  2. Main Effect of Factor B
  3. Interaction Effect (A × B)whether the effect of one factor depends on the levels of the other factor.

Why is Two-Way ANOVA Useful?

It analyses two factors simultaneously, saving time and controlling Type-I error.


Structure Example

Suppose you study:

  • Factor A: Teaching Method

    • A1: Lecture
    • A2: Activity-based
  • Factor B: Gender

    • B1: Male
    • B2: Female

Dependent variable: Test Score


TWO-WAY ANOVA TABLE

Male (B1) Female (B2)
Lecture (A1) 70, 75, 72 78, 80, 76
Activity (A2) 82, 85, 83 88, 90, 87

STEP-BY-STEP SOLUTION

We will solve it in an exam-ready simplified way.


Step 1: Calculate Cell Means

Cell Scores Mean
A1B1 70, 75, 72 72.3
A1B2 78, 80, 76 78
A2B1 82, 85, 83 83.3
A2B2 88, 90, 87 88.3

Step 2: Marginal Means

Teaching Method Means (Factor A)

  • A1 (Lecture) = (72.3 + 78) / 2 = 75.15
  • A2 (Activity) = (83.3 + 88.3) / 2 = 85.8

Gender Means (Factor B)

  • B1 (Male) = (72.3 + 83.3) / 2 = 77.8
  • B2 (Female) = (78 + 88.3) / 2 = 83.15

Step 3: Grand Mean

All 12 scores sum = 1,054


GM=\frac{1054}{12}=87.83

(We will keep simplified values to avoid over-calculation in exam answers.)


Step 4: Compute Sums of Squares (Conceptual Form)

Two-way ANOVA breaks total variance into:

  1. SSA – Variance due to Factor A (Teaching Method)
  2. SSB – Variance due to Factor B (Gender)
  3. SSAB – Interaction Effect A × B
  4. SSW – Within-group variance
  5. SST – Total variance

You DO NOT need full numeric calculations for exams.
You only need to show:


SST = SSA + SSB + SSAB + SSW

Step 5: Degrees of Freedom

Let:

  • a = number of levels of Factor A = 2
  • b = number of levels of Factor B = 2
  • n = number of participants in each cell = 3

Then:

  • dfA = a − 1 = 1
  • dfB = b − 1 = 1
  • dfAB = (a − 1)(b − 1) = 1
  • dfW = ab(n − 1) = 2 × 2 × 2 = 8
  • dfTotal = N − 1 = 12 − 1 = 11

Step 6: Compute F-ratios


F_A = \frac{MS_A}{MS_W}

F_B = \frac{MS_B}{MS_W} 


F_{AB} = \frac{MS_{AB}}{MS_W}

(Where MS = SS / df)


INTERPRETATION 

Main Effect of Teaching Method (A)

  • Students taught using Activity-based method scored higher.
  • If F-value for A is significant → Method affects performance.

Main Effect of Gender (B)

  • Females scored slightly higher.
  • If F-value for B is significant → Gender affects performance.

Interaction Effect (A × B)

  • Does the effect of teaching method differ for males and females?
  • If F(A×B) is significant →
    The effectiveness of a teaching method depends on gender.

Example: Females may benefit more from activity-based teaching.


Conclusion 

A two-way ANOVA was conducted to examine the effects of Teaching Method (Lecture vs Activity) and Gender (Male vs Female) on students' test scores. Results showed:

  1. A significant main effect of Teaching Method, F(1,8) = ___, p < .05
  2. A significant main effect of Gender, F(1,8) = ___, p < .05
  3. A significant interaction effect (Method × Gender), F(1,8) = ___, p < .05

This means that both teaching method and gender influence performance, and their effects interact.

In short ...

Two-way ANOVA is used to study the influence of two independent variables on a dependent variable simultaneously. It tests main effects of each factor and interaction effect between them. A significant interaction means the effect of one factor depends on the levels of the other factors.

CLICK HERE FOR

ANSWERS 👉 1-5   6-10   11-17   18-27   NUMERICAL QUESTIONS  


No comments:

Post a Comment