Archive:Advanced ANOVA/Factorial ANOVA

File:Wikademia.logo.png Resource type: this resource contains a tutorial or tutorial notes. Template:75%done The purpose of this tutorial is to teach use of factorial ANOVA (which involves testing differences between group means based on two or more independent variables). Practical exercises are based on using SPSS.

Overview

• Design
  • 2 or more between subjects categorical/ordinal IVs
  • 1 interval/ratio DV
  • e.g., what is the effect of Gender (2) and Degree Type (3) on Overall Satisfaction?

This would be a 2 x 3 Factorial ANOVA (or 2 x 3 Between-Subjects ANOVA)

• Results of interest are:
  • Main effect of IV1
  • Main effect of IV2
  • Interaction b/w IV1 and IV2
• If significant effects are found and more than 2 levels of an IV are involved, then specific contrasts are required, either:
  • A priori (planned) contrasts
  • Post-hoc contrasts
• Effect sizes should also be reported

General steps

1. Establish hypothesis/hypotheses
   • Make sure you have separate hypotheses for:
     • Main effect for each IV
     • Interactions between IVs
     • Planned contrasts (if warranted)
2. Examine assumptions:
3. IVs (categorical; between-subjects) and DV (at least interval)
   • The data in each cell is normally distributed
   • Homogeneity of variance (the variance in each cell is similar)
   • Cells are independent
4. Examine descriptive statistics, particularly the four moments (M, SD, Skewness, Kurtosis) overall, and also for each cell
5. Examine graphs
6. Conduct inferential test (ANOVA) and interpret significance of F scores
7. Conduct follow-up tests (planned contrasts or post-hoc tests) if F is significant
8. Interpret interactions
9. Calculate and interpret effect sizes
   • Eta-square (omnibus - equivalent to R²)
   • Standardised mean effect size (difference b/w two means)

Example SPSS outputs

• Factorial ANOVA (example) - Are there differences in University Student Satisfaction levels between Gender and Age?
• Factorial ANOVA (example) - Are there differences in University Student Satisfaction levels between Gender and Age? - Are there differences in Locus of Control between Gender and Age?

Descriptives

• A table of descriptive statistics for each cell and for each marginal total, and grand total should be shown. For a 2-way ANOVA, the descriptives table should a breakdown for one IV in the columns and the breakdown for the other IV in the rows.

Understanding interactions

• One of the keys to understanding Factorial ANOVA is being able to intepret interactions.
• A recommended experiential exercise for learning about interactions is to fabricate a dataset which can be used to demonstrate factorial ANOVAs in which there are:
  1. No effects
  2. Main effect A, no main effect B, no interaction
  3. Main effect A, no main effect B, interaction
  4. No main effect A, main effect B, no interaction
  5. No main effect A, main effect B, interaction
  6. Main effect A, main effect B, no interaction
  7. Main effect A, main effect B, interaction
  8. Interaction, no main effects

Francis exercises

• 3.3 (Analysing Differences)
  • 3.3.8 Factorial ANOVA
    • AQUES.sav
    • Motiv.sav

Effect sizes

• Eta-squared

See also

• Factorial ANOVA

External links

• Factorial ANOVA (ucspace)
  • Factorial ANOVA Notes (Handout)