Finding Factors Using exploratory factor analysis to test a performance measure

Finding FactorsUsing exploratory factor analysis to test a performance measure

Roseanne SovkaBC Ministry of Advanced Education and Labour Market Development

PNAIRP Conference 3-5 October 2010

Outline

Background Method Results Next steps

Background

BC Accountability Framework All public post-secondary institutions Annual process 14 performance measures Webpage:

http://www.aved.gov.bc.ca/framework/welcome.htm#std

Background

Skill development performance measure Average of 7 survey questions Bachelor, Diploma & Certificate students

Why these questions? Similar for all credential types?

Method

Exploratory factor analysis Data reduction technique Underlying factors (latent variables) explain

the relationship between variables

Results

Using survey results for diploma, associate degree and certificate students There is a factor structure Skill development is one of the factors Includes questions from performance

measure Explanatory power 46%

Results Performance measure

Results

Using survey results for Apprenticeship students There is a factor structure Skill development is one of the factors Similar to diploma and certificate students Some differences Explanatory power 47%

Results Performance measure

Results

Using survey results for baccalaureate students Fewer questions available Somewhat different question wording and

response sets

Results

Using survey results for baccalaureate students There is a factor structure Skill development is one of the factors Similar to other student groups Some differences Explanatory power 36%

Results Performance measure

Comparison

All groups had a skills factor The same questions grouped with the

skills factor Variation in explanatory power Variation in non-skills factors

Conclusion

Robust skill development factor Different student groups Different questions and response scales

Objective rationale for performance measure

Next steps

Accountability Framework committee is considering the results

Any questions?

Finding FactorsUsing exploratory factor analysis to test a performance measure

Roseanne SovkaBC Ministry of Advanced Education and Labour Market Development

PNAIRP Conference 3-5 October 2010