Top Banner
Mixed Up about Mixed Methods? An Overview of Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton, University of Northern Colorado
14

Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Jul 09, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Mixed Up about Mixed

Methods? An Overview of Mixed

Methods Research Designs

Heather Petcovic, Western Michigan University

Julie Sexton, University of Northern Colorado

Page 2: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Rationale of Presentation

• Provide overview of mixed

methods

– Philosophical foundation

– Research designs

– Examples from our work

• Encourage broader use of the

designCreswell & Plano Clark, 2010

Page 3: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

What and Why?

What is mixed

methods?

• Study that includes

quantitative and

qualitative research

designs*

• Single study or serial

design

Why use mixed

methods?

• Combined approach

provides a better

understanding of the

research problem than

a single approach

*NOT just qualitative and quantitative data!

Page 4: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Philosophy

Worldview influences personal choices in research

Postpositivism

Constructivism

Pragmatism

Advocacy /

Participatory

Quantitative

Qualitative

Mixed

Page 5: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Designs: Explanatory and Exploratory

Qualitative data

collection and

analysis

Quantitative data

collection and

analysis

Interpretation

Quantitative data

collection and

analysis

Qualitative data

collection and

analysis

Interpretation

Page 6: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Design: Exploratory Example

Qualitative data

collection and

analysis

Quantitative data

collection and

analysis

Interpretation

Naïve

scientific &

non-scientific

statements

Sophisticated

scientific

statements

“Mother

nature”

statements

ACC is

beneficial

for nature

and

mankind

Recent

changes

are part of

a cycle

Dissenter

Statements

in Five

Factors

For more: Bentley et al., Tuesday, 9:50 am

Topic: To what extent do individuals agree with climate change skeptic messages?

Page 7: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Design: Embedded

Interpretation

based on

QUANT

QUANTITATIVE data

collection and

analysis

qualitative data

collection and

analysis

Page 8: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Design: Embedded Example

Significant

learning gains

in content are

likely

connected to

the service

learning

aspect of this

courseInstead of just writing up a report and

getting graded on it and then it just gets

recycled, ... It added more to [the class] to

be able to say, ‘‘Okay this is an actual

presentation [to the community].” (SF10-01)

0

5

10

15

20

25

0 5 10 15 20 25

Po

stte

st S

core

Pretest Score

Koretsky et al., 2012

Topic: Does a field course improve concepts of lake systems?

Page 9: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Design: Triangulation

Quantitative data

collection and

analysis

Qualitative data

collection and

analysis

Compare

or relateInterpretation

Page 10: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Design: Triangulation Example

Topic: Does participation in professional development

improve participants' teaching practices?

Reid, Sexton, Orsi , 2015

Quantitative

• Survey data from

students

• Statistical analysis

Qualitative

• Interviews with

faculty participants

• Qualitative analysis

Compare

or relate

Interpretation

Participants who reported

challenges in changing their

teaching (QL), had lower student

engagement scores (QN).

Page 11: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Real World

Some studies may appear to be mixed methods,

but may not actually be

Qualitative data

collection &

analysis

Converted to

quantitative data

for analysis

Interpretation

Sketch or Annotation Type

IndGeo(%)

k=183

AcGeo(%)

k=149

χ2 Statistic(2,K=361)

Landscape (actual) 30.1 26.8 14.27, p < .01

Fault symbols 49.7 48.3 16.19, p < .01

Related sketches 36.1 48.3 9.99, p < .01

Edits or alternates 30.1 16.8 12.74, p < .01

Explain thinking 42.6 34.9 14.08, p < .01

Industry and

academic

geologists

sometimes

sketch differently

361 sketchesPetcovic et al., 2016 in press

Page 12: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Real World

Is this embedded or triangulation?

Study: Why do students select a geoscience major?

QUANTITATIVE

• Close-ended survey data

• Multiple regression analysis

QUALITATIVE

• Interviews with students

• Constant comparative

analysis

OPTIONS

• Embedded

• Triangulation

Page 13: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Conclusion

• Mixed method research can be a powerful tool

– Yields greater insight than a single approach study

– Overcomes limitations of a single approach

• Is mixing for you? Consider your:

– Worldview

– Research question / purpose

– Comfort and familiarity with both qualitative and

quantitative designs/methods

Page 14: Mixed Up About Mixed Methods presentation handout...Mixed Up about Mixed Methods? An Overview o Mixed Methods Research Designs Heather Petcovic, Western Michigan University Julie Sexton,

Questions?

Contact

Heather Petcovic

Western Michigan University

[email protected]

Julie Sexton

University of Northern Colorado

[email protected]