Bannan aect2012

Publish, Don’t Perish:

Design Research

Brenda Bannan, Ph.D.

Associate Professor

Division of Learning Technologies

1) Situated in Real Educational Contexts

Anderson, T. & Shattuck, J. (2012). Design-based research: A decade of progress in education research.

Education Researcher 41, 16-25

2) Design and Testing of Intervention

3) Using Mixed Methods

6.5 hours of classroom interaction videorecordings.

108 episodes involving both gestures and geological observation were analyzed.

4) Involving Multiple Interventions

5) Partnerships: Researchers & Practitioners

Interviewer and ParticipantInterview Being Conducted Behind Large Sign (for shade)

6) Evolution of Design Principles

7) Demonstrate Practical Impact

Models - Design Research

Design Research Model

References found: http://db.tt/CDPmtRx9

Challenges - Design Research

1) Complexity of studies, real world, participatory2) Multiple study cycles3) Mixed methods - empirical and applied4) Contributions to methodology, theory & practice5) Aligning theoretical conjectures with design intervention6) Aligning design intervention with

testing/assessment/evaluation7) Design narrative or process reporting8) Multiple iterations and design process9) Data-driven design decision-making10) Contributions to theory/practice/policy11) Design principles 12) Journal space13) Chunking design research study efforts

Challenges in Publishing - Design Research

1) Clarity in the complexity• Argumentative grammar - logic (Kelly, 2004)• Logical connection

• Research questions• Theoretical conjectures• Outcomes• Revisions

2) Multiple study cycles • Use design research model - advanced organizer• Report clearly phases/cycles/iterations• Document evolution of design and theory

3) Mixed methods - empirical and applied• Relationship of phase-question-results-iteration-theory

4) Results• Contributions to theory, practice/design & methodology

Challenges in Publishing - Design Research5) Articulating theoretical conjectures with design intervention

• Graphical representation• Alignment of theory and initial design • Design cycles

6) Aligning design with testing/assessment/evaluation• Graphical-Table representation• Learning conjectures• Design features• Testing/assessment/evaluation• Articulating learning targets or goals• How do we know the design is accomplishing this?

7) Design Narrative• In addition to just telling the design process story• What were major design moves? • Based on what outcomes?• Results - also design principles for others to employ

Challenges in Publishing - Design Research1) Article analysis design-based research

• Ormel, Pareja Roblin, McKenney, Voogt & Pieters (2012)

• 172 articles • 154 articles - “…lacked explicit discussion of how research

contributed to the design of instructional solutions”

• 18 remaining articles

• “…little attention is devoted to elaborating how designs are

informed by literature, project data or practitioner knowledge.”

2) Journal space• Huge issue for DBR studies - multiple iterations/study cycles

• “Scientific journal articles that carefully articulate how

empirical findings contribute to theory-building may not focus

on, or have the space available to report on the research–practice connection as well.”

3) Chunking design research study efforts• By phase, by study but at what point in overall effort?• True theory to practice connection- beyond publishing