Learning Engineering of MOOClets: Simultaneously benefiting Professional Learning, Financial Success, and Cognitive & Learning Sciences Research Joseph Jay Williams Lytics Lab, Graduate School of Education Office of the Vice Provost for Online Learning, Stanford [email protected]www.josephjaywilliams.com 1 riginally from Trinidad & Tobago – apologies for difficulty in follo
43
Embed
Learning Engineering of MOOClets: Simultaneously benefiting Professional Learning, Financial Success, and Cognitive & Learning Sciences Research
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Learning Engineering of MOOClets: Simultaneously benefiting Professional Learning,
Financial Success, and Cognitive & Learning Sciences Research
Joseph Jay WilliamsLytics Lab, Graduate School of Education
• Modularity in Product Design: “MOOClets”• Future-thinking but Actionable• Empirical and Integrative Work• Experiment-Focused Instructional Design• Matchmaking Relevant Researchers• Iterative Improvement• Collaborative Development
4
I. Motivation
• Beliefs about Intelligence• To what extent do you agree?
How smart you are can be significantly changed by your effort and hard work.You have a certain amount of intelligence, and what you do doesn’t really change that much.
Remember, the more you practice the smarter you become!
Growth Mindset Message
7
Growth Mindset Message helpful?
• Growth Mindset Message
• "Remember, the more you practice the smarter you become.”,
• "Mistakes help you learn. Think hard to learn from them.”
• Practice-as-usual
Jascha Sohl-Dickstein
8
Results: More motivated?
• Growth Mindset Message > Practice-as-Usual
• reduction in dropout rate• increase in Number of problems practiced • increase in Number Correct
• Accuracy: Problems correct/Problems attempted
• Accuracy improvement
9
Interpreting results
• Obvious?• Skeptical? Anything’s statistically
significant with large N…• Second experiment (run simultaneously)
10
Practice-as-usualGrowth Mindset Message
Positive Message
Different motivational messages
Some of these problems are hard. Do your best!Remember, the more you practice the smarter you become!
11
Does any positive message work?
• Growth Mindset Message
• "Remember, the more you practice the smarter you become.”,
• "Mistakes help you learn. Think hard to learn from them.”
• Positive Message• "Some of these problems are
hard. Just do your best."• "This might be a tough problem,
but we know you can do it.”
• Practice-as-usual
12
Effects of Positive Messages?
• Positive Messages not better than Practice-as-Usual!
• Growth Mindset > Positive Message• How intuitive is this result?• Teachers?• Ongoing: After incorrect answer• www.assistments.org Neil Heffernan• Gates Grant for Modeling Research
• Modularity in Product Design: “MOOClets”• Future-thinking but Actionable• Empirical and Integrative Work• Experiment-Focused Instructional Design• Matchmaking Relevant Researchers• Iterative Improvement• Collaborative Development
14
Constraint Satisfaction
Practical ProductResearch
Financial Value
“MOOClets” or Modular Online Resources
• E.g. MOOClet: Math exercise, 5 minute interactive video, 30 minute lesson, Study Strategy coach, Quiz/Assessment
• www.josephjaywilliams.com/mooclets • MOOClets Group Tue 12-1 PST (remote)• tiny.cc/joinmooclets mailing list & updates• Williams, J.J. & Williams, B. A. (2013). Randomized
Experiments as a Methodological and Conceptual Tool for Improving Design of Online Learning. Data Driven Education, NIPS Workshop. tiny.cc/experimentsonlinelearning