AmsterdamAirport Schiphol
1
Ludo W. van Meeuwen1,3, Saskia Brand-Gruwel1, Jeroen J.G. van Merriënboer1,2, & Jeano J.P.R. de Bock3
1Open University of the Netherlands, 2Maastricht University, The Netherlands,
3Air Traffic Control The Netherlands
Lund, May 7 2010
Self-directed Learning Skills in Air-traffic control
AmsterdamAirport Schiphol
2
Presentation
• Introduction– ATC– ATC-training
• Self-directed Learning• Experiment• Future experiments
AmsterdamAirport Schiphol
3
Casus Workload Management
Tom
ATC-Trainee
AmsterdamAirport Schiphol
4
1:Safe (5 NM or 1000 Ft.)
2:Efficient
3:Environmentally aware
1:Flight level (FL)
2:Heading
3:Speed
AmsterdamAirport Schiphol
5
Mental picture
Chuncking
AmsterdamAirport Schiphol
6
Mental picture
Chuncking
Decision of order
3
7
6
5
2
1
4
AmsterdamAirport Schiphol
7
Mental picture
Chuncking
Decision of order
R/T, Labeling…
3
7
6
5
2
1
4
AmsterdamAirport Schiphol
8
Adaptive training
• Need, adaptive training ATC
Individual Task selection
Drop-out
Individual learning need
Cognitive complex
Tehnological change
Current situation
AmsterdamAirport Schiphol
9
SDL / SRL
AmsterdamAirport Schiphol
10
Problems/Questions
• Offline measurement • Thinking aloud • CRR
• Can we measure SRL with use of CRR?
• Does CRR to foster SRL/self assessment?
AmsterdamAirport Schiphol
11
Eye-tracking SRL
ATC TaskSelf-
AssessmentTask
Selection
Cued Retrospective
Report
Adjust Task-Selection
Adjust Self-Assessment
Recording of eye-movements.
And
performance measure for level of ATC competences by experts
Measure for quality of self-assessment
Measure for quality of task selection
Measure for level of SRL skills
Measure for quality influence of CRR on self-assessment
Measure for influence of CRR on quality of task selection
-Visual and audio cue
-75 % speed
-Recording of CRR
Task Instruction
List of Questions
Prepare for task, information for self-efficacy judgment
Questionnaire, self-efficacy
AmsterdamAirport Schiphol
12
Results
• CRR-utterances– “Here, you see how I monitor this
cluster of traffic” (task level)– “I could have chosen to decelerate
this plane, but I used an other strategy…” (meta-level/monitor).
– “Here I should have decided to change the arrival order since…”(meta-level/adjustment)
– “This performance of me was terrible” (meta-level)
AmsterdamAirport Schiphol
13
Results (prelim.)
Regulation (task level): especially monitoring
SRL (learning level): especially assessment
Self-assessment 1: -4,2 (of 100)Self-assessment 2: -3,3 (of 100)
AmsterdamAirport Schiphol
14
Conclusion
• CRR is very suitable for measurement of SRL
• CRR seems to foster self-assessment– Increase number of participants
AmsterdamAirport Schiphol
15
Extension of this study
Pre-measurement
Post-measurement
6 weeks training, No SRL intervention
6 weeks training, with SRL intervention
Expect: increase of SRL and performance
AmsterdamAirport Schiphol
16
Visual expertise
Scanning strategies:
- Experts,
- Intermediates
- Novices
AmsterdamAirport Schiphol
17
Thank you for your attention
Questions?Remarks?!
AmsterdamAirport Schiphol
18
references
• Boekaerts, M., & Cascallar, E. (2006). How far have we moved toward the integration of theory and practice in self-regulation? Educational Psychology Review, 18, 199-210.
• Camp, G., Paas, F., Rikers, R. M. J. P., & van Merriënboer, J. J. G. (2001). Dynamic problem selection in air traffic control training: A comparison between performance, mental effort and mental efficiency. Computers in Human Behavior, 17, 575-595.
• Cascallar, E., & Boekaerts, M. (2006). Assessment in the evaluation of self-regulation as a process. Educational Psychology Review, 18, 297-306.
• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2006). Towards a personalized task selection model with shared instructional control. Instructional Science, 34, 399-422.
• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2008). Selecting learning tasks: Effects of adaptation and shared control on learning efficiency and task involvement. Educational Psychologist, 33, 733-756.
• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2009). Combining shared control with variability over surface features: Effects on transfer test performance and task involvement. Computers in Human Behavior, 25, 290-298.
• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2010). Learner controlled selection of tasks with different surface and structural features: Effects on transfer and efficiency.
• Eva, K. W., & Regehr, G. (2005). Self-assessment in the health professions: A reformulation and research agenda. Academic Medicine, 80(10), S46-S54.
• Eva, K. W., & Regehr, G. (2007). Knowing when to look it up: A new conception of self-assessment ability. Academic Medicine, 82(10), S81-S84.
• Eva, K. W., & Regehr, G. (2008). "I'll never play professional football" and other fallacies of self-assessment. Journal of Continuing Education in the Health Professions, 28(1), 14-19.
• Ericsson, K. A. (1998). The scientific study of expert levels of performance: General implications for optimal learning and creativity. High Ability Studies, 9(1), 75-100.
• Ericsson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363-406.
• Kicken, W., Brand-Gruwel, S., & van Merriënboer, J. J. G. (2008). Scaffolding advice on task selection: A safe path toward self-directed learning in on-demand education. Journal of Vocational Education and Training, 60, 223-239.
• Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2009a). Design and evaluation of a development portfolio: How to improve students' self-directed learning skills. Instructional Science, 37, 453-473.
• Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2009b). The effects of portfolio-based advice on the development of self-directed learning skills in secondary vocational education. Educational Technology Research and Development, 57, 439-460.
• Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2010). The effects of p/reflection prompts on the development of self-directed learning skills in secondary vocational education. Manuscript submitted for publication.
• Knowles, M. S. (1975). Self-directed learning. Chicago, IL: Follett publishing company.• Norman, D. A. (1988). The design of everyday things. London: The MIT Press.• Norman, D. A. (2007). The design of future things. New York: Basic Books.• Oprins, E., Burggraaff, E., & van Weerdenburg, H. (2006). Design of a competence-based assessment system for air traffic control
training. The International Journal of Aviation Psychology, 16, 297-320.• Salden, R. J. C. M., Paas, F., Broers, N. J., & van Merriënboer, J. J. G. (2004). Mental effort and performance as determinants for the
dynamic selection of learning tasks in air traffic control training. Instructional Science, 32, 153-172.• Salden, R. J. C. M., Paas, F., van der Pal, J., & van Merriënboer, J. J. G. (2006). Dynamic task selection in flight management system
training. International Journal of Aviation Psychology, 16, 157-174.• Salden, R. J. C. M., Paas, F., & van Merriënboer, J. J. G. (2006). Personalised adaptive task selection in air traffic control: Effects on
training efficiency and transfer. Learning and Instruction, 16, 350-362.
AmsterdamAirport Schiphol
19
• Van den Boom, G., Paas, F., & van Merriënboer, J. J. G. (2007). Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction, 17(5), 532-548.
• Van den Boom, G., Paas, F., van Merriënboer, J. J. G., & van Gog, T. (2004). Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence. Computers in Human Behavior, 20, 551-567.
• Van Gog, T., Paas, F., van Merriënboer, J. J. G., & Witte, P. (2005). Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting. Journal of Experimental Psychology: Applied, 11(4), 237-244.
• Van Merriënboer, J. J. G. (1997). Training complex cognitive skills. Englewood Cliffs, NJ: Educational Technology Publications.
• Van Merriënboer, J. J. G., & Kirschner, P. A. (2007). Ten steps to complex learning. Mahwah, NJ: Erlbaum / Taylor and Francis.
• Van Merriënboer, J. J. G., & Sluijsmans, D. A. (2009). Towards a synthesis of cognitive load theory, four-component instructional design, and self-directed learning. Educational Psychology Review, 21, 55-66.
• Van Merriënboer, J. J. G., & Sweller, J. (2005). Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychological Review, 17, 147-177.
• Vygotsky, L. S. (1978). Mind in society. London: Harvard University Press.• William, D., & Black, P. (1996). Meanings and consequences: A basis for distinguishing formative and
summative functions of assessment? British Educational Research Journal, 22, 537-548. • Winne, P. H. (1995). Inherent details in self-regulated learning. Educational Psychologist, 30, 173-187.• Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In P. R. Pintrich, M. Boekaerts & M.
Zeidner (Eds.), Handbook of self-regulation (pp. 531-566). Orlando, FL: Academic Press.• Zimmerman, B. J. (1986). Development of self-regulated learning: Which are the key sub processes?
Contemporary Educational Psychology, 16, 307-313.• Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational
Psychologist, 25(1), 3-17.• Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41, 64-
70.