Amsterdam Airport Schiphol 1 Ludo W. van Meeuwen 1,3, Saskia Brand-Gruwel 1, Jeroen J.G. van Merriënboer 1,2, & Jeano J.P.R. de Bock 3 1 Open University.

AmsterdamAirport Schiphol

1

Ludo W. van Meeuwen1,3, Saskia Brand-Gruwel1, Jeroen J.G. van Merriënboer1,2, & Jeano J.P.R. de Bock3

1Open University of the Netherlands, 2Maastricht University, The Netherlands,

3Air Traffic Control The Netherlands

Lund, May 7 2010

Self-directed Learning Skills in Air-traffic control

AmsterdamAirport Schiphol

2

Presentation

• Introduction– ATC– ATC-training

• Self-directed Learning• Experiment• Future experiments

AmsterdamAirport Schiphol

3

Casus Workload Management

Tom

ATC-Trainee

AmsterdamAirport Schiphol

4

1:Safe (5 NM or 1000 Ft.)

2:Efficient

3:Environmentally aware

1:Flight level (FL)

2:Heading

3:Speed

AmsterdamAirport Schiphol

5

Mental picture

Chuncking

AmsterdamAirport Schiphol

6

Mental picture

Chuncking

Decision of order

3

7

6

5

2

1

4

AmsterdamAirport Schiphol

7

Mental picture

Chuncking

Decision of order

R/T, Labeling…

3

7

6

5

2

1

4

AmsterdamAirport Schiphol

8

Adaptive training

• Need, adaptive training ATC

Individual Task selection

Drop-out

Individual learning need

Cognitive complex

Tehnological change

Current situation

AmsterdamAirport Schiphol

9

SDL / SRL

AmsterdamAirport Schiphol

10

Problems/Questions

• Offline measurement • Thinking aloud • CRR

• Can we measure SRL with use of CRR?

• Does CRR to foster SRL/self assessment?

AmsterdamAirport Schiphol

11

Eye-tracking SRL

ATC TaskSelf-

AssessmentTask

Selection

Cued Retrospective

Report

Adjust Task-Selection

Adjust Self-Assessment

Recording of eye-movements.

And

performance measure for level of ATC competences by experts

Measure for quality of self-assessment

Measure for quality of task selection

Measure for level of SRL skills

Measure for quality influence of CRR on self-assessment

Measure for influence of CRR on quality of task selection

-Visual and audio cue

-75 % speed

-Recording of CRR

Task Instruction

List of Questions

Prepare for task, information for self-efficacy judgment

Questionnaire, self-efficacy

AmsterdamAirport Schiphol

12

Results

• CRR-utterances– “Here, you see how I monitor this

cluster of traffic” (task level)– “I could have chosen to decelerate

this plane, but I used an other strategy…” (meta-level/monitor).

– “Here I should have decided to change the arrival order since…”(meta-level/adjustment)

– “This performance of me was terrible” (meta-level)

AmsterdamAirport Schiphol

13

Results (prelim.)

Regulation (task level): especially monitoring

SRL (learning level): especially assessment

Self-assessment 1: -4,2 (of 100)Self-assessment 2: -3,3 (of 100)

AmsterdamAirport Schiphol

14

Conclusion

• CRR is very suitable for measurement of SRL

• CRR seems to foster self-assessment– Increase number of participants

AmsterdamAirport Schiphol

15

Extension of this study

Pre-measurement

Post-measurement

6 weeks training, No SRL intervention

6 weeks training, with SRL intervention

Expect: increase of SRL and performance

AmsterdamAirport Schiphol

16

Visual expertise

Scanning strategies:

- Experts,

- Intermediates

- Novices

AmsterdamAirport Schiphol

17

Thank you for your attention

Questions?Remarks?!

AmsterdamAirport Schiphol

18

references

• Boekaerts, M., & Cascallar, E. (2006). How far have we moved toward the integration of theory and practice in self-regulation? Educational Psychology Review, 18, 199-210.

• Camp, G., Paas, F., Rikers, R. M. J. P., & van Merriënboer, J. J. G. (2001). Dynamic problem selection in air traffic control training: A comparison between performance, mental effort and mental efficiency. Computers in Human Behavior, 17, 575-595.

• Cascallar, E., & Boekaerts, M. (2006). Assessment in the evaluation of self-regulation as a process. Educational Psychology Review, 18, 297-306.

• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2006). Towards a personalized task selection model with shared instructional control. Instructional Science, 34, 399-422.

• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2008). Selecting learning tasks: Effects of adaptation and shared control on learning efficiency and task involvement. Educational Psychologist, 33, 733-756.

• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2009). Combining shared control with variability over surface features: Effects on transfer test performance and task involvement. Computers in Human Behavior, 25, 290-298.

• Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2010). Learner controlled selection of tasks with different surface and structural features: Effects on transfer and efficiency.

• Eva, K. W., & Regehr, G. (2005). Self-assessment in the health professions: A reformulation and research agenda. Academic Medicine, 80(10), S46-S54.

• Eva, K. W., & Regehr, G. (2007). Knowing when to look it up: A new conception of self-assessment ability. Academic Medicine, 82(10), S81-S84.

• Eva, K. W., & Regehr, G. (2008). "I'll never play professional football" and other fallacies of self-assessment. Journal of Continuing Education in the Health Professions, 28(1), 14-19.

• Ericsson, K. A. (1998). The scientific study of expert levels of performance: General implications for optimal learning and creativity. High Ability Studies, 9(1), 75-100.

• Ericsson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363-406.

• Kicken, W., Brand-Gruwel, S., & van Merriënboer, J. J. G. (2008). Scaffolding advice on task selection: A safe path toward self-directed learning in on-demand education. Journal of Vocational Education and Training, 60, 223-239.

• Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2009a). Design and evaluation of a development portfolio: How to improve students' self-directed learning skills. Instructional Science, 37, 453-473.

• Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2009b). The effects of portfolio-based advice on the development of self-directed learning skills in secondary vocational education. Educational Technology Research and Development, 57, 439-460.

• Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2010). The effects of p/reflection prompts on the development of self-directed learning skills in secondary vocational education. Manuscript submitted for publication.

• Knowles, M. S. (1975). Self-directed learning. Chicago, IL: Follett publishing company.• Norman, D. A. (1988). The design of everyday things. London: The MIT Press.• Norman, D. A. (2007). The design of future things. New York: Basic Books.• Oprins, E., Burggraaff, E., & van Weerdenburg, H. (2006). Design of a competence-based assessment system for air traffic control

training. The International Journal of Aviation Psychology, 16, 297-320.• Salden, R. J. C. M., Paas, F., Broers, N. J., & van Merriënboer, J. J. G. (2004). Mental effort and performance as determinants for the

dynamic selection of learning tasks in air traffic control training. Instructional Science, 32, 153-172.• Salden, R. J. C. M., Paas, F., van der Pal, J., & van Merriënboer, J. J. G. (2006). Dynamic task selection in flight management system

training. International Journal of Aviation Psychology, 16, 157-174.• Salden, R. J. C. M., Paas, F., & van Merriënboer, J. J. G. (2006). Personalised adaptive task selection in air traffic control: Effects on

training efficiency and transfer. Learning and Instruction, 16, 350-362.

AmsterdamAirport Schiphol

19

• Van den Boom, G., Paas, F., & van Merriënboer, J. J. G. (2007). Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction, 17(5), 532-548.

• Van den Boom, G., Paas, F., van Merriënboer, J. J. G., & van Gog, T. (2004). Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence. Computers in Human Behavior, 20, 551-567.

• Van Gog, T., Paas, F., van Merriënboer, J. J. G., & Witte, P. (2005). Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting. Journal of Experimental Psychology: Applied, 11(4), 237-244.

• Van Merriënboer, J. J. G. (1997). Training complex cognitive skills. Englewood Cliffs, NJ: Educational Technology Publications.

• Van Merriënboer, J. J. G., & Kirschner, P. A. (2007). Ten steps to complex learning. Mahwah, NJ: Erlbaum / Taylor and Francis.

• Van Merriënboer, J. J. G., & Sluijsmans, D. A. (2009). Towards a synthesis of cognitive load theory, four-component instructional design, and self-directed learning. Educational Psychology Review, 21, 55-66.

• Van Merriënboer, J. J. G., & Sweller, J. (2005). Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychological Review, 17, 147-177.

• Vygotsky, L. S. (1978). Mind in society. London: Harvard University Press.• William, D., & Black, P. (1996). Meanings and consequences: A basis for distinguishing formative and

summative functions of assessment? British Educational Research Journal, 22, 537-548. • Winne, P. H. (1995). Inherent details in self-regulated learning. Educational Psychologist, 30, 173-187.• Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In P. R. Pintrich, M. Boekaerts & M.

Zeidner (Eds.), Handbook of self-regulation (pp. 531-566). Orlando, FL: Academic Press.• Zimmerman, B. J. (1986). Development of self-regulated learning: Which are the key sub processes?

Contemporary Educational Psychology, 16, 307-313.• Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational

Psychologist, 25(1), 3-17.• Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41, 64-

70.