Translation and Verification of ICCS instruments Summary of the Field Trial & Plans for the Main Study National Research Coordinators Meeting Windsor, June 2008
Mar 31, 2015
Translation and Verification of ICCS instruments
Summary of the Field Trial&
Plans for the Main Study
National Research Coordinators Meeting
Windsor, June 2008
NRCMeetingWindsor
9-12 June 2008
Content of presentation
• Field Trial
- Scope of verification
- Quality of translation/adaptations
- Major problems and feedback from the NRCs
• Main Study
- Process of preparation of the national instruments
- Translation/adaptation procedures
- External verification of the national instruments
- Timeline
NRCMeetingWindsor
9-12 June 2008
FT: Scope of verification
• 34 educational systems- 2222 participants: international and regional instruments - 12 participants: international instruments
• 22 languages
- Most popular: Spanish (7) and English (4)
• 2 participants used two languages
• Time: September- October 2007September- October 2007
NRCMeetingWindsor
9-12 June 2008
FT: Quality of translation and/or adaptations
Overall very good quality!
• Primus Inter Pares:
CHILE, ENGLAND, FINLAND
NRCMeetingWindsor
9-12 June 2008
FT: Typical errors
• Translation: mistranslations, “free translation” vs. “word for word” translation, inconsistencies, lack of harmonization between translators
• Cultural Adaptations: not always documented properly, use of English terminology
• Omissions/Additions
• Grammar: English syntax • Punctuation
• Typos
NRCMeetingWindsor
9-12 June 2008
FT: Feedback from countries (TV Summary and SAQ) • 16 participants completed TV Summary Form
- 4 accepted all severity code “1” suggestions- 12 accepted some/partially of severity code “1” suggestions
6 participants reported in SAQ problems with translation and/or translation verification and/or documentation
Reported problems:- Translation/adaptation of some concepts and words (e.g. local
community, school, council, school board, ombudsman, immigrants) - Problems with the Zedland, etc. - Updating NAFs - Verification and NAFs for instruments developed in English - Coordination between NAF – language – layout verification
• Other issues:- Using other country translation (7 countries)
NRCMeetingWindsor
9-12 June 2008
MS: Process of preparation of the national instruments
• The same process as in Field Trial:
Step 1: National Center translates and/or adapts instrumentsStep 2: National Center reviews instruments and completes
NAFStep 3: International Center reviews NAFStep 4: The IEA Secretariat conducts external verification of
translation/adaptation Step 5: National Center corrects and assembles instruments Step 6: International Center conducts layout verificationStep 7: National Center conducts final review and prints
instruments
• The same team as in Field Trial: Translator reviewer NRC
NRCMeetingWindsor
9-12 June 2008
MS: Procedure of preparation of the national instruments
• Select items/questions which were changed after Field Trial. Retranslate them.
• Select and review carefully items/questions which remain unchanged after Field Trial. Correct/ improve them if necessary.
• Follow the same translation/adaptation formula as in Field Trial. Use Field Trial experiences.
• If your country participated in CIVED and you want to have overtime comparisons: do not change the trend items!
• Update NAFs on each stage of your work.
NRCMeetingWindsor
9-12 June 2008
MS: International verification of translation/adaptations
• Materials submitted to external verification:- translated\adapted instruments (international and regional)*
- NAFs ( to be reviewed twice: by the International Center and by the international reviewer) • Feedback in electronic form:
- suggestions inserted in NAFs- proposed corrections, changes and comments (including
severity codes) inserted in instruments
• Please use DPC FTP Server for uploading and downloading instruments!
* Note: Please send test in blocks of items; do not send booklets!
NRCMeetingWindsor
9-12 June 2008
MS: International layout verification
• The same procedure as in Field Trial:
- One copy of each instrument (translation verified and corrected) as PDF file
- Updated NAFs
- The ISC will review instruments and will send its comments to NRC
NRCMeetingWindsor
9-12 June 2008
MS: Finalization of the national instruments
• Final corrections to the instruments have to be introduced
• National Adaptation Forms have to be revised
• Final version of the instruments and National Adaptation Forms should be sent to ISC
• INSTRUMENTS CAN BE PRINTED!
NRCMeetingWindsor
9-12 June 2008
Timeline
• Translation verification opens:
- For Southern Hemisphere: SEPTEMBER 1, 2008
- For Northern Hemisphere: JANUARY 1, 2009
• Verification of full set of instruments takes approximately two – four weeks, dependently on:
- Quality of translation
- “Appointment” for translation verification
NRCMeetingWindsor
9-12 June 2008
Questions and comments
?!!