Ambra Neri, Catia Cucchiarini, Ambra Neri, Catia Cucchiarini, Helmer Strik Helmer Strik Centre for Speech and Language Centre for Speech and Language Technology Technology Dept. of Linguistics - Radboud Dept. of Linguistics - Radboud University Nijmegen University Nijmegen ASR-based corrective ASR-based corrective feedback on feedback on pronunciation: pronunciation: does it really work? does it really work?
20
Embed
ASR-based corrective feedback on pronunciation: does it really work?
ASR-based corrective feedback on pronunciation: does it really work?. Ambra Neri, Catia Cucchiarini, Helmer Strik Centre for Speech and Language Technology Dept. of Linguistics - Radboud University Nijmegen The Netherlands. Outline. Background & problem Goal of present study Experiment - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Ambra Neri, Catia Cucchiarini, Helmer Ambra Neri, Catia Cucchiarini, Helmer StrikStrikCentre for Speech and Language TechnologyCentre for Speech and Language Technology
Dept. of Linguistics - Radboud Dept. of Linguistics - Radboud University University NijmegenNijmegen
The NetherlandsThe Netherlands
ASR-based corrective ASR-based corrective feedback on pronunciation: feedback on pronunciation: does it really work?does it really work?
OutlineOutline
• Background & problemBackground & problem
• Goal of present studyGoal of present study
• ExperimentExperiment
• ConclusionsConclusions
Background and problemBackground and problem
Computer Assisted Pronunciation Training Computer Assisted Pronunciation Training (CAPT)(CAPT)
ASR-based CAPT: ASR-based CAPT:
can provide automatic, instantaneous, can provide automatic, instantaneous, individual feedback on pronunciation in a individual feedback on pronunciation in a private environmentprivate environment
But ASR-based CAPT suffers from But ASR-based CAPT suffers from limitations. limitations.
Is it effective in improving L2 pronunciation? Is it effective in improving L2 pronunciation?
Very few studies with different results.Very few studies with different results.
Goal of this studyGoal of this study
To study the effectiveness and possible To study the effectiveness and possible advantage of automatic feedback advantage of automatic feedback provided by an ASR-based CAPT provided by an ASR-based CAPT system.system.
based on GOP method (Witt & Young 2000)based on GOP method (Witt & Young 2000)
VideoVideo
Dutch CAPTDutch CAPTGender-specific, Dutch & English version. Gender-specific, Dutch & English version.
4 4 units, each containing: units, each containing:
11 video video (from (from NieuweNieuwe Buren Buren) with real-life + ) with real-life + amusing situationsamusing situations
+ ca. 30 exercises based on video: dialogues, + ca. 30 exercises based on video: dialogues, question-answer, minimal pairs, word question-answer, minimal pairs, word repetitionrepetition
Sequential, constrained navigation: min. one Sequential, constrained navigation: min. one attempt needed to proceed to next exercise, attempt needed to proceed to next exercise, maximum 3maximum 3
ConclusionsConclusions Participants enjoyed Dutch CAPT.Participants enjoyed Dutch CAPT. ASR-CAPT seems efficacious in improving ASR-CAPT seems efficacious in improving
pronunciation of targeted phonemes.pronunciation of targeted phonemes. Global ratings are appropriate measure Global ratings are appropriate measure
because CAPT should ultimately improve because CAPT should ultimately improve overall pronunciation quality. overall pronunciation quality.
Fine-grained analyses also useful.Fine-grained analyses also useful.
.
The endThe end
Questions?Questions?
Possible improvementsPossible improvements
• Give feedback on more phonemesGive feedback on more phonemesMore targeted systems for fixed L1-L2 More targeted systems for fixed L1-L2 pairs.pairs.
• Give feedback on suprasegmentalGive feedback on suprasegmental
• Increase sample sizeIncrease sample size• Increase training intensityIncrease training intensity• Match training groups: L1’s, proficiency, Match training groups: L1’s, proficiency,