IM2 GA meeting, October 18th, 2011 Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions F. Ringeval, A. Sonderegger, J. Sauer, D. Lalanne Department of Informatics – Psychology Université de Fribourg – Universität Freiburg, Switzerland 2 nd International Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space, emoSPACE 2013, April 26th, 2013
16
Embed
IM2 GA meeting, October 18th, 2011 Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions F. Ringeval, A. Sonderegger,
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
IM2 GA meeting, October 18th, 2011
Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions
F. Ringeval, A. Sonderegger, J. Sauer, D. Lalanne
Department of Informatics – Psychology
Université de Fribourg – Universität Freiburg, Switzerland
2nd International Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space, emoSPACE 2013, April 26th,
2013
Corpus Design
• Why creating a new corpus of emotion?– Idea originally comes from the EmotiBoard project (enhancing
emotional awareness for remote collaborative interactions)
– Context of remote collaboration has not been studied so far
– No existing corpus with bothaudio-visual and physiological data, neither with French speakers
• Objective of the corpus– Provide rich and consistently annotated multimodal data of natural
human behaviour in a context of remote dyadic collaboration
Page 2
Incrustation of emotional feedback into audiovisual data of the SEMAINE database; publication submitted to ACII 2013
emoSPACE 2013, Shanghai, China Fabien Ringeval
Corpus Design
• Videoconference situation (2 persons working together)
• 2 x 2 between subjects design
• Independent variables– Emotion feedback (yes/no): study the impact of EmotiBoard
– Emotion manipulation (positive/negative): increase difference in emotional valence between participants of a team
• Participants– 46 students (58.7% female)
– Mean age: 22 years ± 3 (min: 18, max: 32)
– French speakers with different origins: 33 French, 4 Germans, 8 Italians and 1 Portuguese
Page 3 emoSPACE 2013, Shanghai, China Fabien Ringeval
• EmotiBoard: emotional feedback generation– Vertical interactive surface on which multiple users can interact using
different devices
– Java library to transmit and display as client/server wizard-of-oz ratings of user’s emotion (arousal & valence)
Page 4
Corpus Design
EmotiBoard: emotional feedback generation
emoSPACE 2013, Shanghai, China Fabien Ringeval
Corpus Design
• Collaborative task– As simple as possible, while ensuring that people would be both
motivated and sufficiently involved with regard to their emotions
– Winter survival exercise: 15 items have to be ranked according to their significance for survival in a deserted and hostile area (plane crash)
Page 5 emoSPACE 2013, Shanghai, China Fabien Ringeval