University of Paris University of Paris 8 8 Animation improvements and face Animation improvements and face creation tool for ECAs creation tool for ECAs Nicolas Ech Chafai Nicolas Ech Chafai Benjamin Dariouch Benjamin Dariouch Maurizio Mancini Maurizio Mancini Catherine Pelachaud Catherine Pelachaud
20
Embed
University of Paris 8 Animation improvements and face creation tool for ECAs Animation improvements and face creation tool for ECAs Nicolas Ech Chafai.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
University of Paris 8University of Paris 8
Animation improvements and face Animation improvements and face creation tool for ECAscreation tool for ECAs
aiming at improving agent's facial aiming at improving agent's facial animation quality:animation quality: we are studying some motion captured datawe are studying some motion captured data we apply results to our ECAwe apply results to our ECA
to allow the creation of individualized to allow the creation of individualized ECAs:ECAs: we developed one tool for MPEG4 face we developed one tool for MPEG4 face
creationcreation we propose some refinements to MPEG4 we propose some refinements to MPEG4
specificationspecification
MOCAP data analysisMOCAP data analysis
Three main goals:Three main goals:
displacement of FAPs during emotion displacement of FAPs during emotion presentationpresentation
synchronization between different FAPssynchronization between different FAPs FAP values during transition between FAP values during transition between
consecutive emotionsconsecutive emotions
Collected MOCAP dataCollected MOCAP data
2 actors2 actors 33 markers, 21 of them are the MPEG4 FAPs33 markers, 21 of them are the MPEG4 FAPs 78 sequences:78 sequences:
fear clipfear clip file: clips/coline 56 fearfile: clips/coline 56 fear
Facial animation modelFacial animation model
FAPs displacement during basic emotionsFAPs displacement during basic emotions our model was simply based on onset-apex-our model was simply based on onset-apex-
offsetoffset
Data observed modelData observed model
on real data we observed other general on real data we observed other general behaviorsbehaviors
ResultsResults
we started to introduce the ADSR model:we started to introduce the ADSR model:given a sequence of given a sequence of (phase,intensity,duration) (phase,intensity,duration)
where phase is fromwhere phase is from {Attack, Decay, Sustain {Attack, Decay, Sustain Release}, Release}, the FAP curve is built using keyframe the FAP curve is built using keyframe Hermite interpolation:Hermite interpolation:
ADSR vs real dataADSR vs real data
ADSR exampleADSR example
clipclip
MPEG4 face toolMPEG4 face tool
MPEG4 face toolMPEG4 face tool imports models from Poserimports models from Poser allows the selection of the areas allows the selection of the areas
influenced by FDPsinfluenced by FDPs
Tool's featuresTool's features
automatic selection and symmetrizationautomatic selection and symmetrization automatic association automatic association region name region name
available FDPsavailable FDPs
ExampleExample
exports into a data file (containing exports into a data file (containing geometry + regions) readable from the geometry + regions) readable from the Greta's playerGreta's player
after adding new faces some refinements after adding new faces some refinements for the MPEG4 player will be neededfor the MPEG4 player will be needed
ExampleExample
clip without new FAPUsclip without new FAPUs clip with new FAPUsclip with new FAPUs
ConclusionsConclusions
more data has to be captured in proper waymore data has to be captured in proper way focus more on interaction between different FAPs focus more on interaction between different FAPs
and transition between sequential expressionsand transition between sequential expressions ADSR has to be fully implementedADSR has to be fully implemented for documentation, papersfor documentation, papershttp://www.iut.univ-paris8.fr/gretahttp://www.iut.univ-paris8.fr/greta
for Greta applications available to the other for Greta applications available to the other HUMAINE members please contact usHUMAINE members please contact [email protected]@iut.univ-paris8.fr