6/8/2011 1 Laboratoire d'InfoRmatiqueen Image et Systèmes d'information UMR 5205 CNRS/INSA de Lyon/Université Claude Bernard Lyon 1/Université Lumière Lyon 2/Ecole Centrale de Lyon http://liris.cnrs.fr Ludovic Dutreve Alexandre Meyer Saïda Bouakaz Université Lyon 1 Easy Acquisition and Real-Time Animation of Facial Wrinkles Motivation Facial Animation o Realism of a virtual character Real-time applications o Video games o Interactive systems Issues o High level human analysis o Variety of deformations o Tissues/muscles complexity Fine details o Wrinkles, bulges, … o Improve expression recognition [Martin09] May 2011 Easy Acquisition and Real-Time Animation of Facial Wrinkles 2 Related work: capture Facial motion capture o Never simple • Structured light [Zhang04, Na04, …] • Stereo with often several pair of cameras [Bickel07,…, Beeler10, …] • Sphere of cameras/polarised lights (Emily project) [Debevec etal09] o Hard to apply only the details on other faces • Capture the face and details in the same huge mesh May 2011 Easy Acquisition and Real-Time Animation of Facial Wrinkles 3 [Beeler2010] [Zhang2004] [Bickel07] [Debevecetal 09] Related work: synthesis Dynamic skin effects (wrinkles) o Hard to get real-time, control, few manual work and realism • Procedural modeling [Bando02] • Simulation [Sifakis05], compression [Volino99,Larboulette04] • Synthesis from examples: wrinkle maps [Oat07] Need simple details acquisition methods compatible with real time animation system May 2011 Easy Acquisition and Real-Time Animation of Facial Wrinkles 4 [Sifakis05] [Bando02] [Larboulette04] Overview Footer … Session of capture (preprocessing) Computethe normal maps Bones of the frame i Generate the normal map using the reference maps according to the bones positions Set of reference poses … Reference pose 0 Reference pose 1 Reference pose N Easy Acquisition and Real-Time Animation of Facial Wrinkles May 2011 Winkles capture system (preprocessing) 1 camera with flashphotosof several expressions N reference poses (= bones position + normal map) 8 June 2011 6 … Session of capture Computethe normal maps (preprocessing) … Referencepose 0 (neutral) Referencepose 1 Referencepose N Easy Acquisition and Real-Time Animation of Facial Wrinkles
4
Embed
Motivation - UMR 5205 CNRS / INSA Lyon / Université ...6/8/2011 1 Laboratoire d'InfoRmatiqueen Image et Systèmes d'information UMR 5205 CNRS/INSA de Lyon/Université Claude Bernard
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
6/8/2011
1
Laboratoire d'InfoRmatique en Image et Systèmes d'information
UMR 5205 CNRS/INSA de Lyon/Université Claude Bernard Lyon
1/Université Lumière Lyon 2/Ecole Centrale de Lyon
http://liris.cnrs.fr
Ludovic Dutreve Alexandre Meyer Saïda Bouakaz
Université Lyon 1
Easy Acquisition and Real-Time Animation of Facial Wrinkles
Motivation
Facial Animation
o Realism of a virtual character
Real-time applications
o Video games
o Interactive systems
Issues
o High level human analysis
o Variety of deformations
o Tissues/muscles complexity
Fine details
o Wrinkles, bulges, …
o Improve expression recognition [Martin09]
May 2011 Easy Acquisition and Real-Time Animation of Facial Wrinkles 2
Related work: capture
Facial motion capture
o Never simple
• Structured light [Zhang04, Na04, …]
• Stereo with often several pair of cameras [Bickel07,…, Beeler10, …]
• Sphere of cameras/polarised lights (Emily project) [Debevec etal 09]
o Hard to apply only the details on other faces
• Capture the face and details in the same huge mesh
May 2011 Easy Acquisition and Real-Time Animation of Facial Wrinkles 3
[Beeler2010]
[Zhang2004]
[Bickel 07][Debevec etal 09]
Related work: synthesis
Dynamic skin effects (wrinkles)
o Hard to get real-time, control, few manual work and realism