IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek ([email protected]) Vojtěch Sázel ([email protected]) Project coordinator: Ing. Ladislav Kunc
Jan 04, 2016
IBM - CVUT Student Research Projects
Video anotation forIBM TalkingHead
Jiří Hronek ([email protected])Vojtěch Sázel ([email protected])
Project coordinator: Ing. Ladislav Kunc
IBM - CVUT Student Research Projects
2
Video anotation forIBM TalkingHead
TalkingHead description The TalkingHead framework is system for
visual interaction with computer users via animated 3D head and sound
Animated head is capable of moves and mimics
voice synthesizer is included in the framework TalkingHead uses XML scenarios, that
describe head movements and contain spoken text
IBM - CVUT Student Research Projects
3
Video anotation forIBM TalkingHead
Our goals Choose short videosequences from English
TV programs – news Create a transcript from videos Add some marks into the transcript, according
to the movements of the TV reporter's head Rewrite the transcript to XML file in format of
TalkingHead
IBM - CVUT Student Research Projects
4
Video anotation forIBM TalkingHead
Our goals – cont. Compare movement of the animated head
with movement of the real head of TV reporter Form a small group of english speaking
people Run “usability test“ Answers for questions on correspondence TalkingHead's
movement with real head movement Aswers for questions on movement realism Answers for question: „Is it possible to use TalkingHead to read
the news?“
IBM - CVUT Student Research Projects
5
Comparsion between the TalkingHead and reporter's head
IBM - CVUT Student Research Projects
6
Video anotation forIBM TalkingHead
Conclusion Results of this project will be used in the
development of automatic 3D TalkingHead movements
What's acomplished TV videos have been chosen Anotations have been made for them
To do usability test
IBM - CVUT Student Research Projects
7
Video anotation forIBM TalkingHead
Any questions? ...