Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France The ViSiCAST Project Vi rtual Si gning: C apture, A nimation, S torage & T ransmission IST.

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

The The ViSiCAST ViSiCAST ProjectProjectViVirtual rtual SiSigning: gning: CCapture, apture, AAnimation, nimation, SStorage & torage & TTransmissionransmission

IST Programme -1999-10500IST Programme -1999-10500

55th th Framework ProgramFramework ProgramKey Actions:Key Actions:

• Systems and services for citizen To meet the needs and expectations of European

citizens for high quality and affordable services

of general interest. RTD will be carried out in the

fields of health, persons with special needs

(including elderly and disabled), administrations,

environment and transport.

• Multimedia context and tools

Duration:Duration:36 months

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

Advanced technology-based

Project statementProject statement

Information access and communicationof pre-lingually deaf people

Open choice

No proprietarysolutions

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

Television accessTelevision access

• Subtitles currently increase significantly TV streams

• Those deaf from birth find it difficult to learn spoken and written English

• Signing is their natural language

• English law requires to sign 2% by 2001, and 5% by 2009

?

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

Television accessTelevision access

? A supporting MPEG-2 stream

Human signer + additional channel

An insert into existing picture

Television accessTelevision access

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

Face-to-face transactionsFace-to-face transactions

?Natural interactionNatural interaction

Deaf customerDeaf customer Counter clerkCounter clerk

Sign Language Speech

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

Multimedia and WWW ApplicationsMultimedia and WWW Applications

WWW pagesWWW pages

Text-to-signgenerator

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

LexiconSL Grammar

Low Bit-Rate Transmission

ServicesSpeechSpeech

Text

BAPs Files

DSs inMPEG-7 DL

PPaarrssiinngg

HamNoSysRepresentation

MPEG-DecoderMPEG-Decoder

BAPs/DS-BasedAvatar

Animation

HamNoSys-Based Avatar

Animation

TV SigningStandards

and Delivery

Interactive DeafSigning on the Web

Face-to-FaceAccess to Services

Synopsis of the Synopsis of the ViSiCAST ViSiCAST ProjectProject

Ges

ture

Notat

ion

MPEG-7 EncoderMPEG-7 Encoder

MPEG-4 EncoderMPEG-4 Encoder

ViSiCAST ViSiCAST GMLGML

Gesture Capture

3D Model-BasedAnalysis/Indexing

SpecificSensors

Signer

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

Independent Television

Commission

The ViSiCAST Consortium

Televirtual

University of East Anglia

The Post Office

Royal Institute for Deaf People

Instituutvoor Doven

Hamburg University

Institut für Rundfunktechnik

Institut National des Télécommunications

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

The ViSiCAST Consortium

Speech and text translation into Sign Language (Speech and text translation into Sign Language (UEAUEA)) Sign Language notation (Sign Language notation (UHUH) ) Avatar creation (Avatar creation (TVTV)) Broadcast technology (Broadcast technology (ITCITC, , IRTIRT)) Broadcast imaging and animation standards (Broadcast imaging and animation standards (INTINT)) Multimedia content creation (Multimedia content creation (IvDIvD))

Evaluation capabilities provided by the UK RNID

Face-to-Face transactions provided by the UK PO

Experts in:Experts in:

Françoise PRETEUX, Unité de Projet ARTEMIS - INT - Evry France

MPEG-4 compliant avatar definition & animation

MPEG-7 compliant sign language indexing

ARTEMIS ContributionsARTEMIS Contributions