OptIPuter Teleconferencing Next Steps Dan Sandin Jan 2007

University of Illinois at Chicago

OptIPuter

Teleconferencing Next Steps

Dan Sandin

Jan 2007

University of Illinois at Chicago

An Embarrassment of Riches

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms?– Audio interleaved

• Y U V HD .8Gb < 100ms?– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

University of Illinois at Chicago

Marketing Categories

• Broadcast– HDSDI– Highest quality, most expensive, low Q/$– Highly standardized, inflexible

• Prosumer– HDV, DVCPRO– Medium to high quality best Q/$– Quite standardized, inflexible

• Industrial– Y U V, Varrier Stereo, GigE– Large range of Q and $– Quite standardized, very flexible

University of Illinois at Chicago

Organizations

• HDV 25Mb 1 sec– everybody

• DVCPRO HD 100Mb 300ms– qvidium calit2

• HDSDI 1.5Gb < 200ms– research channel UltraGrid Calit2

• Y U V HD .8Gb < 200ms– EVL UltraGrid

• Varrier Stereo Video 225Mb < 100ms– EVL Calit2

• GiGE camera .8Gb <100ms– SARA EVL Calit2

University of Illinois at Chicago

Bandwidth

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms– Audio interleaved

• Y U V HD .8Gb < 200ms– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

University of Illinois at Chicago

Audio

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms– Audio interleaved

• Y U V HD .8Gb < 200ms– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

University of Illinois at Chicago

Latency One-Way Transmission Times

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms– Audio interleaved

• Y U V HD .8Gb < 200ms– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

University of Illinois at Chicago

Latency Why So Late

• Every frame takes 33 ms• Every piece of hardware and every software module

wants a 2 or 3 frame buffer• For us, it is almost never the network

– We need to change that so it is the network

University of Illinois at Chicago

Compression and Resolution or Quality

• HDV 25Mb 1 sec– MPEG; long GOP, low Q

• DVCPRO HD 100Mb 300ms– JPEG-like; better Q

• HDSDI 1.5Gb < 200ms– None; best Q largely depends on camera

• Y U V HD .8Gb < 200ms– None; best Q, largely depends on camera

• Varrier Stereo Video 225Mb < 100ms– None; SD but in stereo

• GigE camera .8Gb <100ms– None; camera has Q problems

University of Illinois at Chicago

Compression and Resolution or Quality

• Uncompressed talking heads HD at 1.5GB is a ridiculous waste of resources– Except for broadcast production– Except for science data– Except for here? or maybe a TV studio, you have

never seen uncompressed HD

• Compression can be done in less than a frame– NTT 4K Jpeg 2000 <500Mb <100ms– spectacular quality !

University of Illinois at Chicago

SAGE and Teleconferencing

• SAGE Visual casting supports YUV and RGB video• Calit2 and EVL will make a DVCPRO HD to SAGE

converter– Note: need to buy xmit box and receive software from Qvidum

• UltraGrid and Research Channel have expressed interest in doing conversion routines to SAGE Visual Casting

University of Illinois at Chicago

SAGE and Teleconferencing

• SAGE Visual casting supports YUV and RGB video

University of Illinois at Chicago

SAGE and TeleconferencingSupport of several systems

• Except for SAGE Visual Casting, a receiver box for each source will be used– Potentially support a large number of video

compression standards

University of Illinois at Chicago

Audio Afterthoughts

• Echo cancellation can be accomplished with AccuMic PC– Limitations …

University of Illinois at Chicago

Audio Afterthoughts

• SAGE has to develop an audio standard for visual casting

University of Illinois at Chicago

Persistent setupfirst pass

• DVCPRO HD using Qvidium boxes

• CALIT2 UCSD, Calit2 UCI, EVL

• AccuMic Echo calculation

• Mono simple PCM audio

University of Illinois at Chicago

Near Future

• HDMI camera and capture card

• Multi-channel audio with each SAGE window

• Audio localization with each window

University of Illinois at Chicago

Teleconferencing

• Discussion