Telework Telepresence for the Teleworkplace: Living-in versus visiting Cyberspace… Making Telepresence a Reality Gordon Bell ([email protected]) Bay.

TeleworkTelework

Telepresence for the Teleworkplace:

Living-in versus visiting Cyberspace…

Making Telepresence a Reality

Gordon Bell ([email protected])

Bay Area Research Center

Microsoft Researchhttp://www.research.microsoft.com/users/gbell

TeleworkTelework

TeleworkTelework

“Therapy from long distance debated”

- SJ Mercury 5 April 1998

http://www.sjmercury.com/breaking/headline1/056580.htm

Some tele-tales

Telepresence(comoho*)

Telelearning

Teleconferencing

Telemeetings

“presence”

Telepresentations

Telecollaboration

THE WORK:Telework &

work

Tele-xe.g. telemedicine,Distributed design

Administrivia

Intrastructure& support

CyberAllencoding everybit

Millibill: Tele-art, rides, performance,

interactivetelevision???

Paperlessness

audio eye-tracking gaze avatars

Multi-media Media Machine

*Commercial, mobile and home office

TeleworkTelework

email

Formal presentations sans video

...

Voice & Videomail

Video lectures & courses

ICQ, Internet phone & phone conf.

RealAudio & simple graphics

Workspace for remote program control

Whiteboard (groups)...

Videophone

Remote Rover (Robot Videophone)

person-computer

1:1 personal

comm

unication

2 site-site

conferencing;

n site conferencing

1:p broadcasts

computer

managem

ent

distributed groups

with >2, 10, <100,

view

(tro

ll) h

allw

ays

with

“info

rmal

” inte

ract

ion

1: 1

vid

eophone

calls

for

(pro

blem

solv

ing, a

uthorin

g)

inte

rvie

ws

clas

ses

form

al m

eetin

gs (le

cture

s,

confe

rence

s, s

tock

holder

mee

tings,

town h

alls

, etc

..)

Mechanisms(how)

Synchronous

Asynchronous

GroupInteraction

(Who)

Type

of

Work

(What

)

The Space of Telepresencefor work

Profession

TeleworkTelework

In a decade we can/will have:

More powerful personal computers– processing 10-100x– 4x resolution (2K x 2K); – Very large displays…

everywhere… to be ever anywhere telepresent– storage of one terabyte

Additional small e.g. palm, camera, watch “platforms” to hold a plethora of evolving software

adequate networking????– ubiquitous access = today’s fast LANs– Mobility according to standards and plans

One chip, networked platforms including light bulbs, cameras everywhere, etc.

more cyberization… the challenge… interfacing platforms and people.

TeleworkTelework

0

0.2

0.4

0.8

2.0

199719981999200020012002

Circuit data<9.6kbps

HSCSD57.6kbps

GPRS115kbps

EDGE384kbps

UMTS2Mbps

0.1

The evolution of wireless data standards

TeleworkTelework

2x 1GbE3x 1GbE

G8 Sonet

SC99NOCGigaPop

Juniper M40Cisco 12008

WestinGigaPop

Juniper M40

G2 SonetOC12 Sonet

Cisco 1800

G2 SonetOC12 Sonet

Juniper M40 NCSAUW

University of Washington Microsoft

Nortel NetworksNTON

SC99 @ Portland

1 Gbps5x 270 Mbps

HDTV streams= 1 Gbps

OC-48 = 2,488.32 Mbps = G2OC192 = 9,953.28 Mbps = G8

2x 1GbE3x 1GbE

G8 Sonet

SC99NOCGigaPop

Juniper M40Cisco 12008

WestinGigaPop

Juniper M40

G2 SonetOC12 Sonet

Cisco 1800

G2 SonetOC12 Sonet

Juniper M40 NCSAUW

University of Washington Microsoft

Nortel NetworksNTON

SC99 @ Portland

1 Gbps1 Gbps5x 270 Mbps

HDTV streams= 1 Gbps

OC-48 = 2,488.32 Mbps = G2OC192 = 9,953.28 Mbps = G8

TeleworkTelework

Living in Cyberspace: the environment for

telepresence / telework

TeleworkTelework

Telemeeting clone

TeleworkTelework

Telework clones… being in more than one place at the same time

TeleworkTelework

Intrastructure

TeleworkTelework

SOHO (small office, home office)network computing environment

NT Server for: comm/network, POTS/IP

gateway, file, print, compute

IP Dial tone (Internet, phone, videophone) >1.5 Mbps

Phone

POTS (legacy services)

*NC, NetPC, Xterm, etc.

...

LAN

PC NC*PC...

PhonePhone

TeleworkTelework

Libretto, .5mm

PCS; Pilot

Libretto PS, Ricoh Camera; Swiss Army Knife

Compass; altimeter

Not shown: ECG; GPS;

TeleworkTelework

Audio, pix, T, P, ECG, location, physiological parameters…1 GB

TeleworkTelework

Telepresentations: The 2nd killer app?

TeleworkTelework

Telepresentations “Being There (e.g. meeting, lecture, confererene) Without Really Being There (or Then)”

Presenter or audience need not be physically present Reach a wider audience

“I have a schedule conflict.” Anybody with a web connection can participate

Reduce costs No need to travel to attend or participate in a presentation

Education & training, corporate communication

TeleworkTelework

TeleworkTelework

TelepresentationElements

Slides Audio Video Script,

text comments, hyperlinks,etc.

TeleworkTelework

TeleworkTelework

Telepresentations will be a well-defined app by 2001.

ACM97 was the first telepresented conference with Mbone multicast & servers that host the conference cf. http://www.research.microsoft.com/acm97

Bet: More people will view the conference from Cyberspace than that attended it.

Big question: will telepresentation technology AKA tele-learning affect learning and education?

TeleworkTelework

Telecollaboration… The next “killer tele-app”??

Or just a tremendous challenge

interacting to achieve a common objective … basically, its communications enabling or disabling people

TeleworkTelework

Perspective

Don’t believe in “collaboration” as much as just plain communication.

The next killer app is tele-meetings AKA “videoconferencing”

Interested in desktop 1:1 up to 1:6 (larger numbers turns into presentations with floor control)

TeleworkTelework

““

””

By April 1, 2001 By April 1, 2001 videophones will ship in videophones will ship in 50% of the PCs 50% of the PCs and be in use.and be in use.

Gordon Bell vs Jim Gray1996 (one paper,

loser gets fed)

TeleworkTelework

Conference Rooms with Teleconferencing

TeleworkTelework

TeleworkTelework

Telework: It takes screens, sound, and bandwidth, stupid

http://research.microsoft.com/barc/GBell/http://research.microsoft.com/barc/GBell/

TeleworkTelework

Limits of Computer Supported Collaborative Work -- CSCW

We don’t understand collaboration We do it for limited domains e.g. chip design, some

software, 777s if task is partitionable “One person has the mouse” problem Camera is important NOT for communication,

but and to keep & force (hold) attention plus communicating a few cues (did they “get it”),

Parallel processing & single threading of tasks…a better model of the problem

Limited task parallelism e.g. presentations Brook’s Law matters!

TeleworkTelework

How to Fail at Videoconferencing

Lack of ubiquity: it must obey Metcalfe’s Law Call set up: hard, time-consuming, requires training Small screens, lack of spatiality, destroy visual cues No gaze awareness, limit screen area; only

2-D figures or avatars Audio: high latency and poor quality Fail to overcome the adequacy of the phone:

ubiquitous, no manuals or training, low latency, ok audio.

The targets: audio quality, 3-D in every sense, and gaze awareness

TeleworkTelework

Four steps to video-telephony enabling telemeetings

Very low cost IP telephony becomes ubiquitous

Evolve audio to provide spatial awareness aka stereo, quad, etc.

Make recording easy to do that will enable meeting persistence and minutes

Add multi-party

TeleworkTelework

Gaze-corrected Videoconferencing

Jim GemmellMicrosoft Bay Area Research Center

TeleworkTelework

Videoconferencing: not looking into the camera

TeleworkTelework

Not looking at camera: never eye contact

TeleworkTelework

Looking into the camera: always eye-contact

TeleworkTelework

More eye contact gets you:

More job offers from interviews More help when you ask for it More powers of pursuasion Make you seem more: friendly, self-confident,

natural, mature, sincere

TeleworkTelework

Majic

TeleworkTelework

½ Silvered-mirror

TeleworkTelework

TeleworkTelework

Conclusion

Gaze awareness is important to video-conferencing

Software-only technique Vision: more work to make it robust, faster Explore use of space with multi-party

conferencing Great audio

TeleworkTelework

Attending Several Simultaneous Meetings

TeleworkTelework

But does anyone want telework?

TeleworkTelework

A People Model: Who wants to telework?

Spock

formal(in writing)

Self-control

informal(verbal)

Sally Field

Souter Evangelism Swaggert

Analyticals.. being right, detailed

analretentives

Drivers…results oriented

megalomaniacs

Amiables…consensusbuilders

spinelesswimps

Expressives...want recognition, need contact

psychotics

Managing Interpersonal Relationships(MIR)

2D Model

--------------chat----------------

emailbroadcast- push

Intensity

TeleworkTelework

The End

TeleworkTelework

Outline Telepresence and Telework

– Teleworking environment– Overhead: Support & Administrivia– The “work”

Telepresence dimensions Telepresentations: the 2nd killer app! Telecollaboration: killer app to come? “The work” Is it for everyone?

TeleworkTelework

What is Telepresence?

Injecting your presence

Being immersed in the tele-space

Being there without really being there or then

into tele-space

TeleworkTelework

Telepresence Components

Video Audio Slides, images, web pages Text chat Shared applications Whiteboards Voting, question taking

TeleworkTelework

Time-shifting beats Space-shifting

Gets around scheduling problems– World’s time zones!

Time-shifting requires STORAGE !!!

Lets me pause, rewind, browse, play at faster speeds

Immortality

TeleworkTelework

Today’s killer app : Telepresentations

Presenter and/or audience telepresent

Practical and low cost now

One-way mostly – Not meeting or

collaboration settings– forget the network

latencies and messy social issues

Slides and audio get you 99% and are bandwidth cheap

TeleworkTelework

Telework = (cyber) work + telepresence … being there while being here, and at some other time.

Goal: teleoffice/teleworkplace = workplace office The teleworkplace is ideally just a “remote office” W/O

– Communication, computer, and network support!– Team interactions for work! CSCW is a “rat hole”!– Interaction at coffee, meeting rooms, … in offices– Administrative support for phones, information (especially

paper) management, keeping track of Always on & always connected to intranet/intranet ...! Telecommunication aka phone & email -- the first, “killer apps” Telepresentations -- the 2nd “killer app” Tele-collaboration -- the “killer app” to come

TeleworkTelework

Animatron...

TeleworkTelework

Telework & communications dimensions

•Who and how many are interacting?

•What is the nature of the interaction?

•Which professions?

•Mechanisms: How are they interacting?

TeleworkTelework

Telepresence: who and whatWHO

1:1 person-person communication

n:m 2-site-site video conference

1:n-site broadcasting or Mbone narrowcasting

distributed group. >2 - 5 - 10 - 100

----

person-computer

computer management (no persons)

What

view (troll) hallways, “seeking interaction”

1:1 interview, status report, etc.

1-6 videophone calls for (design, problem solving, authoring)

hold staff meetings with 1 or more members distributed

attend classes

formal meetings (lectures, conferences, stockholder meetings, town halls, etc..)

TeleworkTelework

Synchronous

Internet phone & phone conferencing

Internet Videophone

RealAudio & Overhead graphics

Shared applications

Whiteboards

CU SeeMe on POTS… IP Videophone

Mbone Video conferencing

Room Video conferencing

Remote Rover (Robot Videophone)

Asynchronous

voice mail…STT

email ... TTS

Home pages replace bulletin boards, file transport, and document distribution

Schedule & “Notes”

Voice and Video “email”

Telepresentations (meetings, presentations, & courses)

Telepresence Mechanisms (for Work)

TeleworkTelework

Voice and Visual Alternatives (in order of increasing B/W)

Voice* TTS (synthetic or

speaker driven) 4 Kb-64 Kb codec of

real voice Stereo of real voice Stereo with sound

source identification Projection into arbitrary

virtual world environment

*variable speed

Visual AKA Video* Text avatar (simple… photo) Avatar with voice sync Avatar of real person Video codec based projection

– “Postage stamp” … POTS– “Mailing label” … ISDN or 2x POTS– Compressed VHS (200 Kbps)– MPEG 2 (1- 4 Mbps)

Speaker tracking, 1-n cameras VR image of a large space 3d images “holodeck” Animatron e.g. Barney Mobile Animatron*Meeting in real or virtual world

TeleworkTelework

Alternative Computing Futures

Photos courtesy of Microsoft Cinemania

• Forbidden Planet (1956)

• Metropolis (1926)

• 2001 (1968)

TeleworkTelework

Problems: socio vs technical

Isolation & loneliness– need for communication/stimulation– chance meetings -- serendipity of ideas– loss of group/teamwork skills– danger of becoming “terminal”

interruptions & focus lack of support staff to help, answer ?s supervision and ability to have 1:1 unclear that many people want it…

they simply need the contact with people

TeleworkTelework

Good News

Bandwidth will come Audio and video compression is

improving to live within POTS limit Videophones will be built-into all PCs

within 5 years at 0 cost Telepresentations are here for “live”

and “on demand” useThis will change education!

Telecollaboration tools work for simple apps… and will improve

TeleworkTelework

Telepresence: 5, 10, … 50 year goals

hold a meeting of type, m

university or technical course

interview, staff meeting, co-ordination, board meeting, annual meeting, “town hall”,

with p, distributed persons

with as much interactivity, I, and feeling, f

such that people prefer being telepresent; and

meetings are provably more productive

meetings will evolve to be asynchronous versus traditional synchronous enabling full time-shifting so that people can be in two places at the same time

TeleworkTelework

The End