1 MASH: A Multimedia Architecture that Scales Across Heterogeneous Environments Steven McCanne, Randy H. Katz, Eric Brewer Computer Science Division University.

1

MASH: A Multimedia Architecture that Scales Across Heterogeneous Environments

Steven McCanne, Randy H. Katz, Eric Brewer

Computer Science DivisionUniversity of California, Berkeley

Berkeley, CA 94720-1776© 1997-98

ProxyProxy

ProxyVirtual Collaborative Environment

Internet Multicast Backbone

Virtual Room Environment Desktop Environment Virtual Room Environment

Real-Time Data and Control Transcoding

Transmission format chosen by network characteristics and receiver capabilities

2

Minutes

• Student volunteers to scribe notes?

3

Outline

• Introductions and Agenda

• Brief Overview & Direction of Project

• Accomplishments & Schedule

• Internet Systems Research Group

4

Outline

• Introductions and Agenda

• Brief Overview & Direction of Project

• Accomplishments & Schedule

• Internet Systems Research Group

5

Retreat Goals &Technology Transfer

UC Berkeley Project Team Industrial CollaboratorsGovernment Sponsors

Friends

PeopleProject Status

Work in ProgressPrototype Technology

Early Access to Technology

Early Access to TechnologyPromising Directions

Reality CheckFeedback

6

Ongoing Collaborations

• Semantic Multicast

Hughes & UCLA

• MediaNet

Cornell

7

MASH Design Team

• Core MASH Team

Yatin Chawathe (SRM Proxy & Archive)

Gene Cheung (Codec Synthesis & Optimization)

Adam Costello (Randomcast-based RM)

Todd Hodes (Service Location & Control)

Ketan Mayer-Patel (Scalable Effects Processing)

Matt Podolsky (Internet Audio & FEC)

8

MASH Design Team (cont’d)

• Core MASH Team (cont’d)

Suchitra Raman (SRM, data consistency models)

Angie Schuett (Archive & Distributed Recorders)

Andrew Swan (System Issues for Layered Media)

Tina Wong (Quasi-reliable Multicast, Infocast)

9

MASH Design Team (cont’d)

• Departures

Elan Amir (MeGA & SCUBA)

– FastForward Networks

Cindy Romer (Toolkit Components Integration)

– Netscape

Teck-Lee Tung (MediaBoard & Active Objects)

– Singapore Government

Kristin Wright (WebCast & SRM WebCache)

– Salt Lake-based E-commerce Startup

10

MASH Design Team (cont’d)

• Technical Support

Brian Shiratsuki (Room Deployment, Network

Maintenance, Sys Admin)

Keith Sklower (Sys Programming, Network

Maintenance)

• Administrative Support

Terry Lessard-Smith

Bob Miller

11

Project Collaborators

• James Landay (CSCW Course)

• Martin Vetterli (FEC for Internet Audio)

• Brian Smith (MediaNet, Cornell)

• Peter Kirstein (UCL)

• Deborah Estrin (VINT, USC/ISI)

• Bill Fenner (Xerox PARC)

• Mark Handley (VINT, USC/ISI)

• Kevin Fall (LBNL)

• Sally Floyd (LBNL)

12

Project Collaborations (cont’d)

• Son Dao (Semantic Multicast, Hughes)

• Richard Muntz (Semantic Multicast, UCLA)

• Lixia Zhang (Semantic Multicast, UCLA)

13

Sponsors and Guests

• DARPA IC&V Program

Kevin Mills, DARPA PM

Bob Ollerton, SPAWAR

• Industrial SponsorsFuji Xerox Palo Alto LabsIBMIntelMicrosoftXerox PARC

14

Sponsors and Guests (cont’d)

• Friends

Lance Berc (Compaq/Digital SRC)

Steve Casner (Cisco)

Steve Deering (Cisco)

Anoop Gupta (Microsoft Research)

Christian Maciocco (Intel)

Jean Bolot (INRIA)

Hamid Ahmadi (AT&T Research)

15

Retreat Schedule• Monday, July 13

1200-1300 Lunch at Granlibakken

1300-1330 Introductory Session

– Introductions

– Brief Overview & Direction, Steven McCanne

1330-1600 Talks I: Reliable Multicast

– Brief word on SRMv2, Steven McCanne

– RMX: Proxy-based Reliable Multicast, Yatin Chawathe

– Periodic Information Dissemination Using Quasi-reliable Multicast,

Tina Wong

– Search Party and Rumor Mill: Status and Future Work, Adam

Costello

16

Retreat Schedule

• Monday, July 13 (cont’d)

1530-1800 Break (tennis, hiking, check-in)

1800-1930 Dinner

1930-2100 Demos, Posters, & Refreshments

(In the Lake Room)

– The MBone Playback and Transcoding Service: Soft-state

Archive as an Active Service, Angie Schuett

– The Dali Convergence: Using Dali within MASH for Scalable

Effects Processing across a Cluster, Ketan Mayer-Patel

17

Retreat Schedule

1930-2100 Demos (cont’d)

– Beyond Layered Media Formats: Systems Issues in realizing

RLM and Layered Codecs in RTP/LWS, Andrew Swan

– The SRMv2 Toolkit: Design, Status, and Direction,

Suchitra Raman

– Scaling Reliable Multicast with a Randomized Forwarding

Service and Understanding the Search Party and Rumor Mill

Variants with Network Visualization, Adam Costello

– Control from Afar, Todd Hodes

– RMX: Proxy-based Scalable Reliable Multicast,

Yatin Chawathe

18

Retreat Schedule

1930-2100 Demos (cont’d)

– PalmVideo: MeGafied Video on a Pilot PDA,

Taher Taveliwala, Michael Kaminsky, Eric Mao,

Benjamin Ling, Michael Chew, Andrew C. Huang, and

Kevin Yen (MBA project advisor)

19

Retreat Schedule

• Tuesday, July 14

0730 - 0830 Breakfast

0830 - 1000 Talks II: A Taste of Theory

– Inference of Multicast Routing Trees and Bottleneck

Bandwidths from End-to-end Measurements,

Sylvia Ratnaswamy

– Results from a Simple Model for Delay-constrained

Progressive Internet Audio, Matt Podolsky

– Optimal Lookup Table Design under memory constraints for IP

address lookup and Huffman decoding, Gene Cheung

20

Retreat Schedule

• Tuesday, July 14 (cont’d)

1030 - 1230 Talks III: Systems and Protocols

– Media archival as a soft-state active service, Angie Schuett

– Layered Media and the Session Directory Service,

Andrew Swan

– Scalable Video Effects Processing, Ketan Mayer-Patel

– WebTP: A Receiver-driven, ALF-based Transport Framework

for the Web, Rajarshi Gupta

21

Retreat Schedule

• Tuesday, July 14 (cont’d)

1230 - 1330 Lunch

1330 - Hike to Cascade Falls Rafting on the Truckee

(catch the corresponding bus)

1800 - 1930 Dinner

22

Retreat Schedule

• Tuesday, July 14 (cont’d)

1930 - 2100 Guest Presentations

– An Evaluation Study of MASH, Andy Greenberg, NIMA

– HIPNET Requirements for Reliable Multicast, Bob Ollerton,

SPAWAR

– Enhancing Presence with 3D Audio, Jean Bolot, INRIA

– Ubiquitous Networked PDAs, James Landay, UCB

2100 - 2300 Refreshments & Group Discussion

– six month planning meeting among students

23

Retreat Schedule

• Wednesday, July 15

0730 - 0830 Breakfast

0830 - 1000 Six Month Planning, Steven McCanne

1000 - 1030 Break & Check-out

1030 - 1200 Guest Feedback Session, McCanne

1200 - 1300 Lunch

1300 - Depart Granlibakken

24

Outline

• Introductions and Agenda

• Brief Overview & Direction of Project

• Accomplishments & Schedule

• Internet Systems Research Group

25

The Challenge: Heterogeneous Collaboration Environments

326 Soda

UC-Net /UC-MBone

CAIRN

UCLA

UCBPARC

LBL

MIT

DARPA

NIMA

ISDN

Internet(MBone)

UCL

T1OC-3c

POTS

ISDN

Pen-Based PCs

• Collaboration

in the face of heterogeneity

at large scale

26

Approach

• Build on MBone Tools

and LWS

• Create core mash software system

reusable, scripted components

Web-based “platform”

27

Key Tasks

• On top of mash platform...

Flexible coordination framework

– Coordination Bus

– SCUBA

– Room device controllers

– XML-based UIs for control

– Soft-state gateways

28

Key Tasks (cont’d)

• On top of mash platform...

Active Services

– MeGa Transcoding Service

– Soft-state Archive

– Scalable Effects Processing

» Cornell’s Dali integegration

– RMX Proxy Deployment

Virtual Room Testbed

29

Key Tasks (cont’d)

• Reliable multicast

ALF-based toolkit for SRMv2

Naming for RM

Scalability analysis (SIGMETRICS 98)

Quasi-reliable Info Dissemination

Novel approaches based on Randomcast

– Rumor Mill & Search Party

30

Key Tasks (cont’d)

• Novel media enhancements

Soft-ARQ for Internet audio

Systems issues for layered media

Clustering algorithms for end-to-end multicast

– I.e., tree inference

Codec synthesis & optimization

– side effect: solve fast route lookup problem

31

MASH Colab

Remoteparticipants

LocalParticipants

Details: James LandayDetails: James Landay(this afternoon)(this afternoon)

32

Outline

• Introductions and Agenda

• Brief Overview & Direction of Project

• Accomplishments & Schedule

• Internet Systems Research Group

34

Key Achievements

• Fall 1997

major software and tools components

• Spring 1998

algorithmic work

publications

enhancements to existing software components

35

33

Achievements—Dec 1997

•• MASH ToolkitMASH Toolkit

Design and implementation of flexible, new

programming model and “mash platform”

Vic and vat retrofitted into new toolkit

Number of new tools written against toolkit

MPlug: MASH Plug-in for Netscape

35

Achievements—Dec 1997

•• Mashbrowser Mashbrowser (Suchitra

Raman & Angie Schuett)

ARMS server

client RTSP object

re-usuable ArchiveSystem

OTcl object

Browser platform --- plug

mashlets into viewing area

35

Achievements—Dec 1997

•• Collaborator Collaborator (Cindy Romer)

integrated user-interface

based on CSCW course feedback

35

Achievements—Dec 1997

•• MashCastMashCast (Kristin Wright)

Efficient multicast of web

pages

Novel decomposition

– Casting Director

– WebCache

36

36

Achievements—Dec 1997

•• MediaBoard MediaBoard (Teck-Lee Tung)

Existence proof for ALF/SRM framework

Capabilities

– Active objects

– Extensible data types

– Variety of new formats

(e.g., GIFs)

– Rate control

– Re-play

MediaBoard/Pilot Proxy36

Achievements—Dec 1997

•• MPlugMPlug (Yatin Chawathe)

Reaching real users

Critical vehicle for realizing

“mash platform”

Embed any mash applet in a

browser

Runs under

– Windows or Unix

– Netscape or IE

36

Achievements—Dec 1997

•• MeGa/SCUBA MeGa/SCUBA (Elan Amir)(Elan Amir)

Design and evaluation of SCUBA & MeGa

Robust implementation in MASH toolkit

Integration with directory service

Regular use in CSCW classroom

Seamless bridge into MBone

ISDN

MeGa326 Soda(back porch)

36

Achievements—Dec 1997

•• nsdr nsdr (Andrew Swan)

Flexible session directory tool

Easy config of multiple media

apps

Integrated with MeGa

Research vehicle for

– layered session advertisement

– split addr allocation arch (e.g.,

via DHCP)

37

Achievements Spring 1998

• Major progress on publications

Four papers in ACM MM98!

– including Best Student Paper (Swan)

INFOCOMM-98

SIGCOMM-98

NOSSDAV-98

SIGMETRICS-98

Half dozen or so more in the pipeline...

38

Achievements Spring 1998

• Algorithmic work

clustering algorithms

consistency issues in RM

table design for lookup algorithms

• Software

refined active services (MeGa, archive)

refined component APIs

release snapshots

39

Project Plan

Aug 96 Aug 97 Aug 98 Aug 99

Develop local tool coordarch, API, and GUI

Develop proxy mgr, wide-area “coherent” objects

Active object extensionsto MBone tools

Scalable reliable multicast“middleware”: C++ library

RTP A/V storage repr,Server control protocol,Recording tools and formats

Design and implement 1stcollaboration room

Develop global coord archpubl floor cntrl spec

Develop scalable R/T proxyExploit user focus

Prototype network animatorbased on SRM toolkit

tk/java rendering widget,deployment and feedback

SRM archive tool, sessionrecorder, playback tool;Integrate with Digital Libr

Deploy second room andperform experiments

Experimentation andRefinement of Coordinationand Proxy architectures,IETF standardization;

Extensive interoperability testing;

Demonstration of ease ofextension thru objectarchitecture

Deploy scaled archive &annotation architecture;Integrate feature extractors

Deploy 3rd room andCHI evaluation

Coord-ination

Proxy

ActiveObjects

Archive

Testbed

40

Looking Forward

• Next six months…

specifications and documentations

evaluation

disseminate software

… more on Wed morning

41

Outline

• Introductions and Agenda

• Brief Overview & Direction of Project

• Accomplishments & Schedule

• Internet Systems Research Group

42

Internet Systems Research Group (ISRG)

• Cooperative effort in network/systems

research in UCB EECSEric Brewer

David Culler

Anthony Joseph

Randy Katz

Steven McCanne

43

ISRG Mission

• Basic research to “make the Internet work”

Unify on-going and future research projects

Facilitate technology transfer and standardization

Work closely with industrial partners in an open

laboratory environment Cooperative effort in

network/systems research in UCB EECS

Cultivate ties with external network researchers

(LBL, PARC, USC/ISI, … others?)

44

Project Synergies

BARWANWireless Overlay Networks

Scalable Proxies

MASHCollaboration Applications

Active Services

RTPGatewayService Discovery

vic, vat,wb

TranSendTACC Model

Wireless Access

MASH ToolkitActive Services

Model

NOW/MillenniumComputing Platform

NINJAScalable, Secure Services

Computation in the Network“Smart Spaces” as an app

Event-ResponseProgrammable Access

45

NetworkInfrastructure

GSM BTS

Millennium Cluster

Millennium Cluster

WLANPager

IBMWorkPad

CF788

MC-16

MotorolaPagewriter 2000

Text

Speech

Image/OCR

306 Soda

326 Soda “Colab”

405 Soda

Ericsson

Smart SpacesPersonal Information Management

Fax

Experimental Testbed

46

Retreat Schedule• Monday, July 13

1200-1300 Lunch at Granlibakken

1300-1330 Introductory Session

– Introductions

– Brief Overview & Direction, Steven McCanne

1330-1600 Talks I: Reliable Multicast

– Brief word on SRMv2, Steven McCanne

– RMX: Proxy-based Reliable Multicast, Yatin Chawathe

– Periodic Information Dissemination Using Quasi-reliable Multicast,

Tina Wong

– Search Party and Rumor Mill: Status and Future Work, Adam

Costello

47

SRMv2

• Key mash deliverable

many important external applications

• Naming component design

MM98 paper on “SNAP” (Raman)

• Low-level toolkit API in place

stand-alone C API (independent of mash)

(Raman)

48

SRMv2 (cont’d)

• Need to

exercise in new apps (Tina, Ketan)

write down more formal protocol specs

document API

• Future work

refine the spectrum of reliability

49

Receiver Reliability

• Wb

announce/listen page state

triggers data repair requests

• SNAP

announce/listen name state (I.e., meta-data)

triggers name state repairs

in turn, triggers data repairs

50

Hybrid Reliability

• To scale SNAP

we summarize meta-data with “signatures”

I.e., meta-meta-data (see Raman’s paper)

• So we have an optimization problem

fixed bandwidth

how to divide among

– announce/listen of data, meta-data, meta-meta-data and

so forth…

– received-driven SRM repairs