Top Banner
Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv [email protected]
43
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

Streaming technologies:

Under the hood

Egon Verharen Innovatie management

SURFnet [email protected]

Page 2: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

2

TERENA Networking Conference 2000

Contents

• Digital Video family– Similarities en Differences

• What is streaming and why streaming media?• Technology

– what do you need• formats, standards, server, clients, network

– demo• (forseable) Future• Lessons learned

Content Management

Page 3: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

3

TERENA Networking Conference 2000

Pieces of the puzzle• Why digital video in education

Collaborativetools

Conferencingtools

Multimediaarchives

live eventstreaming

webbased virtualclassroom

Page 4: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

4

TERENA Networking Conference 2000

Digital Video: Similarities and Differences

Video Conferencing

Video chatLike a telephone callTwo - WayCall up or Answertypical bitrates from56 kb/s - 1,5 mb/sVideo format (H.261, H.263,MPEG)transport protocol (RTP)fast network connectionQoS (min. delay, min. jitter,synchronisation

Video Broadcasting

Streaming/WebcastingLike watching TelevisionOne - WayTune In or enter URLtypical bitrates from28 kb/s - 8 mb/sVideo format (H.261, H.263,MPEG)transport protocol (RTP)fast network connectionQoS (jitter, synchronisation)

-Network video

Page 5: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

5

TERENA Networking Conference 2000

What & Why Streaming Media

• “Streaming” is buzz-word. – an adjective

• Many definitions/definotions– Push vs. Pull– Client-oriented vs. server-oriented– on-demand vs. live

• Streaming media: the ‘real-time’ playing of a video-, audio- and/or datastream on a machine from the moment the first bytes come in.

content

ITTelCo

Page 6: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

6

TERENA Networking Conference 2000

Streaming: live vs on-demand

archive realtime

unicast

multicast

VoD Event-driven

Event-driven

scheduled

Page 7: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

7

TERENA Networking Conference 2000

Why streaming? (download times)

Bandwidth transport time (650 MB)2400 bit/s 631 hrs (26 days and 7 hrs)

9600 bit/s 158 hrs (6 days and 14 hrs)

2,5 Mbit/s 34 min

10 Mbit/s 8 min and 40 sec

34 Mbit/s 2 min and 33 sec

155 Mbit/s 32 sec1 Gbit/s 5 sec

1 Gbit/s = 1.000 Mbit/s = 1.000.000 kbit/s = 1.000.000.000 bit/s

Page 8: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

8

TERENA Networking Conference 2000

Streaming media advantages

• data does not need to be downloaded;

• high bitrate make high (video)quality possible;

• you can jump ahead (or back) in stream (‘vcr principle’);

• you can broadcast/netcast live;

• suitable for tele-educatie,

–but also information delivery.

Page 9: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

9

TERENA Networking Conference 2000

Digitale Video QoS myth

• NO, you can start now !

• QoS for end-users = bigger picture, better audio.• QoS for network = delay, packet loss, jitter• Requirements differ per application:

– interactivity vs streaming, minimal delay/jitter ?• Quality is function of many parameters

– client, LAN, campus, access links to PoP, within PoP, natl & int.l. networks

“DV cannot be implemented without QoS technology (which is new, complex, expensive and over the horizon)”

Page 10: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

10

TERENA Networking Conference 2000

Quotes & Provocations by Dennis Glenn, NWU

• “Tape is dead”

• “Delivery is king”

• “Quality is not important”–quality of video–QoS

• “Exposure is everything” –Content is worth nothing if you don’t show it

Page 11: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

11

TERENA Networking Conference 2000

Analog Digital

CostsValue

Digital Content management: driving forces

LARGE archives

Everywhere and always access

Create once, distribute/use many

Save and secure for (re)use

Page 12: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

12

TERENA Networking Conference 2000

Developments in the content chain

Programmaker

Internet provider

Websiteowner

Internethost

Channel

Cable-operator Distributer

Telecomoperator

Author

Broadcastorganisation Publisher

Users/Viewer

Page 13: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

13

TERENA Networking Conference 2000

Merging of the chains

Contentmanager

Distribution media

A/V/D-material

End-users

Format conversionclassificationlogical ordering

Page 14: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

14

TERENA Networking Conference 2000

Video-over-IP value chain

$$$$

Content use

$$

Content deployment(content distribution/content delivery)

Media production

10110111011011

Content management

Encoding

Page 15: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

15

TERENA Networking Conference 2000

Workflow TV “broadcast” via internet

• “Dynamic” services example: DelayTV

NED1

Online Encoding

Batching

NOS ADatabaseA

5 min to 3 hrs

Staging

Spotting

Enhancing

InstallatieVideoserver

Online

disk2tape

Validatie

Mass Archive

Export

InstallatieDB/Webserver

30 hrs encoded video plus metadata each day!

By Ton van Mil, director NOB-interactive

Content management cycle

Page 16: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

16

TERENA Networking Conference 2000

disk2tape

Workflow TV “broadcast” via internet

• “Dynamic” services example: News

NED1

Online Encoding Installatie

Videoserver

InstallatieDB/Webserver

Online

disk2CD

Batching

Validatie

NOS ProgrammaDatabase

3 hrs

Staging

Spotting

Enhancing

Export

NOS Newsroom

NOB graphics

Mass Archive

Archief

By Ton van Mil, director NOB-interactive

Content management cycle

Page 17: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

17

TERENA Networking Conference 2000

VIP platform components

End user

Basicdeployment

AdvanceddeploymentContent

management

BasicContent production

AdvancedContent production

MetadataMPEG7

User metadata provision

Accounting server

Reversed content provision

Page 18: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

18

TERENA Networking Conference 2000

Streaming media service

• content creation–producers, editors, encoders

• content mgt–db mgt, META-DATA, indexing&searching

• content delivery–dynamic streaming (more than one bandwidth),

license control, synchr. Multimedia,–scalability (caching & replication)

• content viewing–softw based players, MPEG2 hw based players,

browser plugin and external helper apps.

Page 19: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

19

TERENA Networking Conference 2000

Technology

• standards, formats–still new codecs (e.g. MPEG4, IBMs LBR)

• streaming servers and clients• network

Page 20: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

20

TERENA Networking Conference 2000

Formats

• Aspects:– Bitrates (constant, variable)– Framesize– QoS

• Bandwidth (at end-user) • dynamic use: Real SureStream, simulcast

• Standards– ISO/IEC (int.l. org for standardization/int.l. electrotechnical commission)

• Moving Pictures Experts Group (ISO/IEC JTC1/SC29/WG11)• MPEG1,2,4,7

– ITU (int.l. telecommunication union)

• Series H (video), Series G (audio) (ITU-T SG16)

Page 21: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

21

TERENA Networking Conference 2000

Formats (cont.: MPEG)

• MPEG1 1,5 mb/s; VHS; part3=audio=MP3

• MPEG2 6-8 mb/s; digitale TV

• MPEG4 lower bitrate (better compr.); multimedia appl.layers (transparent info), content protection, QoS

• MPEG7 metadata model ‘on top of’ MPEG1/2/4; searching,filtering, processes

Page 22: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

22

TERENA Networking Conference 2000

Formats (cont.: Video en Audio)

• Video– ITU-T Series H - Audiovisual and multimedia systems

– H.261 H.263

– DV (Digital Video)

• Audio– MP3 = MPEG-1 audio layer 3

– Series G - Transmission systems and media, digital systems and networks

– G711, 722, 723.1, 726, 728, 729

Page 23: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

23

TERENA Networking Conference 2000

Protocols

• Streaming Media Protocols are protocols that are being used to support the real-time delivery of multimedia data

• TCP vs. UDP• HTTP

–progressive download• RTP

– real time protocol– UDP– payload

Page 24: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

24

TERENA Networking Conference 2000

Protocols (cont.: RTSP)

• RTSP– Real Time Streaming Protocol

• designed to be an open standard aims to provide an extensible framework to enable controlled delivery of real-time data, such as audio and video.

• Denk: videocontrole (play, pauze, stop, back, forward)

– http://www.ietf.org/rfc/rfc2326.txt

Page 25: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

25

TERENA Networking Conference 2000

Distribution

• Scenario’s– Broadcast vs. Groupcast vs. Personcast (Video-on-

demand)

• Technology– Unicast– Multicast

• cookbook

Page 26: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

26

TERENA Networking Conference 2000

What do you need

• Streaming server– on-demand/live; program manager; asset mgt– data pump– encoders (can be separate)

• Streaming client– Fast PC– decoder (up to MPEG1: software, MPEG2 prefer. hardware)– monitor

• Network connection– MPEG-1 (VHS-qual/CD): 2 Mbit/s guaranteed end-to-end

!– UDP/IP– multicast

• Connectivity end-user determintes format (bitrate)

Page 27: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

27

TERENA Networking Conference 2000

Streaming servers & Clients• Architectures

– Real

– Windows Media

– Quicktime

• “High-end”– Kasenna Mediabase, Oracle Videoserver

– (not yet) Broadcast servers !

• Others– FVC I-studio, IBM Videocharger, Cisco IP/TV, …

• Clients– almost all dedicated !

– Not (yet) interoperable

Page 28: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

28

TERENA Networking Conference 2000

Architectures

• RealMedia– codecs: RealVideo, RealAudio

– streaming formaat: RealVideo, RealAudio, met plugins (bijv. BitCasting) MPEG1, MP3

– SureStream: multiple bitrate encodings, bandwidth negotiation

– RealText, RealPix– SMIL (Synchronized Multimedia

Integration Language)– Standards: RTSP, RTP (RDP)

Page 29: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

29

TERENA Networking Conference 2000

Architectures (cont.)

• Apple Quicktime– supports many codecs

• streaming RTP payloads; Sorensen: VBR, CBR

– streaming format: Quicktime (hinted movies)

– plug-in architecture

– tracks & effects & interactivity

– standards: RTSP, RTP

Page 30: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

30

TERENA Networking Conference 2000

Architectures (cont.)

• Microsoft Windows Media Technologies

– NetShow, DirectShow/ActiveMovie, Video for Windows

– codecs: Windows Media Audio (WMA), MPEG-4 v3, ACELP (voice)

– streaming format: ASF (advanced streaming format)

– Multi-Datarate Encoding, Intelligent Transmission, Media rights

– standards: ??; WMM– office integration !! (e.g. streaming

powerpoint)– Most ‘compatible’ client (player)

Page 31: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

31

TERENA Networking Conference 2000

Codecs

• Codecs– MPEG1, MPEG2, MPEG4– MP3 = MPEG-1 audio layer 3 – Qualcomm PureVoice– Qdesign Music (stereo audio for dialup data rates en fast processor)– a2b (AAC, high fidelity, faster data rates, encryption)– liquid audio (arch., AAC, hifi, encryption, licensing, watermarking)– java based: emblaze, GTS– Sorensen (video, both dialup and cable modem data rates)– Vivo (VIV), Vxtreme (VXF), VDOnet

– http://www.terran.com/CodecCentral/

Page 32: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

32

TERENA Networking Conference 2000

Servers• Aspects

– storage– media pump– network (bandwidth)– on-demand vs. live– asset management !

• Examples (not complete !!)– Architectures

• Apple Quicktime, Real G2, Microsoft Windows Media– “high end” IP streamers (live/on-demand)

• Cisco IP/TV, IBM Videocharger, Kasenne Mediabase, Oracle Videoserver

– broadcast servers• Sony,Philips, SUN, ..., AXCENT INSERT

– frameworks• SUN & IBM Java Media Framework

Page 33: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

33

TERENA Networking Conference 2000

Servers (cont.: Examples)

– “high end”• FVC.COM I-Studio

• Cisco IP/TV– standards support

• IBM Videocharger– Digital Library; architectuer; interactivity

– standards support

• Kasenna (formerly SGI) Mediabase

• Ncube/Oracle MediaCUBE/Videoserver

• ...

• Frameworks– SUN & IBM Java media framework

– unified architecture for the playback, synchronization, capture, transmission and transcode of media -- including streaming audio and video -- across most major operating systems

Page 34: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

34

TERENA Networking Conference 2000

Clients

• Aspects– Buffer– Synchronisation– Multicast

• Examples– FVC.COM I-viewer

– Cisco IP/TV viewer

– IBM Videocharger client

– Apple Quicktime client

– Microsoft Windows Media Player

– Mbone tools

• SDR, Vic, Rat, …

Page 35: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

35

TERENA Networking Conference 2000

Figuur 1. Internet- en Video-verkeer op Snelnet

0

500

1000

1500

2000

2500

3000

3500

mrt-98 apr-98 mei-98 jun-98 jul-98 aug-98 sep-98 okt-98 nov-98 dec-98 jan-99 feb-99 mrt-99 apr-99

maand

Gb

yte/

maa

nd

SURFnet ---> Snelnet

NOB ---> Snelnet

SURFnet ---> Universiteit (gem)

What does streaming mean for your network ?

Page 36: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

36

TERENA Networking Conference 2000

All problems solved ?

• NO !• Open issues

–standaards• protocol implementations

– RTP, RTSP

– formats• MPEG program/system/transport streams• Metadata

– filesystems–network

• multicast• Quality of Service (QoS)

–content delivery

Page 37: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

37

TERENA Networking Conference 2000

Rights issues

• Rights organisations see “On demand” as the highest service level possible and therefore demand high compensation

• Rights organisations (in NL) are nog (yet) qualified for–TV rights–Film–News, Sport

• Models for slice payments are missing

• [YMMV]

Page 38: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

38

TERENA Networking Conference 2000

Lessons learned

• Audio and data often more important than Video–scenario dependent

• Image quality and refresh-rate still no problem with Internet users

–compare tv viewers–Connectivity end-user determines format (bitrate)

• Multicast–Commercialisation needed

• Content !–Refresh services

Page 39: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

39

TERENA Networking Conference 2000

Streaming services at your screen

• Do not underestimate technology involved– recording, encoding, network, storage, distribution

• Navigation for the end-user is important• Automate the workflow• Know in advance what to do with the material

afterwards–does it stay online, storage, re-distribute

• Don’t forget the rights !• Warning: it is expensive (still)

• Always subcontract large applications/services

Page 40: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

40

TERENA Networking Conference 2000

Future• Quality

– MPEG2 (both streaming & conferencing); DV format -> HDTV– QoS/Classes of Service

• Contents– 3D (e.g.. VRML, QuicktimeVR)– Metadata (MPEG7)

• Codecs– fractal; VBR

• Standards– RTP/RTSP, incl. Authenticatie; MPEG4 & MPEG7

• Efficiency– multicast: data too; content delivery (caching & replication)

• New applications– gnutella

• More streaming servers/clients– better access networks– media & asset management

Page 41: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

41

TERENA Networking Conference 2000

Come forward: TF-STREAM

• Who has experience ?– which tools, what have you done– plans for content creation, mgt, deployment

• Ideas: how can this (new) technology be put to work in projects

– at your institute– between institutes, organisations, NRNs, ...

• TF-STREAM– http://www.terena.nl/task-forces/tf-stream/– [email protected] ([email protected] subscribe)

Page 42: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

42

TERENA Networking Conference 2000

Demo streaming • SURFnet-TV– 1. FVC I-studio– 2. IBM Videocharger– 3. Cisco IP/TV– Real– Quicktime– WindowsMedia

• SNOB/Snelnet– SGI Mediabase– Compcore player

• FUNET-TV• US:

– ICAIR– ResearchChannel– Vanderbilt Univ.

Page 43: Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL.

43

TERENA Networking Conference 2000

URLs (background info)

• http://stream.surfnet.nl/• http://contact.surfnet.nl/• http://www.surfnet.nl/diensten/seminars/surfnet-sec/streaming/• http://skin.surfnet.nl/video-audio/index.html• http://www.surfnet.nl/innovatie/surfworks/showcase/• http://www.surfnet.nl/innovatie/surfworks/streaming/surfnettven.html

• http://www.surfnet-tv.nl/• http://dv.internet2.edu/• http://dv.internet2.edu/videospace/index.html

• http://www.researchchannel.com/ • http://www.vide.net/