Web video standards

1

Yossi CohenLecture at HTML-IL

Web & Mobile Video

Agenda Introduction (Flash)

HTML5 Video

WebRTC

DASH

Flash Video Vs HTML5 Video

“Flash has inferior video quality…”Apple Video Codec: H.264Flash Video Codec: H.264

Flash consumes battery Apple uses Hardware acceleratorsFlash uses HW accelerators but not on apple device -> Lots of battery

Engineering discussion (Facts not rumors)

Flash VideoFlash Video

Flash - > HTML Transition

8

HTML5 Video Tag

Embed a player into the browser containingFile Format Demuxer Audio decoderVideo Decoder

When a <Video> Tag is detectedMedia is passed to the playerSimple….Yet Fragmented

The Short version

HTML5 Video Tag

Embed a player into the browser containingFile Format Demuxer Audio decoderVideo Decoder

When a <Video> Tag is detectedMedia is passed to the playerSimple….Yet Fragmented

The Short version

11

HTML5 Video Tag

File Format Demuxer – Which file format?Avi? Ogg? MP4? WebM?

Audio decoder – Which Audio Codec?Ogg Vorbis, MP4 AAC, MP3?

Video DecoderTheora, H.264, VP8?

So which one to support?We need to support all!!!

The Fragmented version

12

13

Experience Adaptive HTTP-based streaming

http://www.iis.net/media/experiencesmoothstreaming

In this case MSS

14

AgendaWhat is DASH?The Road to DashDASH

15

DASH - Dynamic Adaptive Streaming over HTTP DASH is an adaptive bitrate streaming technology

where a multimedia file is partitioned into one or more segments and delivered to a client using HTTP.

MPD - media presentation description, describes segment information (timing, URL, media characteristics such as video resolution and bit rates).

Segments can contain any media data, however the specification provides specific guidance and formats for use with two types of containers: MPEG-4 file format MPEG-2 Transport Stream

16

DASH Scope

17

The Road to DASHDASH is convergence and super set of several:

File FormatsStreaming ApproachesSecurity and DRM approaches

18

Media Delivery Evolution

19

Streaming Protocols Convergence

20

DASH Supported FF & Functionality

File Formats Super-set

21

HTTP Streaming

DASHDASH is a superset of both HLS (Apple) and

MPEG-4 based HTTP streaming

HLS MSS

DASH

22

MPEG2 TS Main

DASH Profiles

MPEG2 TS Simple

MAIN ISO BMFF

Live On Demand (VoD)

23

24

WebRTC Today !http://techcrunch.com/2013/02/24/mozilla-att-and-ericsson-team-up-to-demo-seamless-web-to-mobile-webrtc-

integration/

25

WebRTC – VC for browsers

Audio / Speech Encoding / Decoding

Video Encoding / Decoding

Video RTP Packetization / Depacketization

Dynamic Jitter buffer

Lip-Sync

And more

What’s Inside

26

Peer Connection

A

PeerConnection – An Association between two peers Containing one or more RTP sessions Sent using one or more bi-directional RTP

flow.

MediaStream – An WebRTC API MediaStream A set of MediaStreamTracks Synchronized playback

MediaStreamTrack A Media Stream that over RTP will be

represented by a SSRC

WebRTC API

MS1 MS2 MS3

RTP Session

SS

RC

1

SS

RC

2

SS

RC

3

TR

AC

K

TR

AC

K

TR

AC

K

TR

AC

K

TR

AC

K

TR

AC

K

TR

AC

K

B

RTP Session

RTP Session RTP Session

ReferencesMore on

Thank you!

Video Expert

Lectures on Video / Android / VoIP

Android Native Developer

More About me:

Yossi CohenYossi Cohenyossicohen19@gmail.comhttp://www.mobilevideotech.com

+972-545-313092+972-545-313092