1 Yossi Cohen Lecture at HTML-IL Web & Mobile Video
Jan 15, 2015
1
Yossi CohenLecture at HTML-IL
Web & Mobile Video
Agenda Introduction (Flash)
HTML5 Video
WebRTC
DASH
Flash Video Vs HTML5 Video
“Flash has inferior video quality…”Apple Video Codec: H.264Flash Video Codec: H.264
Flash consumes battery Apple uses Hardware acceleratorsFlash uses HW accelerators but not on apple device -> Lots of battery
Engineering discussion (Facts not rumors)
Flash VideoFlash Video
Flash - > HTML Transition
8
HTML5 Video Tag
Embed a player into the browser containingFile Format Demuxer Audio decoderVideo Decoder
When a <Video> Tag is detectedMedia is passed to the playerSimple….Yet Fragmented
The Short version
HTML5 Video Tag
Embed a player into the browser containingFile Format Demuxer Audio decoderVideo Decoder
When a <Video> Tag is detectedMedia is passed to the playerSimple….Yet Fragmented
The Short version
11
HTML5 Video Tag
File Format Demuxer – Which file format?Avi? Ogg? MP4? WebM?
Audio decoder – Which Audio Codec?Ogg Vorbis, MP4 AAC, MP3?
Video DecoderTheora, H.264, VP8?
So which one to support?We need to support all!!!
The Fragmented version
12
13
Experience Adaptive HTTP-based streaming
http://www.iis.net/media/experiencesmoothstreaming
In this case MSS
14
AgendaWhat is DASH?The Road to DashDASH
15
DASH - Dynamic Adaptive Streaming over HTTP DASH is an adaptive bitrate streaming technology
where a multimedia file is partitioned into one or more segments and delivered to a client using HTTP.
MPD - media presentation description, describes segment information (timing, URL, media characteristics such as video resolution and bit rates).
Segments can contain any media data, however the specification provides specific guidance and formats for use with two types of containers: MPEG-4 file format MPEG-2 Transport Stream
16
DASH Scope
17
The Road to DASHDASH is convergence and super set of several:
File FormatsStreaming ApproachesSecurity and DRM approaches
18
Media Delivery Evolution
19
Streaming Protocols Convergence
20
DASH Supported FF & Functionality
File Formats Super-set
21
HTTP Streaming
DASHDASH is a superset of both HLS (Apple) and
MPEG-4 based HTTP streaming
HLS MSS
DASH
22
MPEG2 TS Main
DASH Profiles
MPEG2 TS Simple
MAIN ISO BMFF
Live On Demand (VoD)
23
24
WebRTC Today !http://techcrunch.com/2013/02/24/mozilla-att-and-ericsson-team-up-to-demo-seamless-web-to-mobile-webrtc-
integration/
25
WebRTC – VC for browsers
Audio / Speech Encoding / Decoding
Video Encoding / Decoding
Video RTP Packetization / Depacketization
Dynamic Jitter buffer
Lip-Sync
And more
What’s Inside
26
Peer Connection
A
PeerConnection – An Association between two peers Containing one or more RTP sessions Sent using one or more bi-directional RTP
flow.
MediaStream – An WebRTC API MediaStream A set of MediaStreamTracks Synchronized playback
MediaStreamTrack A Media Stream that over RTP will be
represented by a SSRC
WebRTC API
MS1 MS2 MS3
RTP Session
SS
RC
1
SS
RC
2
SS
RC
3
TR
AC
K
TR
AC
K
TR
AC
K
TR
AC
K
TR
AC
K
TR
AC
K
TR
AC
K
B
RTP Session
RTP Session RTP Session
ReferencesMore on
Thank you!
Video Expert
Lectures on Video / Android / VoIP
Android Native Developer
More About me:
Yossi CohenYossi [email protected]://www.mobilevideotech.com
+972-545-313092+972-545-313092