Dynamics of Video

Today and tomorrow of visual communications, building on 20 years of technology breakthroughs

October 8 – 10

Porto, Portugal

International Multimedia Telecommunications Consortium

Dynamics of Video in Mobile Environments

Chienchung ChangVice President, Head of Multimedia R&D

Qualcomm Inc.

IMTC 20th Anniversary Forum – Porto, Portugal

Behind the Smartphone Frenzy: Multimedia

1/3+of daily media interactions occur on a smartphone

3/4Worlds population has access to a mobile device

604MFacebook users are mobile

3 IMTC 20th Anniversary Forum – Porto, Portugal

• Millions of new consumers with video enabled device (phone/tablet)• Higher availability of digital content services and social sharing platforms

(Hulu, Netflix, Amazon, Facebook, YouTube…)• Improved capability of devices (higher resolution display, better camera and

video engine in devices)

Mobile Video Dominance

2012 2013 2014 2015 2016 20170

2

4

6

8

10

12

M2M Video File sharing Web/Data

Cisco® VNI report

Mobile Data Traffic (Exabytes [1018] per month)

4 IMTC 20th Anniversary Forum – Porto, Portugal

Mobile Video/Camera

5 IMTC 20th Anniversary Forum – Porto, Portugal

Data Growth Driven by Digital Video

1990 1995 2000 2005 2010 2013

1080p 30fps1980x1020

QCIF 15fps176x144

160 x

6 IMTC 20th Anniversary Forum – Porto, Portugal

Data Growth Driven by Digital Video

2015 2020

1080p 30fps1980x1020

2013

8K 120fps7680x4320

4K 60fps3840x2160

8 x

8 x

IMTC 20th Anniversary Forum – Porto, Portugal

MPEG-2

• Standard in 1996• DVD, Digital TV

MPEG-4

• Standard in 1999

AVC (H.264)

• Standard in 2003• Bluray, Digital TV

HEVC (H.265)

• Standard in 2013

25% better 25% better ~40% better

100 MBbyte MPEG-2 video compressed with newer codecs:

MPEG-2 MPEG-4 AVC (H.264) HEVC (H.265)

100MB 75MB 56MB 33MB

Data for high quality video increased by 150x in last 22 yearsWith 4K and 8K video, data will increase by 64x in next 10 yearsVideo codec compression efficiency has only increased by 3x

The Need for Better Compression

8 IMTC 20th Anniversary Forum – Porto, Portugal

• Mobile industry now in the driver seat– Driving the international standards– Friendly to embedded platforms: power, computation,

HW/SW implementation etal.– Mass digital contents are consumed on personal

screens

• Mobile and PC, TV, CE devices converge in video experience

Video Codec Evolution

MPEG-2H.262 (‘95)

MPEG-4 ASP (‘00/’11)H.263++ (‘00)

MPEG-4 AVC H.264 HP (‘03/’05)

HEVC MP (’13)

-40%-44%-20%

VCEG Initiates H.265 -KTA SW (Jul’06)

MPEG’s CfE Results(Apr’09)

-71%

IMTC 20th Anniversary Forum – Porto, Portugal

Drivers of High Resolution Video

Driving Beyond “Retina” Displays

qVGA

hVGA

WVGA

DVGA

HD

FHD

‘05 ‘07 ’08-’09 ’10 ‘11 ’12-’13 ‘14

130~180 ppi

180~310 ppi

326 ppi

329 ppi

450~520 ppi

132ppi

498ppi

244ppi

IMTC 20th Anniversary Forum – Porto, Portugal

Drivers of High Resolution Video

Resolution Upper Limits for Smartphones & Tablets

2 2.3 2.6 2.9 3.2 3.5 3.8 4.1 4.4 4.7 5 5.3 5.6 5.9 6.2 6.5 6.8 7.1 7.4 7.7

8.00000000000001

8.30000000000001

8.60000000000001

8.90000000000001

9.20000000000001

9.50000000000001

9.8000000000000110.1

10.410.7 11

11.311.6

0

100

200

300

400

500

600

QVGAHVGAVGAWVGAqHDXGA720HD1080HDQXGAWQXGA4K

Screen Size (inches)

Reso

lutio

n (P

PI)

Eye resolution SP: 573ppi

Eye resolution Tablet: 382ppi

IMTC 20th Anniversary Forum – Porto, Portugal

Drivers of High Resolution VideoMiracastTM WiFi Display

VideoGamingBrowsingPhotosSocial Networking

Consumers want to share content fromsmaller devices to larger displays.

Video projected via MiracastTM WiFi Display requires the video stream to be simultaneously decoded on the

smartphone/tablet and re-encoded and streamed to the larger display

Video Compression is key to lower overall network bandwidth traffic

IMTC 20th Anniversary Forum – Porto, Portugal

Video Technology Considerations for Mobile

Widely used codecs and file formats supported

Wide Range of Codec & Format Support• HW accelerated codec for higher performance

• Scalable covering from QCIF to 4K video• Transcode, trans-rate HD in real time• HFR (high frame rate) encode in HD

Scalable Performance & Rich Features

• Pre-processing for encode pathRotation, zoom, image stabilization, overlay

• Post-processing for decode pathScaling, sharpening, frame rate conversion, de-interlacing, de-blocking, de-noising, error concealment

CE Grade Video Quality

All major frameworks: DirectShow, OpenCore, StageFright, Flash, Silverlight

OpenMax IL level access to HW codecs Streaming protocol support:

RTSP, RTP, HTTP Live Streaming, HTTP Adaptive Streaming, DASH

Multimedia Framework Support

13 IMTC 20th Anniversary Forum – Porto, Portugal

• 1080p30 is ubiquitous in smartphones(de facto)• Next-gen imaging format: 4K (UHD-1) video is imminent.• Visual quality (VQ) emerges as a key metric• Internet traffic growth fuels the need of

– More efficient data compression : HEVC, SHVC and VP9 evolutions will set new bar in mobile video

– Delivery mechanisms : DASH

• As mobile and TV video experience converges, emerging technologies gain importance: Miracast, Alljoyn, DIAL, AirPlay

• High quality video post-processing is needed to compensate the gap of video and display resolution.

Mobile Video Dynamics

IMTC 20th Anniversary Forum – Porto, Portugal

Adaptive Video Streaming

Quality is adapted to changing network conditions.

Videos encoded to different streams at

different quality

Stored or generated on-

demand

Device selects optimal stream

Low

Video Segments Quality

Med

High

Time

Internet(CDN)

15

Chienchung Chang

[email protected]