My video is a file, now what?

MY VIDEO IS A FILE, NOW WHAT?MJ Drouin, VSF Meeting, May 19th, 2010

WHO AM I?

Director with 15 years of Media experience, I lead technical teams of up to

30 people and 3 managers to deliver most aspects of the business -

Operations, Customer Services, Information Technologies, Project

Management, Engineering, and Procurement. I developed expertise in

managing cable, wireless, satellite, transmission, engineering and

software development. I worked at Bell, Teleglobe, Intelsat, CBC and as a

expert consultant.

Professional Engineer, Masters in Technological Management, ITIL

foundation, PMP

I have extensive experience in speaking since the 90's (ouf!), subjects were

always a mix of technologies, commerce and management.

Past engagements included: Service Oriented Architecture: Tutorial for the

Broadcasters (2010), Pitfalls of SW development: What every executive should

know (2009), 8 weeks on Twitter: I love it! (2009), The Future of Broadcast

Archive Systems (2008), DVB-H: Video over IP goes Wireless (2006), HDTV

distribution (2005), Video over IP (2004) and, Several broadcast technical

training (1994-1998): Video 101, Digital Video and Compression 201, Video

testing techniques 301.

http://www.linkedin.com/in/mjdrouin

http://twitter.com/mjdrouin

2

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

AGENDA

File-based production

Servers

File exchange

Metadata

Wrappers

Workflow

QC

File Transmissions

QoS-aware

OSI model for IP

Video over IP SMPTE 2022

IETF FTP/RTP

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

3

What’s new?

UDT

IEEE 802.1Qav

SOA software development

4

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

FILE-BASED PRODUCTION

FILE-BASED BROADCAST WORKFLOW

6

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

Archives

Low-res

Proxi

FILE-BASED CONTRIBUTION

7

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

TV

Ingest

server

Low-res

Proxi

Cache

FILE-BASED DISTRIBUTION

8

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

Play-back

server

Archives

VOD

Systems

EXCHANGE OF FILES BETWEEN TWO

SYSTEMS: ESSENCE AND METADATA

9

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

*From EBU File Exchange Format for Networked TV production

METADATA: KEYS OF REUSE SUCCESS

10

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

WRAPPERS: FROM MPEG-TS TO…

AAF: Advanced Authoring Format by AMWA

(Advanced Media Workflow Association)

SMPTE 360 General Exchange Format (GXF)

SMPTE 377M Television . Material Exchange Format

(MXF) File Format Specification

ASF: Advance System Format from Microsoft

BXF: Broadcast Exchange Format for Metadata:

SMPTE 2021

3GP for Mobile transmission: 3GPP (3rd Generation

Partnership Project) for GSM, 3GPP2 for CDMA,

etc…

SMPTE 268M ANSI/SMPTE 268M-1994 SMPTE

STANDARD for File Format for Digital Moving-

Picture Exchange (DPX), Version 2.0

11

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

AMWA

AAF wrapper for post production and video

editing workflows

MS06 Integration of MXF with BXF

Mapping and addition of MXF metadata to BXF

(SMPTE S2021-2008). Provides compatibility

between BXF messages and MXF files.

12

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

AMWA: AAF TO APPLICATION SPECIFICATIONS

HOW THEY FIT AN ADVANCED MEDIA WORKFLOW

13

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

QA OF FILES OR VIDEO CONTENT?

Tests at ingest

Exponential complexity with multiple providers

Internal set-ups stability

Sample test and use automatic metadata to your

advantage

Test before the ‘ready for broadcast’

14

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

File Format/Wrapper

Compression Type

Audio/video/data

$$$$$$$

$$

FILE-BASED BROADCASTING CONCERNS

File-based

Production

Meta

data Vendor File

compatibility

Consumer vs

Professional

Stds

Auto-

fill

Persistence

Workflows

Standards

Post &

Edit

To

air

15

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

Archiving

DRMFile

multiple

format

Asset

Mngmt

Q.A.

AMS

interop

Content

Re-use

TRANSMISSIONS OF FILES

QOS-AWARE NETWORKS

17

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

WHERE DO WE

START?

18

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

VIDEO OVER IP

SMPTE 2022

RTP, 1 to 7 MPEG-TS per packet

Transmission (2022-2)

FEC (2022-1)

IETF RTP

Multicast UDP

IETF FTP

TCP19

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

SO… WHAT’S NEW?Ready to stretch a little bit?

UDP-BASED DATA TRANSFER (UDT)

Created in 2001

Current version #4 released in 2007

IETF Candidate draft-gg-udt-03 (April 12th 2010)

Very high speed network (above DS3) – WAN

File transfer of very large files (above 1TB) over long distances

Unicast, duplex, connection-based

Client-server or Rendezvous (P2P)

Muxing

Periodic ACK, relative to time and not traffic

Congestion control (configurable, default = AIMD)

Reliability mechanisms

@ 155mbps, 50msec, 2x better than TCP

@ 1Gbps, 25msec delay, 4x better than TCP21

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

UDP

Socket API

Applications

UDT OVERVIEW

TCP

Socket API

Applications

Applications

UDT

UDT Socket

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

22

*From Yunhong GU, BREAKING THE DATA TRANSFER BOTTLENECK

IEEE 802.1QAV

FORWARDING AND QUEUING ENHANCEMENTS

FOR TIME-SENSITIVE STREAMS

Standardized on Dec 10th, 2009

New time-sensitive Network – LAN

Traffic shaping and priorities

Admission control – scheduling

Precise synchronization

Low delay

2 msec through 7 ethernet bridges

less than 1µsec between devices

Master clock = House clock

Can be accommodated on wireless 802.11

Minimal dropped packets

23

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

AUDIO VIDEO BRIDGING (AVB)

The IEEE 802.1 Audio/Video Bridging

(AVB) draft standards:

IEEE 802.1 AS Timing and Synchronization for Time-

Sensitive Applications in Bridged Local

Area Networks (LANs); a precision time

synchronization protocol.

IEEE 802.1 Qat Stream Reservation Protocol (SRP); an

end-to-end bandwidth reservation protocol

within a bridged LAN.

IEEE 802.1 Qav – Accepted Dec 09 Forwarding and Queuing for Time-

Sensitive Streams; A/V traffic scheduling

enhancements for a mainstream Ethernet

and other network switches.)

IEEE 802.1 BA Audio/Video Bridging (AVB) Systems

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

24

SO

A E

NT

ER

PR

ISE

FR

AM

EW

OR

K

25

MJ

Dro

uin

© -

Ma

y 1

9th

, 20

10

-V

SF

Via JavaWorld

SO… WHAT’S NEXT?