A Basic tutorial on Video over IP Gaétan Gauthier Director, Hardware Engineering, VPG Matrox Electronics Systems February 9th 2016
A Basic tutorial on Video over IP
Gaétan Gauthier Director, Hardware Engineering, VPG
Matrox Electronics Systems February 9th 2016
A Basic tutorial on Video over IP - Ethernet Roadmap
- Physical Layer - Nomenclature, Fiber technology, Modules
- Forum alliance and standards
- Application Layer :
- 2022-6, ASPEN, TR-01, TR-03, TR-04
-Some facts
Ethernet Roadmap Update
• Cisco Predictions for Video, By 2019 :
• 80% of global Internet consumption will be video content.
• Connected devices connected to IP will be > 3x global population.
• Today : ~70 billion meters of cat 5e and cat 6 cabling sold since 2003 and close to a billion Ethernet ports/year sold.
(Ref. Cisco Visual Networking Index: Forecast and Methodology, 2014-2019)
> 3x
The Physical Layer
Physical Layer : Moving towards 400G Nomenclature : 400 BASE - S R 16 (defined by IEEE : 802.3)
– S = Short Reach (100m on OM3 & 150m on OM4)
• C for Coax • F for single-mode fiber ( 2 Km ) • L for Long Reach using single-mode fiber ( 10 Km ) • E for Extended reach using single-mode fiber ( 40 Km ) • T for twisted pair ( up to 40GBe only )
– R = Coding : R for 64/66B (3% overhead vd 25% for 8b/10b) – 16 = Number of Lanes ( example : 16 x 25 Gbit/s = 400G )
Physical Layer : The basic of Fiber – Single-mode fiber = Higher transmission rate + 50 times more
distance, ~ 2x the cost. Laser typ. @1310nm to 1550nm. – Multimode fiber = For distances between 275m to 2km. Laser
typically @ 850nm and 1300nm – Multimode fibers are identified by the OM ("optical mode")
designation (ISO/IEC 11801) Ex. OM3, OM4, – Multimode does not mean multi-stream !
Physical Layer : The basic of Fiber • Fiber can be used in bi-directional
mode, but not usually the case • More fragile than Coax • Risk with short optical cable
• Fiber is future proof : • Same fiber :
• More bandwidth
Physical Layer : Ethernet modules • Convert High speed serial data to a physical interface.
• Act as a gearbox, converts M lanes to N Lanes,
M not equal to N.
Physical Layer : Ethernet modules • Ethernet modules in multi-source agreements (MSAs)
• Non-MSA = not-compatible pinouts
• CFP modules : C for Centum, (100 GbE Ethernet)
• QSFP = Quad SFP : uses multiplexer
– can achieve 40GbE over 12-fiber ( 2x4 being used )
– Or with a pair of single-mode fiber carried over four wavelengths multiplexed (WDM)
Physical Layer : Ethernet Modules http://www.cfp-msa.org/Documents/CFP-MSA_CFP2_HW-Spec-rev03.pdf
Modules RT/TX Standards Data rate Configuration Pins Width Max Power
n : Lanes Ghz Bandwidth per lane mm Watt
SFP 1 1GBASE-xRn 1 1x1 20 13.4
SFP + 1 10GBASE-xRn 10 1x10 20 13.4 1.5
SFP28 1 25GBASE-xRn 10, 25 1x25 20 13.4 1.5
QSFP 4 40GBASE-xRn 10 4x10 38 18.35 3.5
QSFP28 4 100GBASE-xRn 10, 25 4x10, 4x25 38 18.35 3.5
CFP 4, 10 100GBASE-xRn 10, 25 4x10, 4x25, 10x10 148 82 32
CFP2 4, 8, 10 400GBASE-xRn 10, 25, 50 10x10, 8x25, 8x50 104 41.5 18
CFP4 4 100GBASE-xRn 10, 25 4x10, 4x25 56 21.5 6
CFP8 16 400GBASE-xRn 25, 50, 100 16x25, 8x50 , 4x100 104 41.5
Standards, Forum & Alliances ISO/IEC
(General, MPEG) ANSI(Am. Nat. Std
Institute)
AMWA(Workflow/AAF)
ITU(Telecoms/Wan)
EBU(European
Broadcast Union)
VSF(Service/
interoperability)
ETSI(Euro Telecoms)
INCITS(SCSI)
DCI(Digital Cinema
Initiative)
IETF(Internet Eng. Task
Force : RFC)
W3C(World Wide Web
onsortium))
AES(Audio)
ATSC(Broadcast)
DVB
ARIB(Japan)
SCTE(Cable TV)
IEEE(Ethernet,Lan)
SMPTE(AV/Cinema)
AIM(Alliance)
ASPEN(Alliance)
Ref. : Al Kovalick : Video Systems in an IT Environement
Standards, Forum & Alliances ISO/IEC
(General, MPEG) ANSI(Am. Nat. Std
Institute)
AMWA(Workflow/AAF)
ITU(Telecoms/Wan)
EBU(European
Broadcast Union)
VSF(Service/
interoperability)
ETSI(Euro Telecoms)
INCITS(SCSI)
DCI(Digital Cinema
Initiative)
IETF(Internet Eng. Task
Force : RFC)
W3C(World Wide Web
onsortium))
AES(Audio)
ATSC(Broadcast)
DVB
ARIB(Japan)
SCTE(Cable TV)
IEEE(Ethernet,Lan)
SMPTE(AV/Cinema)
AIM(Alliance)
ASPEN(Alliance)
Workgro
up
RFC 3550
TR-03
AES-67
1588 v2
Wor
kgro
up
BT. 709, 2020
Ref. : Al Kovalick : Video Systems in an IT Environement
Forum
Video Services Forum (VSF) $$, ( Non-Profit) ~ 100 members Service providers, dedicated to interoperability Produces Technical recommendations ( ex. TR-01, 02, 03) Advanced Media Workflow Association (AMWA) ; Open, ~ 70 Members Started in 2000 as the Advanced Authoring Format (AAF) Association AMWA Networked Media Incubator project (NMI) Will cover : Discovery, Identity/Timing, and Connection Management
Alliances & Community
• Alliance for IP Media Solutions (AIMS) $$, ~ 10 members Founded by GVG to promote the standards like : ST 2022-6, TR-03, TR-04,
and AES67.
• Adaptive Sample Picture Encapsulation (ASPEN) ; Open, ~ 70 Members Community started at IBC 2015 by Evertz Open framework for IP-facilities available today. Dedicated to providing a comprehensive end-to-end IP solution
The Application Layer
IP Encapsulation
IP Encapsulation • ST 2022-6 (2012) • VSF TR-01 (2013), TR-03 & 04 (2015) • ASPEN (2015) • And Other : NDI (Newtek) , etc …
• RTP
Evolution of a standard :
• L’histoire se charge de nous enseigner tout ce que nous n’avons pas su apprendre de l’histoire.
• Evelyne Dodeur, Les Territoires de la Mémoire asbl, 2005
Evolution of a standard :
Ref. : John Hudson (2013). "3Gb/s SDI for Transport of 1080p50/60, 3D, UHDTV1 / 4k and Beyond"
• SDI standards Guarantee Interoperability . • An SDI wrapper includes legacy support. • SMPTE 2022-6 is a natural evolution of SDI to IP.
ST 2022-6
• Still same SDI core wrapper but new I/P layers added. • Originate in 2012 from a VSF recommendation • With 2022-5, used when covering long distances
ST 2022-6
• But ST2022-6 add more layer of encapsulation !
• And it does not support 4K, HFR for now
HBRMT Layer :
•RTP Header is 12 Bytes as per RFC 3550 : ( Payload type, sequence #, sampling timestamp & source ) • HBRMT Header is 8-16 Bytes long : ( Frame-count, Source Format, Frame-rate, Video Timestamp & clock freq. Opt.) • SDI Payload is divided into chunks of 1376 bytes. • The overhead adds ~ 6% (no FEC).
New proposal • Introduction : Source, Flows and Grain.
• Started with BBC White paper in 2013
• Followed by a Joint study from EBU, SMPTE and VSF produced the JT-NM study , Phase 1 & 2
• Support 4K + many EOTF and colorimetry systems.
• Early implementations rely on standards that are still evolving
New proposal
• Ref. 2013 : BBC : The IP Studio, white paper Whp 268
• Each Flow consists of a number of Grains, each Grain represents an element. • Flows : Elementary streams, Grains = PES ( Packet )
New proposal
• Ref. 2013 : BBC : The IP Studio, white paper Whp 268
- Multiple Audio Flows - Multiple Video Flows : ex. Proxy for mobile devices
ASPEN : Adaptive Sample Picture Encapsulation
• Project Initiator : Evertz
• Standard Body : RDD 37 In Progress
• Video Data type : Uncompressed on MPEG-2 TS
• Status : Approved on Jan 5 2016. First public announcement made on Dec. 15; NBC Sports deployment of ASPEN using Evertz and SONY starting in February 2016
ASPEN • Video : RDD37:2016 (Based on MPEG-2 TS ISO/IEC 13818-1:2007) • Audio uses ST302M:2007 with some exceptions (Mapping of AES3 Data into an MPEG-2 TS)
• Metadata uses ST2038:2008 (Mapping of ST291 Ancillary Data Packets in an MPEG-2 TS)
• Synchronization : mechanisms of the MP-2 TS time stamps.
VSF TR-03
• Project Initiator: VSF SVIP (Studio over IP group)
• Standard Body : SMPTE TC-32NF-60 WG
• Video Data type : Uncompressed (RFC 4175)
• Status : Draft released in Oct. 2015
• Synchronization : rely on IEEE 1588V2 PTP.
VSF TR-03 • Video : RFC 4175 (32k x 32k)
• Audio : AES-67
• ( 24 bits linear, 48 kHz samples with provision for 96kHz)
• Metadata : IETF draft Ancillary 15
• Session Description Protocol : RFC 4566
• Discovery aspect will be address by AMWA
VSF TR-01
• VSF TR-01 2013
( Transport of J2K in MPEG-2 TS over IP. )
– J2K TS streams as per Annex M (ITU-T T.800 A3)
– Ancillary data as per ST-291-1.
– No support for HDR & HFR
VSF TR-04 • TR-04 : add ST-2022‐6 Media Flows over TR-03
- Add AES67 for separate IP addressable audio
- Presents an easy path for the optimal IP structures by integrating existing 2022-6 implementation towards future implementation of VSF TR-03
Some facts :
Some facts
Some facts
• Fiber cable cost is now affordable and offer higher possible bandwidth, longer distance, better noise immunity, with less weight.
• Video payload is moving rapidly from 1.5Gb – 3Gb – 12Gb and now to 24Gb for UHD-HFR-HDR which will shortly be the mainstream.
• New colorimetry processing, dynamic metadata, Multiple resolutions (Proxy), More audio streams will require more processing power
•
Some facts
• ST2022-6 support SDI legacy product and new encapsulating method proposed by ASPEN and VSF offers important advantages for second phase of Video over IP.
• SFP+ and SFP28 Ethernet modules will provides all the flexibility and upgradability to adapt for the different possible physical interface.
Some facts
• The constant push for higher quality images in real-time makes hardware processing products still more economical and this for many years to come.
• Hardware Product based on powerful and flexible FPGA will help through a period of changes and instability.
• In 1995 : Fast Ethernet was defined at the nominal rate of 100Mbit/sec ! • In 2016 : we are transitioning to 25Gbe on a single lane.
• Where will we be in 10 years from now ?
Contact
Gaétan Gauthier
Director, Hardware Engineering, VPG
Matrox Electronics Systems
References
• The Ethernet Roadmap Panel, Scott Kipp, March 2015.
• Video Systems in an IT Environment, Al Kovalick