/ Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap UltraGrid: Low-Latency High-Quality Video Transmissions on Commodity Hardware Petr Holub CESNET z.s.p.o., Prague/Brno, Czech Republic <[email protected]> SITOLA Internet Global Summit Denver, ––
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1/53
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
UltraGrid: Low-Latency High-Quality VideoTransmissions on Commodity Hardware
Petr HolubCESNET z.s.p.o., Prague/Brno, Czech Republic
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
What is UltraGrid?
● A�ordable platform for high-quality interactive videotransmissions using commodity hardware◾ high-resolution video: HD, 4K, 8K◾ as low latency as possible on commodity hardware◾ commodity equipment equipment
◆ Linux, Mac, Windows◆ common GPUs and video capture cards
◾ open-source software, dual BSD/GPL license◆ UltraGrid itself is BSD-licensed, may become “GPL infected” (e.g.,
x264)◾ picks up where common videoconferencing ends
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
Who Is UltraGrid For?
● Researchers◾ experimental validation of your research results◾ Holub et al.: real-time image processing algorithms◾ Perkins et al.: network protocols, congestion control,. . .◾ Holub & Rudová et al.: data distribution models & scheduling◾ Renambot et al.: image compression & large scale visualizationsystems
◾ Hutanu et al.: distributed visualization systems
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
History of UltraGrid
● History of Development◾ 2002–2004: ISI EAST (720p)◾ 2005–2012: CESNET (→ 1080i)◾ 2006–2008: forks by KISTI (GUI, AJA KONA) and i2cat (SAGE)◾ 2013: i2cat starts contributes to common codebase maintainedby CESNET
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
World Firsts. . .
● 2011 – GPU-JPEG Transatlantic 4K
◾ CineGrid Workshop, December 2011◾ real-time movie post-production review/approval process◾ playback on a machine worth $1.000 ($500 PC + $500 NVIDIA580GTX)
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
World Firsts. . .● 2013 – UltraGrid + CoUniverse + inter-domain bandwidth ondemand◾ USA + Japan + Czech Rep using AutoGOLE with NSI◾ multipoint using self-organizing re�ectors
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
Features of UltraGrid
● Supported video formats◾ HD, 2K◾ 4K – tiled or native◾ 8K – experimental, problems with available sources◾ (almost) arbitrary video resolution◾ multichannel video (e.g., 3D HD, 4K)
● Uncompressed vs. compressed◾ only interested in low-latency compression◾ GLSL-accelerated DXT1, DXT5-YCoCg◾ CUDA-accelerated JPEG, DXT5-YCoCg◾ CPU-based low-latency H.264 via x264 & libavcodec
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
Features of UltraGrid
● Supported audio formats◾ various sample rates◾ multi-channel
● Uncompressed vs. compressed◾ uncompressed by default◾ OPUS codec
● Synchronization of audio with video◾ depends on the source, if it is synchronized◾ synchronized when using HD-SDI and HDMI as audio source◾ audio is transmitted with as low latency as possible when usingstandalone soundcard
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
GPU-Accelerated Compression
● Available compression schemes◾ DXT1: CPU-based (FastDXT library from EVL)◾ DXT1, DXT5: OpenGL Shader Language (GLSL) based◾ JPEG: NVidia CUDA based◾ DXT5: NVidia CUDA based (for 8K)
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
GPU-Accelerated Compression
● Fine-grained parallelization of JPEG◾ per-row/column DCT/IDCT◾ per pixel RLE◾ per pixel Hu�man◾ parallel stream compacting◾ parallel decompression using restart intervals◾ use of auxiliary indexes for more e�cient parsing
● Available also as BSD-licensed open-source library:http://gpujpeg.sf.net/
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
GPU-Accelerated Compression
● JPEG performance
20 40 60 80 1000
3
6
9
12
Quality
Dura
tion
[ms]
(a) Encoder performance (GPU only)
20 40 60 80 1000
3
6
9
12
Quality
Dura
tion
[ms]
1080p1080p 4:2:02160p2160p 4:2:0
(b) Decoder performance (GPU only)
20 40 60 80 1000
5
10
15
20
Quality
Dura
tion
[ms]
(c) Encoder performance (both CPU and GPU)
20 40 60 80 1000
5
10
15
20
Quality
Dura
tion
[ms]
(d) Decoder performance (both CPU and GPU)
20 40 60 80 100
25
30
35
40
45
50
Quality
PSN
R[d
B]
(e) Quality of reconstruction
20 40 60 80 100
100
200
400
800
1,600
3,200
6,400
12,800
Quality
Imag
esi
ze[k
B]
(f) Compressed image size
Figure 6: JPEG coder performance and quality loss in dependence on quality and mode settings. Average over all image typeshas been used for the evaluation.
● Transcoding re�ector is part of UltraGrid$ ./bin/hd−rum−transcode [global_opts] buffer_size port [host1_options]host1 [[host2_options] host2] ...
where global_opts may be:−−control−port <port_number > − control port to connect to
and hostX_options may be:−c <compression > − compression−m <mtu> − MTU size. Will be used only with compression.−l <limiting_bitrate > − bitrate to be shaped to−f <fec> − FEC that will be used for transmission.
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
Ongoing Development
● GPU-based LDGM FEC◾ CUDA-based◾ works up to uncompressed 4K◾ extended performance and con�guration pro�ling◾ to be submitted into Future Generation Computer Systemsjournal
● New implementation of video mixer – with i2cat◾ to avoid OpenGL/GLSL readback performance problems◾ based on OpenCV with OpenCL acceleration
Introduction UltraGrid Features UltraGrid Community What’s New? Tutorial/Demo Roadmap
Selected Papers
[1] HOLUB, Petr - MATYSKA, Luděk - LIŠKA, Miloš - HEJTMÁNEK, Lukáš - DENEMARK, Jiří -REBOK, Tomáš - HUTANU, Andrei - PARUCHURI, Ravi - RADIL, Jan - HLADKÁ, Eva.High-de�nition multimedia for multiparty low-latency interactive communication.Future Generation Computer Systems, Amsterdam, The Netherlands, Elsevier Science, TheNederlands. ISSN 0167-739X, 2006, vol. 22, no. 8, pp. 856–861.
[2] HOLUB, Petr - ŠROM, Martin - PULEC, Martin - MATELA, Jiří - JIRMAN, Martin.GPU-accelerated DXT and JPEG compression schemes for low-latency networktransmissions of HD, 2K, and 4K video. Future Generation Computer Systems,Amsterdam, The Netherlands, Elsevier Science, The Nederlands. ISSN 0167-739X, 2013,vol. 29, no. 8, 1991–2006-16 pp.