Top Banner
connect • communicate • collaborate LOLA (LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK MUSICAL PERFORMANCES AND INTERACTION Conservatorio G. Tartini Consortium GARR
12

Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

Dec 26, 2015

Download

Documents

Clyde Weaver
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

LOLA(LOw LAtency Audio Visual Streaming System)

A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK MUSICAL

PERFORMANCES AND INTERACTION

Conservatorio G. TartiniConsortium GARR

Page 2: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

...at the GARR Conference 2005, in Pisa...

To perform together, from distant locations...as if distance has vanished

in a click of a computer mouse.

The Dream…

http://www.garr.it/eventiGARR/conf_05/ram/Violista.ram

Page 3: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

H.323/SIP

A/V tools before LOLA…

DVTS

Conference XP Skype

Page 4: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

H.323/SIP DVTS

Conference XP Skype

Latency: 400msEcho

Latency: 200msAudio for voice

Auto echo cancellation

Latency: 350msEcho

Latency: > 300msAudio for voice

Auto echocancellation

A/V tools before LOLA…

Page 5: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

LOLA

Latency: 5msAudio for music

No echo

Very Fast reliable networks

Hi-Speed camerasMachine Vision Grabbers

Good PC (i5/i7)…

New programming approach!

http://www.conts.it/artistica/lola-project/introducing-lola-workshop/

100 Mbps 500 Mbps30 fps 60 fps

2 ch 8 ch

Page 6: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

• Target applications:

• Network interactive musical tasks• musical rehearsing and performances• music education and training

... but also...

• Network interactive on stage performances• dance performances• drama performances• performing arts education and training• and beyond…• surgery, real time control…

Motivations and Goals

Page 7: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

Latency: • ~25ms (one way) is the confort limit for most instruments

Discoveries with LOLA

Courtesy of Nathan Brock, UCSD

Sound rendering: • mixing different ambients;• reproducing acoustic

instruments;

Page 8: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

• Network Performing Arts Production Workshop: 23.11.2010 Tartini (Trieste) – IRCAM (Paris) 1300Km.

• Network Performing Arts Production Workshop: 15.06.2011Tartini (Trieste) – Gran Teatre del Liceu (Barcelona) 2700Km.

• Internet2 Fall Members Meeting: 04.10.2011 NIU (Chicago, IL) – Congress Center (Raleigh, NC) 1850km.

• Network Performing Arts Production Workshop : 05.03.2012 NIU (Chicago, IL) – NWS (Miami, FL) 2400km.

• AEC Annual Meeting for International Coordinators: 15.09.2012

• Tartini (Trieste) – SS. Marcellino & Festo (Naples) 1200Km.

• JANET Performing Arts Networkshop : 19.09.2012 Royal College of Music (London) – Napier Univ. (Edinburgh) 700km.

LOLA Events

Page 9: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

Trieste Next International Festival: 29.09.2012 Tartini (Trieste) – Ca’ Foscari (Venice) – Academy of Music (Ljubljana) 750Km (on GARR shared network) + 100 Km (on a 1Gbps Lambda)

LOLA public Concert

Page 10: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

• Northern Illinois University School of Music - DeKalb, IL, USA• CESNET - Czech Republic Research and Education Network - Praha, CZ• New World Symphony - America's Orchestral Academy – Miami, FL, USA• Internet2 networking consortium - Washington, DC, USA• Università degli Studi di Cassino e del Lazio Meridionale - Cassino, Italy• JAnet - UK Education and Research Network - Oxford, Didcot, UK• Universidade de São Paulo - CMU, Departamento de Música - São Paulo, Brasil• Rensselaer Polytechnic Institute - Department of the Arts - Troy, NY, USA• MAGPI - Mid-Atlantic Gigapop - Multimedia Service - Philadelphia, PA, USA• Napier University, School of Arts and Creative Industries, Music dept. -Edinburgh, UK• University of North Carolina, School of Music, Greensboro, NC, USA• University of Virginia, School of Arts, Charlottesville, VA, USA• Royal Academy of Music, Aarhus, Denmark• Joseph Haydn Konservatorium, Eisenstadt, Austria• University of Southern California, School of Music, Los Angeles,CA,USA

Contact us at [email protected], build you own PC and join the community!

LOLA: the community

Page 11: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

Making a LOLA PC

Node Construction- Commercial Machines Available- Additional Hardware Support

- CoaXpress (CXP)/Bitflow Karbon

- Other ASIO Soundcards

Steps Forward….

Page 12: Connect communicate collaborate LOLA ( LOw LAtency Audio Visual Streaming System) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK.

connect • communicate • collaborate

G.F. Handel/J. Halvorsen:Passacaglia for violin and cello

Marjorie Bagley, violinSchool of Music, Theatre and DanceUniversity of North Carolina – Greensboro, NC

Cheng-Hou Lee, celloSchool of MusicNorthern Illinois University – DeKalb, IL

Let’s see…