The Montreux Jazz Digital Project: From a Collection to an ...€¦ · Research & Innovation projects at one Glance • Sound Dots => Silence bubble • Reconstitution of the acoustics

Alain Dufaux, EPFL Metamedia Center

The Montreux Jazz Digital Project:

From a Collection to an Innovation Platform

Claude Nobs ’s vision

Record the concerts in:

• high quality audio

• broadcast-level video

“It’s the most important testimonial to the history of music, covering jazz, blues and rock”

Quincy Jones

• Digitization Project initiated in 2007

• Creation of the Claude Nobs Foundation

• Registration to UNESCO in 2013

Montreux Jazz Digital Project: From Archiving to Innovation

• Inventory

• Database creation

• Digitization

• Quality Control

• Documentation

• Storage

• Preservation

• Valorization

• Innovation

• Education

The Archive in numbers

• 14’000 Master tapes

• 18 different audio & video tape formats

• Covering 1967 – 2017, with overlaps

• Video: 11’000 hours of recordings, in HD from 1991 !

• Audio: 6000 hours of recordings, including multi-tracks

• Pictures: 100’000 photos (60’000 digitized at EPFL)

The Digitized Archive

• Un-compressed audio and video formats

• Broadcast format (MXF)

• Customized sub-formats (iPads, TV, web,…)

• Metadata gathered in a central database

• Song / event indexing and segmentation

• Storage on 2 sets of LTO Tapes (> 3’000 tapes)

• Additional storage on HGST Active Archive System:

3 split units of 4.7 Peta-Bytes each, optically linked

• MD5-based integrity file check

Live Archiving at the Festival

• Live recording of the concert streams onto files

• Storage on Active Archive

• Transcoding in subformats for public platforms

• Song indexing and segmentation

• Check of author’s rights

• Availability during the festival, on iPads

Sound Dotsby Hidacs

Casino Kursaal Revival

Casino Kursaal Revival

Casino Kursaal Revival

Remix The Archive

Remix The Archive by Future Instruments

Open Mic

360 video+ 3D audio recordings

Defect Detection and CorrectionDefect Detection and Correction

Super-resolution (SD => UHD)

Thumbnail Generation for each Song

Montreux Jazz Galaxie(Start-up Kirelion)

Montreux Jazz Galaxie(Start-up Kirelion)

MJHL 1Specific to digital heritage

Immersion with every formats

Main image never touched

Browsing as part of

immersion

Materiality of the

environment

Social interaction

Inside / outside relation

Montreux Jazz Heritage Lab

MJHL 2Visual augmentation

Audio augmentation

Content augmentation

New screen materiality

Inside / outside relation

Browsing through history

MJHL NomadThe Gesamtkunstwerk edition

Moving installation

Content enrichment through

encounters

Minimal space / Maximum

immersion

Additional VR for context

perception

Bad weather and traffic jam will be

turned into cultural highlights…

Research & Innovation projects at one Glance

• Sound Dots => Silence bubble

• Reconstitution of the acoustics of the old Casino

• Remix-the-Archive

• Open Mic (multi-tracks)

• 360 degrees + 3D audio concert recordings and visualization

• Audio / video defect detection + enhancement

• Super-resolution video (SH => UHD)

• Automatic thumbnail generation for every song

• Montreux Jazz Galaxie: archive discovery by artists links

• Solo detection, emotion detection, artist recognition, …

Long-Term Storage on Synthetic DNA

Iconic Perfromances of Deep Purple and Miles Davis at Montreux

stored on DNA for the first time in September 2017

ARTLAB BUILDING - MONTREUX JAZZ CAFÉ @ EPFL

http://metamedia.epfl.ch

http://claudenobsfoundation.com

WITH SUPPORT OF THE FOLLOWING PARTNERS