Pathways to SEASR Audio Analysis NEMA NESTER National Center for Supercomputing Applications University of Illinois at Urbana-Champaign The SEASR project and its Meandre infrastructure are sponsored by The Andrew W. Mellon Foundation
Pathways to SEASR
Audio Analysis
NEMA
NESTER
National Center for Supercomputing Applications"University of Illinois at Urbana-Champaign
The SEASR project and its Meandre infrastructure!are sponsored by The Andrew W. Mellon Foundation
Defining Music Information Retrieval?
• Music Information Retrieval (MIR) is the process of searching for, and finding, music objects, or parts of music objects, via a query framed musically and/or in musical terms
• Music Objects: Scores, Parts, Recordings (WAV, MP3, etc.), etc.
• Musically framed query: Singing, Humming, Keyboard, Notation-based, MIDI file, Sound file, etc.
• Musical terms: Genre, Style, Tempo, etc.
NEMA
Networked Environment for Music Analysis
– UIUC, McGill (CA), Goldsmiths (UK), Queen Mary (UK), Southampton (UK), Waikato (NZ)
– Multiple geographically distributed locations with access to different audio collections
– Distributed computation to extract a set of features and/or build and apply models
SEASR: @ Work – NEMA
Executes a SEASR flow for each run
– Loads audio data
– Extracts features from every 10 second moving window of audio
– Loads models
– Applies the models
– Sends results back to the WebUI
NEMA Flow – Blinkie
NEMA Vision
• researchers at Lab A to easily build a virtual collection from Library B and Lab C,
• acquire the necessary ground-truth from Lab D,
• incorporate a feature extractor from Lab E, combine with the extracted features with those provided by Lab F,
• build a set of models based on pair of classifiers from Labs G and H
• validate the results against another virtual collection taken from Lab I and Library J.
• Once completed, the results and newly created features sets would be, in turn, made available for others to build upon
Do It Yourself (DIY) 1
DIY Options
DIY Job List
DIY Job View
Nester: Cardinal Annotation
• Audio tagging environment
• Green boxes indicate a tag by a researcher
• Given tags, automated approaches to learn the pattern are applied to find untagged patterns
Nester: Cardinal Catalog View
Examining Audio Collection
• Tagged a set of examples Male and Female
Pathways to SEASR"Audio
National Center for Supercomputing Applications"University of Illinois at Urbana-Champaign
The SEASR project and its Meandre infrastructure"are sponsored by The Andrew W. Mellon Foundation