Pathways to SEASR
Audio Analysis
NEMA
NESTER
National Center for Supercomputing Applications"University of Illinois at Urbana-Champaign
The SEASR project and its Meandre infrastructure!are sponsored by The Andrew W. Mellon Foundation
Defining Music Information Retrieval?
• Music Information Retrieval (MIR) is the process of searching for, and finding, music objects, or parts of music objects, via a query framed musically and/or in musical terms
• Music Objects: Scores, Parts, Recordings (WAV, MP3, etc.), etc.
• Musically framed query: Singing, Humming, Keyboard, Notation-based, MIDI file, Sound file, etc.
• Musical terms: Genre, Style, Tempo, etc.
NEMA
Networked Environment for Music Analysis
– UIUC, McGill (CA), Goldsmiths (UK), Queen Mary (UK), Southampton (UK), Waikato (NZ)
– Multiple geographically distributed locations with access to different audio collections
– Distributed computation to extract a set of features and/or build and apply models
SEASR: @ Work – NEMA
Executes a SEASR flow for each run
– Loads audio data
– Extracts features from every 10 second moving window of audio
– Loads models
– Applies the models
– Sends results back to the WebUI
NEMA Flow – Blinkie
NEMA Vision
• researchers at Lab A to easily build a virtual collection from Library B and Lab C,
• acquire the necessary ground-truth from Lab D,
• incorporate a feature extractor from Lab E, combine with the extracted features with those provided by Lab F,
• build a set of models based on pair of classifiers from Labs G and H
• validate the results against another virtual collection taken from Lab I and Library J.
• Once completed, the results and newly created features sets would be, in turn, made available for others to build upon
Do It Yourself (DIY) 1
DIY Options
DIY Job List
DIY Job View
Nester: Cardinal Annotation
• Audio tagging environment
• Green boxes indicate a tag by a researcher
• Given tags, automated approaches to learn the pattern are applied to find untagged patterns
Nester: Cardinal Catalog View
Examining Audio Collection
• Tagged a set of examples Male and Female
Pathways to SEASR"Audio
National Center for Supercomputing Applications"University of Illinois at Urbana-Champaign
The SEASR project and its Meandre infrastructure"are sponsored by The Andrew W. Mellon Foundation
