Signal Processing Algorithms for Music, Marine Mammals and Speech Yannis Stylianou Outline of the talk Rhythmic Similarity of Music Whales Click Detections Measuring jitter References Signal Processing Algorithms for Music, Marine Mammals and Speech Yannis Stylianou University of Crete, Computer Science Dept., Multimedia Informatics Lab [email protected]AUTH 2008 June 23rd
58
Embed
Signal Processing Algorithms for Music, Marine Mammals …
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Signal Processing Algorithms forMusic, Marine Mammals and Speech
Yannis Stylianou
University of Crete, Computer Science Dept., Multimedia Informatics [email protected]
AUTH2008 June 23rd
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
1 Rhythmic Similarity of Music
2 Whales Click Detections
3 Measuring jitter
4 References
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Rhythmic Similarity of Music Based onDynamic Periodicity Warping
ECS 2008 (The Netherlands),3rd Workshop on Detection and Classification of MarineMammals, Boston 20072nd Workshop on Detection and Classification of MarineMammals, Monaco 2006
References:[5][6][7]
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Why to do it?
Localization and tracking with passive acoustics
Study animal behavior
Abundance estimation
Correlations with physiology (size of animals, soundproduction mechanism)
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Examples of clicks from Sperm whales
Regular clicks:
0 500 1000 1500 2000 2500 3000 3500
−1
−0.5
0
0.5
1(a)
Time in ms
Am
plitu
de
Creak clicks:
0 50 100 150 200 250 300 350 400−0.04
−0.02
0
0.02
0.04(a)
Time in ms
Am
plitu
de
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Examples of clicks from Beaked whales
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Approaches/Softwares for clickdetection
Rainbow click (D. Gillespie, 1997)[8]
Moby click (O. Jake, 1996)[9]
Ishmael (D. Mellinger, 2001)[10]
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Teager-Kaiser energy operator[5][6]
Definition for a discrete time signal
Ψ[s(n)] = s2(n)− s(n + 1)s(n − 1)
For a signal with 3 components: interference x [n],transient y [n], and noise u[n], so s[n] = x [n] + y [n] + u[n]:
Ψ[s(n)] = Ψ[x(n)] + Ψ[y(n)] + Ψ[u(n)] + T [n]
we may show that:
Ψ[s(n)] ≈ Ψ[y(n)] + w(n)
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Teager-Kaiser energy operator[5][6]
Definition for a discrete time signal
Ψ[s(n)] = s2(n)− s(n + 1)s(n − 1)
For a signal with 3 components: interference x [n],transient y [n], and noise u[n], so s[n] = x [n] + y [n] + u[n]:
Ψ[s(n)] = Ψ[x(n)] + Ψ[y(n)] + Ψ[u(n)] + T [n]
we may show that:
Ψ[s(n)] ≈ Ψ[y(n)] + w(n)
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Synthetic example
0 50 100 150 200150
200
250(a)
Time (ms)
Am
plitu
de
0 50 100 150 200−0.5
0
0.5
1(b)
Time (ms)
Am
plitu
de
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Applied on clicks
From Sperm whales, Regular clicks: (a) Raw file, (b) after TK
0 500 1000 1500 2000 2500 3000 3500−1.5
−1
−0.5
0
0.5
1(a)
Time (ms)
Am
plitu
de
0 500 1000 1500 2000 2500 3000 3500−0.5
0
0.5
1(b)
Time (ms)
Am
plitu
de
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Applied on clicks
From Sperm whales, Creak clicks: (a) Raw file, (b) after TK
0 50 100 150 200 250 300 350 400−0.04
−0.02
0
0.02
0.04(a)
Time (ms)
Am
plitu
de
0 50 100 150 200 250 300 350 400
0
0.5
1(b)
Time (ms)
Am
plitu
de
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
Comparison with Rainbow click
Det. Score: =Correctly detected hand labeled clicks
Total hand labeled clicks100
Table: Percentage (%) of correctly identified clicks per file.Tolerance of 2ms.
TK RBFile name clicks score (%) clicks score (%) clicks
Rhythmic similarity of music based on dynamic periodicity warping.In IEEE ICASSP 2008.
Jonathan Foote, Matthew D. Cooper, and Unjung Nam.
Audio retrieval by rhythmic similarity.In Proc. of ISMIR 2002 - 3rd International Conference on Music Information Retrieval, 2002.
Geoffroy Peeters.
Rhythm classification using spectral rhythm patterns.In Proc. of ISMIR 2005 - 6th International Conference on Music Information Retrieval, pages644–647, 2005.
Jouni Paulus and A.P. Klapuri.
Measuring the similarity of rhythmic patterns.In Proc. of ISMIR 2002 - 3rd International Conference on Music Information Retrieval, 2002.
V. Kandia and Y. Stylianou.
Detection of creak clicks of sperm whales in low SNR conditions.In CD Proc. IEEE Oceans, Brest, France, 2005.
V. Kandia and Y. Stylianou.
Detection of sperm whale clicks based on the Teager-Kaiser energy operator.Applied Acoustics, 67(11-12):1144–1163, 2006.
V. Kandia and Y. Stylianou.
Detection of clicks based on group delay.Accepted in Canadian Acoustics, 2008.
D. Gillespie.
SignalProcessingAlgorithmsfor Music,Marine
Mammals andSpeech
YannisStylianou
Outline of thetalk
RhythmicSimilarity ofMusic
Whales ClickDetections
Measuringjitter
References
An acoustic survey for sperm whales in the Southern Ocean sanctuary conducted from the R/VAurora Australis.Rep. Int. Whal. Comm., 47:897–908, 1997.
O. Jake.
Acoustic Censusing of sperm whales at Kaikoura, New Zealand: An inexpensive method to countclicks and whales automatically.Master Thesis, University of Otago, Dunedin, New Zealand, 1996.
D. K. Mellinger.
Ishmael 1.0 Users Guide.NOAA, NOAA/PMEL/OERD, 2115 SE OSU Drive, Newport, OR 97365-5258, 2001.Technical Memorandum OAR PMEL-120.
M. Vasilakis and Y. Stylianou.
A mathematical model for accurate measurement of jitter.In MAVEBA 2007, Florence, Italy, 2007.
Kay Elemetrics.
Disordered Voice Database (Version 1.03), 1994.
Paul Boersma and David Weenink.
Praat: doing phonetics by computer (Version 4.6.24) [Computer program], 2007.
Kay Elemetrics.
Multi-Dimensional Voice Program (MDVP) [Computer program], 2007.