Top Banner
Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component Analysis and Blind Source Separation, ICA 2004 Paris Smaragdis / Mitsubishi Electric Research Laboratori Presenter: Jain_De ,Lee
13

Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Jan 29, 2016

Download

Documents

Daniella Horton
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factor Deconvolution;Extracation of Multiple Sound Sources from Monophonic Inputs

International Symposium on Independent Component Analysis and Blind Source Separation, ICA 2004

Paris Smaragdis / Mitsubishi Electric Research Laboratories

Presenter: Jain_De ,Lee

Page 2: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Outline

• Introduction

• Non-negative Matrix Factorization

• Non-negative Matrix Factor Deconvolution

• Conclusions

Page 3: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Introduction

• Theory of The Origin

• An extension to the Non-Negative Matrix Factorization algorithm – Identifying components with temporal

structure

Paatero (1997)

Lee&Seung (1999)

Page 4: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factorization

• The Original Formulation of NMF

NRRMNM HWV

[W] : Basis Functions Matrix

[H] :Time Weights Matrix

Page 5: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factorization

• The Cost Function

• Multiplicative Update Algorithm

1

T

T

WHWV

WHH T

T

H

HHWV

WW

1

F

WHVWH

VVD )ln(

Page 6: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factorization

• NMF for Sound Object Extraction

STFT

Page 7: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factorization

Page 8: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factor Deconvolution

• The Formulation of NMFD

• The Operator Shifts The Columns

WHV

1

0

T

t

t

t HWV

987

654

321

A

870

540

2101

A

700

400

1002

A ….

i

)(

Page 9: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factor Deconvolution

• The Cost Function

• The Update Rules

F

VV

VD

ln

1

Tt

t

Tt

W

VW

HH Tt

Tt

tt

H

HV

WW

1

10 Tt

1

0

T

t

t

t HW, where

Page 10: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factor Deconvolution

Page 11: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factor Deconvolution

• In this example the drum sounds exhibit some overlap at both time and frequency

Three types of drum sounds present into the scece Sampled at 11.025 kHz 256-point DFTs which were overlapping by 128-points Performed for 3 basis functions

Page 12: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Non-negative Matrix Factor Deconvolution

• Reconstruction

tT

t

jtj HWV

1

0

)(

Page 13: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component.

Conclusions

• Pinpointed some of the shortcomings of conventional NMF when analyzing temporal patterns and presented an extension

• Spectral bases have been used on spectrograms to extract sound objects from single channel sound scenes