Top Banner
IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY VARYING SYSTEMS Ron Gaizman and Yehoshua Y. Zeevi, Department of Electrical Engineering, Technion, Haifa, Israel. 1
25

IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Aug 09, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

IMAGE UNMIXING SUCCESS ESTIMATION IN

SPATIALLY VARYING SYSTEMS

Ron Gaizman and Yehoshua Y. Zeevi,Department of Electrical Engineering, Technion,

Haifa, Israel.

1

Page 2: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

• The problem of recovering source signals from mixtures with only limited knowledge of the mixing process.

• Motivation: Speech signals separation, Image reflection unmixing, Medical Signals Anaysis (MRI, ECG), Communication signals unmixing,…

• Example: “Cocktail party problem”

Introduction

sN zN

2

Page 3: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Introduction

1 111 12

21 222 2

Z SH

z sh h

h hz s

3

Page 4: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Introduction

1 1

21 11 22 122 2

''

'1 1

/ / '

Z SH

z s

h h h hz s

4

1 11 1

2 12 2

'

'

s h s

s h s

Page 5: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

SSCA( Staged Sparse Component Analysis )

1 1

2 2

1 1

2 3

Z SH

z s

z s

s1

s2

z1

z2

s1

s2

z1

z2

5

Space invariant Instantaneous example:

Stage 1:Estimate based on sparseness of the data.

Stage 2:Use in order to estimate .H S

H

R.Kaftory, Y.Zeevi 2009

Page 6: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

SSCA( Staged Sparse Component Analysis )

s1

s2

z1

z2

2

1

1 221 22

*1 2

1 2

' ' ' '

2 3,

* 0 either 0

zr active active

z

s sh h

s s

s s

s1

s2

z1

z2

0 0.5 1 1.5 2 2.5 3 3.5 4 4.50

1000

2000

3000

4000

r1 hist

0 0.5 1 1.5 2 2.5 3 3.5 4 4.50

2

4

6

r1 smooth by gaussian kernal with =0.040241

| 2.9996| 2.00176

Stage 1:

Page 7: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Non-Sparse signals Sparsify

7

Page 8: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Signals Estimation

8

ˆ

ˆˆ ˆ ˆargmin RegS

S Z H S S

Page 9: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Success Estimation Method (SEM)

* Function Demands:

- Local Minima when

- Smooth, Convex around true parameters.

* Known Methods demand prior knowledge :

- Signals independence on one another ( ).

- Signals sparseness on some domain.

( ) 0.20.3

ˆ ˆ ˆ ˆ, , ,i i i iPC s Edge s Grad s SIFT s

ˆS

ˆ

ˆ ˆ ˆ ˆ ˆ: minS S

9

1 2ˆ ˆ,MI s s

A.Achtenberg Thesis 2011

Page 10: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Proposed Success Estimation Method(SEM)

Use additional knowledge of active set coefficients to estimate success.

10

Page 11: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

1

2

1 2 1 2 1 2

1 1

1 2

ˆ ˆ, , , , ,

ˆ

ˆ

ˆp p

active set s

active set s

s s z z active set s active set s

z s

z s

1z 1z

11

Proposed Success Estimation Method

Page 12: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Success Estimation Methods (SEM)

12

- Success versus deviation in mixing system parameters estimation.- Other methods do not satisfy function demands.

Proposed SEM

Page 13: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Feedback Approach to Signal Estimation

Sparse Representation

System Model Estimation

Sources Estimation

Separation Success

Estimation

Mixtures S

ˆ

ˆ

ˆ ˆmin

ˆ ˆ ˆ ˆ. . argmin RegS

S

s t S Z H S S

13

ˆ

Page 14: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Feedback Approach : An Example

s1

s2

z1

z2

14

s1 gal (lsqlin),MSE=0.00026189, SNR=12.1468[dB]

s2 gal (lsqlin),MSE=0.00023082, SNR=12.4588[dB]

s1 gal-s

1

s2 gal-s

2

Original Signals Mixtures Estimated Signals using SSCA

Page 15: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

15

Optimization of success estimation function.

-0.2 -0.15 -0.1 -0.05 0 0.05 0.1 0.15 0.2

-0.2

-0.1

0

0.1

0.2

0.1

0.15

0.2

0.25

0.3

0.35

2

1

Success Optimization using Q Newton

Success E

st

Feedback Approach : An Example

ˆ

ˆ

ˆ ˆmin

ˆ ˆ ˆ ˆ. . argmin RegS

S

s t S Z H S S

Page 16: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Feedback Approach : An Example

Without Feedback With Feedback

Page 17: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Summary

• Staged Sparse Component Analysis Method.

• Success Estimation Method For Signal and Image un-mixing.

• Feedback Approach for improving Sources Reconstruction.

17

Page 18: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

The End…

18

Page 19: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Mixing kernels

• Instantaneous time/space invariant

• Instantaneous time/space variant

• Attenuation and shift time/space variant

,ij ij ijh a T

,ij ijh a

,ij ijh a

19

Page 20: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Sparsification

• Commutative

• One ‘Active’ Source

Z H S H S

1...|

: 1.. , 1.. :

,

z

ii N

s z

i ij j

activeset min z th

activeset j N N

z h s

20

Page 21: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Proposed Success Estimation Method

21

12 121

12 122

12 12

12 12

12

12

1 2 1 2

12 12

1 1,

12 12

1 2,

12 12

1,

12 12

1 2,

,

ˆ ˆ, , , ,

ˆ· ·

ˆ· ·

ˆ· ·1..2

ˆ· · ·1..2

1..2

ˆ

k k

k k

k k

k k

i

k

i

p p k

k kk p q s p

k kk p q s p

k kk p q s p

k kk p q s p

k p

i

q

i

s s z z p

z p s p

z p s p

z p s pi

s s p s pi

i

12

12 12

12 12 12

1 2

12 1

ˆ

2

,

ˆ· · ·

ˆ· ·1..2

0

i

i

k

k k

k k ks p

i k kk p q s p

i

i

s p s p s p

s p s pi

Page 22: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Single path mixtures

,ij ij ijh a T

, , , , , ,x y

i ij ij j ij ij

j j

z x y w x y a x y s T x y T x y

22

𝑇𝑖𝑗 𝜉

Page 23: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Not Sparse ? Sparsify

23

• Single path spatial distortion system

-> SIFT (for spatial transform)

Model 1 matches:314 (/469) SIFT matches

Model 2 matches:73 (/469) SIFT matches

1...|

|

z

aligned

ii N

aligned

i

i

activeset min z th

activeset z th

Page 24: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Not Sparse ? Sparsify

24

• Single path spatial distortion system

-> SIFT (for spatial transform) + Alignment

z1

z2 aligned

Page 25: IMAGE UNMIXING SUCCESS ESTIMATION IN SPATIALLY … · Proposed SEM. Feedback Approach to Signal Estimation Sparse Representation System Model Estimation Sources Estimation ... Feedback

Not Sparse ? Sparsify

25

• Single path spatial distortion system

-> SIFT (for spatial transform) + Alignment + Wavelet Transform (For attenuation model)

50

100

150

200

250

300

350

400

450

500

50 100 150 200 250 300 350 400 450 500

#points=9511

X

Y

100200

300400

50050 100 150 200 250 300 350 400 450 500

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

2

2.2

Y

X

All Points: #= 9579

r

Outliers, #points=5489

Model #1 #points=4090

Estimated Model #1

True Model #1