1/35 Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion Journal club presentation Imane El hamzaoui [email protected]S´ eparation non-supervis´ ee de composantes multivalu´ ees parcimonieuses et applications en astrophysique 20/05/2019 Universit´ e Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Outline
1 Introduction
2 Sparse BSS from Poisson measurementsOverview of the problemFull description of the pGMCA algorithmApplications in astrophysics
3 Sparse BSS with spectral variabilitiesOverview of the problemProposed algorithmPreliminary results
4 Conclusion
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
3/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Multivalued data analysis with BSSIntroduction to BSS
- Modelization of the data through the Linear Mixture Model(LMM):
- Blind Source Separation (BSS) aims at disentangling mixedcomponents to retrieve spectral and spatial information.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
4/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Multivalued data analysis with BSSIntroduction to BSS
minA,S‖X− AS‖2F . (1)
Ill-posed problem requiring further assumptions:
- Statistical independence of the sources: IndependentComponent Analysis 1,
- Non-negativity of the components: Non-negative MatrixFactorization 2,
- Sparsity of the sources (possibly in a transformed domain):sparse BSS e.g. Generalized Morphological ComponentAnalysis algorithm (GMCA 3).
1Comon et al 2010
2Lee et al 1999
3Bobin et al 2007
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
5/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Multivalued data analysis with BSSGoal and organization of the PhD
BSS has proven to be efficient in the detection of microwaveand infra-red rays, including the detection ofthe oldest observable electromagnetic radiation of the Universe 4.
This PhD is aimed at extending BSS methods to high energydata (detection of supernova remnants, blackholes...).
Supernova remnant Cassiopeia A seen by X-ray
telescope Chandra
CMB reconstruction with sparse BSS
4Bobin et al 2013
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
6/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Multivalued data analysis with BSSGoal and organization of the PhD
Challenges raised by high-energy imaging
1 Poisson noise: High-energy photon count is so low that wecannot consider the noise gaussian. The modelisationX = AS + N is no more valid.
Observation derived from Chandra simultations with gaussian noise and poissonian noise. Both of the noises have
the same level in terms of mean square error.
Poisson noise, unlike gaussian noise is data dependent.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
7/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Multivalued data analysis with BSSGoal and organization of the PhD
Challenges raised by high-energy imaging
2 Spectral variabilities:spatially variant spectra are ubiquitious to X-ray imaging.Their estimation is of great astrophysical intereste.g. Fe line shifting allows to estimate the speed of supernovaeremnants for example.
Spectral distribution Spatial distribution of Fe1 Spatial distribution of Fe2
Necessity of a method fully accounting for spectral variabilities.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
8/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Outline
1 Introduction
2 Sparse BSS from Poisson measurementsOverview of the problemFull description of the pGMCA algorithmApplications in astrophysics
3 Sparse BSS with spectral variabilitiesOverview of the problemProposed algorithmPreliminary results
4 Conclusion
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
9/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Overview of the problem
Model X = AS + N not valid.
The noise corrupting high energy data follows shot noise statistics.
Poisson law
P(Xj [t] | [AS]j [t]) =e−[AS]j [t][AS]j [t]Xj [t]
Xj [t]!, (2)
where [AS]j [t] is the sample of the pure mixture AS located at thej-th row and t-th column.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
10/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Overview of the problemSparse BSS with Poisson measurements
P(Xj [t] | [AS]j [t]) =e−[AS]j [t]
[AS]j [t]Xj [t]
Xj [t]!
Optimization function
minA,SL(X | AS)︸ ︷︷ ︸
antiloglikelihood
+ ‖ Λ� SΦT ‖1 +i.≥0(S)︸ ︷︷ ︸constraints on S
+ iC (A)︸ ︷︷ ︸constraints on A
, (3)
where L the antiloglikelihood of Poisson noise:
L(X | AS) =∑j ,t
[AS]j [t]− Xj [t] log([AS]j [t])
= AS− X� log(AS),
(4)
Λ contains the regularization parameters;C = OB(m) ∩ K+.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
11/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Overview of the problemSparse BSS with Poisson measurements
Optimization function
minA,SL(X | AS)︸ ︷︷ ︸
antiloglikelihood
+ ‖ Λ� SΦT ‖1 +i.≥0(S)︸ ︷︷ ︸constraints on S
+ iC (A)︸ ︷︷ ︸constraints on A
, (5)
Multiconvex problem =⇒ Block Coordinate Descent (BCD)algorithm 5;
Smooth and differentiable likelihood required =⇒ replace it bya smooth approximate.
L(X | AS) = AS− X� log(AS).
5Tseng 2001
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
12/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Smooth approximation of the data-fidelity term
We propose an approximation of L based on Nesterov’s techniqueNesterov, 2005
Lµ(X | Y) = infU < Y,U > − L∗(X | U)︸ ︷︷ ︸Fenchel dual of L
− µ‖U‖2F︸ ︷︷ ︸
regularization function
,
(6)
where µ ∈ R+ is the smoothing parameter.
Lµ is differentiable and admits a 1µ -Lipschitzian gradient.
Hierarchial Alternating Least Square algorithm: NMFalgorithm with sequential updates 6;
β NMF: NMF with Kullback-Leibler divergence (β=1) 7;
sparse NMF algorithm 8.
6Gillis et al, 2012
7Mihoko et al, 2002
8Le Roux et al, 2015
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
21/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
State-of-the-Art algorithms compared to pGMCA
Metric: SAD = 1n
∑ni=1 arccos(< Ai | Ag
i >) with A the mixingmatrix recovered with the proposed approach and Ag theground-truth mixing matrix.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
22/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Outline
1 Introduction
2 Sparse BSS from Poisson measurementsOverview of the problemFull description of the pGMCA algorithmApplications in astrophysics
3 Sparse BSS with spectral variabilitiesOverview of the problemProposed algorithmPreliminary results
4 Conclusion
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
23/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Overview of the problem
The mixing matrix is pixelwise dependent:
∀ sample k X[k] =n∑
i=1
Ai [k]Si [k] + N[k], (11)
State-of-the-Art model: Perturbed Linear Mixture Model (PLMM)a
aThouvenin et al, 2016
X = AS + ∆AS
Applied to hyperspectral terrestrial images.
sum-to-one assumption∑
i Si = 1: the sources are notindependent,
pure pixel assumption ∀i , ∃k ′/X[k ′] = Ai .Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
24/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Overview of the problemLinearization and angular variability
Inspired by Perturbated Linear Mixture Model (PLMM), welinearise A
∀i , j , k Aij [k] = Ai
j + ∆ij [k]
Angular variability:
‖∆i [k]‖2 = 2sin(θi [k]
2) ' θi [k]�‖Ai‖2;
since A ∈ OB(m) in the sparsity framework.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
25/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Overview of the problemLinearization and spatial regularization
∀i , j , k Aij [k] = Ai
j + ∆ij [k] with ‖∆i [k]‖2 = θi [k].
Optimization function:
minA,S
1
2
∥∥∥∥∥(X−∑i
AiSi )
∥∥∥∥∥2
F
+ ‖Λ� S‖1
Underdetermined and (very) ill-posed problem → constraint onspectral variabilities (SV) required.
Spatial regularization of the SV:
∀i‖γ � θi ΨT‖1 =‖γ�‖Ai − Ai‖2 ΨT‖1
'‖γ � (Ai − Ai )ΨT‖2,1.(12)
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
26/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Optimization function
minA,S
1
2
∥∥∥∥∥(X−∑i
AiSi )
∥∥∥∥∥2
F
+‖Λ� S‖1+n∑
i=0
∥∥∥γ � (Ai − Ai )ΨT∥∥∥
2,1+iC (A)
(13)where
Λ (resp γ) contains the regularization parameters and weightsfor the source matrix and resp. the spectral variabilities,
C = OB(m) ∩ K+.
For these preliminary tests, we do not enforce sparsity of thesources.
Multiconvex problem 99K BCD algorithm.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
27/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Initialization and update of S
Initialization
GMCA per patch algorithm: GMCA on blocks + filtering. a
aBobin et al, 2013
Update of S assuming A is fixed
minS
1
2
∥∥∥∥∥(X−∑i
AiSi )
∥∥∥∥∥2
F
.
Moore-Penrose pseudo-inverse : S(l) = A(l)†X .
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
28/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Update of A
Update of A assuming S is fixed
minA
1
2
∥∥∥∥∥(X−∑i
AiSi )
∥∥∥∥∥2
F
+n∑
i=0
∥∥∥γ � (Ai − Ai )ΨT∥∥∥
2,1+ ιC (A).
The proximal operator of the positivity and the obliqueconstraint is their composition,
The proximal operator of the `2,1 norm in transformed domainis analytical...
... but there is no proximal operator for all three constraint.
We use a Generalized Forward Backward (GFB) algorithm.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
29/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Update of Aprox of `2,1
minA
1
2‖(X− AS)‖2
F+n∑
i=0
∥∥∥γ � (Ai − Ai )ΨT∥∥∥
2,1+ι.≥0(A)+ι‖.‖2=1(A).
At iteration (k + 1),γ acts as a threshold applied to‖A(k) − A + 1
LA(X−A(k) � S)ST‖2 (χ distribution). Following the
previous reasonning (applied to a χ distribution), we have:
∀i , λi ' 1.5 k MAD(‖(A(k) − A +1
LA(X− A(k) � S)ST )i‖2)
To allievates biases errors:
∀i , ∀k , γi [k] = λiwi [k]
wi [k] + ε
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
30/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Numerical experimentsDataset
2 sources, 1500 samples and 5 observations,sources generated from Generalized Gaussian distribution withρ = 0.3,Spectral variabilities exactly sparse in DCT domain (2activated coefficients for each source) and low frequency,Maximal amplitude of θ
6 ,comparison with GMCA and GMCA per patch.
Projection of the two first sources onto the slice defined
by the two first observations of the hypersphere Sm−1
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
31/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Numerical experiments
Figure: Spectral variabilities in the sample domain
θ = π6 θ = π
8 θ = π12
svGMCA 9.97× 10−5 1.11× 10−4 7.13× 10−5
GMCA per patch 8.69× 10−3 3.26× 10−4 1.57× 10−4
GMCA 9.63× 10−3 4.07× 10−4 9.31× 10−3
Table: GMSE for various angles
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
32/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Outline
1 Introduction
2 Sparse BSS from Poisson measurementsOverview of the problemFull description of the pGMCA algorithmApplications in astrophysics
3 Sparse BSS with spectral variabilitiesOverview of the problemProposed algorithmPreliminary results
4 Conclusion
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
33/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
ConclusionFirst half of the PhD
pGMCApGMCA has been presented in iTwist’19 conferenceJournal papier on pGMCA submitted on IEEE journalpGMCA is being currently applied to Chandra data by
F.Acero9.
svGMCA
Preliminary resultssvGMCA submitted to SPARS conference
9Departement d’ Astrophysique, CEAUniversite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
34/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
ConclusionSecond half of the PhD
svGMCAEncouraging preliminary results on SVs.Work on progress: leverage morphological diversity betweenthe sources and the spectral variabilitiesPreparation of a journal article with focus on the introducedmethodologyApplication to high-energy astronomical data
spectral variabilities with shape informationMethodology and applications to come.
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay
35/35
Introduction Sparse BSS from Poisson measurements Sparse BSS with spectral variabilities Conclusion
Acknowledgement
This work is supported by the European Community through thegrant LENA (ERC StG - contract no. 678282).
Universite Paris-Saclay Laboratoire Cosmostat, CEA Paris-Saclay