Top Banner
The Best Bits in the Iris Code Karen Hollingsworth Dept. of Computer Science and Engineering University of Notre Dame
44

The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Mar 17, 2018

Download

Documents

truongnga
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

The Best Bits in the Iris Code

Karen Hollingsworth Dept. of Computer Science

and Engineering University of Notre Dame

Page 2: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

2

Where do the bits in the iris code come from?

Page 3: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Acquire Image Segment Iris

“Unwrap” the Iris Region

3

Steps in Iris Biometrics

Page 4: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Apply filter to normalized iris

Real Axis

Imaginary Axis

00

01 11

10

Quantize complex filter response

1111111010100000000101…

4

Steps in Iris Biometrics

Page 5: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Compare two aligned iris codes using Hamming distance, masking regions covered by eyelids.

1111111010100… 1111101010101…

HD =codeA⊕ codeB( )∩maskA∩maskB

maskA∩maskB

Fractional Hamming distance score

5

Steps in Iris Biometrics

Page 6: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

6

Fragile Bits

Page 7: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Bolle et al. suggested that “…perhaps not all bits are

equally likely to flip, … there are some particularly ‘fragile’ bits.”*

7

Existence of Fragile Bits

*Ruud M. Bolle et al., “Iris individuality: A partial iris model,” in Int. Conf. on Pattern Recognition, 2004, II: 927-930.

Page 8: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

8

We compared iris codes from multiple aligned images of the same eye.

1101010010...

0101000010...

1101010010...

Comparison for consistency

Existence of Fragile Bits

Page 9: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

9

Data:   1226 images   24 subjects   For each subject, we had between 15 and

118 images of their left eye

Software:   IrisBEE software with the segmentation

improvements by Xiaomei Liu.*

Existence of Fragile Bits

*Xiaomei Liu, Kevin W. Bowyer, and Patrick J. Flynn, “Experiments with an improved iris segmentation algorithm,” in Proc. Fourth IEEE Workshop on Automatic Identification Technologies, 2005, 118-123.

Page 10: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

10

Once we had multiple iris codes from the same eye, we aligned them, and compared them to find the average value for each bit.

1101010010…

0101000010…

1101010010…

1101000010…

0101000010…

0.6 1 0 1 0 0.4 0 0 1 0…

Fragile bits are shown in black.

Existence of Fragile Bits

Page 11: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

11

All subjects had fragile regions in their iris codes.

Fragile bits for 4 different subjects.

Existence of Fragile Bits

Bits that flipped in more than 30% of iris codes were marked as fragile. The masked region is the union of masked regions across all images.

Page 12: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

12

The number of fragile bits depends on the threshold used.

There are more bits that flip in at least 20% of iris codes than there are that flip in at least 40% of iris codes.

Existence of Fragile Bits

Page 13: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

13

Where do fragile bits come from?

Page 14: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

14

Where do fragile bits come from?

1110100001…

1010100001…

00

01 11

10 1010100001…

1110100001…

1010100001…

Fragile bits come from the quantization of the filter response.

Page 15: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

15

Where do fragile bits come from?

1110100001…

1010100001…

00

01 11

10 1010100001…

1110100001…

1010100001…

The best bits come from filter responses far from the axes.

Page 16: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

16

Where do fragile bits come from?

We are not saying that particular parts of the iris are fragile.

Instead, bit fragility occurs when the combination of iris texture an filter produces a result with (1) a small magnitude, or (2) a phase response close to the quantization boundary.

Page 17: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

17

Where do fragile bits come from?

When we use a different filter, we get a different fragile bit pattern.

Fragile bit pattern created using a filter from OSIRIS.

Fragile bit pattern created using a filter from IrisBEE.

Page 18: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

18

Where do fragile bits come from?

Larger filters produce fewer fragile bits.

OSIRIS came with three different sizes of 2D Gabor filters. We graphed the consistency of bits created by each filter.

X-axis is percent of times a bit flipped for the given filter. Y-axis is frequency.

Page 19: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

19

Can we mask fragile bits?

Page 20: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

20

Theoretically, we could create a mask for each subject, and use it to mask fragile bits during matching.

Probe: iris & occlusion-mask

Gallery: iris, occlusion-mask, & consistency-mask

compare

compare

Can we mask fragile bits?

Page 21: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

21

Experimentally, we tried a simpler technique to approximate masking fragile bits.

Real Axis

Imaginary Axis

00

01 11

10

Can we mask fragile bits?

Fragile regions

Page 22: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

22

Masking bits close to the axes of the complex plane improved performance.

All numbers included. Bits from complex numbers close to the axes omitted from

calculations.

Can we mask fragile bits?

Page 23: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

How many fragile bits should we mask?

23

Page 24: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

 Daugman suggested masking 25% of bits closest to the axes.

 Barzegar et al. found that 35% works best on CASIA v3 iris images.*

24

How many fragile bits should we mask?

*N. Barzegar and M.S. Moin, “A New User Dependent Iris Recognition System Based on an Area Preserving Pointwise Level Set Segmentation Approach,” EURASIP Journal on Advances in Signal Processing, 2009.

Page 25: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

  Tanya Peters masked 40 to 50% of bits with good success using my set of low-occlusion, high-quality images.

 On larger data sets, both Tanya and I have found that less masking is better (5 to 10%).*

25

How many fragile bits should we mask?

*Hollingsworth, Bowyer, and Flynn, Improved Iris Recognition Through Fusion of Hamming Distance and Fragile Bit Distance, submitted.

Page 26: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

  Trade-off: Masking more bits reduces amount of good information, but the bits left are theoretically of higher quality.

 Speculation: You can mask more fragile bits when you have data of higher quality or with less occlusion.

 However, Tanya tried experiments masking different amounts depending on quality level, and did not get any clear results, so this is still an open question.

26

How many fragile bits should we mask?

Page 27: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

What else could we do with fragile bits?

27

Page 28: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

28

Subject 2463 Image 1910 2400 fragile bits

Subject 2463 Image 1912 2396 fragile bits

Subject 4261 Image 1032 2389 fragile bits

Subject 4261 Image 1034 2400 fragile bits

Fragile Bit Masks What Else can be done with Fragile Bits?

Page 29: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

29

Comparisons Between Pairs of Masks

2463 match comparison: 3631 masked bits

4261 match comparison: 3721 masked bits

Nonmatch comparison: 4202 masked bits

Nonmatch comparison: 4247 masked bits

What Else can be done with Fragile Bits?

Page 30: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Measures how well two fragile bit patterns align. Each iris template contains

an iris code i, an occlusion mask m, and a fragility mask f.

Unmasked bits = 1, Masked bits = 0.

30

Fragile Bit Distance (FBD) What Else can be done with Fragile Bits?

Page 31: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

The FBD expresses the fraction of unoccluded bits masked for fragility. The FBD between two iris templates A and B is:

31

Fragile Bit Distance (FBD) What Else can be done with Fragile Bits?

Page 32: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Each iris code: 25% fragile, 75% consistent. In a nonmatch comparison: (75%)(75%) = 56.25% consistent in both iris codes, i.e. 43.75% fragile (FBD = 0.4375).

32

Expected FBD What Else can be done with Fragile Bits?

Page 33: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Each iris code: 25% fragile, 75% consistent. In a nonmatch comparison: (75%)(75%) = 56.25% consistent in both iris codes, i.e. 43.75% fragile (FBD = 0.4375). In a match comparison: between 25% and 43.75% fragile

33

Expected FBD What Else can be done with Fragile Bits?

Page 34: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Data: 19891 images 686 subjects (1372 eyes) LG 4000 camera

34

What Else can be done with Fragile Bits?

Page 35: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Average Impostor FBD (std dev)

Average Genuine FBD (std dev)

Theoretical Value 0.4375

Between 0.25 & 0.4375

Measured Value 0.4397 (0.0097) 0.4047 (0.0149)

35

FBD for matches and nonmatches

What Else can be done with Fragile Bits?

Page 36: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

36

  FBD is less powerful than HD.

  Fusion is better than either alone.

  Fusion methods tried:

  Multiplication   Weighted

Average

Joint distribution of HD and FBD What Else can be done with Fragile Bits?

Page 37: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

FBD is less powerful than HD, but we can combine the two features and do better than HD alone.

37

Method Equal Error Rate (EER)

HD (baseline) 8.70 x 10-3

0.4HD + 0.6FBD 8.02 x 10-3

HD x FBD 7.99 x 10-3

The EER decreased by 8%.

What Else can be done with Fragile Bits?

Page 38: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

38

What Else can be done with Fragile Bits?

Page 39: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

39

Related Work

Page 40: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

40

Kong et al. divided the complex plane into six or eight bins and found an improvement in the ROC curve.

A. Kong, D. Zhang, and M. Kamel, “An Analysis of IrisCode,” IEEE Transactions on Image Processing, vol. 19, Feb. 2010, pp. 522-532.

Related Work

Page 41: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Conclusions

41

Page 42: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

  Fragile bits exist.   Fragile bits come from the quantization

of the filter response.   Fragile bits are a result of the

combination of iris texture and filter.  Masking fragile bits improves

performance.   Commercial systems already mask

fragile bits.

42

Conclusions

Page 43: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

  FBD measures how two fragile bit patterns differ.

  Low FBDs -> Genuine Comparisons.   High FBDs -> Impostor Comparisons.

  To compute FBD, the system must save fragile and occlusion bits separately (costs space and time).

  Fusion of FBD and HD improves EER by 8%.

43

Conclusions

Page 44: The Best Bits in the Iris Code - University of Notre Damekwb/2010-09-FragileBitsTalk.pdfThe Best Bits in the Iris Code ... LG 4000 camera 34 ... 0.4HD + 0.6FBD 8.02 x 10-3 HD x FBD

Questions?

44