Top Banner
GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009
39

GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Jan 05, 2016

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

GP-based Image Segmentation (GPIS)

withApplications to Biomedical

Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 2: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Problem statement

(c) Louis Charbonneau and Nawwaf Kharma, 2009

• How do we select an optimal sequence of low-level image operators (& parameters) to get the segmented image?

Page 3: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Segmentation example: cell nuclei

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 4: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 5: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 6: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 7: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 8: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 9: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Model description• We use Cartesian GP:– Primitive operators are clearly defined, their right combination is the problem

– CGP allows for an easy interpretation of the resulting sequence

– Segmentation is a class of problems without one perfect solution; CGP can handle this

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 10: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

System objectives • Effectiveness: segmentation should be correct• Efficiency: The smallest number of operations• Transparency: operation sequences should be easy to understand

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 11: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

System objectives (cont.)• Segmentation should be doable without a priori information (except for training ground truths)• Generality: effective on wide classes of images• Ease of Use: Minimal human intervention

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 12: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 13: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 14: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 15: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 16: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Crossover

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 17: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Mutations (I)

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 18: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Mutations (II)

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 19: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 20: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Data

(c) Louis Charbonneau and Nawwaf Kharma, 2009

1026 images, 512 x 384 pixels

120 images, 340 x 780 pixels

Page 21: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

System settings, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 22: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Pixel segmentation accuracy, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 23: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Cell segmentation accuracy, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 24: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Statistical results, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 25: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Example of evolved program, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 26: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Example of evolved program, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 27: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

System settings, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 28: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Pixel segmentation accuracy, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 29: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Cell segmentation accuracy, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 30: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Statistical results, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 31: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Example of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 32: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 33: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 34: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 35: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Superimposed input + evolved program

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 36: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

GPIS on other types of images

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Lane detection tree detection

Page 37: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

GPIS on other types of images

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Intra-cellular content of Wright-stained white blood cell images

Page 38: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Conclusion• CGP was able to adapt to the complexity of input images:– A short program was evolved to solve the easy problem – a longer program was evolved to solve the harder problem

• Operator pool can be extended with specialized operators• Injection was a reliable means of maintaining population diversity

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 39: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009.

Conclusion• A training window approach is very effective for operator refinement

• A small but accurate set of ground truths is enough to evolve segmentation algorithms without a priori information on the images

(c) Louis Charbonneau and Nawwaf Kharma, 2009