Top Banner
Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan, Begoña Acha, and Carmen Serrano University of Calgary, Calgary, Alberta, Canada University of Seville, Spain
54

Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Mar 15, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color Image Processing with Biomedical Applications

Rangaraj M. Rangayyan, Begoña Acha, and Carmen Serrano

University of Calgary, Calgary, Alberta, Canada University of Seville, Spain

Page 2: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

2

SPIE Press 2011 434 pages

Page 3: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

The Nature of Color Images

3

Photo courtesy of Chris Pawluk

Page 4: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color Attributes

4

Hue: dominant wavelength or band Saturation: quality or colorfulness, not diluted with white Intensity or Brightness: primary visual sensation related to physical luminance Also used: Chroma, Lightness

Page 5: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color Perception and Trichromacy

5

Page 6: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

6

Representation of Color Images: Color Spaces

A color image may be represented using the following standard representations:

• [red, green, blue] or RGB

• [cyan, magenta, yellow, black] or CMYK

• [hue, saturation, intensity] or HSI

• L*u*v*, L*a*b*

• YIQ, YUV, CIE RGB, CIE XYZ

• others…

Page 7: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color-matching Functions

7

Page 8: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color-matching Functions

8

Page 9: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

CIE Chromaticity Diagram: Triangular Gamut of sRGB

9

Page 10: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

The RGBW-CMYK Cube

10

Page 11: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

11

Relationships between RGBW, HSI, and CMYK representations of color images

Page 12: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

12

Hue, Saturation, and Intensity

Varying hue with constant saturation and intensity

Varying hue and saturation with constant intensity

Page 13: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

13

Representation of Color Images: RGB

Original image Red component

Green component Blue component

Page 14: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

14

Representation of Color Images: RGBV Histograms

Page 15: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

15

Representation of Color Images: RGB Histogram

Page 16: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

16

Representation of Color Images: HSI

Original image Hue

Saturation Intensity

Page 17: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

17

Representation of Color Images: HSI

Original image Hue

Sin (hue/2) = distance from red Sin[(hue-120)/2] = distance from green

Page 18: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

18

Representation of Color Images: HSI

Original image Hue-saturation histogram

Page 19: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

19

HSI: Roles of Hue Saturation and Intensity

Page 20: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

20

Chromatic vs Achromatic Pixels

Page 21: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Natural versus Pseudo Color

21

Page 22: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Acquisition of Color Images

22

1. Sensor color filter array data

2. Dark current correction

3. White balance

4. Demosaicking

5. Color transformation to unrendered color space

6. Color transformation to rendered color space

Page 23: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Demosaicking by Interpolation

23

Page 24: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

The Need for Calibration of Color Images

24 Image Alert!

Page 25: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color Characterization

25

Page 26: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Filtering to Remove Noise

26

Page 27: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Neighborhood Shapes

27

Page 28: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Mean and Median Filtering

28

Mean = 90.67 Median = 87

Page 29: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Ordering of Vectorial Data

29

RGB pixel values in a 3x3 neighborhood of a color image:

Page 30: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Marginal Median: sort by R, G, B

30

Page 31: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Reduced Ordering: Euclidean distance to mean

31 =

Page 32: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Vector Median and Vector Directional Filters

32

sum of distances from each vector to all other vectors

Page 33: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

33

Filtering using statistics derived using adaptive neighborhoods

Page 34: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

34

Page 35: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

35

Page 36: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Enhancement of Color Images

36

Quite often, the enhancement required would be only in the intensity component: Gamma correction, Histogram equalization. Sometimes, saturation may need to be increased. Rarely would we want to alter the hue component. Processing the RGB components individually is not usually recommended.

Page 37: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

37

Page 38: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Enhancement of Contrast in Luminance and Color

38

Page 39: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

39

m: mean over 5x5 region max: max over image

Enhancement of Contrast in Luminance and Color

Page 40: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

40

Enhancement of Contrast in Luminance and Color

Page 41: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

41 Green and Blue channels also scaled as above [Liu & Yan]

Enhancement of Contrast in Luminance and Color

Page 42: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

42

Page 43: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

43

Color Histogram

Equalization

Page 44: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

44

Segmentation of Color Images

Selecting ranges in RGB Selecting ranges in HSI

Page 45: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

45 Image Alert!

Page 46: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

46

Segmentation of Images of Skin Ulcers

Black (necrotic scar) Ulcer regions

Red (granulation) Yellow (fibrin)

Original image Hue-saturation histogram

S>0.4 and H 300º to 0 to 30º

S>0.2 and H 30º to 90º

S<0.2 and I<0.25*max

Page 47: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Segmentation: k-means Algorithm

47

color pixel dataset

code book of centroids

set of pixels corresponding to vi : for which vi is nearest

Page 48: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Segmentation: k-means Algorithm

48

Starting from the finite dataset X, iteratively move the k code vectors so as to minimize an error measure and recalculate the sets.

Page 49: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

49

Page 50: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

50

Page 51: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color Deconvolution in Histopathology Images

51

R G B

P =

Page 52: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Color Separation in Histopathology Images

52

Page 53: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Additional Topics

53

Edge detection in color Region growing in color Morphological image processing in color Hyperspectral image processing Analysis of texture in color Coding and data compression of multispectral data Analysis of burn wounds Analysis of skin ulcers Teledermatology Telepathology Aerial photogrammetry...

Page 54: Color Image Processing - University of Calgarypeople.ucalgary.ca/~ranga/enel697/ColorImageProcessingIntro.pdf · Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan,

Thank You!

Please see the book for details, references, and credits