3/23/2005 © Dr. Zachary Wartell 1 Eyes and Displays.

3/23/2005 © Dr. Zachary Wartell 1

Eyes and Displays


Light

© Kessler , Watson, Hodges, Ribarsky

• Vision is perception of electromagnetic energy (EM radiation).

• Humans can only perceive a very small portion of the EM spectrum:

Wavelength (nm)

Gamma X UV Infra Radar FM TV AM AC

Violet Blue Green Yellow Red 400 500 600 700


Radiant-EnergyEmission Spectrum

Wavelength

Ene

rgy

or P

ower

,

Energy [ joules]:

, ( :Plank's Constant)

Power[Watts=J/s] :

, radiant flux, radiant power

photon f

fall photons

sourcef all photons

E h f h

E h f

E h f

dE

dt


Light in real world

medium

emission spectrum

reflection spectrum

phototopic curve(eye sensitivity)


Light in graphics

medium

emission spectrum

reflection spectrum

Display

RGB

RGB

RGB

RGBRGB

RGBpixels

space “outside”display typically

not computationallymodeled


Light interactions

Light interacts with a surface in some combination of:

• emission• reflection

– on surface : mirror, specular or diffuse– suspended particles: random scattering

• transmission– transparent, translucent, refraction

• absorption


Eye Structure

• The eye can be viewed as a dynamic, biological camera: it has a lens, a focal length, and an equivalent of film.

• A simple diagram of the eye's structure:

Retina

Lens

Cornea



Lens Basics: Light Refraction

• Snell’s Law

• η index of refraction – light speed in vacuum light speed in material– complications: varies with material temperature, light

wavelength, anisotropic materials, double refraction

NL

T

Rθiθi

θr

reflected

refracted

ηi

ηr

sin sinir i

r


Thin Lens Equation

:object distance1 1 1

:image distance

:focal distance

o

so i f

f

ff

o i


Thin Lens Equation

• If the incident light comes from the object, we say it is a real object, and define the distance from the lens to it as positive. Otherwise, it is virtual and the distance is negative.

• If the emergent light goes toward the image, we say it is a real image, and define the distance from the lens to it as positive.

• f = positive for a converging lens• f often cited in measured in diopters (1/m)• A light ray through the center of the lens is undeflected.

, Dr. Larry Hodges

ff

o i

ff

o i


Eye: The Lens

• The lens must focus (accommodation) on directly on the retina for perfect vision:

• But age, genetic factors, malnutrition and disease can unfocus the eye, leading to near- and farsightedness:

FarsightedNearsighted



Eye: The Retina

• The retina functions as the eye's "film".

• It is covered with cells sensitive to light. These cells turn the light into electrochemical impulses that are sent to the brain.

• There are two types of cells, rods and cones

Retina



The Retina: Cell Distribution


20,000

100,000

60,000

180,000

140,000

cones

rods

Blind spot

Num

bers

of r

ods

or c

ones

pe

r m

m2

Temporal periphery

Fov

ea

Opt

ic d

isk

Nasal

periphery

(Right Eye)

20,000

100,000

60,000

180,000

140,000

cones

rods

Blind spot

Num

bers

of r

ods

or c

ones

pe

r m

m2

Temporal periphery

Fov

ea

Opt

ic d

isk

Nasal

periphery

(Right Eye)“Blind Spot Trick”


Dark Adaptation

[Goldstein,pg 56]


The Retina: Rods


• Sensitive to most visible frequencies (brightness).

• About 120 million in eye.

• Most located outside of fovea, or center of retina.

• Used in low light (theaters, night) environments, result in achromatic (b&w) vision.

• Absorption function:

400 700nm

500n

m

Rod

555n

m

Cone


The Retina: Cones


• R cones are sensitive to long wavelengths (nm), G to middle nm, and B to short nm.

• R: 64%, 32% G, 2% B• About 8 million in eye.• Highly concentrated in fovea, with B cones more evenly

distributed than the others (hence less in fovea).• Used for high detail color vision (CRTs!), so they will

concern us most.


The Retina: Cones


• The absorption functions of the cones are:

400 700

B G R445 nm 535 nm

575 nm


Color Constancy


• If color is just light of a certain wavelength, why does a yellow object always look yellow under different lighting (e.g. interior/exterior)?

• This is the phenomenon of color constancy.• Colors are constant under different lighting

because the brain responds to ratios between the R, G and B cones, and not magnitudes.


Vision: Metamers

© Kessler , Watson, Hodges, Ribarsky,Wartell

• Because all colors are represented to the brain as ratios of three signals it is possible for different frequency combinations to appear as the same color. These combinations are called metamers.

This is why RGB color works!• Example – [Goldstein,pg143]

mix 620nm red light with 530nm green light matches color percept of 580 nm yellow

BG

R

1.05.0 8.0

BG

R

1.05.0 8.0

530 + 620 580


Sensitivity vs Acuity


• Sensitivity is a measure of the dimmest light the eye can detect.

• Acuity is a measure of the smallest object the eye can see.

• These two capabilities are in competition.

– In the fovea, cones are closely packed. Acuity is at its highest, sensitivity is at its lowest (30 cycles per degree).

– Outside the fovea, acuity decreases rapidly. Sensitivity increases correspondingly.


Displays: Pixel

• Pixel - The most basic addressable element in a image or on a display

– CRT - Color triad (RGB phosphor dots)– LCD - Single color element

• Resolution - measure of number of pixels on a image (m by n)

– m - Horizontal image resolution– n - Vertical image resolution

©Larry F. Hodges, Zachary Wartell


Other meanings of resolution

• Dot Pitch [Display] - Size of a display pixel, distance from center to center of individual pixels on display

• Cycles per degree [Display] - Addressable elements (pixels) divided by twice the FOV measured in degrees.

• Cycles per degree [Eye] - The human eye can resolve 30 cycles per degree (20/20 Snellen acuity).


3/23/2005 © Dr. Zachary Wartell 23©Larry F. Hodges, Zachary Wartell

Basic Image Synthesis Hardware (Raster Display)

DisplayProcessor Display

ProcessorMemory

FramebufferVideo

Controller

PeripheralDevices

CPU SystemMemory

System Bus

raster imagesfound here


Raster – Bit Depth

• A raster image may be thought of as computer memory organized as a two-dimensional array with each (x,y) addressable location corresponding to one pixel.

• Bit Planes or Bit Depth is the number of bits corresponding to each pixel.

• A typical framebuffer resolution might be

1280 x 1024 x 8

1280 x 1024 x 24

1600 x 1200 x 24



Displaying Color

• There are no commercially available small pixel technologies that can individually change color.

• spatial integration – place “mini”-pixels of a few fixed colors very close together. The eye & brain spatially integrate the “mini”-pixel cluster into a perception of a pixel of arbitrary color

• temporal integration - field sequential color uses red, blue and green liquid crystal shutters to change color in front of a monochrome light source. The eye & brain temporally integrate the result into a perception of pixels of arbitrary color



CRT Display


Focusing System

Electron Guns

Red Input

GreenInput

Blue Input

Deflection Yoke

Shadow Mask

Red, Blue, and Green

Phosphor Dots

CRT


Electron Gun

•Contains a filament that, when heated, emits a stream of electrons.

•Electrons are focused with an electromagnet into a sharp beam and directed to a specific point of the face of the picture tube.

•The front surface of the picture tube is coated with small phosphor dots.

•When the beam hits a phosphor dot it glows with a brightness proportional to the strength of the beam and how often it is excited by the beam.



•Red, Green and Blue electron guns.

•Screen coated with phosphor triads.

•Each triad is composed of a red, blue and green phosphor dot.

•Typically 2.3 to 2.5 triads per pixel.

FLUORESCENCE - Light emitted while the phosphor is being struck by electrons.

PHOSPHORESCENCE - Light given off once the electron beam is removed.

PERSISTENCE - Is the time from the removal of excitation to the moment when phosphorescence has decayed to 10% of the initial light output.

Color CRT


G R B G

B G R B

G R B G

3/23/2005 © Dr. Zachary Wartell 29©Larry F. Hodges, Zachary Wartell

•Shadow mask has one small hole for each phosphor triad.

•Holes are precisely aligned with respect to both the triads and the electron guns, so that each dot is exposed to electrons from only one gun.

•The number of electrons in each beam controls the amount of red, blue and green light generated by the triad.

Shadow Mask

SHADOW MASK

RedGreen

Blue

Convergence Point

Phosphor Dot Screen


CRITICAL FUSION FREQUENCY

•Typically 60-85 times per second for raster displays.

•Varies with intensity, individuals, phosphor persistence, room lighting.

Frame: The image to be scanned out on the CRT.

•Some minimum number of frames must be displayed each second to eliminate flicker in the image.

Scanning An Image



•Display frame rate 30 times per second

•To reduce flicker at lesser bandwidths (Bits/sec.), divide frame into two fields—one consisting of the even scan lines and the other of the odd scan lines.

•Even and odd fields are scanned out alternately to produce an interlaced image.

•non-interlaced also called “progressive”


Time

Interlaced Scanning

1/30 SEC

1/60 SEC

FIELD 1 FIELD 2

FRAME

1/60 SEC

1/30 SEC

1/60 SEC

FIELD 1 FIELD 2

FRAME

1/60 SEC


(0,0)

VERTICAL SYNC PULSE — Signals the start of the next field.

VERTICAL RETRACE — Time needed to get from the bottom of the current field to the top of the next field.

HORIZONTAL SYNC PULSE — Signals the start of the new scan line.

HORIZONTAL RETRACE — Time needed to get from the end of the current scan line to the start of the next scan line.

Scanning


Device CS(alternate conventions)

(0,0)


NTSC – ? x 525, 30f/s, interlaced (60 fld/s)PAL – ? x 625, 25f/s, interlaced (50 fld/s)HDTV – 1920 x 1080i, 1280 x 720pXVGA – 1024x768, 60+ f/s, non-interlacedgeneric RGB – 3 independent video signals and synchronization signal, vary in resolution and refresh rategeneric time-multiplexed color – R,G,B one after another on a single signal, vary in resolution and refresh rate

Example Video Formats



Calligraphic/Vector CRT

older technologyvector file instead of framebufferwireframe engineering drawings flight simulators: combined raster-vector CRT

P0

P1

P0

P1

Line (P0,P1)Video

Controller


Flat-Panel Displays

Flat-Panel

Emissive Non-Emissive

LED

CRT(90°deflected)

Plasma

Thin-Filmelectroluminescent

LCD DMD

Active-Matrix(TFT)

Passive-Matrix


Flat-Panel Displays (Plasma)

Flat-Panel


LED

CRT(90°deflected)

Plasma


LCD DMD

Active-Matrix

Passive-Matrix

ToshibaTM, 42”, Plasma HTDV$4,500 (circa 2005)


Flat-Panel Displays (Plasma)

[Hearn&Baker,pg 45]


Flat-Panel Displays (thin-film electroluminescent)

[Hearn&Baker,pg 45]


Flat-Panel Displays (LED)

Flat-Panel


LED

CRT(90°deflected)

Plasma


LCD DMD

Active-Matrix

Passive-Matrix

BarcoTM “Light Street” (LED)


Flat-Panel Displays (DMD)

Flat-Panel


LED

CRT(90°deflected)

Plasma


LCD DMD

Active-Matrix

Passive-Matrix

Digital Micro-mirror (DMD)

4 μm


LCD


• Liquid crystal displays use small flat chips which change their transparency properties when a voltage is applied.

• LCD elements are arranged in an n x m array call the LCD matrix

• Level of voltage controls gray levels.• LCDs elements do not emit light, use backlights behind the LCD

matrix


LCD nematic liquid crystal details

[Hearn&Baker,pg 46]


LCD Components


Small fluorescent tubes

Diffuser

Linear Polarizer

LCD Module Color

Filter

Linear Polarizer

Wavefront distortion

filter


LCD Resolution


LCD resolution is occasionally quoted as number of pixel elements not number of RGB pixels.

Example: 3840 horizontal by 1024 vertical pixel elements = 4M elements

Equivalent to 4M/3 = 1M RGB pixels

"Pixel Resolution" is 1280x1024

dot pitch


LCD


• Passive LCD screens– Cycle through each

element of the LCD matrix applying the voltage required for that element.

– Once aligned with the electric field the molecules in the LCD will hold their alignment for a short time

• Active LCD (TFT)– Each element contains

a small transistor that maintains the voltage until the next refresh cycle.

– Higher contrast and much faster response than passive LCD

– Circa 2005 this is the commodity technology


LCD vs CRT


flat & Lightweight

low power consumption

always some light

pixel response-time (8-30ms)

view angle limitations

resolution interpolation required

heavy & bulky

strong EM field & high voltage

true black

better contrast

pixel response-time not noticeable

inherent multi-resolution support


Eye Versus 1280 x 1024 Display

28° 1280 pixel = 640 cycles

33 cm

Pictured: 22.8 c/d (cycles/degree with Vres=600/x → 26.25→ 20/26.25 vision (Snellen acuity)Widescreen at 60° → 20/56.25 vision

66 cm


Measurements

• Radiometry• Photometry• “Brightness”


Radiometry Measures

Quantity SI unit Abbr.

Symbol Notes

radiant energy Joule J Q Energy

radiant flux/power Watt W Φ Energy per unit time

radiant intensity Watt per steradian

W/sr I Power per unit solid angle

radiance Watt per steradian per meter2

W/(sr∙m2)

L Power per unit solid angle per unit projected source area

irradiance Watt per meter2

W/m2 E power incident on a surface

radiant emittance/exitance

Watt per meter2

W/m2 M power emitted from a surface


Intensity (Watts/steradian)

y

x

NdΦ

dωθ

r

dAdω=dA/r2

dI

d


Irradiance (Watts/m2)

y

x

N

dωθ

●sums radiance over hemisphere arriving on a surface


Radiant Emittance (Watts/m2)

y

x

N

dωθ

●sums radiance over hemisphere leaving a surface


Radiance

y

x

NdΦ

dωθ

2

0 cos

dL

d ds

●measure in specific direction

ds0


Planckian Radiator

• “black body” radiator– radiate energy perfectly– absorb light perfectly (no reflection)– as the radiator temperature rises how does

the spectral power distribution change?

Φ (

W)

λ (nm)

1000K

2000K

3000KSPD


Graph of Theoretic Planckian Radiator SPD

20000 K

10000 K

5600 K

3000 K

2000 K

1000 K


Planckian radiator SPD in Visible Region

• increasing temperature (1000K to 100,000K) yields red, orange-red, yellowish-white, bluish-white

• tungsten bulb example

1000K 2000K 3000K

4000K 5000K 6000K

8000K 10000K 100,000K


Examples SPD’s

[McDonald]


Examples SPD’s

[McDonald]


Color Temperature

• if light source SPD is similar to black body radiator, associate the source’s color with the temperature at which a Planckian radiator will give similar color

Source Temp.

candle 1200K

tungsten lamp

2800K

bright midday sun

6000K

heavy overcast sky

10000K


Photometry

60 WConductors

-15 W

45 Wretinal

stimulation?

400 700

555n

m

photopic curve Vλ

W

nm

XΣ1.0

? = 900 lm


Photometry & Lumens

400 700

555n

m

(yell

ow-g

reen

)

photopic curve VλΦ

(W

)

λ (nm)

XΣ760

380

683 VvΦ

1.0

1 W of 555nm yields 683 lm


Photometry Measures

Quantity SI unit Abbr. Symbol Notes

luminous energy lumen second lm ∙ s Qv Energy

luminous flux/power

lumen lm Φv Energy per unit time

luminous intensity candela cd (=lm/sr)

Iv lum. flux per solid angle

luminance candela/meter2 cd/m2 Lv luminous flux per unit solid angle per unit projected area

illuminance lux (lm/m2) lx Ev light incident on a surface

luminous emittance/exitance

lux (lm/m2) lx Mv light emitted from a surface


Brightness Measures (!)

• very hard to define analytically (no simple Vλ)

• complications– contrast effects

• Gelb’s (1929) experiment – breaks light constancy

– adaptation effects• dark adapt one eye

• above effects can cause same SPD to be perceived differently

• active area of psychophysics research


Contrast Effects Example


Colorimetry: Measuring Color

• Colorimeter: adjust primaries so that:

R[R]

G[G]

B[B]

eye

C[C]

white screen

black partition

view holewith surround

“C[C] = R[R] + B[B] + G[G]”


Negative tristimulus values

• very pure target color may be unmatchable

C[C] ≠ R[R]+ G[G]+ B[B] for any (R,G,B)

• all we can do is de-saturate the target color C[C] + R[R] = G[G]+ B[B]

• this could be formulated as negative coordinates C[C] = -R[R] + G[G]+ B[B]

• No set of real primaries will allow for positive coordinates to match all real colors!


An Early Experiment (1931)

• Primaries: [R]=700nm, [G] = 546.1, [B] = 435.8• Determine tristimulus values (R,G,B) for set of target

stimulus {[Ci]} where [Ci] is a single spectral color (i.e. SPD contains 1 wavelength)

• Use (R,G,B)λ to definedistribution curves

, ,r g b 435.8 546.1 700


Compute tristimulus value (R,G,B) for any SPD

• Multiply SPD by and compute area under curve: , ,r g b

780 780 780

360 360 360

Let SPD be E

E , E , ER r G g B b

λ

Eλ

ener

gy

λ

r

tris

timul

us

λ

Eλ rR

Yuck! (R,G,B)can be < 0!


Transform tristimulus values between primaries

If C[C] = Rc1[R1]+ Gc1[G1] + Bc1[B1] and

1[R1] = RR2[R2]+ GR2 [G2] + BR2 [B2]

1[G1] = RG2[R2]+ GG2[G2] + BG2[B2]

1[B1] = RB2[R2]+ GB2[G2] + BB2[B2]

then

C[C]=Rc1 (RR2[R2]+ GR2 [G2] + BR2 [B2])+

Gc1 (RG2[R2]+ GG2[G2] + BG2[B2])+

Bc1 (RB2[R2]+ GB2[G2] + BB2[B2])

=(Rc1RR2 +Gc1 RG2 +Bc1 RB2 ) [R2] +

(Rc1GR2 +Gc1 GG2 +Bc1 GB2 ) [G2] +

(Rc1BR2 +Gc1 BG2 +Bc1 BB2 ) [B2] +

= Rc2[R1]+ Gc2[G1] + Bc2[B1]


Use “Imaginary” primaries to allow > 0 (R,G,B)

• CIE primaries defined by:

• Solve for (X,Y,Z) over spectrum yields:

700

546

435

0.73467[X] 0.26533[Y] 0.00000[Z]

0.27376[X] 0.71741[Y] 0.00883[Z]

0.16658[X] 0.00886[Y] 0.82456[Z]

C

C

C

xy

z

Yey! (X,Y,Z)always > 0!


CIE XYZ Space

Y

X

Z

Features:- X,Y,Z > 0-[Y] follows Vλ

-equal energy SPD has coordinate (k,k,k)


Chromaticity

• chromaticity – independent on amount of luminous energy, dependent on dominant wavelength and saturation

• Note:– x + y + z = 1– x , y , z are on X+Y+Z=1 plane– if we know x , y, z is just 1- x – y, so we define

chromaticity by just x , y.– use 2D plot of x , y by projecting X+Y+Z=1 plane onto

X,Y plane– if we need full X,Y,Z we need to know (x , y ,Y) where

Y encodes the luminous energy

, ,X Y Z

x y zX Y Z X Y Z X Y Z


Chromaticity Diagram

C

B

A

D

E

C - white lightB – dominant wavelength of AD & E – complementaryAC/BC – excitation purityF – nonspectral (G) dom. wave. is complement of H

FG

H


Color Gamut of Displays

[R1]

[G1]

[B1][R2]

[G2]

[B2]


Correlated Color Temperature

1000

060

00 4000

3000

2500

2000

1500

∞

Planckian locus (labeled in Kelvin)

(x,y) of colors with c.c.t of 10000K


Color perception more complicated

• Jameson (1985) – SPD of blue chip under tungsten light = yellow chip under sunlight, yet its still blue (color constancy)

• color constancy only approximate• chromatic adaptation

– red adapt one eye & compare perception between eyes

– eye adapts to tungsten light long wv’s indoors (white paper appears white), but if adapted to nighttime looking inside light appears yellow


White Point

• visual system scales response from photoreceptor according to illuminant color– white point of scene is reference point for

perception• display white point – result of maximum output

on all 3 channels to display– described by c.c.t. or chromaticity (x,y)– sometimes called c.c.t. or c.t. (yuck!)– adjust internally (bias & gain) or digitally in

graphics card

3/23/2005 © Dr. Zachary Wartell 1 Eyes and Displays.

Documents

zachary wartell

light kessler

ribarsky slide

light interactions light

light wavelength

rr slide

light ray

incident light