Top Banner
Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: Known Un-Owneds: What We Know We Don’t Yet What We Know We Don’t Yet Have Have Digital Digital & HD TV & HD TV Pioneer Pioneer and Poet and Poet of the of the Known Known Un- Un- Owneds, Owneds, Donald Donald Rumsfeld Rumsfeld
28

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Dec 25, 2015

Download

Documents

Joella Booker
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 11

Known Un-Owneds:Known Un-Owneds:What We Know We Don’t Yet What We Know We Don’t Yet

HaveHave

DigitalDigital& HD TV& HD TVPioneerPioneerand Poetand Poetof theof theKnown Known Un-Un-Owneds,Owneds,DonaldDonaldRumsfeldRumsfeld

Page 2: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 22

Movies & TVMovies & TV

Stimulate Sight and HearingStimulate Sight and Hearing

And?And?

Page 3: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 33

Five Five Senses?Senses? Hearing Hearing (audio)(audio)

loudness, pitch, duration, direction, loudness, pitch, duration, direction, depth, vector, rhythm, harmony, +depth, vector, rhythm, harmony, +

Sight Sight (video)(video) brightness, color, shape, depth, brightness, color, shape, depth,

transparency, vector, number, +transparency, vector, number, + Feeling Feeling (Tingler & motion seats)(Tingler & motion seats)

pressure, texture, moisture, pressure, texture, moisture, fatiguefatigue, , heat, thirst, hunger, heat, thirst, hunger, nauseanausea,, pain pain, + , +

Smell & Taste Smell & Taste (Odorama, CP 5+1)(Odorama, CP 5+1)

discriminationdiscrimination““cocktail-party effect”cocktail-party effect”

Page 4: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 44

Add 3-DAdd 3-D 3-D TV transmissions in 19283-D TV transmissions in 1928

Increase color gamutIncrease color gamut Increase dynamic resolutionIncrease dynamic resolution WhyWhy increaseincrease temporaltemporal oror spatialspatial

resolution?resolution? Post-production optionsPost-production options

re-frame, stabilize, scan BG, slo-mo re-frame, stabilize, scan BG, slo-mo Perception evolvesPerception evolves

Vision – We Already Have Vision – We Already Have HDHD19531953

3-D TV3-D TVglassesglasses

Page 5: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 55

Perception is LearnedPerception is Learned

Kittens deprived from birth Kittens deprived from birth of a particular type stimulusof a particular type stimuluscannot perceive that type cannot perceive that type stimulus until it is learnedstimulus until it is learned

Page 6: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 66

Human Perceptions EvolveHuman Perceptions Evolve

18951895L’arrivL’arrivéée d’un traine d’un trainen gare de La Ciotaten gare de La Ciotat

19191919Edison “Tone Test”Edison “Tone Test”

Page 7: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 77

Human Perceptions EvolveHuman Perceptions Evolve

18951895L’arrivL’arrivéée d’un traine d’un trainen gare de La Ciotaten gare de La Ciotat

““One of my neighbors One of my neighbors was so much was so much captivated that she captivated that she sprung to her feet... sprung to her feet... and waited until the and waited until the car disappeared before car disappeared before she sat down again” – she sat down again” – Henri de Parville, 1895Henri de Parville, 1895

Page 8: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 88

Human Perceptions EvolveHuman Perceptions Evolve

19191919Edison “Tone Test”Edison “Tone Test”

"It did not seem difficult "It did not seem difficult to determine in the dark to determine in the dark

when the singer sang when the singer sang and when she did not. and when she did not. The writer himself was The writer himself was

pretty sure about it until pretty sure about it until the lights were turned on the lights were turned on

again and it was again and it was discovered that [the discovered that [the

singer] was not on the singer] was not on the stage at all and that the stage at all and that the

new Edison alone had new Edison alone had been heard.“been heard.“

Pittsburgh PostPittsburgh Post

Page 9: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 99

Human Resolution Theory - Human Resolution Theory - 18621862

Snellen ChartSnellen Chart 20/20 (6/6) optotype20/20 (6/6) optotype

Page 10: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1010

Resolution and Viewing Resolution and Viewing DistanceDistance

1 arc minute = 30 cycles per degree 1 arc minute = 30 cycles per degree (cpd) (cpd)

NTSC NTSC ≈≈ 480 active lines = 8 480 active lines = 8°° 88°° = 7.15 x the picture height (PH) = 7.15 x the picture height (PH) Similarly, 1080 lines = 18Similarly, 1080 lines = 18° = 3.16 x ° = 3.16 x

PHPH 4K ≈ 36° = 1.54 x PH4K ≈ 36° = 1.54 x PH UDTV: 4320 lines = 72° = 0.69 x PHUDTV: 4320 lines = 72° = 0.69 x PH

for 9’ viewing distance, screen height = for 9’ viewing distance, screen height = 13’13’

LechnerLechnerDistanceDistance

9 feet9 feet

courtesy Warner Bros. Technical Operationscourtesy Warner Bros. Technical Operations

Page 11: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1111

Problems with 30-cpd Problems with 30-cpd TheoryTheory

3 chart3 chart lineslines belowbelow 20/2020/20 April SMPTE April SMPTE Motion ImagingMotion Imaging Journal:Journal:NHK “Research on Human Factors in UHDTV”NHK “Research on Human Factors in UHDTV”

possible to distinguish between 78 and 156 cpdpossible to distinguish between 78 and 156 cpd 156 cpd is more than five times the 20/20 criterion156 cpd is more than five times the 20/20 criterion

““realness” is a function of image detailrealness” is a function of image detail rises rapidly to 50 cpd rises rapidly to 50 cpd continues rising through 156 cpdcontinues rising through 156 cpd

Bottom line: more rez worksBottom line: more rez works

higher-frequency contenthigher-frequency content

Page 12: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1212

20 40 60 80 100 LP/mm

100

MTF%

2/3-Inch HD2/3-Inch HD

(simplified from (simplified from Small Format HD Acquisition,Small Format HD Acquisition, Larry Thorpe, Canon, Larry Thorpe, Canon,

2005 SMPTE Fall Technical Conference)2005 SMPTE Fall Technical Conference)

But Lenses Have IssuesBut Lenses Have Issues2/3-inch 1080-line HD = 100 lp/mm2/3-inch 1080-line HD = 100 lp/mm

S35 “4K” S35 “4K” ≈ 60 lp/mm≈ 60 lp/mm2/3-inch 4320-line UD = 400 lp/mm2/3-inch 4320-line UD = 400 lp/mm1/6-inch 1080-line HD = 379 lp/mm1/6-inch 1080-line HD = 379 lp/mm

Page 13: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1313

Fixing Optical Issues w/o Fixing Optical Issues w/o OpticsOptics

Canon HJ17Ex7.7B, 36 glass elements

Astigmatism, coma, geometric, Petzval, & spherical aberrations,Astigmatism, coma, geometric, Petzval, & spherical aberrations,flare, ghosts, vignetting, light distribution, MTF, and diffraction?flare, ghosts, vignetting, light distribution, MTF, and diffraction?

lateral chromatic aberration correction via LUTlateral chromatic aberration correction via LUT

Page 14: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1414

DeconvolutionDeconvolution

from from The Scientist and Engineer’s Guide to Digital Signal Processing,The Scientist and Engineer’s Guide to Digital Signal Processing,by Steven W. Smith, Ph. D., California Technical Publishingby Steven W. Smith, Ph. D., California Technical Publishing

Page 15: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1515

ConvolutionsConvolutions Lens focusLens focus Camera Camera

shakingshaking Excess fogExcess fog

Multiple audio Multiple audio sourcessources

EchoesEchoes Room toneRoom toneknownknown

blindblind

Page 16: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1616

Holographic lensesHolographic lenses

Page 17: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1717

500-watt halogen light500-watt halogen light

Page 18: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1818

Imaging Dynamic RangeImaging Dynamic Range

10,000,000:1 (>23-stop) contrast ratio10,000,000:1 (>23-stop) contrast ratiocourtesy of Thomsoncourtesy of Thomson

Page 19: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1919

More Basic Known Un-More Basic Known Un-OwnedsOwneds Color gamutColor gamut

Why not Why not allall colors? colors?

DisplaysDisplays Direct stimulation of the visual cortexDirect stimulation of the visual cortex Eye projectionEye projection Eye-tracking for data reductionEye-tracking for data reduction Personal vs. communityPersonal vs. community

Sound imagingSound imaging heightheight

Page 20: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2020

High-Frame-Rate ViewingHigh-Frame-Rate Viewingpopped water balloonpopped water balloon

Vision Research Phantom V12Vision Research Phantom V12shoots 720p to ~7000 fpsshoots 720p to ~7000 fps

Field EmissionField EmissionTechnologiesTechnologies240-fps display240-fps display

cameras from AOS, CPL, DRS, Fastec, i-Movix, Kinor, NAC, Photo-Sonics, cameras from AOS, CPL, DRS, Fastec, i-Movix, Kinor, NAC, Photo-Sonics, Photron, PCO, Redlake, Shimadzu, SVSi, VR, Weinberger, WeisscamPhotron, PCO, Redlake, Shimadzu, SVSi, VR, Weinberger, Weisscam

area forarea forhuman-human-visionvision

training?training?

simulationsimulation

not HDTVnot HDTV

Page 21: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2121

Temporal & Dynamic Temporal & Dynamic ResolutionResolution

Do we knowDo we knowthe humanthe humanvisual limit visual limit of temporalof temporalresolution?resolution?

Regardless,Regardless,we know thatwe know thateye trackingeye tracking

makes movingmakes movingobjects staticobjects static

Page 22: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2222

““True” 3-DTrue” 3-D

James ClarJames Clar10x10x10 voxel10x10x10 voxel

monochromemonochrome

RabbitHoles MediaRabbitHoles Mediain Demo Roomin Demo Room

Page 23: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2323

InteractivityInteractivity Are we storytelling or storymaking?Are we storytelling or storymaking? Choices rapidly grow: 2Choices rapidly grow: 22020=1,048,576=1,048,576

Page 24: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2424

Artists Advance TechnologyArtists Advance Technology

Satellite Arts Project, 1975: GEO Satellite Arts Project, 1975: GEO latencylatency

World Opera Project, 2009: fiber World Opera Project, 2009: fiber latencylatency

Real time contrast compression, 1973Real time contrast compression, 1973 Multilingual live HD subtitling, 2007Multilingual live HD subtitling, 2007 Beyond-color imagingBeyond-color imagingMilitary, tooMilitary, too

Page 25: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2525

Sometimes Both TogetherSometimes Both Together

Page 26: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2626

Behind the ScenesBehind the Scenes

The storage bit bucketThe storage bit bucket buckets don’t care about formatbuckets don’t care about format

The universal IP address & The universal IP address & ubiquitous wirelessubiquitous wireless

Voice recognitionVoice recognition Thought control?Thought control?

Page 27: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2727

Things Take TimeThings Take Time

& Perceived Need & & Perceived Need & ROIROI

Page 28: Mark Schubin, HPA “Visions of the Future,” 2009 February 17 1 Known Un-Owneds: What We Know We Don’t Yet Have Digital & HD TV Pioneer and Poet of the KnownUn-Owneds,DonaldRumsfeld.

Mark Schubin, HPA “Visions of the Future,” 2009 February 17 Mark Schubin, HPA “Visions of the Future,” 2009 February 17 2828

The Future Is Really BigThe Future Is Really Big

& No Matter How You Slice & No Matter How You Slice It,It,

There’s Plenty for AllThere’s Plenty for All