SchubinCafe.com, Beyond HD, 2012 February 9 1 Beyond HD: Resolution, Frame Rate, & Dynamic Range Mark Schubin multiple Emmy-award- winning SMPTE Fellow.

SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 11

Beyond HD:Beyond HD:Resolution, Resolution, Frame Rate, & Frame Rate, & Dynamic RangeDynamic Range

Mark SchubinMark Schubinmultiple Emmy-award-multiple Emmy-award-winning SMPTE Fellowwinning SMPTE Fellow


Why Go Beyond HD?Why Go Beyond HD? EvolutionEvolution

resolutionresolution started at 8 linesstarted at 8 lines

frame rateframe rate started at 8 fpsstarted at 8 fps

wider screenwider screen started verticalstarted vertical

soundsound colorcolor surround soundsurround sound

Baird 30-line TV 1932Baird 30-line TV 1932


(Not) (Not) S3DS3D

extra gearextra gear prod. & view.prod. & view.

extra signalsextra signals extra workextra work extra extra

processesprocesses noticeablenoticeable

good when it good when it works wellworks well

bad when it bad when it doesn’tdoesn’t

NEP SS-3D plansNEP SS-3D plans

PaceS3Drig

66 ofof 1616seatsseats


Good & Bad S3DGood & Bad S3D

GoodGood BadBad


TerminologyTerminology Higher resolutionHigher resolution

4K: either 4096 or 3840 active pixels per line4K: either 4096 or 3840 active pixels per line nominally 2160 linesnominally 2160 lines

8K: either 8192 or 7680 active pixels per line8K: either 8192 or 7680 active pixels per line nominally 4320 lines nominally 4320 lines 7680 version also called UHDTV or Super Hi-Vision7680 version also called UHDTV or Super Hi-Vision

Higher Frame Rate = HFRHigher Frame Rate = HFR includes 1080 lines at 60 fps progressive scanincludes 1080 lines at 60 fps progressive scan

Higher Dynamic Range = HDRHigher Dynamic Range = HDR range from darkest to brightest in an imagerange from darkest to brightest in an image


What Is HD?What Is HD?

??


"The exposition's opening "The exposition's opening on April 30 also marked on April 30 also marked the advent of this the advent of this country's first regular country's first regular schedule of high-schedule of high-definition broadcasts." definition broadcasts."

??



"The exposition's opening "The exposition's opening on April 30 also marked on April 30 also marked the advent of this the advent of this country's first regular country's first regular schedule of high-schedule of high-definition broadcasts." definition broadcasts."

- Broadcasting- Broadcasting magazinemagazine

??



"The exposition's opening on "The exposition's opening on April 30 also marked the April 30 also marked the advent of advent of this country'sthis country's first first regular schedule of high-regular schedule of high-definition broadcasts." definition broadcasts."

- Broadcasting- Broadcasting magazine, magazine,reporting from the 1939reporting from the 1939

New York World’s Fair onNew York World’s Fair on 441-line (total) television441-line (total) television



“…“…this country’s…” ?this country’s…” ?


TV D That Was More HTV D That Was More H

Baird 600-line color 1940Baird 600-line color 1940

French TVFrench TV819-line819-line

1948-19861948-1986

Thousand-lineThousand-linesystems testedsystems testedin the 1940sin the 1940s


Human Resolution Theory - Human Resolution Theory - 18621862

Snellen ChartSnellen Chart 20/20 (6/6) optotype20/20 (6/6) optotype


Resolution and Viewing Resolution and Viewing DistanceDistance Detail falls with Detail falls with

distancedistance Too close can’t Too close can’t

see picture due see picture due to visible pixelsto visible pixels

Peak where Peak where pixels match pixels match visual acuityvisual acuity 20/2020/20 == 30 cpd30 cpd NTSCNTSC ~~ 480 lines480 lines

88°, 7.15x height°, 7.15x height 1080-line1080-line HDHD

3.16H3.16H

viewing distanceviewing distance

rreezz

cycle = white line & black linecycle = white line & black line


Lechner Distance:Lechner Distance:9 feet9 feet

(2.7 m)(2.7 m)

Flat-Panel DisplaysFlat-Panel DisplaysIncreaseIncrease Distance Distance


Seeming Lack of Need for Seeming Lack of Need for HDTVHDTV

9 feet (2.7 m)9 feet (2.7 m)

15.115.1inchesinches(38 cm)(38 cm)

1515inchesinches

25-inch (64 cm) TV25-inch (64 cm) TV

CEA: 27-inch (69 cm) averageCEA: 27-inch (69 cm) averagesize sold to U.S. dealers in 2006size sold to U.S. dealers in 2006 Dealer inventory one yearDealer inventory one year 10 years to replace all TVs10 years to replace all TVs 1080 lines visible on 70-inch1080 lines visible on 70-inch

(178 cm) 16:9 HDTV (178 cm) 16:9 HDTV

8°8°


July 2011 Lawrence Berkeley National Laboratory ReportJuly 2011 Lawrence Berkeley National Laboratory Reportbased on DisplaySearch data (actual & projected)based on DisplaySearch data (actual & projected)

Home TV Screen Size Home TV Screen Size ShippedShipped

(their typo)


Panasonic 150-inch/3.8-m plasma TV atPanasonic 150-inch/3.8-m plasma TV at2008 2008 ConsumerConsumer Electronics Show Electronics Show

4096x21604096x2160

One Heck of a Home TVOne Heck of a Home TV

2006 August 16, 2006 August 16, Stan Glasgow, pres.Stan Glasgow, pres.

Sony Electronics,Sony Electronics,““next big leap” in HDnext big leap” in HD[beyond 1080-line][beyond 1080-line] could be 3-5 yearscould be 3-5 years

70-inch:1080-line::70-inch:1080-line::140-inch:2160-line140-inch:2160-line


Changing Theatrical Changing Theatrical ExpectationsExpectations

courtesy Warner Bros. Technical Operationscourtesy Warner Bros. Technical Operations

The tiny-screenThe tiny-screenmovie palace ismovie palace isancient historyancient history


based on 20/20 visionbased on 20/20 vision

HDTVHDTV≈≈

““2K”2K”

courtesy of ARRI, used with permissioncourtesy of ARRI, used with permission


NHK – Ultra-Definition TVNHK – Ultra-Definition TV

Super Hi-Vision 7680 x 4320 (8K) – 400-inch (10.2-m)Super Hi-Vision 7680 x 4320 (8K) – 400-inch (10.2-m)16x more pixels than 1920 x 1080 HDTV16x more pixels than 1920 x 1080 HDTV

NAB 2007NAB 2007


Problems with 30-cpd Problems with 30-cpd TheoryTheory

EdgesEdges 3 chart3 chart lineslines belowbelow 20/2020/20 April 2008 SMPTE April 2008 SMPTE Motion ImagingMotion Imaging Journal:Journal:NHK “Research on Human Factors in UHDTV”NHK “Research on Human Factors in UHDTV”

possible to distinguish between 78 and 156 cpdpossible to distinguish between 78 and 156 cpd 156 cpd is more than five times the 20/20 criterion156 cpd is more than five times the 20/20 criterion

““realness” is a function of image detailrealness” is a function of image detail rises rapidly to 50 cpd rises rapidly to 50 cpd continues rising through 156 cpdcontinues rising through 156 cpd


Beyond-HDTV Spatial Beyond-HDTV Spatial ResolutionResolution

Cameras from:Cameras from: ARRI, Astro, ARRI, Astro,

Canon, Canon, Dalsa, Dalsa, Hitachi, Ikegami, Hitachi, Ikegami, JVC, JVC, Lockheed-Lockheed-Martin, Meduza, Martin, Meduza, NHK, Olympus, NHK, Olympus, Red, Sony, Vision Red, Sony, Vision ResearchResearch

Displays from:Displays from: CMO, JVC, LG, CMO, JVC, LG,

Panasonic, Panasonic, Samsung, Sharp, Samsung, Sharp, Sony, ToshibaSony, Toshiba

Other gear:Other gear: codecs, recorders, codecs, recorders,

up- & down-up- & down-convert, convert, productionproduction switchersswitchers

But first…But first…


HigherHigherFrameFrameRatesRates

50 Hz50 Hz100 Hz100 Hz

BBC/EBUBBC/EBUsimulationsimulationfrom 300-from 300-fps videofps video

Raw data rate same mult.Raw data rate same mult. Compressed data rate TBDCompressed data rate TBD

less change between framesless change between frames sharper for easier estimationsharper for easier estimation


Also Motion StrobingAlso Motion Strobing

Panning-speed tables Panning-speed tables based on frame rate based on frame rate and viewing angleand viewing angle

If higher resolution If higher resolution means greater angle, means greater angle, then higher frame then higher frame raterate

S3D sometimes S3D sometimes halves frame rate per halves frame rate per eyeeye


Douglas Trumbull on HFR, Douglas Trumbull on HFR, New York Times,New York Times, 2012 Feb 5 2012 Feb 5

““There are really no words for it in There are really no words for it in English, but it’s a window onto English, but it’s a window onto reality” reality”

Tree of Life, Tree of Life, Fox Searchlight PicturesFox Searchlight Pictures


““There are really no words for it in There are really no words for it in English, but it’s a window onto reality” English, but it’s a window onto reality”

““Digital cinematography can Digital cinematography can effortlesslyeffortlessly go to 1,000 frames a second”go to 1,000 frames a second”

???????????? lightlight data data

Douglas Trumbull on HFR, Douglas Trumbull on HFR, New York Times,New York Times, 2012 Feb 5 2012 Feb 5

Bill Huberhttp://www.pbase.com/image/41450051

http://www.pbase.com/image/41450051


AlternativeAlternative forfor Strobing/FalseStrobing/False

MotionMotion

http://www.tessive.com/





Back to Spatial ResolutionBack to Spatial Resolution More detailMore detail Reframing/Reframing/

stabilizationstabilization Single-sensor 3DSingle-sensor 3D

Increased Increased sharpnesssharpness

Desired HDDesired HD

Skewed HDSkewed HD

Resulting HDResulting HD

4k4k

Zepar S3D lens on VR Phantom 65Zepar S3D lens on VR Phantom 65


Which Person Looks Which Person Looks Angrier?Angrier?

““Angry Man/Neutral Woman,” 1997Angry Man/Neutral Woman,” 1997copyright Aude Oliva, MIT and copyright Aude Oliva, MIT and

Philippe G. Schyns, University of GlasgowPhilippe G. Schyns, University of Glasgowused with permissionused with permission

in the experiments, LSF<2 cpd, HSF>6 cpdin the experiments, LSF<2 cpd, HSF>6 cpd


Introducing ContrastIntroducing Contrastco

ntr

as

contr

as

tt

resolutionresolutionDo you see a curve along the bottom?Do you see a curve along the bottom?


Contrast-Sensitivity Contrast-Sensitivity FunctionFunction

contr

as

contr

as

tt

resolutionresolution

curve variescurve varieswith retinalwith retinalangle andangle andobserverobserver

max.max.contrastcontrast

sensitivitysensitivity1-8 cpd1-8 cpd


Modulation Transfer Modulation Transfer FunctionFunction

contr

as

contr

as

tt


““sharpness” issharpness” isproportional to theproportional to thesquare of the areasquare of the areaunder the curveunder the curve

(ARRI paper differs)(ARRI paper differs)

curve shapecurve shapevaries duevaries due

to such factorsto such factorsas filtering,as filtering,

diffraction, imagerdiffraction, imagerresolution, etc.resolution, etc.


HDCAM/DVCPRO HD HDCAM/DVCPRO HD CompromiseCompromise

contr

as

contr

as

tt


loss of lotsloss of lotsof resolutionof resolutionbut very littlebut very little

sharpnesssharpness


Combining Vision & Combining Vision & TechnologyTechnology

contr

as

contr

as

tt


invisib

le

invisib

le

not reproduced

not reproduced

availableavailable& visible& visible


Why More Resolution Is Why More Resolution Is GoodGood

SINC Function

0

0.2

0.4

0.6

0.8

1

1.2

1 2 3 4 5 6 7 8 9 10 11

Samples

Contr

astst



SINC Function

0

0.2

0.4

0.6

0.8

1

1.2

1 2 3 4 5 6 7 8 9 10 11

Samples

Contr

astst

If this is 1080 lines,If this is 1080 lines,then the contrast ratiothen the contrast ratioat 1080 lines is zeroat 1080 lines is zero

zerozerocontrastcontrast



SINC Function

0

0.2

0.4

0.6

0.8

1

1.2

1 2 3 4 5 6 7 8 9 10 11

Samples

Contr

astst

If this is 2160 lines,If this is 2160 lines,

64%64%contrastcontrast

then the contrast atthen the contrast at1080 lines is 64%1080 lines is 64%


Real MTF CurvesReal MTF Curves

EOS 10D 3072 x 2048

EOS 20D3504 x 2336

14% linear increase in sensors14% linear increase in sensorscourtesy Bob Atkins www.bobatkins.comcourtesy Bob Atkins www.bobatkins.com

used with permissionused with permission


Real-World Sharpness Real-World Sharpness ChangeChange

EOS 10DEOS 10D 3072 x 20483072 x 2048

EOS 20DEOS 20D3504 x 23363504 x 2336

courtesy Bob Atkins www.bobatkins.comcourtesy Bob Atkins www.bobatkins.comused with permissionused with permission


What Is Resolution?What Is Resolution? Traditional video definition:Traditional video definition:

1920 x 1080, 1280 x 720, etc.1920 x 1080, 1280 x 720, etc. Optical definition:Optical definition:

line pairs per millimeter (lp/mm)line pairs per millimeter (lp/mm) (video resolution (video resolution ÷ 2) ÷ imager size in ÷ 2) ÷ imager size in

mmmm Imager Width lp/mmImager Width lp/mmS35S35 23.8 40 23.8 40 1-inch1-inch 13.9 69 13.9 692/3-inch 2/3-inch 9.6 9.6 1001001/2-inch 1/2-inch 7.0 1387.0 1381/3-inch 1/3-inch 5.2 1845.2 1841/4-inch 1/4-inch 3.9 2453.9 245

for 1920for 1920pixelspixels

per lineper line

full-widthfull-width16:916:9


2020 40 40 60 60 80 80

LP/mmLP/mm

100100

MTFMTF%%

Relative MTF of HDTV 2/3-Inch, 1/2-Inch, and 1/3-Relative MTF of HDTV 2/3-Inch, 1/2-Inch, and 1/3-Inch LensInch Lens

Measured at Picture CenterMeasured at Picture Center

1/3-Inch1/3-Inch

1/2-Inch1/2-Inch2/3-Inch2/3-Inch

(from (from Small Format HD Acquisition,Small Format HD Acquisition, Larry Thorpe, Canon, Larry Thorpe, Canon, 2005 SMPTE Fall Technical Conference)2005 SMPTE Fall Technical Conference)

Red One S35 @ 4520 pels slightly easier than 2/3-inch @ 1920Red One S35 @ 4520 pels slightly easier than 2/3-inch @ 1920


But How Should It Be But How Should It Be Measured?Measured?

traditional color videotraditional color video Hitachi, IkegamiHitachi, Ikegami Lockheed-MartinLockheed-Martin NHK, Olympus (diff.)NHK, Olympus (diff.)

ARRIARRI AstroAstro CanonCanon JVCJVC RedRed Sony (different)Sony (different) Vision ResearchVision Research


SensitivitySensitivity

Both hi-rez and HFR tend to need larger image sensorsBoth hi-rez and HFR tend to need larger image sensors


The Story So FarThe Story So Far Frame-rate increase = data & light increaseFrame-rate increase = data & light increase Linear rez increase = (data & light increase)Linear rez increase = (data & light increase)22

Lenses to match optical rez increaseLenses to match optical rez increase

Single-camera ok; multi-camera not yetSingle-camera ok; multi-camera not yet downconversion usefuldownconversion useful

Astro 4K products (more models plus coders & converters)Astro 4K products (more models plus coders & converters)


500-watt halogen light500-watt halogen light


High Dynamic RangeHigh Dynamic Range

10,000,000:1 (>23-stop) contrast ratio10,000,000:1 (>23-stop) contrast ratioGrass Valley XensiumGrass Valley Xensium

(also ARRI, Fuji, Red, others)(also ARRI, Fuji, Red, others)


Different HDR-Capture Different HDR-Capture MethodsMethods

Areal – Bigger PixelsAreal – Bigger Pixels Fewer pixels (ARRI)Fewer pixels (ARRI)

less resolutionless resolution Larger sensor (Vision Research)Larger sensor (Vision Research)

cost, lens availabilitycost, lens availability

Spatial – Multiple SitesSpatial – Multiple Sites FujiFuji

Temporal – Multi-ReadoutTemporal – Multi-Readout RedRed

short duration for highlightsshort duration for highlightsold Fuji Super CCDold Fuji Super CCD


Other Optical SolutionsOther Optical SolutionsRosco ViewRosco View

Live Technologies LiveLensLive Technologies LiveLens


HDR Good News & BadHDR Good News & Bad Good: No change after image sensingGood: No change after image sensing Bad: HDR displays before contentBad: HDR displays before content

(also wider color gamut)(also wider color gamut)

Dolby PRM-4200 monitor shot by Bill Bennett, ASCDolby PRM-4200 monitor shot by Bill Bennett, ASChttp://www.mobypicture.com/user/CineBill/view/7473526

used with permissionused with permission

http://www.mobypicture.com/user/CineBill/view/7473526


We’ve come a long wayWe’ve come a long waysince 1888since 1888

Questions?Questions?

Comments?Comments?

SchubinCafe.com, Beyond HD, 2012 February 9 1 Beyond HD: Resolution, Frame Rate, & Dynamic Range Mark Schubin multiple Emmy-award- winning SMPTE Fellow.

Documents

line hd

line tv

image slide

white line black line

typo slide

permission slide

optotype slide

s slide