Mark Schubin, 3D Stereo MEDIA, Liege, 2010 December 9 1 Some Aspects of 3D… in Depth! Single-Source Stereo and Microstereoscopic 3D Mark Schubin, SchubinCafe.com.

Mark Schubin, 3D Stereo MEDIA, Liege, 2010 December 9Mark Schubin, 3D Stereo MEDIA, Liege, 2010 December 9 11

Some Aspects of 3D… in Some Aspects of 3D… in Depth!Depth!

Single-Source Stereo and Single-Source Stereo and Microstereoscopic 3DMicrostereoscopic 3D

Mark Schubin, SchubinCafe.comMark Schubin, SchubinCafe.com

PLEASE VIEW IN SLIDE SHOW MODE TO ACTIVATE AUDIO PLEASE VIEW IN SLIDE SHOW MODE TO ACTIVATE AUDIO


2X equipment & signals +2X equipment & signals + Additional personnelAdditional personnel

convergence per pairconvergence per pair stereographerstereographer

Additional processingAdditional processing correct, match, formatcorrect, match, format

Graphics z-axis depthGraphics z-axis depth Distribution resolutionDistribution resolution Monitoring challengesMonitoring challenges

3D Challenges Pre-Viewer3D Challenges Pre-Viewer

Sony brochuresSony brochures

Pace rigPace rig

NEP SS-3D (6 of 16 seats)NEP SS-3D (6 of 16 seats)


3

3D Viewer Challenges3D Viewer Challenges Limited 3DTV penetrationLimited 3DTV penetration

need for separate coverage?need for separate coverage? GlassesGlasses

cost, batteries, maintenancecost, batteries, maintenance Compatibility w/2D viewingCompatibility w/2D viewing

need for 2D glasses?need for 2D glasses? Perceptual conflictsPerceptual conflicts

stereovisual-vestibularstereovisual-vestibular distance-baseddistance-based

Pace-Pace-Fujinon Fujinon ShadowShadow

Sony 3DTVSony 3DTVat CES 2009at CES 2009

““simulatorsimulatorsickness”sickness”


MotionMotion what just happened?what just happened?

SoundSound what’s she saying?what’s she saying?

ColorColor red dress? army green?red dress? army green?

HDHD earring or blood?earring or blood?

3D3D depth depth informationinformation?? or just depth or just depth sensationsensation??

What Is 3D?What Is 3D?


Theory of Two-Lens StereoscopyTheory of Two-Lens Stereoscopy

acquisitionacquisition presentationpresentation

3D =3D =height,height,width,width,depthdepth

screenscreen


OtherOther 33 StereoStereo DimensionsDimensions

pupillary distancepupillary distance40-80 mm40-80 mm

(down to 5-year-olds)(down to 5-year-olds)

screen size ~ 3 cm to 30 mscreen size ~ 3 cm to 30 mviewing distanceviewing distance

vastvast range of vergence-based distance for same 3D master range of vergence-based distance for same 3D master


Infinite Distance*Infinite Distance*

Normal:Normal:parallel viewsparallel views

Reduced:Reduced:converging viewsconverging views

Expanded:Expanded:divergingdiverging views views

*in visual terms, “infinite distance” starts at as little as 6 m*in visual terms, “infinite distance” starts at as little as 6 m

notnot normal! normal!


http://www.nds.com/pdfs/3DTV-DoesSizeMatter_IBC2010Award.pdf

IBC 2010 Best Paper AwardIBC 2010 Best Paper Award““Does Size Matter?” NDS authorsDoes Size Matter?” NDS authors


Vergence-Accommodation Vergence-Accommodation ConflictConflict

from Prof. Martin Banks,from Prof. Martin Banks,Visual Space Perception LabVisual Space Perception LabUniversity of California – BerkeleyUniversity of California – Berkeley

3.2 meters (10.5 feet) ok to3.2 meters (10.5 feet) ok to ++∞∞


Countering V-A ConflictCountering V-A Conflict

In-Three “3D in the Home”In-Three “3D in the Home”http://www.in-three.com/3DintheHomev2.html http://www.in-three.com/3DintheHomev2.html


MiniaturizationMiniaturization

Elan Valley Miniature Elan Valley Miniature (tilt-shift technique based on blur)(tilt-shift technique based on blur)http://www.flickr.com/photos/frosted_peppercorn/481102393/ http://www.flickr.com/photos/frosted_peppercorn/481102393/

2D2D

left-eyeeft-eyeviewview

right-eyeright-eyeviewview

Image position Image position relatively easy to relatively easy to

change; imagechange; imagecontent much content much

harder to changeharder to change


Ghosting (Crosstalk)Ghosting (Crosstalk)

GlassesGlasses DisplayDisplay SynchronizationSynchronization Viewing AngleViewing Angle OrientationOrientation Inability to fuseInability to fuse

shot through active-shutter glasses for Gizmodo 3DTV reviewshot through active-shutter glasses for Gizmodo 3DTV reviewhttp://gizmodo.com/5501900/the-best-3dtv-samsung-un55c7000-vs-panasonic-tc+p50vt20http://gizmodo.com/5501900/the-best-3dtv-samsung-un55c7000-vs-panasonic-tc+p50vt20


Spatial ResolutionSpatial Resolution photos byphotos byPeter FascianoPeter Fasciano


Anaglyph ChallengesAnaglyph Challenges Inexpensive glassesInexpensive glasses Any TV Any TV Any color TV distributionAny color TV distribution Full resolutionFull resolution

ButBut Strong ghostingStrong ghosting Poor color renditionPoor color rendition Eye rivalryEye rivalry Light lossLight loss Display adjustmentDisplay adjustment

TrioScopicsTrioScopics

ColorCode 3-DColorCode 3-D


Why Not Anaglyph?Why Not Anaglyph?

even inexpensive glasses pass & reject as desiredeven inexpensive glasses pass & reject as desired

Ghosting in Anaglyphic Stereoscopic ImagesGhosting in Anaglyphic Stereoscopic ImagesAndrew J. Woods & Tegan RourkeAndrew J. Woods & Tegan Rourke

Centre for Marine Science & Technology, Curtin University of TechnologyCentre for Marine Science & Technology, Curtin University of Technologyhttp://cmst.curtin.edu.au/local/docs/pubs/2004-08.pdf http://cmst.curtin.edu.au/local/docs/pubs/2004-08.pdf

but displays don’t matchbut displays don’t match


Cue SignificanceCue Significance

S. Nagata, 1991S. Nagata, 1991 J. Cutting & P. Vishton, 1995J. Cutting & P. Vishton, 1995


The Elusive GrailThe Elusive GrailCan there be a 3D system withCan there be a 3D system with no ghostingno ghosting no V-A conflict or shrinkingno V-A conflict or shrinking 2D-viewer compatibility2D-viewer compatibility no extra personnelno extra personnel one lens & camera/positionone lens & camera/position one signal path/recordingone signal path/recording full resolutionfull resolution inexpensive glassesinexpensive glasses for for all all TVs & distribution?TVs & distribution?


Alternatives to Twin-Lens 3DAlternatives to Twin-Lens 3D

Less Than Fully StereoscopicLess Than Fully Stereoscopic e.g., choromostereoscopic, Pulfriche.g., choromostereoscopic, Pulfrich

2D-to-3D Conversion2D-to-3D Conversion frame-by-frame, auto+assist, liveframe-by-frame, auto+assist, live

Virtual 3D CamerasVirtual 3D Cameras second VC per positionsecond VC per position

Single-Lens StereoscopicSingle-Lens Stereoscopic Sony TDG, ISee3D, etc.Sony TDG, ISee3D, etc.

ISee3DISee3Dshutteringshuttering

BBC R&D White Paper 180BBC R&D White Paper 180


ChromostereopsisChromostereopsis Eye lens focuses one colorEye lens focuses one color

red seems in front of bluered seems in front of blue Real-world often matchesReal-world often matches

front: people, animalsfront: people, animalsback: green trees, blue skiesback: green trees, blue skies

easy animationeasy animation ChromaDepth glassesChromaDepth glasses

prism-based color shiftprism-based color shift

portion of portion of Apparatus to Talk to Aliens,Apparatus to Talk to Aliens,Akiyoshi Kitaoka, Ritsumeikan U.Akiyoshi Kitaoka, Ritsumeikan U.


Pulfrich IllusionPulfrich Illusion

One eye darkenedOne eye darkened dark eye sees what wasdark eye sees what was clear eye sees what isclear eye sees what is

Choreography crucialChoreography crucial carousel idealcarousel ideal

Rolling Stones Rolling Stones Steel WheelsSteel Wheels tour – good tour – goodSuper Bowl half-time – badSuper Bowl half-time – bad


View ShiftingView Shifting

““Wiggle-Vision”Wiggle-Vision” 3D for the one-eyed3D for the one-eyed Constant motionConstant motion

if not subtle, annoyingif not subtle, annoying if subtle, near invisibleif subtle, near invisible

V3 iris-shifting lens adaptorV3 iris-shifting lens adaptor widely used, very subtlewidely used, very subtle see for yourself: see for yourself:

http://www.inv3.com/examples_section.html http://www.inv3.com/examples_section.html


LessLess ThanThan FullFull Stereoscopy in Stereoscopy in UseUse

New York Times,New York Times,April 22, April 22, 19801980

enhanced chromostereopsis (ChromaDepth) – VH1enhanced chromostereopsis (ChromaDepth) – VH1

Pulfrich - DiscoveryPulfrich - Discovery

micro-micro-stereopsisstereopsis – –Nine TV SydneyNine TV Sydney(TrioScopics shown)(TrioScopics shown)

view-view-shift –shift –CBSCBS


Virtual-Camera S3DVirtual-Camera S3D

Imec above, BBC Research White Paper 180 similarImec above, BBC Research White Paper 180 similar


Origins of StereoscopyOrigins of Stereoscopy

1833 Wheatstone1833 Wheatstone adjustable distanceadjustable distance

1849 Brewster1849 Brewster lenticular (lensed)lenticular (lensed)

1851 Holmes1851 Holmes adjustable prismatic adjustable prismatic

lenticularlenticular


The Other StereoThe Other Stereo

Scientific American, Scientific American, December 31, 1881December 31, 1881

A-B Stereo (Spaced A-B Stereo (Spaced Omnis)Omnis)

BIGBIG sensation sensation differencedifference

UnnaturalUnnatural Poor mono Poor mono

compatibilitycompatibility

distance >>human head widthdistance >>human head width

remember “ping-pong” stereo?remember “ping-pong” stereo?

““Binauricular Auduition”Binauricular Auduition”compared to stereoscopecompared to stereoscope


““Single-Source” StereoSingle-Source” Stereo

X-Y, M-S, Dummy HeadX-Y, M-S, Dummy Head““coincident stereo” techniquescoincident stereo” techniques

consumer, tooconsumer, too


Narrow-Separation ListeningNarrow-Separation Listening

EmbracingSoundEmbracingSoundspeaker systemspeaker system

common professional Wohler stereo monitoringcommon professional Wohler stereo monitoring

Philips HTS7140 3D Blu-ray homePhilips HTS7140 3D Blu-ray hometheatre with surround-sound bartheatre with surround-sound bar


Visual StereoacuityVisual Stereoacuity

““Stereoacuity at Distance and Near,” Wong, Woods, & PeliStereoacuity at Distance and Near,” Wong, Woods, & Pelihttp://www.eri.harvard.edu/faculty/peli/posters/optometry/AAO2000_poster.pdf http://www.eri.harvard.edu/faculty/peli/posters/optometry/AAO2000_poster.pdf

Binocular Vision and Stereopsis, Binocular Vision and Stereopsis, Howard & Rogers, 1996Howard & Rogers, 1996

10 arcsecond stereoacuity ~10 arcsecond stereoacuity ~1/6 of a pixel at “optimum” 1/6 of a pixel at “optimum” (6/6, 20/20) viewing angle(6/6, 20/20) viewing angle


Limited StereopsisLimited Stereopsis

reference: Canon XJ22x7.3reference: Canon XJ22x7.3compact studio lenscompact studio lens165 mm wide box165 mm wide box

Canon 3D lens,Canon 3D lens,shown on XL1shown on XL1DXG-321DXG-321

much much narrower thannarrower thanpupillary distancepupillary distance

Sharp 3D moduleSharp 3D moduleHammacher-Hammacher-SchlemmerSchlemmer

Panasonic VW-CLT1Panasonic VW-CLT13D conversion lens3D conversion lens(outer width 58 mm)(outer width 58 mm)

lens adaptorlens adaptor


3ality Demo at 2010 DCS3ality Demo at 2010 DCS

photo by Mark Forman photo by Mark Forman http://screeningroom.com/ http://screeningroom.com/


MicrostereopsisMicrostereopsis Term coined by Mel Siegel, Robotics Institute, Term coined by Mel Siegel, Robotics Institute,

Carnegie Mellon University, and co-authors of Carnegie Mellon University, and co-authors of papers “Kinder Gentler Stereo,” and “Just papers “Kinder Gentler Stereo,” and “Just Enough Reality: Comfortable 3D Viewing via Enough Reality: Comfortable 3D Viewing via Microstereopsis” Microstereopsis” ((Proc. SPIE, Proc. SPIE, 1999)1999)

Intended as a solution to “simulator sickness”Intended as a solution to “simulator sickness” Concept much older (as will be seen)Concept much older (as will be seen) Not likely to be confused with Not likely to be confused with

microstereoscopymicrostereoscopy, term used for 3D , term used for 3D microscopymicroscopy


MicrostereopsisMicrostereopsis

CES 2009CES 2009no-glassesno-glasses

2D-compatible2D-compatible(no double(no double

images)images)

1979: D.O.T.S. NL1979: D.O.T.S. NL(Beiser US;(Beiser US;

1970: Songer)1970: Songer)Nine TV SydneyNine TV Sydney

in focus: normalin focus: normal too close: LG, RMtoo close: LG, RM too far: LM, RGtoo far: LM, RG oneone camera camera

ISee3D alternate-shuttered versionISee3D alternate-shuttered version

Sony TechnologyDevelopment Group


Successfully broadcastSuccessfully broadcast Patents have expiredPatents have expired One ordinary lens/position*One ordinary lens/position* Single-camera/position*Single-camera/position* 3D display ok for 2D viewing3D display ok for 2D viewing Ghosting not an issueGhosting not an issue V-A conflict not an issueV-A conflict not an issue* depends somewhat on system* depends somewhat on system








?


More at SchubinCafe.comMore at SchubinCafe.comThanks to All-Mobile VideoThanks to All-Mobile Video

for 3D production andfor 3D production andtransmission facilitiestransmission facilities

Mark Schubin, 3D Stereo MEDIA, Liege, 2010 December 9 1 Some Aspects of 3D… in Depth! Single-Source Stereo and Microstereoscopic 3D Mark Schubin, SchubinCafe.com.

Documents

d slide

d mark schubin

d stereo media

d glasses

d system

d master slide

dviewer compatibility

d depth information