3DTV technologies and challenges LINK LINK .

3DTV technologies and challenges

LINK http://www.sc.ehu.es/ccwgamoa/docencia/Material/Presentaciones

http://www.sc.ehu.es/ccwgamoa/docencia/Material/Presentaciones

Alex Garcia-Alonso 2

stereo is usefull - generates emotions- captures attention- we often get more info when data is stereo perceived : diagrams figures maps drawings ...

but ... stereo de crisp as colourfull ...so two types of display

googles? eye projection?neural connection?

UPV/EHU


Contents

1. Introduction2. Visual perception: eyes+brain perception3. 3DTV4. Image production

UPV/EHU


Introduction

UPV/EHU


First steps & expectations

Year 1889

Friese-Greene

http://www.stereo-3d-info.de

1977

Star Wars

UPV/EHU

http://www.stereo-3d-info.de/


Expectations may become true

“Crazy” user expectations

(25 years ago)

Engineer

(watching shaded images first time) :

Nice image, …

would you move it in real time?

UPV/EHU


Expectations may become true

“Crazy” user expectations

(25 years ago)

Journalist (first PC & Mac had just appeared in the market) : new media… it is nice …I want a foldable display, like the newspaper

UPV/EHU


Holographic displays

Desired

“display”

UPV/EHU


surrounding

outside spectator surrounding

Immersive displayscorner

20 years old

not in consumer market

UPV/EHU


3DTV (2012)

Stereoscopic

displays ActivePassive Auto

3DTVMovies Advertising

UPV/EHU


Towards a new media• Many companies have entered the market– Philips, Mitsubishi, Sony, Vizio, Sharp, LG, Panasonic,

Samsung, Hyundai, JVC, ACER, Optoma, DepthQ, Toshiba, Viewsonic, Sanyo …

• New requirements creating MM content– TV vs. Radio Cinema vs. Theater– Studio floor, event broadcast, commercials, film-

series, animation, gaming, … • Required knowledge– Perception– Technologies

UPV/EHU


Visual perception

Goal : review basic concepts, focus on Binocular vision

Depth perception

UPV/EHU


Scholars studied the topic years ago

• Euclid• Ptolemy • Aristotle• Galen• Plato• Leonardo DaVinci• al-Haytham (Alhazen)

UPV/EHU


Alhazen (965-1021)

Alhazen (965-1021) and Galileo (1564-1642)

UPV/EHU

Abū ʿAlī al-Ḥasan ibn al-Ḥasan ibn al-Haytham الهيثم بن الحسن بن الحسن علي، أبوBorn : Basra (965) البصرة

Book of Opticswritten from 1011 to 1021


Visual perception

• Components– Light – “Eyes” perceive light, generate signals– Signals transmit data from receptors to processors– Signals are processed by the brain, …

• Many perception theories

UPV/EHU


Visual perception

• Color, depth, brightness, motion, …• Foveal and peripheral vision• Binocular vision• Context

UPV/EHU


Binocular vision

• Properties– Field of view– Convergence– Stereopsis (2 imagenes distintas, dan info de profundidad)

– Binocular fusion (vemos 1 imagen, no 2)

– etc.

One “spare” eye ?

UPV/EHU


Field of view

Humans : 40 +120+ 40 = 200º

Pigeon Owl

Binocular Monocular

UPV/EHU


Convergence 10m. (acommodation 2m.)

UPV/EHU


Stereopsis : depth perception

Stereopsis (two views from different positions)

Left eye view Right eye view

UPV/EHU


Binocular fusion

UPV/EHU


Distance, depth perception

OcclusionPerspective (distance) nearer objects are larger

Relative size of similar objectsExpected size of objectsShadows and lightingTextureAtmospheric blurring (distance fog)

Stereopsis (different image in each eye )Accommodation (2 m.)

Convergence (10 m.)• Etc … wiki

UPV/EHU

http://en.wikipedia.org/wiki/Depth_perception


Very farFartherFront

Occlusion

Perspective

Relative sizeUPV/EHU


Texture

Lighting

“Fog”

UPV/EHU


Stereopsis

UPV/EHU


PERCEPTION ILLUSION :Palazzo Spada, Francesco Borromini, 8 meters in length looks like 35 m. The floor of the hallway slopes upward, the ceiling and walls converge. The "hedges" at the end of the hall are scaled down, as is the sculpture in placed in the end

PERCEPTION ILLUSION :It has been often used in movies

UPV/EHU


2D image 3D percived - depth illusion

UPV/EHU


Shape illusion

sebastien kuntz ( cb.nowan.net/blog )

UPV/EHU

http://cb.nowan.net/blog


motion - depth cue

sebastien kuntz ( cb.nowan.net/blog )

UPV/EHU



Swapping images - stereo illusion

sebastien kuntz ( cb.nowan.net/blog )UPV/EHU



3DTV

UPV/EHU


Stereo for consumer market

• Consumer market– Active stereo system– Passive stereo– Autoestereo

• Other– anaglyph images– immersive• projection• goggles (+ contact lenses, eye projection)

– holographic

UPV/EHU


Active stereoEmitter : shutter-image synchronization

Higher “refresh” rate

UPV/EHU


Passive stereo (polarization)

UPV/EHU


Linear polarization

wikipedia

UPV/EHU


Circular polarization

wikipedia

UPV/EHU


Autostereo

UPV/EHU


Autostereo

UPV/EHU


Autostereo

• http://www.seereal.com/en/company/index.php (SeeReal sketch)

UPV/EHU

http://www.seereal.com/en/company/index.php


Autostereo

• Perception improves with screen size• 8, 16 “positions”• Other techniques

UPV/EHU


Advertising

UPV/EHU


Autostereo & 3D recording

• The LG Optimus 3D • launched in Dubai, sept 2011• Creates content

UPV/EHU


• Shutter glasses – Some people notice flicker– Glasses much more expensive, need batteries– Up to 2011 lack of compatibility

• Polarized glasses– Perception tends to be worse– Attenuate brightness (half “black”)– Monitor must polarize

• In a nutshell– Both technologies continue improving– One might overcome the other one– However, comparing them is not the core target

Active vs passive

UPV/EHU


Hardware challenges

• Tilt creates problems– the highest in autostereo and linear polarized– fewer in circular polarized– the highest tilt can be achieved with active

• Afterglow, Light Leakage double images– Fast Switching Phosphor– High-Speed Shutters

UPV/EHU


Unsolved perception challenges

• Presently no “viewer selected”:– Convergence– Accommodation

• “Revolutionary” hw/sw solutions are required• Proper MM content production may alleviate

user discomfortUPV/EHU


MM content production

UPV/EHU


Viewing vs. Watching vs. Inmmersion

• Accommodation and convergence– Viewing real world• Conscious control (also unconscious reflex)• Focus, accommodation• We see reality as we want to see

– Watching displays (TV, PC)

• We see reality as we are shown• Some vision mechanisms cannot actuate

• Immersion (as in virtual worlds, games) means more : interaction

UPV/EHU

Alex Garcia-Alonso 48UPV/EHU




Field of view & aspect ratio

z

y

α

yx z

UPV/EHU

3DTV technologies and challenges LINK LINK .

Documents

depth perception stereopsis

visual perception color

visual perception goal

eyes brain perception

dtv technologies

signals signals

true crazy user expectations

years old