Gaze-Dependent Simulation of Light Perception in Virtual Reality Research Division of Computer Graphics Institute of Visual Computing & Human-Centered Technology TU Wien, Austria ISMAR 2020 Laura R. Luidolt 1 Michael Wimmer 1 Katharina Krösl 2 1 TU Wien, 2 VRVis Forschungs-GmbH 1 2
27
Embed
Gaze-Dependent Simulation of Light Perception in Virtual Reality · 2020. 10. 30. · Gaze-Dependent Simulation of Light Perception in Virtual Reality Research Division of Computer
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Gaze-Dependent Simulation of Light Perception
in Virtual Reality
Research Division of Computer Graphics
Institute of Visual Computing & Human-Centered Technology
TU Wien, Austria
ISMAR 2020
Laura R. Luidolt1
Michael Wimmer1
Katharina Krösl2
1TU Wien, 2VRVis Forschungs-GmbH1 2
Motivation ▪
Overview ▫
Methodology ▫
Evaluation ▫
Conclusion ▫
Introduction
L. R. Luidolt2
<brightness range
tone mapping
Motivation ▪
Overview ▫
Methodology ▫
Evaluation ▫
Conclusion ▫
Introduction
L. R. Luidolt3
Motivation ▪
Overview ▫
Methodology ▫
Evaluation ▫
Conclusion ▫
Introduction
▪ → Perceptual algorithms necessary!
▪ Medically based
▪ Account for viewing direction, pupil size
L. R. Luidolt4
Motivation ▪
Overview ▫
Methodology ▫
Evaluation ▫
Conclusion ▫
Contribution
▪ Post-processing workflow
▪ Accurate simulation of light perception in VR/AR
▪ Medically-based, perceptual effects
▪ In real-time VR/AR
▪ Following optometrist advice
▪ Eye tracking for measuring light incidence
▪ Pilot user study, comparison of
▪ Real-world low-light situation
▪ And VR simulation
L. R. Luidolt5
Motivation ▫
Overview ▪
Methodology ▫
Evaluation ▫
Conclusion ▫
L. R. Luidolt6
Visual adjustment to
bright and dark
Adaptation of rods
and cones over time
Temporal Eye Adaptation
Colorful patterns
when viewing bright
light sources
Scattering of light in
the eye
PerceptualGlare
Blurred details in low
light scenes
Rods not present in
fovea (point of
sharpest vision)
Visual Acuity Reduction
Color shift towards
blue in low light
scenes
Rods more sensitive
to longer wavelength
light than cones
Scotopic Color Vision
Based on Krawczyk et al., 2005and Ritschel et al., 2009
Motivation ▫
Overview ▪
Methodology ▫
Evaluation ▫
Conclusion ▫
L. R. Luidolt0 0 2 1,.4 -0.02 0.15 2.2 2.98
Visual adjustment to
bright and dark
Adaptation of rods
and cones over time
Temporal Eye Adaptation
Colorful patterns
when viewing bright
light sources
Scattering of light in
the eye
PerceptualGlare
Blurred details in low
light scenes
Rods not present in
fovea (point of
sharpest vision)
Visual Acuity Reduction
Color shift towards
blue in low light
scenes
Rods more sensitive
to longer wavelength
light than cones
Scotopic Color Vision
Based on Krawczyk et al., 2005and Ritschel et al., 2009
Motivation ▫
Overview ▪
Methodology ▫
Evaluation ▫
Conclusion ▫
L. R. Luidolt10
Visual adjustment to
bright and dark
Adaptation of rods
and cones over time
Temporal Eye Adaptation
Colorful patterns
when viewing bright
light sources
Scattering of light in
the eye
PerceptualGlare
Blurred details in low
light scenes
Rods not present in
fovea (point of
sharpest vision)
Visual Acuity Reduction
Color shift towards
blue in low light
scenes
Rods more sensitive
to longer wavelength
light than cones
Scotopic Color Vision
Based on Krawczyk et al., 2005and Ritschel et al., 2009
Motivation ▫
Overview ▪
Methodology ▫
Evaluation ▫
Conclusion ▫
L. R. Luidolt12
Visual adjustment to
bright and dark
Adaptation of rods
and cones over time
Temporal Eye Adaptation
Colorful patterns
when viewing bright
light sources
Scattering of light in
the eye
PerceptualGlare
Blurred details in low
light scenes
Rods not present in
fovea (point of
sharpest vision)
Visual Acuity Reduction
Color shift towards
blue in low light
scenes
Rods more sensitive
to longer wavelength
light than cones
Scotopic Color Vision
Based on Krawczyk et al., 2005and Ritschel et al., 2009
Motivation ▫
Overview ▪
Methodology ▫
Evaluation ▫
Conclusion ▫
L. R. Luidolt14
Visual adjustment to
bright and dark
Adaptation of rods
and cones over time
Temporal Eye Adaptation
Colorful patterns
when viewing bright
light sources
Scattering of light in
the eye
PerceptualGlare
Blurred details in low
light scenes
Rods not present in
fovea (point of
sharpest vision)
Visual Acuity Reduction
Color shift towards
blue in low light
scenes
Rods more sensitive
to longer wavelength
light than cones
Scotopic Color Vision
Based on Krawczyk et al., 2005and Ritschel et al., 2009
Motivation ▫
Overview ▫
Methodology ▼
Adaptation ▪
Glare ▫
VA reduction ▫
Color shift ▫
Evaluation ▫
Conclusion ▫
Temporal Eye Adaptation
L. R. Luidolt15
▪ 𝐿𝑖 = 𝐿𝑖−1 + (𝑌 − 𝐿𝑖−1) ∙
1 − 𝑒− ൗft 𝜏(𝑌)
▪ Target luminance Y
▪ Temporally filtered
luminance Li of frame i
▪ Photoreceptor adaptation
times τ
L. R. Luidolt16Image adapted fromcommons.wikimedia.org/wiki/File:Eyesection.svg