Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Haptic Interaction in Virtual and Mixed Reality Environments Konstantinos Moustakas, Assistant Professor Konstantinos Moustakas, Assistant Professor Electrical and Computer Engineering Department, University of Electrical and Computer Engineering Department, University of Patras Patras
66
Embed
Haptic Interaction in Mixed Environments and Virtual Reality
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Haptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality Environments
Konstantinos Moustakas, Assistant ProfessorKonstantinos Moustakas, Assistant Professor
Electrical and Computer Engineering Department, University of Electrical and Computer Engineering Department, University of PatrasPatras
A. Vogiannou, K. Moustakas, D. Tzovaras and M.G. Strintzis, “Enhancing Bounding Volumes using Support Plane Mappings for Collision Detection”, Eurographics Computer Graphics Forum, vol. 29, no. 5, pp. 1595-1604, August 2010.
K. Moustakas, G. Nikolakis, K. Kostopoulos, D. Tzovaras and M.G. Strintzis, “Haptic Rendering of Visual Data for the Visually Impaired”, IEEE Multimedia , vol. 14, no. 1, pp. 62-72, January 2007.
From the distance field to the force fieldFrom the distance field to the force field
-di -di
di
Distance field
Force field
K. Moustakas, G. Nikolakis, K. Kostopoulos, D. Tzovaras and M.G. Strintzis, “Haptic Rendering of Visual Data for the Visually Impaired”, IEEE Multimedia , vol. 14, no. 1, pp. 62-72, January 2007.
Haptic renderingHaptic rendering• The force feedback is calculated for a given
point through:
• whereD(x) andF(x) are the values and the
∈ 3x R
• whereD(x) andF(x) are the values and the vector of the distance and force field respectively
-di -di
di
Distance field Force field
SQ-Map: Efficient layered collision detection and haptic renderingdetection and haptic rendering
K. Moustakas, D. Tzovaras and M.G. Strintzis, “SQ-Map: Efficient Layered Collision Detection and Haptic Rendering”, IEEE Transactions on Visualization and Computer Graphics, vol. 13, no. 1, pp. 80 - 93, January 2007.
– Run-time processing• Layered collision detection (3 levels of processing)
K. Moustakas, D. Tzovaras and M.G. Strintzis, “SQ-Map: Efficient Layered Collision Detection and Haptic Rendering”, IEEE Transactions on Visualization and Computer Graphics, vol. 13, no. 1, pp. 80 - 93, January 2007.
• Entertainment• Haptic Visualization• Applications for the
disabled• …
Applications Haptic interactionHaptic interaction
Haptic mapsHaptic maps
Haptic map with embedded semantic iformation
K. Moustakas, G. Nikolakis, K. Kostopoulos, D. Tzovaras and M.G. Strintzis, “Haptic Rendering of Visual Data for the Visually Impaired”, IEEE Multimedia , vol. 14, no. 1, pp. 62-72, January 2007.
D. Tzovaras et.al., “Design and implementation of haptic virtual environments for the training of the visually impaired, IEEE Neural Systems and Rehab. Eng., 2004
D. Tzovaras, K. Moustakas, G. Nikolakis and M.G. Strintzis, "Interactive Mixed Reality White Cane Simulation for the Training of the Blind and the Visually Impaired", Springer Journal on Personal and Ubiquitous Computing, vol.13, no.1, pp.51-58, January 2009.
Virtual cane
Cane replica
CyberGrasp
Magnetic sensor 2
VR game for the hearing and the visually impaired
Applications Haptic interactionHaptic interaction
visually impaired
K. Moustakas, L. Dybkjaer, O. Aran, D. Tzovaras and N.O. Bernsen, "Communication Between Blind and Hearing Impaired People Through a Multimodal Interactive Game", IEEE Multimedia , accepted for publication.
Applications Haptic interactionHaptic interaction
The ideal caseThe ideal case
Applications Haptic interactionHaptic interaction
ArchitectureArchitecture
Applications Haptic interactionHaptic interaction
Game stepsGame steps
Applications Haptic interactionHaptic interaction
Game videoGame video
Future work Haptic interactionHaptic interaction
• Haptic visualization– Use the haptic channel to complement vision
in information visualization applications
• Haptic interaction with videos
Future directionsFuture directions
• Haptic interaction with videos– Highly dynamic
• Content• Interaction
– Partial input of the environment, ill-posed
• Towards a theory of haptic rendering…
Haptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality EnvironmentsHaptic Interaction in Virtual and Mixed Reality Environments
Thank you for your
Konstantinos Moustakas, Assistant Professor Konstantinos Moustakas, Assistant Professor [email protected]@ece.upatras.gr
Electrical and Computer Engineering Department, University of Electrical and Computer Engineering Department, University of PatrasPatras