Top Banner
X3D Mobile VR Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA July 31, 2017 Myeong Won Lee (The University of Suwon)
36

X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Sep 10, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

X3D Mobile VR

Unity H-Anim Viewer Implementation

Web3D Korea Standardization Meeting

Los Angeles, CA, USA

July 31, 2017

Myeong Won Lee (The University of Suwon)

Page 2: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Mobile VR and Sensors

2017-7-31 SIGGRAPH Web3D Meeting 2

• HMD (Gear VR)• Camera, Acceleration, Zyro, Proximity,

Magnetic

• Mobile phone• Camera, Zyro, GPS, Gesture, Proximity,

Light, RGB, Acceleration, Magnetic, Temperature, Pressure, Atmosphere

• An example of mobile travel VR

• 3D VR world

– Geo-synchronized

– Units specified

• Sensors

– GPS, Camera, Acceleration, Zyro,

Proximity, Light, RGB, Temperature

Page 3: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Mobile MAR

2017-7-31 SIGGRAPH Web3D Meeting 3

Video worlds + Augmented objects 3D VR worlds + Augmented video objects

Page 4: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 4

An Example X3D File

Page 5: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Unity H-Anim Viewer Organization

Page 6: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Import an X3D File into Unity

Page 7: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

X3D Parsing in Unity

Page 8: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Draw an X3D File

Page 9: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 9

Unity X3D Scene Generation

Page 10: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Unity X3D Scene Generation

Page 11: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 11

Unity X3D Scene Generation

Page 12: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 12

Unity X3D Texture Mapping

Page 13: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Unity X3D Texture Mapping

Page 14: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 14

Results of Unity X3D Texture Mapping

Page 15: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Results of Unity X3D Texture Mapping

Page 16: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Draw an H-Anim Character

Page 17: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Load the H-Anim Character

Page 18: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Load BVH Mocap Data

Page 19: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Parse BVH Mocap Data

Page 20: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Joint Mapping of BVH to H-Anim

Page 21: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

BVH Mocap Animation

Page 22: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Display Unity BVH Mocap Animation (1)

Page 23: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Display Unity BVH Mocap Animation (2)

Page 24: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 24

Load Multiple H-Anim Characters

Page 25: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 25

Transform Texture and Size

Page 26: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 26

Load Another H-Anim Character

Page 27: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 27

Adjust H-Anim Coordinates

Page 28: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 28

Results of Loading Multiple H-Anim Characters

Page 29: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 29

Rotate X3D Camera

Page 30: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

2017-7-31 SIGGRAPH Web3D Meeting 30

Adjust X3D Camera FOV

Page 31: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Screen Touch for Camera Rotate and Zoom (1)

Page 32: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Screen Touch for Camera Rotate and Zoom (2)

Page 33: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Screen Touch for Camera Rotate and Zoom (3)

Page 34: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Screen Touch for Camera Rotate and Zoom (4)

Page 35: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Screen Touch for Camera Rotate and Zoom (5)

Page 36: X3D Mobile VR Unity H-Anim Viewer Implementation · 2017. 10. 20. · Unity H-Anim Viewer Implementation Web3D Korea Standardization Meeting Los Angeles, CA, USA ... support program

Conclusions

• Goal

• X3D based mobile 3D data representation and exchange

• Representation of mobile sensors, their functions, and interaction with copied real worlds

• X3D based Mobile VR

• Geo-synchronized X3D worlds (copied real worlds)

• Units specified scene graph

• Physical sensor nodes and device interfaces

• Unity X3D Mobile VR Implementation

• Unity H-Anim Viewer

• Import and load X3D

• X3D texture mapping

• Load an H-Anim character

• Load Multiple H-Anim characters

• H-Anim motion capture animation

• X3D camera control by screen touch

2017-7-31 SIGGRAPH Web3D Meeting 36

Acknowledgement:This research was supported by the MSIP(Ministry of Science, ICT and Future Planning), Korea, under the ITRC(Information Technology Research Center) support program (IITP-2017-2016-0-00312) supervised by the IITP(Institute for Information & communications Technology Promotion)