Introduction to OSVR - Apr 2015

Apr 2015

Yuval Boger (@osvrguy),

CEO , Sensics

OSVR

Software

OSVR HDK

OSVR

Community

2

3

• Very low geometric and color distortion

• Sharp image throughout

4

• Open source

• On-board video processing

• Real-time image rotation

• Convert full desktop to side-by-side

• On-board USB 3.0 for expansion

• Compatible with wireless video links

• Removable cover

• Positional tracking

• Leap Motion

5

The OSVR™ API is a multi-platform, standardized interface to virtual reality devices and peripherals.

Designed to encourage adoption of and innovation in AR/VR.

With the OSVR API, developers can:

• Discover, configure and operate a wide range of devices through standardized, abstract interfaces

• Mix-and-match devices (e.g. hand trackers) with analysis plugins (e.g. gesture engines)

• Write once, run on many hardware/platform configurations

6

• Software available under Apache Software License, version 2.0

• http://osvr.github.io

• Can change and redistribute

• Can use proprietary plugins

• Choice of license intended to encourage participation of both academic institutions and commercial firms

7

8

Cloud

(storage,

Connectivity)

Position and

orientation trackersEye tracker

Body tracking

(including hand and

finger)

Cameras and

Depth sensors

Audio

Power management

Mouse and game

controllerHaptics

Device discovery

(which devices, where,

what are they

connected to?)

Rendering

Utilities

Software updatesDisplay

Biometric sensors

Windows-specific code

Gesture enginePose estimationGaze detection

User-defined libaries System configuration

(which devices and

libraries are used, how

are they connected)

Object and face

detection

Environmental sensors

Position detectionSensor fusion

Network transport

Force feedback

Store/ load

configurations (cloud,

local, non-volatile)

Device configuration

Input devices Output devices

Engine-based VR app

Unity/ UnrealNative VR App

Non-VR game

Vorpx/ Tridef/ Vireio

HMD 1 HMD 2 HMD 3 Peripheral 1 Peripheral 2 Peripheral 3 ...

Android-specific code Linux-specific code OSX-specific code

Open architecture supports additional plugins

9

Cloud

(storage,

Connectivity)

Engine-based VR app

Unity/ UnrealNative VR App

Non-VR game

Vorpx/ Tridef/ Vireio

10

• Native applications can work directly with the OSVR API• Applications built on engines (Unity, Unreal, etc.) can operate via

game engine plugins• Applications unaware of VR can work through 3D DirectX drivers

such as Vorpx, Tridef or Vireio

HMD 1 HMD 2 HMD 3 Peripheral 1 Peripheral 2 Peripheral 3 ...

11

• Supports a wide range of displays (HMDs and other display types)

• Supports multiple classes of devices such as:• Motion trackers• Eye trackers• Position trackers• Depth cameras• Haptic controllers• Biometric sensors

• Discovers compatible devices

12

Cloud

Game 1

Unity/ UnrealNative VR App

Non-VR game

Vorpx/ Tridef/ Vireio

Eileen Other HMDs Peripherals

Position and

orientation trackersEye tracker

Body tracking

(including hand and

finger)

Cameras and

Depth sensors

Audio

Power management

Mouse and game

controllerHaptics

Display

Biometric sensors

Environmental sensors

Force feedback

Input devices Output devices

• Abstracts devices by functional interface• A device might expose several different functions. For

instance an HMD might expose display, head tracker and audio interface

• Provides standardized interface to automatically discover, determine capabilities, configure and operate each device

Rendering

UtilitiesGesture enginePose estimationGaze detection

User-defined libariesObject and face

detectionPosition detectionSensor fusion

13

Analysis plugins turn raw data into useful information:• Video image identified face• Hand position recognized gesture• Input from multiple position sensors better data

• Pose estimation

• Face detection

• Distortion correction

• Object/marker detection

• Gesture engine

• Position detection

• Gaze detection

• Rendering

• Directional sound

• Speech recognition

• Redirected walking

• Store to log file

• Additional libraries can

be added

14

Libraries are automatically discovered

15

• OSVR Resources:

• http://www.osvr.com

• http://osvr.github.io

• Sensics (founding contributor to OSVR): http://www.sensics.com

• Yuval Boger’s blog: www.vrguy.net

16