11.19 hong quan_leapmotion-beyondthemouseandkeyboard

Leap Motion Beyond the Mouse and Keyboard

Le Hong Quan

HCI Lab, Dept. of Smart ICT

Konkuk University

Date: 19-Nov-2014

Leap Motion – Beyond the mouse and keyboard

Contents

Leap Motion

How does it work?

Value of proposition

Conclusion

Leap Motion – Beyond the mouse and keyboard

Leap Motion device (the Leap)

iPod size gesture recognition human computer interaction.

Connect to computer via USB 3.0

200 times more accurate than other touch-free technologies (Microsoft’s Kinect).

Tracking motions of all 10 fingers with speed is millimeters/second.

Distinguishes individual fingers and objects.

Affordable: $99.99

Tiny devices. Huge possibilities.

2

Leap Motion – Beyond the mouse and keyboard

It works with what you already have. (Hands and fingers included)

A little bit of magic. A lot of freedom. Everything you do is just move your hands and fingers. Leap Motion Controller will recognizes every your movement and responses corresponded actions in both 2D and 3D spaces.

Leap Motion device (the Leap)

2

Leap Motion – Beyond the mouse and keyboard

It works with what you already have. (Hands and fingers included)

How does it work?

At the first connect motion controller via USB cable.

Leap Motion – Beyond the mouse and keyboard

It works with what you already have. (Hands and fingers included)

How does it work?

Peel off sticker Plug into you computer Be comfortable

Leap Motion – Beyond the mouse and keyboard

Inside Leap Motion

- Operates in an proximity with high precision and tracking frame rate and reports positions, gestures and motions.

- The device uses optical sensors and infrared light.

- The effective range of Leap Motion extends from approximately 25~600 millimeters above the device.

Leap Motion – Beyond the mouse and keyboard

Inside Leap Motion

- The device observes a hemispherical area, to a distance of about 1 meter.

- Consume only 1~2% of CPU.

Leap Motion – Beyond the mouse and keyboard

Inside Leap Motion

- Sensor detects the finger, determines where finger is and updates current position.

- Sensor has come minimal processing: it streams frames of data.

- Extracting position information using extremely complex math.

- Sensor update position typically 215 times per second.

2

Leap Motion – Beyond the mouse and keyboard

Value of proposition

It works with what you already have. (Hands and fingers included) Computer controls

Creative tools Experimental Education Music / Entertainment Games Medical / Healthcare Productivity

Leap Motion – Beyond the mouse and keyboard

Education Explore Complex Anatomy in 3D space

Form & Function 3D is an educational tool meant to return a sense of space to learning comparative anatomy.

Features: •Use the Leap Motion Controller •Accurate 3D anatomical models •Highlight and label structures •Switch between surface and internal views •Blood flow simulation •Quiz mode.

Leap Motion – Beyond the mouse and keyboard

Games Sortee

Sortee is a puzzle game that tests your perception of every objects. Think fast. Play fast.

Features: •400 hand-drawn items and 100+ categories •51 increasingly challenging levels •3 game modes: classic, fast and kids. •Languages: English, French, German, Spanish and Portuguese

Leap Motion – Beyond the mouse and keyboard

Music / Entertainment Cubase iC Air

Control Cubase 7 and Cubase Artist 7 with the sole movement of your hand.

Features: •Control Cubase 7 and Cubase Artist 7 with hand gestures. •Use pre-defined gesture commands for transport control and navigation. •Control virtually any parameters through Advanced Integration.

Leap Motion – Beyond the mouse and keyboard

Productivity Natural Sculpting

Features: •Explore different materials including glass, clay and plastic. •Sculpting tools. •Visually stunning environment. •Allows to view and work with underlying wireframes.

Natural Sculpting – beauty in design – lets you sculpt your own 3D creations, express yourself with intuitive interactions.

Leap Motion – Beyond the mouse and keyboard

Medical / Healthcare TedCas & Leap Motion in Operating Room

With Leap Motion device embedded into the TedCas module, the surgeon operate faster and reduce risks for patients.

Features: •Embedded system. •Navigate images quickly and intuitive. •Provide a safeguard for cross-contamination. •Manipulate the screens.

Leap Motion – Beyond the mouse and keyboard

Conclusion

- Leap represent a significant step forward for motion sensing technology.

- Google endorses Leap Motion with latest version of Google Earth.

- Leap has partnered with HP and Asus to ship high end notebooks and in one PCs in later 2013.

Leap Motion – Beyond the mouse and keyboard

References

https://www.leapmotion.com/

https://apps.leapmotion.com/categories/all

https://plus.google.com/u/0/106312624963623427811/posts

http://blog.leapmotion.com/tedcas-strides-toward-the-next-gen-operating-room/

Thank you!

Leap Motion – Beyond the mouse and keyboard