Top Banner
#CDays14 – Milano 25, 26 e 27 Febbraio 2014 VS02 - Kinect 1, Kinect 2, Leap Motion, Intel Perceptual Computing: quale scegliere? Matteo Valoriani [email protected] - @MatteoValoriani
37
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

VS02 - Kinect 1, Kinect 2, Leap Motion, Intel Perceptual Computing: quale scegliere?

Matteo Valoriani

[email protected] -@MatteoValoriani

Page 3: Communitydays2014

WHO I AM…

PhD Student at Politecnico of Milano

CEO of Fifth Element

Consultant

[email protected]

Page 4: Communitydays2014

FOLLOW ME ON TWITTER OR THE

KITTEN GETS IT: @MatteoValoriani

Page 5: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Agenda

• Why NUI

• Sensors

Kinect 1

Leap Motion

Intel Camera

Kinect 2

• Which to choose?

Page 6: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Why NUI?

Page 7: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Page 8: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Page 9: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Page 10: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

NUI devices

Page 11: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Kinect

Page 12: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

3D DEPTH SENSOR

RGB CAMERA

MULTI-ARRAY MIC MOTORIZED TILT

Kinect - SpecsHardwareDepth resolution:320x240

RGB resolution:640x480

FrameRate:60 FPS

Latency

90 ms

Page 13: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Kinect - Field of View

• 43° vertical by 57° horizontal field of view

Page 14: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Skeleton Data

Maximum two players

tracked at once

Six player proposals per

Kinect

Page 15: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

demo

Page 16: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Leap Motion

https://www.youtube.com/watch?v=_d6KuiuteIA

https://airspace.leapmotion.com/

Page 17: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Leap Motion -Field of View

150° - Long Side

120° - Short Side

Max 60 cm abovethe controller

Max 60 cm wide on each side

Page 18: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Leap Motion for Developers

Page 19: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Hands Recognition

Page 20: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Page 21: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

demo

Page 22: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Intel Perceptual Computing

https://www.youtube.com/watch?v=WePIY7svVtg

Page 23: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Camera Specs Hardware:

Depth resolution:320x240

RGB resolution:1280x720

FrameRate:30 FPS

• Size:10.15 x 5.1 x 5 cm

Page 24: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Page 25: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

demo

Page 26: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Xbox One - Kinect 2

http://youtu.be/Hi5kMNfgDS4

Page 27: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Kinect 2 - Specs

3D DEPTH SENSOR

RGB CAMERA

MULTI-ARRAY MIC

Hardware:

Depth resolution:512×424

RGB resolution:1920×1080 (16:9)

FrameRate:60 FPS

Latency:60 ms

Page 28: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Kinect 2 vs Kinect 1

Version 1 Version 2

Depth range 0.4m → 4.0m 0.4m → 4.5m

Color stream 640×480 1920×1080

Depth stream 320×240 512×424

Infrared stream None 512×424

Audio stream 4-mic array 16 kHz 4-mic array 48 kHz

USB 2.0 3.0

Hand Traking External tools Yes

Face Traking Yes Yes+Expressions

FOV 57° H 43° V 70° H 60° V

Tilt Motorized Manual

Page 29: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

demo

Page 30: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Which to choose?

Page 31: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Some selection criterias…

1° 2° 3° 4°

2 or + users Kinect 2 Kinect 1 Intel Leap

Full body interaction Kinect 2 Kinect 1 - -

Hand Recognition Intel Leap Kinect 2 Kinect 1*

Accuracy Leap Intel Kinect 2 Kinect 1

Voice command Intel (Kinect 2) Kinect 1

Minimum Hardware Intel Leap Kinect 1 Kinect 2

Price Leap Kinect 1 Intel* (Kinect 2)

Compatibility Leap Intel Kinect 1 Kinect 2

Page 32: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Which to choose? ALL

Microsoft Kinect Issues:

The device is large

A dedicated power cord is required

The amount of data generated by the sensor also tends to saturate a USB controller

Kinect cannot easily distinguish individual fingers on a hand

Most of the features listed above require the Microsoft SDK, which is only supported for desktop applications on Windows 7 and 8.

Microsoft Kinect Advantages:

Skeletal tracking

Face tracking

Multiple sensors:

Raw data

Voice control

Best for:

Kiosks, installations, and digital signage projects where the user will be

standing fairly far away from the display.

Page 33: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Which to choose? ALL

Leap Motion Issues:

Sensing range is fairly limited.

Only fingers are tracked.

There is no skeleton or face tracking.

No access to the raw sensor data.

Leap Motion Advantages:

Finger tracking is fast and accurate.

Smaller and less expensive

Framework support: .NET, Processing, Cinder, etc.

Compatible: Mac OS and Windows.

Best for:

Controlled kiosk environments with a pointing-based UI.

Generally best for general audience desktop apps which can be distributed in the

Airspace store.

Page 34: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Which to choose? ALLIntel Issues:

• Getting some of the deeper features (like age and gender detection) to work is a bit tricky.

• Device and software are in beta.

• Due to the close range of the tracking system, hand gestures must be designed such that a user’s hand doesn’t occlude their own view of the display.

Intel Advantages:

Smaller and less expensive

Close-range tracking

Hand posture/gesture recognition

Facial analysis

Speech (built-in support for speech synthesis powered by Nuance).

Raw data

Framework support: Processing, Unity and OpenFrameworks

Best for:

Desktop/laptop applications where the user will be seated in front of the PC.

Close range applications where features, apart from hand tracking and recognition, are

necessary without too much precision or accuracy.

Page 35: Communitydays2014

… TIRED?

Page 36: Communitydays2014

So Long and Thanks for all the Fish

Page 37: Communitydays2014

#CDays14 – Milano 25, 26 e 27 Febbraio 2014

Q&ATutto il materiale di questa sessione su

http://www.communitydays.it/

Lascia il feedback su questa sessione,

potrai essere estratto per i nostri premi!

Seguici su

Twitter @CommunityDaysIT

Facebook http://facebook.com/cdaysit

#CDays14