Haptic Education Adding the Tactile Sensation to Virtual Learning with the Novint Falcon and the Wii.

Haptic EducationHaptic EducationAdding the Tactile Sensation to Virtual Learning with the Novint Falcon and the Wii

Adding the Tactile Sensation to Virtual Learning with the Novint Falcon and the Wii

What are Haptics?What are Haptics?

“Haptics” are any device that provides a touch-based system of interaction with virtual environments.

“Haptics” are any device that provides a touch-based system of interaction with virtual environments.

Where are we going?Where are we going?

Theoretical Framework in Education

Novint FalconFunctionalityGamesProgrammingEducational UsesResearch

Brainstorming – Next Steps

Theoretical Framework in Education

Novint FalconFunctionalityGamesProgrammingEducational UsesResearch

Brainstorming – Next Steps

Wii Technology Physical

Education Simulation Other Uses

Wii Technology Physical

Education Simulation Other Uses

Experiential LearningExperiential Learning

Theoretical FrameworkTheoretical Framework

So What is the Falcon?So What is the Falcon?

Three arms that updates every 1/1000th of a second!

Interchangeable grip

Cons Only compatible with

Windows Has problems on some

Vista machines

Three arms that updates every 1/1000th of a second!

Interchangeable grip

Cons Only compatible with

Windows Has problems on some

Vista machines

So what can this thing do?

So what can this thing do?

Stops the haptic hand grip when it encounters a digital solid object. This could be anything from wall to a spherical ball.

Stops the haptic hand grip when it encounters a digital solid object. This could be anything from wall to a spherical ball.

So what can this thing do?So what can this thing do?

The active mode will pull and push the hand grip, adding resistance or assistance depending on the object encountered.

If a ball is thrown and you catch it with the haptic device, it may push the hand grip out simulating a catch. If you get to close to a magnetic surface, it may pull the hand grip in.

The active mode will pull and push the hand grip, adding resistance or assistance depending on the object encountered.

If a ball is thrown and you catch it with the haptic device, it may push the hand grip out simulating a catch. If you get to close to a magnetic surface, it may pull the hand grip in.

So what can this thing do?So what can this thing do?

This allows the simulation of liquids and specialized textures.

One can create bumpy surfaces that pull you into valleys and push the hand grip to hill tops.

One can also increase the resistance of the hand grip, but still allow passage through objects to simulate heavy liquids like molasses.

This allows the simulation of liquids and specialized textures.

One can create bumpy surfaces that pull you into valleys and push the hand grip to hill tops.

One can also increase the resistance of the hand grip, but still allow passage through objects to simulate heavy liquids like molasses.

So what can this thing do?So what can this thing do?

Mixed Resistance

Don’t bother me Mom… I’m learning

Don’t bother me Mom… I’m learning

MANY MANY Games… Novint.com:

Released:Haptics – Life 2

Exploration PhaseWorld of Warcraft DriversSecond Life Drivers

Outside ExplorationCroquet Virtual World

MANY MANY Games… Novint.com:

Released:Haptics – Life 2

Exploration PhaseWorld of Warcraft DriversSecond Life Drivers

Outside ExplorationCroquet Virtual World

Can I do more?Can I do more?

Downloadable SDK (Software Development Kit) written in C++All the.dll files needed to run the

Novint FalconAn extensive Programmer’s

guideBasic programming text written

for OpenGL, DX9, VC 6, VC 8 and 3D Game Studio

Downloadable SDK (Software Development Kit) written in C++All the.dll files needed to run the

Novint FalconAn extensive Programmer’s

guideBasic programming text written

for OpenGL, DX9, VC 6, VC 8 and 3D Game Studio

So How is this Useful…IN EDUCATION?

So How is this Useful…IN EDUCATION?

Think of something that would be educational for students to experience, but for whatever reason is not feasible in real life (cost, distance, existence, etc.)…

UsesUses

Proposed StudyProposed Study

Hypothesis:“A haptic-based model of virtual

dissection will be found to have significant results with regards to engagement and comprehension than a non-haptic based model, i.e., virtual or literal.”

Hypothesis:“A haptic-based model of virtual

dissection will be found to have significant results with regards to engagement and comprehension than a non-haptic based model, i.e., virtual or literal.”

Croquet ResearchCroquet Research

Questions?Questions?

WiiWii

Wildly successful seventh-generation platform, released in November of 2006

Different from competitors due to unique control system

Totally revitalized company, simply by adding a $2.50 part to previous-generation hardware

Wildly successful seventh-generation platform, released in November of 2006

Different from competitors due to unique control system

Totally revitalized company, simply by adding a $2.50 part to previous-generation hardware

TechnologyTechnology

Accelerometer + optical sensor allow for motion-based control; accurate up to 5m

No force feed-back, but vibration and sound capabilities

Numerous homebrew SDKs and application interfaces available to interact with the hardware itself – WiiRemoteJ, GlovePie, etc

Accelerometer + optical sensor allow for motion-based control; accurate up to 5m

No force feed-back, but vibration and sound capabilities

Numerous homebrew SDKs and application interfaces available to interact with the hardware itself – WiiRemoteJ, GlovePie, etc

Physical EducationPhysical Education

Wii Sports Tennis, Bowling, Golf, Baseball,

Boxing Actions mimic real-world

counterparts; simplified, yet similar

Games useful in educating on the basics

Alternative to prohibitively expensive/unfeasible activities

Encouragement

Wii Fit Activities design to improve

balance, strengthen muscles, burn calories

Wii Sports Tennis, Bowling, Golf, Baseball,

Boxing Actions mimic real-world

counterparts; simplified, yet similar

Games useful in educating on the basics

Alternative to prohibitively expensive/unfeasible activities

Encouragement

Wii Fit Activities design to improve

balance, strengthen muscles, burn calories

Simulation Simulation

Trauma Center Players presented

with various medical scenarios

Remote is implemented in various ways to manipulate surgical tools

Useful for training/educating in otherwise prohibited activities

Trauma Center Players presented

with various medical scenarios

Remote is implemented in various ways to manipulate surgical tools

Useful for training/educating in otherwise prohibited activities

Other UsesOther Uses

Johnny Chung Lee, Carnegie Mellon Ph.D. candidate, HCI Using the Wii

Remote in innovative ways: SmartBoard, Head-Mounted VR display unit, etc.

Johnny Chung Lee, Carnegie Mellon Ph.D. candidate, HCI Using the Wii

Remote in innovative ways: SmartBoard, Head-Mounted VR display unit, etc.

QuestionsQuestions

So How is this Useful…IN EDUCATION?

So How is this Useful…IN EDUCATION?

Think of something that would be educational for students to experience, but for whatever reason is not feasible in real life (cost, distance, existence, etc.)…

Some General Area’sSome General Area’s

CreditsCredits

SILS Human Interaction Course – Fall ’07Dr. Gary Marchionini Novint Falcon

Jeff VanDrimmelenCary GillenwaterBrian MoynihanAmit Kumarhttp://haptic.edutechie.com

WiiBert PurvisTim BaldwinHínár Polczer

SILS Human Interaction Course – Fall ’07Dr. Gary Marchionini Novint Falcon

Jeff VanDrimmelenCary GillenwaterBrian MoynihanAmit Kumarhttp://haptic.edutechie.com

WiiBert PurvisTim BaldwinHínár Polczer

Questions/ContactQuestions/Contact

Jeff VanDrimmelen – jeffvand@unc.edu

Cary Gillenwater - cgillen@email.unc.edu

Bert Purvis – jpurvis@email.unc.edu

Jeff VanDrimmelen – jeffvand@unc.edu

Cary Gillenwater - cgillen@email.unc.edu

Bert Purvis – jpurvis@email.unc.edu