Page 1
Directional vs Non-directional Modes of Vibrotactile Feedback for Arm Posture Replication
Albert Causo, Le Dung Tran, Song Huat Yeo and I-Ming Chen
School of Mechanical and Aerospace Engineering
Nanyang Technological University, Singapore
25th
Jun 2012
1
Page 2
Motivation & Objective http
:/2.b
p.b
log
spo
t.com
/69
cpY
P6
lmkU
/TV
l_IZ
iRp
zI/AA
AA
AA
AA
Ea
c/
x8y2
JdG
_S
GQ
/s40
0/p
hysio
the
rap
y%2
Bstro
ke%
2B
old
%2
Bw
om
an
.jpg
http:/i1.ytimg.com
/vi/tdFX
lB3H
LUQ
/hqdefault.jpg
15m
67%
stroke patient
survive
Develop low-cost device
for rehabilitation
Best feedback strategy for
posture correction2
Page 3
Presentation Outline
System Overview
Arm Posture Modeling & Measurement
Vibo-tactile for Posture Correction
3
Page 4
Different ways of capturing motion
Inertial Motion Unit
MAGNETIC
MECHANICAL
SYSTEM
OPTIC
System Overview Modeling Vibro-tactile
4
Page 5
Vibro-tactile Feedback
posture guidance
motor learning hand
rehabilitation
5
System Overview Modeling Vibro-tactile
Page 6
IMU
IMU
Vibro-tactile Unit
System Overview
IMU
Vibro-tactile
Unit
6
System Overview Modeling Vibro-tactile
Software
Page 7
Arm Posture Modeling
Wrist
Position
Elbow
Position
Forearm
Roll
7
System Overview Modeling Vibro-tactile
Page 8
Shoulder
Wrist
Elbow
IMU 1
IMU 2
𝐿2
𝐿1
Arm Posture Kinematics
IMU 1 -
𝑟1 ,𝑝1 , 𝑦1
IMU 2 -
𝑟2 ,𝑝2 , 𝑦 2
Arm Lengths -
𝐿1,𝐿2
𝑓 (𝑟 1 ,𝑝1 , 𝑦 1 ,𝑟2 ,𝑝2 , 𝑦 2 ,𝐿1 ,𝐿2)𝑓 (𝑟 2 ,𝑝2 , 𝑦2 ,𝐿2)
wrist -
elbow -
forearm roll -
𝑟1
8
System Overview Modeling Vibro-tactile
Page 9
Vibro-tactile feedback for arm posture correction
Vibro-tactile unit
Directional feedback
Non-directional feedback
9
System Overview Modeling Vibro-tactile
Page 10
Directional Feedback Non-directional Feedback
Global
system at
shoulder 10
right hand right hand
System Overview Modeling Vibro-tactile
Local
system at
wrist
Page 11
Experiments
1 2 3
4 5
11
System Overview Modeling Vibro-tactile
Page 12
Calibration Step
12
System Overview Modeling Vibro-tactile
Page 13
Using Vibro-tactile Feedback
Directional Feedback Non-directional Feedback
1m36s 25s13
System Overview Modeling Vibro-tactile
Page 14
Results
Feedback Strategy Mapping Time (s)Directional Feedback 52.68 ± 17.98
Non-directional Feedback 36.82 ± 19.37
2 3
1 42 3 5
Average error of 7 subjects for 5 posturesAverage error of 7 subjects for 5 postures
14
The use of tactors as directional & non-directional feedback
Error Directional Feedback Non-directional Feedback
Wrist position (mm)
34.42 ± 22.46 26.61 ± 12.92
Elbow position (mm)
20.63 ± 9.53 19.61 ± 9.56
Forearm roll (deg) 6.81 ± 2.96 7.07 ± 3.05
System Overview Modeling Vibro-tactile
Page 15
Conclusion
IMU
IMU
Vibro-tactile Unit
Integrated System
Arm Posture Modeling
& Measurement
Vibo-tactile for
Posture Correction
15
Page 16
Future Work
• Combine active visual + audio + vibro-tactile feedback
• Compare direction & non-direction when adding vision
• Design rehab modules
16
Page 17
Thank you!
Email: [email protected]
17
Page 19
Design of GUI
Experiment tabTesting tabConfiguration tab 19
Page 20
Software - System Overview
StartReceive
Master’s IMU
data
Determine
target
position
Receive
Student’s
IMU data
Determine
current
position
Handle
error
Send tactile
feedbackFinish
Student
adjusts
his/her arm
+-
Arm Replication Process
Page 21
IMU Measurements
IMU packs 9 sensors (3 accelerometers, 3 angular rate
gyros, 3 magnetometers)
Given the angular value at (t − 1) and t, the numerical approximation becomes
Inertial Motion Unit
Page 22
Kinematic Formulation (1)
Cartesian transformation
Page 23
Kinematic Formulation (2)
Yaw - z axis
Pitch - y axis
Roll - x axis
Page 24
Kinematic Formulation (3)
Page 25
IMU Specification
Page 26
Tactor Specification
Specifications of VPM2
VPM2 tactor
Dimensions of VPM2
Page 27
Capture of Program
Page 29
Vibrotactile Unit
Page 30
Average error of 7 subjects for 5 posturesAverage error of 7 subjects for 5 postures
Data
Directional and non-directional feedback indicators
Feedback Strategy Mapping Time (s)
Directional feedback 52.68 ± 17.98
Non-directional feedback 36.82 ± 19.37
Average mapping time of 7 subjects for 5 posturesAverage mapping time of 7 subjects for 5 postures
Error Directional feedback Non-directional feedback
Wrist position (mm)
34.42 ± 22.46 26.61 ± 12.92
Elbow position (mm)
20.63 ± 9.53 19.61 ± 9.56
Forearm roll (deg) 6.81 ± 2.96 7.07 ± 3.05
Page 31
Threshold values
Directional and non-directional experiments