Robots, Microcontrollers & Sensors http://www.martinet.nl
Popchilla @ Autism Center of Pittsburgh & Interbots iPad app + robot
Therapy for children with Autism
Control the robot to identify emotions
Microcontroller Small computer on a single integrated circuit
Processor Core
Memory
I/O peripherals
Embedded Applications
Example: Arduino, Gumstix, …
Arduino Flexible, easy to use platform
Microcontroller: ATmega168
14 Digital I/O pins, 6 Analog input pins
Serial Communication
Programming: Preburned bootloader allows to upload new codes through Arduino software.
Sensors
Display
Compass
GPS
Accelerometer
Gyro
Pressure Sensor
Microphone
Camera
Force sensor
IR sensor
Teams Input Device Design
Arduino/Sensor Programming Establishing wireless communication via Bluetooth Glove design Machine Learning - Pattern Recognition
Robot Application Design Robot Programming Application design & Programming Establishing wireless communication
1/18/11
1
Multi Input Glove
!!Collaboration with Children’s Healthcare of Atlanta
!!Cerebral Palsy patients
!! Incapable of dexterous tasks
Multi Input Glove
!!Current Technology
!! Computerized speech generating device !! Touch screen / Tablet Computers
!! Many patients have hard time pressing buttons
1/18/11
2
Multi Input Glove
!!A glove that turns your forearm into a big remote controller.
!! Force Sensitive Resistor sensors
!! Safety issues
Concept Sketch
Sliding through sensors
1/18/11
3
Concept Sketch
Tapping each sensor
Tasks
!!Design multi-input ‘glove’ device
!! Arduino board and the sensors
!! Interface/Control
!! iPad application
!! Robot
!! ??
1/18/11
4
References !! Engaging Children with Severe Physical Disabilities via
Teleoperated Control of a Robot Piano Player
!! Making Muscle-Computer Interfaces More Practical !! Scott Saponas, Desney Tan, Dan Morris, Jim Turner, and James Landay,
Proceedings of ACM CHI 2010, April 2010
!! Demonstrating the Feasibility of Using Forearm Electromyography for Muscle-Computer Interfaces !! T. Scott Saponas, Desney S Tan, Dan Morris, Ravin Balakrishnan, Conference on
Human Factors in Computing Systems, 2008
!! !Skinput: Appropriating the Body as an Input Surface !! Chris Harrison, Desney S Tan, Dan Morris, Proceedings of ACM CHI 2010
!! Experimental Research Methods !! Wickens, Gordon, and Li, An Introduction to Human Factors Engineering, 1998.