Student Name Server Utah School of Computing slide 1 Utah School of Computing Gestures CS5540 HCI Rich Riesenfeld Fall 2010
Mar 29, 2015
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 1slide 1
Utah School of Computing
Utah School of Computing
GesturesGestures
CS5540 HCI Rich Riesenfeld
Fall 2010
CS5540 HCI Rich Riesenfeld
Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 2slide 2
Gestures Studies Gestures Studies
Following Gesture material from: Following Gesture material from:
Hand Centered Studies of Human Movement Project, School of Kinesiology, Simon Fraser University, February 1996
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 3slide 3
Gestures-1Gestures-1
• Praying (two flat hands up together) • Begging (flat hand) • Expressing anger (raising a fist) • Derogation (middle finger up) • Accusation (index pointing) • Live or die decisions in the Roman
amphitheater (thumb up/down)
• Praying (two flat hands up together) • Begging (flat hand) • Expressing anger (raising a fist) • Derogation (middle finger up) • Accusation (index pointing) • Live or die decisions in the Roman
amphitheater (thumb up/down)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 4slide 4
Gestures-2Gestures-2Hitch hiking (thumb up, hand moving sideways)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 5slide 5
Gestures-3Gestures-3
Legal and business transactions (handshake, judge hammering)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 6slide 6
Gestures-4Gestures-4
Pointing to real and abstract objects and concepts (index, hand)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 7slide 7
Gestures-5Gestures-5
Waving and Saluting
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 8slide 8
Gestures-6Gestures-6
Waving and Saluting
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 9slide 9
Gestures-7Gestures-7
Finger Counting
Thumb often used for “1”, esp abroad
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 10slide 10
Gestures-8Gestures-8
Fall 2010Fall 2010
I beg of you …
I hope so …
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 11slide 11
Gestures-9Gestures-9
Fall 2010Fall 2010
Let’s hope its true
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 12slide 12
Gestures-10Gestures-10
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 13slide 13
Gestures-11Gestures-11
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 14slide 14
Gestures-12Gestures-12
Terminate / cut
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 15slide 15
Gestures-12Gestures-12
Love (Am Sign Language)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 16slide 16
Gestures-13Gestures-13
Fall 2010Fall 2010
Whoa, stop, …
End
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 17slide 17
Gestures-14Gestures-14
110 100
Trading Floor Hand Signals
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 18slide 18
Gestures-15Gestures-15
Fall 2010Fall 2010
juneseptember
callput out
Trading Floor Hand Signals
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 19slide 19
Gestures-16 Gestures-16
• Conducting an orchestra (variety of both gestures with arms and body)
• Traffic control of cars and airplanes (hands flat pointing or moving)
• Shaping of imagined objects (hands tracing out curves and shapes)
• Martial arts, fighting (variety of movements of arms and body)
• Conducting an orchestra (variety of both gestures with arms and body)
• Traffic control of cars and airplanes (hands flat pointing or moving)
• Shaping of imagined objects (hands tracing out curves and shapes)
• Martial arts, fighting (variety of movements of arms and body)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 20slide 20
Gestures-17 Gestures-17
• Dance (Balinese dancing) • Gesturing by singers (hand and body
movements) • Stock exchange operations (various
hand shapes) • Affective gestures (hand touching) • Rejective (index up moving left & right) /
appreciative (hand clapping) gestures
• Dance (Balinese dancing) • Gesturing by singers (hand and body
movements) • Stock exchange operations (various
hand shapes) • Affective gestures (hand touching) • Rejective (index up moving left & right) /
appreciative (hand clapping) gestures
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 21slide 21
Gestures-18 Gestures-18
• Game playing (hand signs to communicate with partner in card games)
• Game scoring (cricket, basketball, soccer, rugby, football)
• Dinner table actions (commanding waiter to refill wine glass)
• Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)
• Game playing (hand signs to communicate with partner in card games)
• Game scoring (cricket, basketball, soccer, rugby, football)
• Dinner table actions (commanding waiter to refill wine glass)
• Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 22slide 22
Gestures-6 Gestures-6
• Moving, touching and interacting with objects
• Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)
• “Italianate" gestures (two hands open shaking)
• Moving, touching and interacting with objects
• Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)
• “Italianate" gestures (two hands open shaking)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 23slide 23
Gestures-7 Gestures-7
• Mimicry and pantomime (actions and objects are depicted with hand/body movements)
• sign language (a complete linguistic communication system)
• Mimicry and pantomime (actions and objects are depicted with hand/body movements)
• Mimicry and pantomime (actions and objects are depicted with hand/body movements)
• sign language (a complete linguistic communication system)
• Mimicry and pantomime (actions and objects are depicted with hand/body movements)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 24slide 24
Gestures-8 Gestures-8
• Shimmering hand (maybe, maybe not)• Sign language (a complete linguistic
communication system) • Aircraft carrier landings• Dog training• Gambling signals at a casino
• Shimmering hand (maybe, maybe not)• Sign language (a complete linguistic
communication system) • Aircraft carrier landings• Dog training• Gambling signals at a casino
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 25slide 25
Pictograms - 1Pictograms - 1
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 26slide 26
Pictograms - 2Pictograms - 2
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 27slide 27
Pictograms - 3Pictograms - 3
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 28slide 28
Pictograms -4Pictograms -4
Pictgram standardMAYON OF LOND ON
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 29slide 29
Pictogram standardMAYOR OF LOND ON
Pictograms - 5Pictograms - 5
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 30slide 30
Special Need Group: DiversSpecial Need Group: Divers
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 31slide 31
“Help”
“Which direction?”
“Boat"
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 32slide 32
Underwater Communications and Hand Signals - 1
Underwater Communications and Hand Signals - 1
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 33slide 33
Underwater Communications and Hand Signals - 2
Underwater Communications and Hand Signals - 2
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 34slide 34
Underwater Communications and Hand Signals - 3
Underwater Communications and Hand Signals - 3
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 35slide 35
ARFF Emergency Hand Signals - 1ARFF Emergency Hand Signals - 1
Aircraft Rescue and Fire Fighting (ARFF) Communications
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 36slide 36
Recommend EvacuationRecommend Evacuation
ARFF Emergency Hand Signals - 2ARFF Emergency Hand Signals - 2
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 37slide 37
Recommend StopRecommend Stop
ARFF Emergency Hand Signals - 3ARFF Emergency Hand Signals - 3
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 38slide 38
Emergency ContainedEmergency Contained
ARFF Emergency Hand Signals - 4ARFF Emergency Hand Signals - 4
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 39slide 39
hear this,hear this,
Fall 2010Fall 2010
Now, Now,
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 40slide 40
hear this,hear this,Now, Now,
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 41slide 41
Aircraft Carrier Deck OperationsAircraft Carrier Deck Operations
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 42slide 42
Flight Deck Organization -1Flight Deck Organization -1
Fall 2010Fall 2010
Aircraft traffic flow using angle deck
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 43slide 43Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 44slide 44
Uniform Colors-1Uniform Colors-1
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 45slide 45Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 46slide 46
Uniform Colors-2Uniform Colors-2
Fall 2010Fall 2010
Yellow Shirts: Flight Deck Officers and Plane Directors
Green Shirts: Catapult and Arresting Gear people
Red Shirts: Aviation ordnance crews.
Checker Shirts: Squadron maintenance
White Shirts: (w Red Cross):
Flight deck medical corpsmen
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 47slide 47
Uniform Colors-3Uniform Colors-3
Fall 2010Fall 2010
Blue Shirts: Flight Deck Crew
Brown Shirts: Squadron personnel
Purple Shirts: Aviation fuels people
White Shirts: Mail and people handlers
White Shirts: (w Red Cross):
Flight deck medical corpsmen
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 48slide 48
Plane Director Uses Hand Signals to Give Directions to Pilots - 1
Plane Director Uses Hand Signals to Give Directions to Pilots - 1
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 49slide 49
Plane Director Using Hand Signals - 2Plane Director Using Hand Signals - 2
Fall 2010Fall 2010
<Flight_Deck.mht>
Cat video.avi
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 50slide 50
Ready for Launch Ready for Launch Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 51slide 51
B & O Touchless Remote - 1 B & O Touchless Remote - 1
Bang & Olufsen (see folder of neat material in resource folder)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 52slide 52
ConclusionsConclusions
• Like poetry, extraordinarily succinct• Can be highly Universal, International
- Subject to bad cultural misinterpretations
• Increasingly widespread use- Olympics- Travel- Commerce
• Like poetry, extraordinarily succinct• Can be highly Universal, International
- Subject to bad cultural misinterpretations
• Increasingly widespread use- Olympics- Travel- Commerce
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 53slide 53
Utah School of Computing
Utah School of Computing
End End
Gestures Gestures
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 54slide 54
BOOKMARKBOOKMARK
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 55slide 55
Complete Final Turn
Up(Instructions to pilot)
Suspend Catapult Operation
All Clear or Affirmative
Brakes off or Brakes
On
(Fist clenched = Suspend Operation)
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 56slide 56
I have control. (Taking over from previous controller)
Hang Fire(Pilot to hold on until further instructions)
Lower Launch Bar
or Raise Launch Bar
The pilot salutes when ready to launch.The Plane Director returns salute to acknowledge pilot's readiness.
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 57slide 57
BOOKMARKBOOKMARK
Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 58slide 58Fall 2010Fall 2010
<http://www.youtube.com/v/RmhtFk2zCmM?version=3
Logitech Harmony 900
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 59slide 59Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 60slide 60Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 61slide 61Fall 2010Fall 2010
Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 62slide 62Fall 2010Fall 2010