121/10/06 Using Visual Cues of Contact to Improve Interactive Manipulation of Virtual Objects in Industrial Assembly/Maintenance Simulations Jean Sreng,

21/10/06 1

Using Visual Cues of Contact to Improve Interactive Manipulation of Virtual

Objects in Industrial Assembly/Maintenance

SimulationsJean Sreng, Anatole Lécuyer, Christine Mégard, Claude Andriot

jean.sreng@cea.fr

21/10/06 2

Outline

•Introduction•Type of information to visualize•Related work •Visual cues of contact

– Contact glyphs– Contact lights

•Preliminary evaluation•Conclusion

OUTLINE

21/10/06 3

Outline

•Introduction•Type of information to visualize•Related work •Visual cues of contact

– Contact glyphs– Contact lights

•Preliminary evaluation•Conclusion

OUTLINE

21/10/06 4

Introduction

• Context: Virtual prototyping, assembly/maintenance simulations

• Problem: Complex industrial geometries– Multiple contact– Hard manipulation

21/10/06 5

Two types of information to visualize

For all contacts :– Local minimal distances [Johnson et al., 03]

• First point• Second point

– Contacts• Contact point and orientation• Contact force

“ Imagine two models that have just collided. This collision can be represented at a single point on each surface [...]. If the models move apart, this pair of points tracks the local minimum distance and represents the potential future contacts between entire sections of these two models. “

[Johnson et al., 03]

21/10/06 6

Related work

– Visual aids [McNeely et al., 06]

– Visual glyphs [Redon, 02]

– Visual cues [Wanger et al., 92]

21/10/06 7

Visual cues

• We have chosen to develop two novel types of visual feedback :– Contact glyphs

• Proximity• Effort• Hybrid

– Contact lights

21/10/06 8

Outline

•Introduction•Type of information to visualize•Related work •Visual cues of contact

– Contact glyphs– Contact lights

•Preliminary evaluation•Conclusion

OUTLINE

21/10/06 9

Proximity – Contact - Forces

21/10/06 10

Proximity glyphs

21/10/06 11

Proximity glyphs

• Video

21/10/06 12

Effort glyphs

21/10/06 13

Effort glyphs

• Video

21/10/06 14

Hybrid glyphs

21/10/06 15

Hybrid glyphs

21/10/06 16

Hybrid glyphs

21/10/06 17

Hybrid glyphs

• Video

21/10/06 18

Glyph filtering

•Reduce the number of displayed glyphs :– Filtering technique based on user’s motion

21/10/06 19

Outline

•Introduction•Type of information to visualize•Related work •Visual cues of contact

– Contact glyphs– Contact lights

•Preliminary evaluation•Conclusion

OUTLINE

21/10/06 20

Contact lights

•Lights are disposed at the contact point :– Do not overload the visual feedback– Can be combined with glyphs

21/10/06 21

Without visual feedback

21/10/06 22

Spherical lights

21/10/06 23

Conical lights

21/10/06 24

Contact lights

• Video

21/10/06 25

Contact lights and hybrid glyphs

• Video

21/10/06 26

Outline

•Introduction•Type of information to visualize•Related work •Visual cues of contact

– Contact glyphs– Contact lights

•Preliminary evaluation•Conclusion

OUTLINE

21/10/06 27

Preliminary evaluation

•Collect data about users’ preferences•Participants were asked to perform an industrial

assembly operation– Without visual cues– With each visual cues

•They had to fill a subjective questionnaire

21/10/06 28

Experimental setup

SpacePilot

PhysicalEngine

(GVM/LMD)

GraphicalEngine(VTK)

P4 2.4GHz / NVidia Quadro 4

30 FPS

21/10/06 29

Experimental evaluation

•18 participants•Procedure :

– Learning phase (20 min)– Testing phase (20 min)

• All the visual glyphs were presented• They were asked to complete the assembly• They have to test successively all glyphs• They were no time limited• They could freely test again any glyph

– Fill subjective questionnaire (5 min)

21/10/06 30

Collected data

•Rank 5 visual effects according to 4 preference criteria :– 5 visual effects :

• Apparition of a light• Apparition of a glyph• Color change• Size change• Deformation

– 4 criteria :• Understanding the blocking situations• Perception of distances• Perception of contact forces• Focus on contact area

•Preferences among the shapes : disk / sphere / arrow ?•Preferences about filtering : with or without ?

21/10/06 31

Results

•χ2 test on ranks and parametric ANOVA test on rank used as value

•Participants were able to associate effects and visual cues

•Contact lights : Preferred to focus attention– Some found it useful for distances appreciation

[Kjelldahl et al.]

– Decrease the visual workload– Can suggest information in occlusion context

21/10/06 32

Discussion

•Glyphs : Preferred for distances and contact forces– Are reported to help precise manipulation– Color gradient is easily understood (distances)– Size change are globally well appreciated

•Deformation : Preferred for contact forces– Can be naturally perceived (Meet up the

pseudo-haptic effect [Lécuyer et al., 00])

21/10/06 33

Conclusion

•We proposed visual cues to improve manipulation in industrial assembly/maintenance context :

– Glyphs• Arrows, disks, sphere• Proximity, Effort, Hybrid

– Filtering– Lights

•Preliminary evaluation suggested that the visual cues and their associated visual effects seemed useful

21/10/06 34

Further work

•Quantitative evaluation in complex industrial context – Compare visual feedback and haptic or audio

feedback•Develop contextual visual cues

– Adapt to different situations•Complementary technique could be investigated :

– Camera motions– Automatic and multiple viewpoints– Magnifying effects– Transparency on occlusions

21/10/06 35

?Question

Thank you for listening

Questions ?