Top Banner
Effects of 2D Geometric Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner University of British Columbia Vancouver, Canada July 30, 2006
40

Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

Jun 25, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

Effects of 2D Geometric Transformation on Visual Memory

Heidi Lam, Ronald A. Rensink, Tamara Munzner

University of British ColumbiaVancouver, Canada

July 30, 2006

Page 2: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

2

The screen space challenge

IT WAS the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the season of Darkness, it was the spring of hope, it was the winter of despair, we had everything before us, we had nothing before us, we were all going direct to Heaven, we were all going direct the other way.

DataScreens

Too much data to fit on any screen

Device has severe screen space

limitations

Geometric transformationsare a commonly used solution in interface design

Page 3: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

3

Geometric transformation: Scaling

Scaling: Thumbnails are widely used

File System

Web Search

Page 4: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

4

Geometric transformation: Fisheye

Fisheye: Example of Focus+Context from InfoVis

Fisheye polar Fisheye rectangular

Bederson, B.B., Clamage, A., Czerwinski, M.P., and Robertson, G.G. 2004. DateLens: A Fisheye Calendar Interface for PDAs. ACM ToCHI 11(1), 90-119.

Schafer, W.A., Bowman, D.A. A Comparison of Traditional and Fisheye Radar View Techniques for Spatial Collaboration. Graphics Interface, 2003, 39-46.

Page 5: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

5

Geometric transformation: Rotation

Rotation: Used for interactive visualization

Yee, K.P., Fisher, D., Dhamija, R., Hearst, M. 2001. Animated Exploration of Graphs with Radial Layout. In Proc IEEE InfoVis, 45-50.

Network Visualization

Page 6: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

6

Transformation costs and benefits

Benefit:Apportioned screen space to provide information required for thetasks

Costs:Transformed images may be too distorted to be recognizable

Users may not be able to associate the components in the original image to those in the transformed image

Users may still be able to perform the tasks, but with increased task time

Page 7: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

7

Heuristics to minimize transformation costs

Maintain… [Misue et al., 1995]

Orthogonal ordering: left-right, up-down ordering

Proximity: distance relationships between objects

Topology: inside-outside relationships

Rules are…Too vagueLargely unquantified

Use…Visual cue: landmarks, grids[Carpendale et al., 1997, Zanella et al., 2002]

Animation: supports object constancy to retain components relationships during transformation [Robertson et al., 1989]

Page 8: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

8

Our motivation: To guide interface design

Studied the commonly used transformations in interface design:

Scaling

Rotation

Fisheye (rectangular and polar)

Measured the effects of background grids

Quantified perceptual costs of geometric transformations on visual memory

Different transformation types

Different transformation levels

Page 9: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

9

Related work

Current work is an extension of previous studies on perceptual effects of geometric transformation on visual search

Rensink (2004) The Invariance of Visual Search to Geometric Transformation. Journal of Vision 4.

Translation, rotation, scaling

Lau, Rensink, Munzner (2004) Perceptual Invariance of Nonlinear Focus+Context Transformations. In Proc ACM APGV, 65-72.

Rectangular fisheye transformation

Found no-cost zones for all geometric transformations studied

Translation was found to be robust within range studied

Skopik and Gutwin (2005) looked at the effects of rectangular fisheye transformation on visual memory

Participants could compensate the distortions with longer task time in a task to remember and find target nodes in a graph

Page 10: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

10

Experimental design

10 experiments

Single-factor with the transformation type being the only factor

5 levels of transformation, counterbalanced between participants

8 trials per level, randomized

20 participants per experiment

Measured reaction time and task accuracy

Page 11: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

11

Experiment: Stimuli

Abstract images of 15 dots connected by straight lines

Dots: Randomly placed within the 300x300 pixel area

Avoided collision

Lines:Joined the dots to at least one nearest neighbour

Used heuristic to avoid line crossing

Page 12: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

12

Experiment stimuli: Scaling

Page 13: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

13

Experiment stimuli: Rotation

Page 14: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

14

Experiment stimuli: Fisheye rectangular

)1()1(

)( ++

= dxxd

xT Leung, Y.K. and Apperley, M.D. 1994. A Review and Taxonomy of Distortion-Oriented Presentation Techniques. ACM ToCHI, 1(2), 126-160.

Page 15: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

15

Experiment stimuli: Fisheye polar

)1()1(

)( ++

= dxxd

xT Leung, Y.K. and Apperley, M.D. 1994. A Review and Taxonomy of Distortion-Oriented Presentation Techniques. ACM ToCHI, 1(2), 126-160.

Page 16: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

16

Experiment: Procedure

For each experimental level:

1. Learning: 8 original, untransformed images @ 12 seconds, separated by blank screens

2. Recognition: 8 images transformed at one of the 5 levels, half were shown in the original form in the learning phase

Participants needed to answer if image was seen before in learning phase

Measured reaction time and task accuracy

Page 17: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

17

Experiment: Procedure

Participant preparation and training:

Shown examples of transformed images

Informed of the need to recognize images in second phase of the study

Had up to two training sessions using the baseline untranformed level to obtain at least 80% accuracy

Page 18: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

18

Experiment: Procedure

Rotation tryout:

Page 19: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

19

Experiment: Procedure

Page 20: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

20

Experiment: Procedure

Page 21: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

21

Experiment: Procedure

Page 22: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

22

Experiment: Procedure

Page 23: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

23

Experiment: Procedure

Page 24: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

24

Experiment: Procedure

Page 25: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

25

Experiment: Procedure

Page 26: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

26

Experiment: Procedure

Seen this before?

Page 27: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

27

Experiment: Analysis

Response time results:

Initial analysis: repeated-measure ANOVA with the transformation type as the only factor

Post-hoc analysis: multiple comparisons with Bonferroni correction

Accuracy results:

Initial analysis: Friedman test

Post-hoc analysis: Mann-Whitney test

Defined no-cost zone for each transformation type

Page 28: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

28

Our set of 10 experiments

Scaling (1, 0.5, 0.33, 0.25, 0.2x)Exp 1. no gridExp 2. rectangular grid

Rotation (0, 30, 45, 60, 90 degrees clockwise rotation)Exp 3. no gridExp 4. rectangular grid

Fisheye rectangular (0, 0.5, 1, 2, 3 transformation level)Exp 5. no gridExp 6. rectangular gridExp 7. polar grid

Fisheye polar (0, 0.5, 1, 2, 3 transformation level)Exp 8. no gridExp 9. rectangular gridExp 10. polar grid

no limit found (0.2x)no limit found (0.2x)

45°60°, improved accuracy by 10%

12 Improved accuracy from 2 chance to >75%

12 did not improve accuracy2

N O

–C

O S

T

Z O

N E

S

Page 29: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

29

0

1

2

3

4

5

0 0.5 0.33 0.25 0.2

Scaling factor

Tim

e (s

)

No GridRectangular Grid

0

20

40

60

80

100

0 0.5 0.33 0.25 0.2

Scaling factorA

ccu

racy

(%

)

No Grid

Rectangular Grid

Chance

Experiment: Scaling results

No significant difference between the 5 scaling levels, with or without grids

No-cost zone: at least 0.2x

Page 30: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

30

0

1

2

3

4

5

6

7

8

0 30 45 60 90 120 150 180

Degrees of Clockwise Rotation

Tim

e (

s)

No GridRectangular GridRectangular Grid Ext

Experiment: Rotation results

No grid: marginal time and accuracy effects time: F(1.9, 35.8) = 2.92, p = .070; accuracy: χ2(4, N=20) = 8.75, p = .070)

Rectangular grid:

Extended the study range to 180° to better identify the no-cost zone boundaryExtended the boundary from 45° at 60°Improved accuracy by 10%

0

20

40

60

80

100

0 30 45 60 90 120 150 180

Degrees of clockwise rotation

Ac

cura

cy (

%)

No GridRectangular GridRectangular Grid ExtChance

Page 31: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

31

Experiment: Fisheye rectangular results

0

1

2

3

4

5

6

7

8

0 0.5 1 2 3

Fisheye tranformation d factor

Tim

e (s

)

No GridRectangular GridPolar Grid

0

20

40

60

80

100

0 0.5 1 2 3

Fisheye transformation d factorA

ccu

racy

(%

)

No GridRectangular GridPolar GridChance

No grid: marginal time and significant accuracy effect time: F(1.9, 36.2) = 2.83, p = .074; accuracy: (χ2(4, N=20) = 43.80, p < .001)

Polar or rectangular grids:Extended the boundary to from d = 1 to d = 2Improved accuracy from chance to at least 75%

Page 32: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

32

0

1

2

3

4

5

6

7

0 0.5 1 2 3

Fisheye transformation d factor

Tim

e (s

)

No GridRectangular GridPolar Grid

Experiment: Fisheye polar results

0

20

40

60

80

100

0 0.5 1 2 3

Fisheye tranformation d factor

Acc

ura

cy (

%)

No GridRectangular GridPolar GridChance

No grid: significant accuracy effect (χ2(4, N=20) = 17.16, p = .002 )

Polar or rectangular grids:Extended the boundary from d = 1 to d = 2Did not significantly improve accuracy

Page 33: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

33

A Fisheye polar follow-up study

Should line curvature match the transformation?Previous experiment drew straight lines with polar transformation

Tried lines with same curvature, and opposite curvature

Distinctiveness may be more important than consistencySame curvature was less accurate

Opposite curvature made no difference

Lower accuracy

Page 34: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

34

Experiment: Result summary

Scaling:

No-cost zone to at least 0.2x

Rotation:

Grid extended the no-cost zone boundary from 45° to 60°

Grid improved accuracy by 10%

Fisheye Rectangular:

Grid extended the no-cost zone boundary from d = 1 to 2

Grid improved accuracy from chance to at least 75%

Fisheye Polar:

Grid extended the no-cost zone boundary from d = 1 to 2

Accuracy was not at chance

Grid had no significant effects on accuracy

Page 35: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

35

Interpretation: Effects of transformation

Our results corroborated our previous finding that no-cost zones exist for all studied geometric transformations

No-cost zone boundaries were found to be further in visual memory than visual search studies [Lau et al., 2004; Rensink, 2004]

Preliminary work suggests image distinctiveness is more important for memorability than global consistency with the underlying transformation and object coordinate systems

Page 36: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

36

Interpretation: Effects of grids

Verified that grids helped:

Extended no-cost zone boundaries

Improved accuracy

The type of grid did not seem to matter

Consistency between grid and transformation coordinate system was not necessary

Grids should not be visually intrusive

Grids were too visually prominent in previous work; results weredetrimental [Lau et al., 2004]

Page 37: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

37

Interpretation: Revisiting design guidelines

Guidelines recommend maintaining: [Misue et al., 1995]

Orthogonal ordering: left-right, up-down ordering

Proximity: distance relationships between objects

Topology: inside-outside relationships

Scaling preserves all three

Our visual memory is robust against scaling transformation within our tested range

Rotation violates up-down orderingGrid failed to help starting at 90°

Orthogonality generalization: need a principal axis with a clear up/down direction

Page 38: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

38

Interpretation: Revisiting design guidelines

Fisheye transformation violates proximity

Relative distance estimation is difficult

Fisheye rectangular transformation

Grids greatly improved task accuracy

Fisheye polar transformation

Better task accuracy, even without grids

Grids had no significant effects

Easier for participants to estimate distance as the widths and heights were integrated in the transformation?

Page 39: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

39

Future directions

In this work, we transformed the location of objects within the space

What if we also transform the objects themselves?

Preliminary results were inconclusive

Our experiments looked at single and uniform transformations

In some applications, images may transform by parts, and independently

Page 40: Transformation on Visual Memory...Transformation on Visual Memory Heidi Lam, Ronald A. Rensink, Tamara Munzner ... direct to Heaven, we were all going direct the other way. Data Screens

40

Conclusions

Systematically studied the effects of geometric transformations on visual memory

Mapped out no-cost zones within which performance in terms of reaction time and task accuracy were unaffected by the transformation:

Scaling: robust within range studied

Rotation and fisheyes: found boundaries

Verified positive effects of grids:Extended no-cost zone boundaries

Improved accuracy