Top Banner
Stroke Perception Karan Singh, Ryan Schmidt
44

Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

Mar 27, 2018

Download

Documents

hatu
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

Stroke Perception

Karan Singh, Ryan Schmidt

Page 2: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

2

Warning lights

http://www.michaelbach.de/ot/mot_sam/index.html

Page 3: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

3

Warning lights

http://www.michaelbach.de/ot/mot_sam/index.html

Page 4: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

4

Why do we see things?

• Shape (silhouettes, features, lines).

• Value (shading, curvature, lighting).

• Space (Segments, relationships of parts).

Page 5: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

5

Shape (Necker Cube)

Page 6: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

6

Value

Page 7: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

7

Value

Page 8: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

8

Space

Page 9: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

9

Shape Understanding

• Gestalt (shape, value, space)

• NPR (shape, value, space)

• Geometry and Projection (shape, space)

Page 10: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

10

Gestalt

http://graphics.stanford.edu/~niloy/research/emergence/emergence_image_siga_09.html

Page 11: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

11

Gestalt (Emergence)

http://graphics.stanford.edu/~niloy/research/emergence/emergence_image_siga_09.html

Page 12: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

12

Gestalt and Hidden Imagery

Page 13: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

13

Gestalt and Hidden Imagery

Page 14: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

14

NPR: Important lines

ridges & valleys Rusinkiewicz et al. SIGGRAPH course notes 2008

Page 15: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

15

Silhouettes

Page 16: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

16

Lines

Page 17: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

17

Lines

Page 18: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

18

Lines+Shading

Page 19: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

19

Dithering/Halftoning

• Halftoning:

• process to represent continuous tone in binary media -print or display.

• Necessary loss of information due to limited resolution

• Approximate tone by using the human visual system

Page 20: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

20

Stippling and Cross-hatching

• Stippling:use a series of properly scaled and spaced spots.

• Crosshatching consists in crossing a series of lines of various lengths, widths and at various angles with which the artist constructs areas of tone and texture.

Page 21: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

21

Shape Understanding

• Gestalt (shape, value, space)

• NPR (shape, value, space)

• Geometry and Projection (shape, space)

Page 22: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

22

Geometry and projection (maya)

Page 23: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

23

Perceptual Bias (low level)

[Wolfe, Maloney & Tam, Distortions of perceived length in the frontoparallel plane: tests of perspective theories, Perception & pyschophysics, 2005]

Page 24: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

24

Perceptual Bias (low level)

[Wolfe, Maloney & Tam, Distortions of perceived length in the frontoparallel plane: tests of perspective theories, Perception & pyschophysics, 2005]

Page 25: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

25

Perceptual bias (high level)

Page 26: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

26

Perceptual bias (high level)

Page 27: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

27

Perceptual bias (high level)

[Taylor & Mitchell, Judgements of apparent shape contaminated by knowledge of reality: viewing circles obliquely, British Jnl. of Psych., 1997]

Page 28: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

28

Sketching Dogma

Page 29: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

29

Experts!

[Schmidt, Khan, Kurtenbach, Singh, On expert performance in 3D curve drawing tasks. SBIM 2009] http://www.dgp.toronto.edu/~rms/data/CurveDrawing

Page 30: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

30

Expert Drawing I: Circle-on-Plane

Page 31: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

31

Expert Drawing I: Circle-on-Plane

Page 32: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

32

Expert Drawing II: Line-on-Cylinder

Page 33: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

33

Expert Drawing II: Line-on-Cylinder

Page 34: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

34

Expert Drawing III: Silhouette Curves

Page 35: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

35

Expert Drawing III: Silhouette Curves

Page 36: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

36

Expert Drawing IV: Curve-on-Surface

Page 37: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

37

Page 38: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

38

Page 39: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

39

Implications for 3D Sketching

• Artists and Designers can’t draw either!

• Averaging Oversketches [Baudel, Bae et al 08,09, …]

• Reduces mechanical error • Converges on biased position

• Viewpoint selection • no free lunch, 45° largest bias

• Drawing on surfaces is just as hard

Humans have an audio IN and OUT, a biased video IN but no explicit video OUT!

^

Page 40: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

40

Experts and drawing systems

Page 41: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

41

Analytic Drawing

1. Pick a drawing system

• 2-point perspective, isometric,…

• Rules for how to interpret lines

2. Construct a 3D scaffold

3. Draw curves within the scaffold

Page 42: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

42

rendering

inference

x1.2

Modeling Perceptual Bias

Page 43: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

Bayesian Ideal Observer Theory

• P(scene | image) ~ P(image | scene) P(scene)

• Perceptual systems evolve to fit “natural” distributions

• Collect natural distributions

• Predict biases

Page 44: Karan Singh, Ryan Schmidtkaran/courses/csc2521/fall_2011/stroke_p... · Karan Singh, Ryan Schmidt . 2 Warning lights . 3 ... • Averaging Oversketches [Baudel, Bae et al 08,09, …]

Take-aways

• Mechanical Error / Error of Intent

• Error of intent caused by perceptual bias (?)

• Multiple layers of perceptual bias

• Solutions will affect inference and rendering!