Top Banner
A Sketch-Based Interface for A Sketch-Based Interface for Collaborative Design Collaborative Design Zhe Fan Zhe Fan 1 Manuel M. Oliveira Manuel M. Oliveira 2 Chi Ma Chi Ma 1 Arie Kaufman Arie Kaufman 1 1 Stony Brook University Stony Brook University 2 UFRGS UFRGS
52

A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Dec 21, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

A Sketch-Based Interface for A Sketch-Based Interface for Collaborative DesignCollaborative Design

Zhe FanZhe Fan11 Manuel M. Oliveira Manuel M. Oliveira22 Chi Ma Chi Ma11 Arie Kaufman Arie Kaufman11

11Stony Brook UniversityStony Brook University 22UFRGSUFRGS

Page 2: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

• Often used in conceptual designOften used in conceptual design

• Powerful tool for communicating ideasPowerful tool for communicating ideas

• System prototype elementSystem prototype element

– Modeling primitivesModeling primitives

– User-defined objectsUser-defined objects

IntroductionIntroduction

Page 3: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

ExamplesExamples

Collaboration by two usersCollaboration by two users

A new user’s soloA new user’s solo

Page 4: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

• Logically organized in six modulesLogically organized in six modules

System InterfaceSystem Interface

Image Manager

3D Manager

2D Manager

Floor Manager

Interface

Library Manager

Viewer Manager

Page 5: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

• Top view – floor profileTop view – floor profile

• Perspective view – exploration in 3DPerspective view – exploration in 3D

Floor and Viewer ManagersFloor and Viewer Managers

Top view of the scene Perspective view

Page 6: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

2D Manager2D Manager

• Projecting 2D strokes to 3DProjecting 2D strokes to 3D

Page 7: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

• Sketching on 3D surfacesSketching on 3D surfaces

2D Manager (cont.)2D Manager (cont.)

Page 8: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Conventional Rendering Sketch-like Rendering

• Provides 3D primitivesProvides 3D primitives

• NPR rendering for sketch-like appearanceNPR rendering for sketch-like appearance

• Imports 3D polygonal meshesImports 3D polygonal meshes

3D Manager3D Manager

Page 9: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

• Animated billboardsAnimated billboards

• Textures, background images, imposterTextures, background images, imposter

Image ManagerImage Manager

Background and textures Imposter: building far away

Page 10: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Video 1: Single UserVideo 1: Single User

Page 11: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Video 2: CollaborationVideo 2: Collaboration

Page 12: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Video 3: Explore the Town SceneVideo 3: Explore the Town Scene

Page 13: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Result 1: Baseball fieldResult 1: Baseball field

• A new userA new user

• 5 minutes tutorial5 minutes tutorial

• 50 minutes design50 minutes design

• TexturesTextures

Page 14: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Result 2: FarmResult 2: Farm

• Experienced userExperienced user

• 4 minutes design4 minutes design

Page 15: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

• 2 collaborators 2 collaborators

• Approximately 4 hoursApproximately 4 hours

• Most time spent on creating Most time spent on creating textures and planning the textures and planning the design design

Result 3: TownResult 3: Town

Page 16: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Other ResultsOther Results

Page 17: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Bruce Gooch Bruce Gooch University of UtahUniversity of Utah

Greg Coombe Greg Coombe University of North Carolina University of North Carolina at Chapel Hill at Chapel Hill

Peter Shireley Peter Shireley University of UtahUniversity of Utah

Artistic Vision: Painterly Rendering Using Artistic Vision: Painterly Rendering Using Computer Vision TechniquesComputer Vision Techniques

Page 18: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

ExampleExample

Page 19: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

AlgorithmAlgorithm

• Segmentation and Smoothing

• Ridge Set Extraction

• Ridge Set Tokenizing and Grouping

• Rendering Images

Page 20: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

AlgorithmAlgorithm• Segmentation and Smoothing

• Ridge Set Extraction

Page 21: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

AlgorithmAlgorithm• Ridge Set Tokenizing and Grouping

• Rendering Images

• Moment tokens

• Line Lists

Page 22: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

User-directed EnhancementUser-directed Enhancement

Page 23: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Segmentation LevelsSegmentation Levels• Level 12, 48, 72, 150

Page 24: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Brush Artifact LevelBrush Artifact Level

10 percent 40 percent

70 percent 100 percent

Page 25: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

ResultsResults

Page 26: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Curve AnalogiesCurve Analogies

Aaron HertzmannAaron Hertzmann11 Nuria Oliver Nuria Oliver 22

Brain CurlessBrain Curless11 Steven M. Seitz Steven M. Seitz11

1 1 University of WashingtonUniversity of Washington2 2 Microsoft ResearchMicrosoft Research

Page 27: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

PolylinePolyline• Represent each curve as a polyline

• Interpolation

Page 28: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

AlgorithmAlgorithm• The general problem statement

• Curve synthesis with constraints

• Randomly generating a B’ curve in the style of an A’ curve.

• Synthesize a shape according to some constraints.

• Curve Analogies

BBAA ::::

Page 29: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

ResultsResults

Page 30: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

ResultsResults

Page 31: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

A Suggestive Interface for 3D DrawingA Suggestive Interface for 3D Drawing

Takeo IgarashiTakeo Igarashi John F. HughesJohn F. Hughes

Computer Science DepartmentComputer Science DepartmentBrown UniversityBrown University

Page 32: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

User InterfaceUser Interface• Drag and Selection

Page 33: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

User InterfaceUser Interface• The prediction mechanism

Page 34: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

User InterfaceUser Interface• Cutting

Page 35: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Suggestions Suggestions (1)(1)

Page 36: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Suggestions Suggestions (2)(2)

Page 37: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

ResultsResults

Page 38: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Surface DrawingSurface Drawing

Steven SchkolneSteven Schkolne Peter SchroderPeter Schroder

Caltech Department of Computer ScienceCaltech Department of Computer ScienceTechnical Report CS-TR-99-03Technical Report CS-TR-99-03

:

Page 39: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Surface DrawingSurface Drawing

Page 40: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

Surface ConstructionSurface Construction

Page 41: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

InterfaceInterface

Page 42: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 43: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 44: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 45: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 46: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 47: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 48: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 49: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 50: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 51: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery

Page 52: A Sketch-Based Interface for Collaborative Design Zhe Fan 1 Manuel M. Oliveira 2 Chi Ma 1 Arie Kaufman 1 1 Stony Brook University 2 UFRGS 1 Stony Brook.

GalleryGallery