i3 - Recent iServer, iPaper and iGesture Developments

Post on 07-Nov-2014

1371 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

Presentation given at OMS Seminar, Zurich, Switzerland, December 2007

Transcript

5 December 2007

i3 – Recent iServer, iPaper and iGesture Developments

Beat Signer

http://www.beatsigner.com

Institute for Information Systems

ETH Zurich

CH-8092 Zurich, Switzerland

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 2

iServer Extensions and Modifications

RSL (resource-selector-link) model is the new

name for the underlying iServer model

Context Resolver

Layers

Structural Links

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 3

3

RSL Context Resolver

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 4

4

RSL Layers

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 5

5

RSL Structural Links

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 6

RSL Structural Links …

Structure over data

structural relationship of different resources

e.g. regular document (chapters, sections, ...)

possible to reuse the same resource in different

structures transclusion (Ted Nelson)

context-dependant structures based on context

resolver concept

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 7

RSL Structural Links …

Structure over structures

reuse of complete substructures

structural composition of data and substructures can

be combined

Structure over links

put different navigational links in relation to each other

e.g. single structural link to define linear order over

set of links trails and tours

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 8

8

Links

Users

Layers Plug-ins

Structure

Active

Content

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

RSL Metamodel

Beat Signer and Moira C. Norrie, As We May Link:

A General Metamodel for Hypermedia Systems,

In Proceedings of ER 2007, 26th International Conference on

Conceptual Modeling, Auckland, New Zealand, November 2007

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 10

10

Digital Link Authoring Tool

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 11

Digital Link Authoring Tool …

Extension of iServer authoring tool, Adriana

Integration of earlier student projects (e.g. active

component authoring tool)

Focus on the iPaper authoring plug-in but later

other plug-ins may be integrated

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 12

iPaper Templates

Links that occur on multiple pages (e.g. controls,

headers, footers) should not have to be repeated

Templates can be defined on document or

individual page level

Multiple templates can be combined (page and

document level)

PaperPoint currently uses a single template to

define the functionality available on all slides

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

iServer / iPaper Infrastructure

Resource plug-in management

Application management

Pattern space management, Monica Frisoni

I/O pen connector (Bluetooth), Claudio Hatz

...

13

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 14

PaperPoint v0.5

New design / functionality

colours, pointer types, …

Single step printing

process

User studies, Elke

interviews

lab sessions

long term usage

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

PaperPoint v0.5

Beat Signer and Moira C. Norrie, PaperPoint: A Paper-Based

Presentation and Interactive Paper Prototyping Tool, In

Proceedings of TEI 2007, First International Conference on

Tangible and Embedded Interaction, Baton Rouge, USA,

February 2007

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 16

Interactive Table (iTable)

Pen-Based Google Earth Browser Pen-Based Drawing Tool

Photo Browser Photo Browser (Slider)

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Interactive Table (iTable) …

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 18

Interactive Table (iTable) …

Extension of iTable interface, Matthias Geel

calibration of beamer and input area

general desktop control active components

Applications

Pen-based Google Earth Explorer

Pen-based Drawing Tool

Photo Browser

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 19

19

19

Rough Guide

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Query by Sketching (QbS)

Pen-based sketching

interface

University of Basel

GlobIS group

Michael Springmann, Adriana Ispas, Heiko Schuldt, Moira

C. Norrie and Beat Signer, Towards Query by Sketch,

Second DELOS Conference on Digital Libraries, Pisa, Italy,

December 2007

Start date: October 2007 (2 year project), Adriana

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

PaperWeb

Automatic authoring of

active areas

all hyperlinks become

interactive on the

printout version

21

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Remote Sketching on Paper

Integration of Skype and

paper-based remote

sketching, Hermann

Hofstetter

HCI group University of

Konstanz, H. Reiterer

GlobIS group

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Powerwall, Konstanz

Facts

5.20 m x 2.5 m

8 beamers

4640 x 1920 pixels

soft-edge-blending

Visualisation of large data sets

Input devices

3D tracker, laser "pen", mouse

iPaper as a new input device?

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 24

Wellness Game Project, Shanghai

Science, Technology &

Culture Festival, May 2008

Projects

Thai Chi, Native Systems Group,

Dennis Majoe

China Gates, Native Systems

Group, Art Clay

Real Time Panorama, Native

Systems Group, Jürg Gutknecht

iPaper Project, GlobIS Group,

Moira C. Norrie

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 25

Multi Digital, LZ Medien

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 26

26

26

PaperProof

Planned user studies,

Nadir & Elke

Definition of new gestures

for edit commands?

Nadir Weibel, Adriana Ispas, Beat Signer and Moira C. Norrie,

PaperProof: A Paper-Digital Proof-Editing System,

Proceedings of CHI 2008, 26th International Conference on

Human Factors in Computing Systems (Interactivity Track),

Florence, Italy, April 2008

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 27

iGesture Framework

http://www.igesture.org

Open Source (Apache 2.0)

initial release February 2007

1682 downloads

Presented at ICDAR 2007

FKI Group, University of Berne

DFKI, Germany

Computer Vision Center,

Barcelona

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

iGesture Framework …

New input handler for graphics tablets and

Tablet PCs, Michele Croci

Beat Signer, Ueli Kurmann and Moira C. Norrie, iGesture:

A General Gesture Recognition Framework, Proceedings of

ICDAR 2007, 9th International Conference on Document

Analysis and Recognition, Curitiba, Brazil, September 2007

Beat Signer, Moira C. Norrie and Ueli Kurmann, iGesture:

A Java Framework for the Development and Deployment of

Stroke-Based Online Gesture Recognition Algorithms,

Technical Report ETH Zurich, TR561, September 2007

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Geco (Gesture Control)

Mapping of gestures

(iGesture gesture sets),

Michele Croci

hotkeys

command line calls

Initial release (freeware)

planned within next month

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

Department Events

Maturandentage 2008

January 8/9

PaperProof and PaperPoint

Jahr der Informatik

visit different locations

PaperPoint as presentation tool?

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch 36

iServer

layer

|Layers|

layer

Active

Layers

resource

Containers

activeComponent

Active Com-

ponents

medium

Media

medium

Movies

medium

Images

medium

Webpages

OnLayer

Contains

(1,1)

(1,1) (0,*) (0,*)

document

Documents (0,*)

shape

Shapes

partition (2,*)

(0,*)

rectangle

Rectangles

ellipse

Ellipses

polygon

Polygons

circle

Circles

complexShape

Complex

Shapes

HasShapes

page

Pages OnPage

Contains

Pages

(0,*)

(1,1)

(1,1)

(0,*)

Resources

parameter

Preferences

link

Links

user

Users

group

Groups

individual

Individuals

HasMembers

HasTarget

(0,*)

(0,*) (0,*)

(0,*)

(0,*)

(0,*) (0,*)

(1,*)

(0,*)

(0,*)

(1,1)

(0,*)

partition partition

(1,*)

CreatedBy

RefersTo

Has

Preferences

parameter

Properties

selector

Selectors

resource

Resources

HasSource

(0,*)

AccessibleTo

InaccessibleTo

(0,*)

(0,*)

entity

Entities HasProperties

Users

Plug-ins

Links

(0,*)

Layers

iPAPER

iSERVER

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

5 December 2007 Beat Signer / Institute for Information Systems / signer@inf.ethz.ch

top related