CSE5390 & 7390 - SMUlyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/slides/01_HCI.… · Special Topics in Ubiquitous and Cognitive Computing CSE5390 & 7390 Eric C. Larson, Lyle

Special Topics in Ubiquitous and Cognitive ComputingCSE5390 & 7390

Eric C. Larson, Lyle School of Engineering, Computer Science and Engineering, Southern Methodist University 1

lecture one, introduction & history of computing

class logistics

• Office Hours: W 12:30-1:30 and by appt / walk-in

• Course Website and Class Syllabus:

• http://lyle.smu.edu/~eclarson/ubicomp.html

• We will use canvas for turning in assignments and discussion forums!

• email me the assignment if canvas goes down. same goes for posting to the discussion forum!

2

agenda• introductions

• what is ubicomp?

• syllabus and what is this course?

• how to do well

• goals and questions

• The History of Computing

3

introductions• about you:

• name

• interest, research area, or specialization

• something unique about you

• could be true or false

• and the class will guess

4

introductions• education

• undergrad and masters from Oklahoma State • PhD from the university of Washington, Seattle

• research • signal, image, and video processing

• how can combining DSP, machine learning, and sensing make seamless computing?

• natural gestures • novel interaction techniques and user interface

technology • health

• moving outside the clinic: how mobile sensing can help patients and doctors

• sustainability • how technology can increase awareness

5

http://eclarson.com

UbiComp

6

• easy to love... hard to explain, …but we will try...

• look at “a day made of glass” (not all UbiComp):

• http://www.youtube.com/watch?v=6Cf7IL_eZ38

• previous conferences:

• www.ubicomp.org

• www.pervasive.org

course syllabus• Let’s head over to the class website

7

first assignment

8

Discussion Board Intro and Discussion Leading Preferences Introduce yourself on the message board and include the following information •research interests (and/or areas of specialization) •what you want to get out of this class •your experience with software and hardware •anything else you would like to share! •topic preferences for leading discussions*

* Indicate which topic/day you would be interested in leading the discussion (select at least three). Discussion leads will present a brief overview of the papers and kick start the discussion with questions to the class.

how to do well• read the papers on the schedule

• post questions on time (BEFORE 9AM!!)

• participate in the discussion! ask open ended questions!

• lead discussion creatively, don’t summarize

• use visuals and your own experiences, storytelling

• start papers/projects well in advance

• take video creation seriously

• collaborate, collaborate, collaborate

9

course goals• an exposure to the vision and history of UbiComp and the role of

cognitive computing

• rapid prototyping skills, both programming and hobbyist

• communicate complicated or ill formed ideas fluidly

• see different applications (and research) through a ubiquitous lens:

• assistive computing, mobile health, sustainability, interaction techniques, wearable technology

• get out of your comfort zone!

10

a history of computing

11

history of computing: agenda

• history of UbiComp (a history of HCI)

• catalog a series of HCI paradigm shifts

• review the key players in UbiComp’s history

12

paradigms in interaction• paradigm: predominant theoretical frameworks or scientific

world views

• for example: european paradigm shifts: migration, renaissance, enlightenment, colonialism, etc.

• history of computer interaction is divided similarly with paradigm shifts

13

paradigms in interaction• most simply,

time

prod

uctiv

ity

14

paradigm: batch processing• computer had single, sequential tasks

• many humans to one computer

• no true “interaction” after task was started

• punch cards, tape used to input serial operations

15

innovator: Vannevar Bush• as we may think (1945)

• human knowledge has exceeded our ability to make real use of the records...

16

innovator: Vannevar Bush• memex

• stores all human knowledge

• retrieved by hyperlink

• microfilm... not computer

• interactive, nonlinear

http://web.mit.edu/STS.035/www/PDFs/think.pdf

17

innovator: J.C.R. Licklider• 1960s, man-computer symbiosis

• “to enable men and computers to cooperate in making decisions and controlling complex situations without inflexible dependence on predetermined programs.”

http://www.youtube.com/watch?v=IMpfmDEC5JQ

18

innovator: Ivan Sutherland• 1963 PhD Thesis: SketchPad

• light pen input on screen

• copy / paste

• lines and circle drawings

• perspective and 3D understanding

• icons, pictures, sub-pictures

http://www.youtube.com/watch?v=USyoT_Ha_bA

19

paradigm: graphical displays

• sutherland’s demo is landmark for graphical displays

• in short: an oscilloscope and camera on a pen

• gave rise to real time computing, beginning of the end for batch

• inspired Douglas Engelbart...

20

innovator: Douglas Engelbart• the mother of all demos (December 9, 1968)

• multimedia, high resolution display, windows, shared files, messaging, teleconferencing, hierarchical hypertext, word processing, revision control, collaborative editing...

• the mouse

21

http://www.youtube.com/watch?v=yJDv-zdhzMY

innovator: Alan Kay (1972)

• the Dynabook, notebook computer with multimedia

• coined the term, object-oriented programming

• metaphor: desktop, overlapping window

22

paradigm: personal computing• power comes through ease of use

• small, dedicated machine used by one person

• personal computers

• 1974 IBM 5100

• 1981 Databaster

• 1981 IBM X-tended Technology (XT), actually sold!

23

paradigm: WIMP and GUI

•Windows, Icons, Menus, Pointers

•Graphical User Interfaces

•from time sharing to multi-tasking

•parallel tasks

•more familiar GUI

24

Xerox Star 1981

• first “business professional PC”

• used “desktop,” pointers, WYSIWYG, consistent, simple

• based upon usability engineering

• paper prototypes

• usability studies

• iterative design

25

Xerox Star 1981

• total flop

• $16,000

• slow

• lacked spreadsheet

• only XEROX programs

• other text entry PC’s: $2000

26

Apple Lisa 1982

• copied star

• more personal, rather than business

• $$$, failed

27

innovator: Ben Shneidermen

• direct manipulation

• object visibility

• incremental action (animation)

• reversibility

• replace text with action

• WYSIWYG

• exploration / undo

28

paradigm: metaphor• use of computing is problem solving and learning

• relate computing to real world tasks

• skeuomorphism design

• file managed on desktop

• financial analysis via spreadsheet

• recycle bin/clipboard/folder

• literalism vs. magic

29

Apple Mac 1984

• $2500, aggressive price

• good interfaces, used metaphors

• 3rd party applications

• high quality graphics and laser printer

30

paradigm: hypertext

• coined by Ted Nelson

• information is interconnected nodes

• non-linear browsing structure

• WWW 1993

31

where are we now?

time

prod

uctiv

ity

32

as w

e m

ay th

inkm

an-h

uman

sym

bios

is

ivan

suth

erlan

d

MoA

Dpe

rson

alm

etap

hor

hype

rtext

inter

net

paradigm: multi-modal input

• beyond keyboard/mouse/trackpad

• mode is a human communication

• not just human senses, e.g., speech vs non-speech audio

• emphasize simultaneous use of input channels

• rampant use in video games

• where else do we see multimodal input?

• gives rise to ...

33

paradigm: speech and agents• interface is the mediator for processes, an agent

• language paradigm

• how much should it understand?

• vocabulary, domains, just numbers?

• how human are we prepared for it to be?

• HAL, clippy, Siri, Cortana, etc.

34

innovator: Mark Weiser

• “calm technology”

• everywhere, receding into the background

• CTO of Xerox PARC

• father of UbiComp

35

paradigm: ubiquitous computing• many devices serving in a computationally rich environment

• cannot neglect the social aspects computing enforces

• desktops, laptops, PDAs, mobile phones

36

what’s next?

time

prod

uctiv

ity

37

as w

e m

ay th

inkm

an-h

uman

sym

bios

is

ivan

suth

erlan

d

MoA

Dpe

rson

alm

etap

hor

hype

rtext

inter

net ubicomp?

mobile computing?

CSCW?

Cognitive?Collective?

the next paradigm shift?ubiquitous computing

mobile computing

38

cognitive computing

For next class...• look at the course website and canvas

• there is an assignment already!

• pick your preferred discussions, choose at least three!

• try to do the questions for discussion next class

• next class: Weiser’s vision

• remember that these papers were written over twenty years ago... look up an event that happened the same year to get a better perspective of the timeframe

39

Special Topics in Ubiquitous and Cognitive ComputingCSE5390 & 7390

Eric C. Larson, Lyle School of Engineering, Computer Science and Engineering, Southern Methodist University 40

lecture one, introduction & history of computing