Raskar UIST Keynote 2015 November

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Innovating for Billions

Ramesh RaskarAssociate Professor

MIT Media Lab

Slit Lamp for Cataracts

4

Slit Lamp Exam Retinal Scan

Retinal Scan

Phoropter

Next 5 Billion

Emerging InterfacesEmerging Worlds

Pamplona, Mohan, Oliveira, Raskar SIGGRAPH 2010

eyeNETRA: Glasses and Cataract

Shack-Hartmann WS

Wavefront aberrometer

Refraction Map using Wavefront Sensor

300+ DPI LCDs

Shack-Hartmann Wavefront Sensor

Lase

r

Sensor

10

Microlens Array

Planar Wavefront

Shack & Platt 1971Liang et al 1994

David Williams et al, Rochester

Spot Diagram

Lase

r

Sensor

Displacement = Local Slope

of the Wavefront

Spot Diagram

Shack-Hartmann Wavefront SensorShack & Platt 1971

Liang et al 1994David Williams et al, Rochester

NETRA = Inverse of Shack-Hartmann

12

Spot Diagram on LCD

Cell Phone Displa

y

Eye Piece

Shack-Hartmann ~ Augmented LightfieldsOh, Raskar, Barbastathis 2009: Augmented Light Field

NETRA = Inverse of Shack-Hartmann

13

Eye Piece

Shack-Hartmann ~ Augmented LightfieldsOh, Raskar, Barbastathis 2009: Augmented Light Field

Spot Diagramon LCD

CellPhone LCD

14

Spot Diagramon LCD

NETRA = Inverse of Shack-Hartmann wavefront sensor

User interactively creates the Spot Diagram

1. Displace 25 spots with smart UI

CellPhone LCD

EyePiece

2. Displace spots till single dot

perceived

15

Spot Diagramon LCD

NETRA = Inverse of Shack-Hartmann wavefront sensorUser interactively creates the Spot Diagram

1. Displace 25 spots with smart UI

CellPhone LCD

EyePiece

2. Displace spots till single dot

perceived

16

Spot Diagramon LCD

NETRA = Inverse of Shack-Hartmann wavefront sensorUser interactively creates the Spot Diagram

1. Displace 25 spots with smart UI

CellPhone LCD

EyePiece

2. Displace spots till single dot

perceived

17

Kenya

Thermometer for Eye

India

Brazil

EyeSelfie, Swedish et al SIGGRAPH 2015

MIT Media Lab

Next 5 Billion

Rethinking Engineering Design Execution

LVPEI@ Hyderabad

Doctor Instrument Patient

IA > AIIntelligence

AmplificationArtificialIntelligence

Health and Wellness Interfaces

Saving Lives

Markets Partners

Kadambi, Gupta et al

F. Huang, G. Wetzstein, B. Barsky, R. Raskar, Siggraph 2014

Pre-corrected

Images on

Lightfield Display Siggraph 2012

Siggraph 2014

Read a book without opening pages using THz

Read a book without opening pages using THz

Sanchez, Heshmat, Reza, Romberg, Raskar 2015

Zensei: Bio ImpendanceCasual Indentification

Sato, Puri, Ivan

?

Receiver/Transmitte

r

TX

RX1

RX2

RX3

RX4

Chervat, McCullum, Feignin, Raskar 2015, NATURE SciRep 2015

See Through Walls, NATURE SciRep 2015

Demo: Rflow, Bedri et al

FLIM

Satat et al. Nature Comm 2015Bhandari et al. 2015

Pratik Shah, Hyunsung Park

Hospitals Schools

Food Transactions

Here There Together

Kumbh Mela: 30M Visitors 30 Days

Health

Food Transport

Housing Payments

Civic

Next: Jan 24-30, 2016

Crowds from Cell Tower Data

DataThings

Citizens

Emerging Worlds

Ram

esh

Raskar

Ale

x (

San

dy)

Pen

tlan

d

Ken

t L

ars

on

Eth

an

Zu

ckerm

an

Iyad

Rah

wan

Cesar

Hid

alg

o

uist@

Emerging InterfacesEmerging Worlds

Publish Demo Deploy

Pencil + Cassettes

Photo of women and weighing scale

Entrepreneur

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Innovating for Billions

IA > AI

END

neXt

• What will a camera/display look like in 20 years?

• How will the next billion cameras change the social culture?

• How can we augment the camera to support best ‘image search’?

• How will portable health diagnostics impact healthcare?

• Will we live mostly in virtual/augmented reality, telepresent?– TiVo for life?

• How will ultra-high-speed/resolution imaging change us?

• How can we improve ‘trust’ in imaging?

• Can we print anything .. Cars, food, .. babies .. – (what will make Amazon obsolete)

• What are the opportunities in pervasive recording?– e.g. GoogleEarth Live

• What will be in Photoshop2030?

• What is the future of movie-making, news reporting, sports viewing?

Camera in 20 years

Photoshop 2032

Pervasive Recording

Movies and News

Trust and Social Stability

Health Diagnostics

Augmented Reality

3D Displays

Print Anything

Saving Lives

Markets Partners

DOPS, DAPS and DIPS

Digital Opportunities for Physical SystemsDigital Applications for Physical Systems

Digital Interfaces for Physical Systems

Jesse Schell

Comfort

Excitement

Solo

Multi-year

Team

Swift

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Ramesh RaskarAsso. ProfessorMIT Media Lab

What isSiggraph NEXT

Geometry Rendering Animation

CAD

Imaging

Movies Games Photography

???

G R A I

Games/Movies

MLSPOpticsAudioGraph Cuts…

G R A I

Games/Movies

'Does this work contribute TO Siggraph techniques’

MLSPOpticsAudioGraph Cuts…

G R A I

Games/Movies

?

'Does this work contribute Siggraph techniques TO ..’

NewFabrication, VR, Displays, Cameras, Perception, …

EmergingHealth, Drones, Transport, Materials, Food, Energy, …

NEXT Speakers’ key challenges + visual computing can solve