HCI, Art & Creativity

HCI, Art & CreativityCeline Latulipe, University of North Carolina at Charlotte

About Me

Undergrad Degree inEconomics

Worked as technical writerin the 1990s

Masters and PhD inComputer Science from theUniversity of Waterloo

Prologue

Dissertation Work: Design andimplementation of novelbimanual interaction techniques

Layered SurveillanceArt Installation with Annabel Manning, Presented at CHI 2010Tech: pairs of trackballs control opacity, blurriness, brightness and sound level

Interactive LensesArt Installation with Annabel Manning Presented at British HCI, 2008Tech: wireless gyroscopic mice in pairs control size and position of surveillance lenses

The Dance.Draw ProjectFunded by the NSF CreativeIT program, 2009-2013

Practice-BasedResearch

Project goals would be realizedthrough the process of makinginteractive dance with artisticvisualizations

Research Goals

Support and measureaudience engagement

Realtime tracking ofdancers’ activity

Support and measurecollaborative creativity

1.

2.

3.

AudienceSensingUnderstanding how choreographers anddirectors make sense of audience responsedata

AudienceSensingUnderstanding the relationshipbetween implicit physiologicalaudience response and explicitaudience engagement

Love, hate, arousal and engagement: Exploring the measurement and use of audienceengagement data in the performing arts. Latulipe, Carroll & Lottridge. In ACM CHI 2011.

Dance asPhysicalSensingLaboratory

Goal: inexpensive, portable, non-cumbersome sensing

If you can sense dancers robustlyyour can sense anyone, anywhere

Exquisite Interaction Choreographed by Sybil Huskey, performed in 2007 and 2008Tech: wireless gyroscopic mice carried by dancers

SoundPainter DanceChoreographed by Sybil Huskey and Melissa WordPerformed at ACM Creativity & Cognition in 2012Tech: overhead camera tracking, microphone, audience GSR system

Heavy RecursionChoreographed by Melissa WordPerformed in 2011Tech: overhead camera tracking, microphone

Dance.DrawPerformanceLessons

Spatial tracking more obviousthan activity tracking

Abstraction is moreinteresting

Some portion of the audiencewill be trying to ‘figure out’tech, and most enjoy that

Celine Latulipe, Erin Carroll, and Danielle Lottridge. Evaluatinglongitudinal projects combining technology with temporal arts. InACM CHI 2011.Berto Gonzalez, Erin Carroll, and Celine Latulipe. 2012. Dance-inspired technology, technology-inspired dance. In NordiCHI2012.

✤

✤

✤

The Choreographer’s NotebookThe Choreographers Notebook: A video annotation system for dancers andchoreographers. Singh, Latulipe, Carroll & Lottridge. In ACM Creativity & Cognition, 2011.NSF I-Corps Project 2013

Video Collaboratory

Exploring Multi-VideoInteractionExploring the Design Space of Multiple Video Interaction. Jinyue Xia, Vikash Singh, DavidWilson and Celine Latulipe. NordiCHI 2014.

Creativity Support Index (CSI)A standardized survey for measuring how well digital tools support creative endeavors

Quantifying the Creativity Support of Digital Tools Through the Creativity Support Index. Cherry & Latulipe. In ACM TOCHI 2014.

Creativity Factor Evaluation: Towards A Standardized Survey Metric For Creativity Support.Carroll, Latulipe, Fung & Terry. In ACM C & C 2009.

Dance.DrawCollaborationLessons

Asynchronouscommunication fit into dailyroutine easily, but work-lifebalance changed

Dancers get more feedback

Quality of dancing improved

Latulipe, Wilson, Huskey, Gonzalez and Word.TemporalIntegration of Interactive Technology in Dance: CreativeProcess Impacts.In ACM Creativity & Cognition 2011.

Latulipe, Carroll, and Lottridge. Evaluating longitudinal projectscombining technology with temporal arts. In ACM CHI 2011.

Carroll, Lottridge, Latulipe, Singh, and Word.Bodies in critique: atechnological intervention in the dance production process. InACM CSCW 2012.

✤

✤

✤

Future Research Direction

Exploring links between interface/interactional complexity and creativity support

Future Research DirectionTeaching programming and computer science through art and designUsing HCI methods to investigate and innovate with technology to support team learning

Latulipe, Long & Seminario. Structuring Flipped Classes with Lightweight Teams and Gamification. To appear in SIGCSE 2015.

Maher, Latulipe, Lipford & Rorrer. Flipped Classroom Strategies for CS Education. To appear in SIGCSE 2015.

Dave Wilson

Berto Gonzalez,Erin Carroll,Vikash Singh

Sybil Huskey

Melissa Word

DanielleLottridge

NathanNifong

[email protected] Supported by NSF CreativeIT #0855882

Elizabeth Riddell

AGA Collaborative

Photo CreditsRob Singh-Latulipe -- Dance.Draw photosJeff Cravotta -- Dance.Draw photos