Art and Technology

Art and TechnologyMaria C. R. Harrington, Ph.D. Art: http://mariacrharrington.com/ | Science: http://mariacrharrington.org/ | Tech: http://www.virtualfieldtrips.com/ CandidateAssistant Professor of Digital Media School of Visual Arts & DesignUniversity of Central Florida

Maria C. R. Harrington, Ph.D. | Candidate Assistant Professor of Digital Media | School of Visual Arts & Design | University of Central Florida | 3/23/2006

http://mariacrharrington.com/

http://mariacrharrington.com/

http://mariacrharrington.org/

http://mariacrharrington.org/

http://www.virtualfieldtrips.com/


Art and TechnologyResearch & Scholarship Intersection of Art and TechnologyFuture Research and Teaching Q&A


Research & Scholarship


Educational Background I graduated from Carnegie Mellon University in 1988 with

degrees in Economics and Art Ph.D. in Information Science in 2008, from the University of

Pittsburgh My dissertation was on virtual reality, simulations, and

human-computer interaction for learning and creating I am founder and CEO of Virtual Field Trips, LLC, a company

bringing educational simulations, virtual reality, to market, and works of art exploring emotions in virtual reality.



The Virtual Trillium Trail, 2010


https://www.youtube.com/watch?v=CMIhdzsOlTk



Findings Technical and Research Design Matters

Virtual Trillium Trail as Data Generated Virtual Ecologies for Virtual Learning Environments and as a Planned Orthogonal Contrast Statistical Framework (POC 2x2 ANOVA)

Reality Matters: Comparison of Real and Virtual Learning Environments: Ethnographic and empirical evidence prove the transfer of

knowledge from Real to Virtual and Virtual to Real, thus demonstrating how to use virtual environments for priming, transfer, and reinforcement for maximum learning gain.

Gender Differences in Information Seeking and Learning Behavior of Young Children in Virtual Learning Environments


VR Photorealistic


The Virtual Trillium Trail, 2007


Control with the Real


VR can be used for learning Visual Fidelity and Navigational Freedom and as Design

Factors: There is significant interaction, F(1,60) = 4.85, p = 0.0315),

between Visual Fidelity and Navigational Freedom on Knowledge Gained, so both factors must be in the design for such results

Visual Fidelity is strong and significant F(1,60) = 10.54, p = 0.0019)

Navigational Freedom shows a trend, F(1.60) = 2.71, p = 0.105). The combined conditions of both High Visual Fidelity and High

Navigational Freedom result in far superior Knowledge Gained on tests, (cell mean = 37.44, SD = 13.88) when compared to the Low Visual Fidelity x Low Navigational Freedom conditions (cell mean = 20.93, SD = 13.36)


High Fidelity High Navigation Low Fidelity Low Navigation0

5

10

15

20

25

30

35

40

37.44

20.93

Mean Knowledge Gained (n = 64)


What this means… I proved

“Virtual Reality doubles learning outcome.” ~ Maria C. R. Harrington, Ph.D.


VR impacts exploration and inquiry There is no interaction, F(1,60) = 1.48, p = 0.2285), between Visual

Fidelity and Navigational Freedom, on Salient Events. Salient Events measure the number of times student behavior changes

from exploration to deep inquiry. Visual Fidelity is strong and significant, F(1,60) = 4.35, p = 0.00413). It

alone, is responsible for significantly increasing learning activity. Navigational Freedom, as a factor, shows a strong trend, F(1,60) = 3.23,

p = 0.0773. The data show that the High Visual Fidelity condition (Row Mean = 14.46, SD = 6) resulted in more Salient Event counts than did the Low Visual Fidelity condition (Row Mean=11.31, SD = 6.37).

The more a virtual reality environment, simulation, or serious game looks high fidelity and photo-realistic, the more times a child’s behavior will change from exploration to inquiry. Thus, Visual Fidelity increases a child’s desire to learn, to understand, and to stop in order to independently and actively inquire.


What this means…I proved

“Visual Fidelity in VR increases inquiry,”

~ Maria C. R. Harrington, Ph.D.


VR and Emotions Spearman's rho Correlations (N=64) Sig(2-tail) This shows the correlation and relationships between

Beauty, whatever it may be for the individual, the emotional reaction of Awe and Wonder, and the empirical data on test scores, Knowledge Gained Knowledge Gained is correlated to Awe and Wonder

rho = 0.273, p = 0.032 Beauty correlated with Awe and Wonder

rho =0.506, p =0.000 Beauty correlated with Total Attitudinal Survey ranking

rho = 0.727, p = 0.000 A major contribution shows empirical link between

Beauty and Learning.


“Empirical link between Beauty and Learning in VR”



ResultsVR can be used for simulating the real world with scientific accuracy

VR can be used to trigger emotionsVR can be used for learningAwe and Wonder, and Beauty experienced in VR are highly correlated with a desire to learn


“The Perceptual Ambient Array may be Captured Mathematically in VR”



My Research & ScholarshipMy dissertation is about the environmental factors that cause learning and creativity to occur, specifically the environmental factors with respect to computer systems and simulations.


My Research & Scholarship

“The tool impacts what we see, feel, learn, and do.”



My Research & ScholarshipSuch systems are important as they influence scientific, human, social, and cultural transformations and growth.


My Research & ScholarshipI am interested in interdisciplinary empirical research with virtual reality, simulations, serious games, human-computer interaction, and immersive new media art.


My Research & ScholarshipOf high interest is the investigation of human factors in system design research, as it influences perception, learning, and creating.


Intersection of Art and Technology


Framing Future Possibilities Connection between external world and internal feelings and

thoughts Art is the non-technical VR of the past

It communicated information It changed what we knew It changed how we felt It moved us to take action

VR is the 21st Century Art of impact if used as such A cultural artifact of high information density A new form of stories, theater, and opera A way to communicate brilliant ideas, vision, and beauty


What is Art?

Art is BeautyArt is InformationArt is StoryArt is ParadoxGreat Art Transcends Time… and Culture


We know it when we see it


Sandro Botticelli. The Birth of Venus (Detail) 1480. Uffizi Gallery. Retrieved from https://commons.wikimedia.org/wiki/File:The_Birth_of_Venus_%28Botticelli%29_detail.jpg

What do you see?

What is her emotion?

What do you feel?

https://commons.wikimedia.org/wiki/File:The_Birth_of_Venus_(Botticelli)_detail.jpg

https://commons.wikimedia.org/wiki/File:The_Birth_of_Venus_(Botticelli)_detail.jpg


Jean Fouquet. Virgin and Child Surrounded by Angels, Melun Diptych, (Right wing of the diptych), (1452). Royal Museum of Fine Arts, Antwerp

Retrieved from https://en.wikipedia.org/wiki/Melun_Diptych#/media/File:Fouquet_Madonna.jpg

https://en.wikipedia.org/wiki/Royal_Museum_of_Fine_Arts,_Antwerp

https://en.wikipedia.org/wiki/Royal_Museum_of_Fine_Arts,_Antwerp

https://en.wikipedia.org/wiki/Melun_Diptych#/media/File:Fouquet_Madonna.jpg




Leonardo da Vinci. Mona Lisa (1503-1506). Louvre Museum. Retrieved from https://commons.wikimedia.org/wiki/File:Mona_Lisa,_by_Leonardo_da_Vinci,_from_C2RMF_retouched.jpg

https://commons.wikimedia.org/wiki/File:Mona_Lisa,_by_Leonardo_da_Vinci,_from_C2RMF_retouched.jpg



What is Technology? The branch of knowledge that deals with

the creation and use of technical means and their interrelation with life, society, and the environment, drawing upon such subjects as industrial arts, engineering, applied science, and pure science

Tools applied to art or science as a means to an end

A collection of techniques, skills, methods, and processes used for artistic expression or in scientific investigation

Computers are used as tools, as a kind of technology to achieve goals in calculation or expression


Pedro Reyes, Imagine (Double Psaltery), 2012. Retrieved from http://www.blog.pedroreyes.net/

http://www.blog.pedroreyes.net/

http://www.blog.pedroreyes.net/


Camera Obscura


Camera obscura, from a manuscript of military designs. 17th century, possibly Italian. Retrieved from https://en.wikipedia.org/wiki/Camera_obscura#/media/File:Camera_obscura2.jpg

https://en.wikipedia.org/wiki/Camera_obscura#/media/File:Camera_obscura2.jpg

https://en.wikipedia.org/wiki/Camera_obscura#/media/File:Camera_obscura2.jpg

Game Engines


3D Models 3D Model, 2D Art, joints rigged for motion and animation Character specific behaviors, expressions, or reactions UV mapping (https://en.wikipedia.org/wiki/UV_mapping)


http://www.turbosquid.com/3d-models/deer-animation-3d-model/542770

https://en.wikipedia.org/wiki/UV_mapping



2D Art, Textures & Skins


https://www.adobe.com/products/photoshop.html

https://www.adobe.com/products/photoshop.html

Rigged & Animated http://www.turbosquid.com/3d-models/deer-animation-3d-mo

del/542770




Open World Demo


https://www.youtube.com/watch?v=clakekAHQx0



Are Video Games ART?


Is a Hot Dog a Sandwich? https://www.youtube.com/watch?v=EuZdHTKzXa8

https://www.youtube.com/watch?v=EuZdHTKzXa8

https://www.youtube.com/watch?v=EuZdHTKzXa8

Char Davies. Osmose (1995)


Retrieved from https://www.youtube.com/watch?v=54O4VP3tCoY

https://www.youtube.com/watch?v=54O4VP3tCoY

https://www.youtube.com/watch?v=54O4VP3tCoY

The Garden of Earthly Delights by Hieronymus Bosch in VR

Burrell Durrant Hifle website (2016, March 16). VR Bosch. Retrieved from http://www.bdh.net/work/boschvr/


http://www.bdh.net/work/boschvr/

Walk into a Dali with VR

The Dali Museum (2016, January 21). Dreams of Dali: Virtual Reality Experience. Retrieved from https://www.youtube.com/watch?v=2nh1itve0AQ

The Dalí Museum in St. Petersburg, Florida, or at dreamsofdali.org. Opens January 23, 2016.

Go inside and beyond Dalí’s painting Archeological Reminiscence of Millet’s Angelus

Experience Dreams of Dalí in the special exhibit Disney & Dalí: Architects of the Imagination


https://www.youtube.com/watch?v=2nh1itve0AQ

Artistic Experience in VR


Future Colossal. Shadows of Isolation - Virtual Reality Trailer (Oculus DK2) (2015, March 16). Retrieved from https://www.youtube.com/watch?v=mmHTTb69wTk

https://www.youtube.com/watch?v=mmHTTb69wTk

https://www.youtube.com/watch?v=mmHTTb69wTk


http://vrse.com/

http://vrse.com/

http://vrse.com/

Future Research and Teaching


Future possibilities for research and teaching

Art & Science of Virtual Reality for Education (Virtual Field Trips for K-12)

User Centered Design, Human Computer Interaction, UX of Virtual Reality (the matrix of features and functions)

Human Factors Research on Spatial Ambient Array and impacts on Perception, Emotions, and Creativity as Action (AI of Creativity)

Design Frameworks for Collaboration & Co-Creativity (frameworks that support work)

Future Cities, Space Stations, and Colonies co-designed and tested in Virtual Reality (Scenario analysis & consensus decision-making)

Future Realities, Simulations, Data Visualizations (Algorithms) Landscapes as Art and Virtual Reality Experiences (ART as

Information and Emotion)


Art & Science of Virtual Reality for Education

Virtual Field Trips for K-12


User Centered Design, Human Computer Interaction, UX of VR


Spatial Perceptual Ambient ArrayHuman Factors Research on Spatial Ambient Array and

impacts on Perception, Emotions, and Creativity as Action (AI of Creativity)

James J. Gibson, Ph.D. Ecological Psychology Visual perception

Extend to creativity research How do we know we don’t know? How do we perceive the unknown? How do we create something new? What is Beauty?


Measure Psychophysical


Measure the Geometry


Design Frameworks for Collaboration & Co-Creativity

Frameworks that support co-creativity 3 large IRB studies: Investigation and Evaluation of

Virtual Worlds, 3D Environments, and Simulations for Alternative Learning, Collaboration, Co-creating, and Decision Support Formats:


Pittsburgh Renaissance


© 2016 University Library System, University of Pittsburgh, “Frank Lloyd Wright’s concept for Point redevelopment,1947.” Retrieved from http://digital.library.pitt.edu/pittsburgh/exhibits/thepoint/

http://www.library.pitt.edu/

http://www.pitt.edu/

http://www.pitt.edu/

http://digital.library.pitt.edu/pittsburgh/exhibits/thepoint/



Future Cities, Space Stations, and Colonies in VR


NASA website (2016, January 16) Research & Technology Images. Retrieved from https://www.nasa.gov/content/research-and-technology-image-gallery

Space-grant University: Founded in 1963, UCF opened to provide personnel to support the U.S. space program at the Kennedy Space Center and Cape Canaveral Air Force Station on Florida's Space Coast

https://www.nasa.gov/content/research-and-technology-image-gallery

https://www.nasa.gov/content/research-and-technology-image-gallery

https://en.wikipedia.org/wiki/NASA

https://en.wikipedia.org/wiki/NASA

https://en.wikipedia.org/wiki/Kennedy_Space_Center

https://en.wikipedia.org/wiki/Kennedy_Space_Center

https://en.wikipedia.org/wiki/Cape_Canaveral_Air_Force_Station



https://en.wikipedia.org/wiki/Space_Coast

https://en.wikipedia.org/wiki/Space_Coast

NASA Concept Art to communicate ideas, model, and inspire


NASA Ames summer studies in the 1970s. Colonies housing about 10,000 people were designed. A number of artistic renderings of the concepts were made.

Bryan Yager, Toroidal Colonies, NASA ID NUMBER AC75-1086-1. Retrieved from http://settlement.arc.nasa.gov/70sArt/art.html

http://www.nas.nasa.gov/~byager

http://www.nas.nasa.gov/~byager

http://settlement.arc.nasa.gov/70sArt/art.html

http://settlement.arc.nasa.gov/70sArt/art.html

Rama, by Eric Bruneton


3D animation of a spacecraft freely inspired from the book "Rendez-vous with Rama" from Arthur C. Clarke.

Making of Rama: http://www.youtube.com/watch?v=wKM2nD...

See also: http://ebruneton.free.fr/rama3/rama.html

Bruneton, Eric. (2009, July 19) Rama. Retrieved from https://www.youtube.com/watch?v=zBIQCm54dfY

http://www.youtube.com/watch?v=wKM2nDZ4rM4




http://ebruneton.free.fr/rama3/rama.html



https://www.youtube.com/watch?v=zBIQCm54dfY

https://www.youtube.com/watch?v=zBIQCm54dfY

Virtual Reality in the hands of an Artist


Intersection of Art and Technology I create immersive, virtual landscapes that are dynamic and

responsive to past and future scientific data sets, in addition to user interaction scenarios

These tools offer a new medium and process for the artist to explore and harness, resulting in new cultural artifacts relevant to our era

My artwork is an investigation of landscapes, much like the Hudson River School of the past, Clayton Merrill and Clifford Ross of the present

It hints at a powerful connection between art, technology, the land, and the self


Hudson River School


Thomas Cole. The Oxbow (The Connecticut River near Northampton) (1836)

Clayton Merrill


Fire and Sun Smoke, 2012

Clifford Ross


Clifford Ross, "Sopris Wall I," 2015 (Installation view) MASS MoCA

http://r.search.yahoo.com/_ylt=A0LEVi7hevBWXoQAFVYnnIlQ;_ylu=X3oDMTEyaHZqdG1nBGNvbG8DYmYxBHBvcwMyBHZ0aWQDQjE1OTJfMQRzZWMDc3I-/RV=2/RE=1458629474/RO=10/RU=http:/www.cliffordross.com/news/mass-moca/RK=0/RS=eWvlyAKHfcdYvq07CVH5UclFiPI-

http://r.search.yahoo.com/_ylt=A0LEVi7hevBWXoQAFVYnnIlQ;_ylu=X3oDMTEyaHZqdG1nBGNvbG8DYmYxBHBvcwMyBHZ0aWQDQjE1OTJfMQRzZWMDc3I-/RV=2/RE=1458629474/RO=10/RU=http:/www.cliffordross.com/news/mass-moca/RK=0/RS=eWvlyAKHfcdYvq07CVH5UclFiPI-

Artistic StatementThe intent of my art is to present landscapes in different perspectives to viewers. By doing so, I aim to challenge them, intellectually and emotionally, to reflect on their personal relationships with nature and with themselves within the ideals of truth and beauty.



Artistic StatementMy landscapes intentionally frame views with impossible, almost surrealistic perspectives that are completely unreal, yet made real by the visulization, and application of simulation and virtual reality technology.



Artistic StatementPlacing the viewer into a frame of reference of the earth—using anything from a leafy tree to a rippling river—the viewer is cast in an impossible role. But it feels natural because it is perceived as real as the real world, and thus very familiar.



Future possibilities for research and teaching with Art

Human Factors Research on Spatial Perceptual Ambient Array and impacts on Perception, Emotions, and Creativity as Action (AI of Creativity)

Design Frameworks for Collaboration & Co-Creativity (frameworks that support work)

Landscapes as Art and Virtual Reality Experiences (ART as Information and Emotion), Extend Shannon and Weaver’s Model of Communication to Beauty


What are you going to Create?


Q&A
