Top Banner
/ M I N E R V A 2 EVA/Minerva 2013 Jerusalem Conference on the Digitisation of Cultural Heritage End-users, User Generated Content, and Personas: Testing the European Waters Dr. Susan Hazan, The Israel Museum, Jerusalem Chair, UGC Task Force, Europeana
37

B2 susan hazan_endusers_personas

Jan 12, 2015

Download

Technology

evaminerva

pptx Presentation by Dr. Susan Hazan on End-users Generated content
at the EVA/Minerva Jerusalem International Conference on Digitisation of Culture,
Jerusalem, The Jerusalem Van Leer Institute, 12-13 November 2013
http://www.digital-heritage.org.il
Presentations available at: http://2013.minervaisrael.org.il
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: B2 susan hazan_endusers_personas

E V A / M I N E R V A 2 0 1 3

EVA/Minerva 2013Jerusalem Conference on the Digitisation of Cultural Heritage

End-users, User Generated Content, and Personas: Testing the European Waters

Dr. Susan Hazan, The Israel Museum, JerusalemChair, UGC Task Force, Europeana

Page 2: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Who uses Europeana and its 30 million objects?

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-users who can only be identified as abstract individuals and need to be characterized as a generic type that can be evoked to evaluate how a user would typically behave.

PART IIThe active end-user who agrees to be crowd-sourced and drawn in to collaborate with others whether they be man or machine.

Page 3: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

The approach taken to visualize the end user comes from classical user studies and incorporates personas; a form of role-playing where volunteers are asked to take on a role, or persona and to perform an explicit task with a specific outcome.

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-user

Athena Plus User needs and requirementsCoordinated by ICCU and PACKED, gathers information on user needs and requirements in relation to the creative applications for the (re)use of digital cultural heritage content that will be developed in the AthenaPlus WP5 by META and PACKED.

Download document >>

Page 4: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

The approach taken to visualize the end user comes from classical user studies and incorporates personas; a form of role-playing where volunteers are asked to take on a role, or persona and to perform an explicit task with a specific outcome.

In the AthenaPlus study we chose to run the tasks twice;

• once requiring our volunteers to complete their scripted task within the Europeana environment

• with a second round using in a more open environment; typically searching with Google and including results from Wikipedia, national portals and other specified parameters.

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-user

Page 5: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Persona 1 - John Persona 2 - Caroline Persona 3 - Sarah

Persona 4 - Giuseppe Persona 5 - Miguel

Who is the end-user in the Europeana ecosystem?PART I - The absent end-user

Page 6: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

The Task

A specific task was scripted and the volunteer who was playing the persona was asked to visit websites in a way that would be appropriate from the point of view of the specific personas they are playing, performing their tasks either on Europeana or through generic searches via Google.

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-user

Page 7: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Volunteer included photography, going to the movies, listening to classical music, discovering and reading books and online blogs, going to the theatre, travelling, cycling, keeping up with the latest fashion trends and gardening.

In total, 61 completed test reports were completed

Conducted in Dutch, French, Polish, English, Hungarian and Italian, and in most cases translated to English before processing.

The age of the Volunteers was between 41 - 72 years old.

Volunteers included IT professionals, students, an art historian, a translator, a communication officer, an architect, a teacher and a librarian.

Page 8: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-user

What were we looking for?

1. Time taken to accomplish the task according to the satisfaction of the volunteer

2. The ease of retrieval of appropriate content

3. Frustration/satisfaction level of the volunteer during the task

4. Qualitative evaluation of the results by the supervisor – was the goal reached, were the results useful, was anything critical overlooked

* Each volunteer was presented with one task according to his or her persona

Page 9: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Fig. 1 Time spent by the Volunteers in carrying out the task (according to the supervisors)

Page 10: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Fig. 2 Level of difficulty in retrieval of content on different platforms (according to Volunteers)

Page 11: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Fig. 3. Level of frustration or satisfaction by Volunteers during the task

Page 12: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Fig. 4 Presence of results after completion of task by Volunteers (according to the supervisors)

Page 13: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Google, Youtube and Wikipedia preferred over Europeana from a usability perspective

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-user

RESULTS

Typos and the use of keywords were problematic in Europeana

Europeana was deemed often too specific – lack of useful generic content: particularly audiovisual

Not enough choice - particularly for contemporary content

Lack of practical information e.g. exhibition information, links to other websites

Broken links were frustrating

Users found to hard to work with filters

Searching on Europeana was more frustrating than with the other platforms and content retrieval more difficult

Page 14: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Europeana was preferred over Google because of the profusion/excess of results

Who is the end-user in the Europeana ecosystem?

PART IThe absent end-user

RESULTS

Wikipedia was in particular appreciated for biographical content.

Google retrieves more resources than Europeana for non-English speakers.

Page 15: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Who uses Europeana and its 30 million objects?

Who is the end-user in the Europeana ecosystem?

The active end-user who agrees to be crowd-sourced and drawn in to collaborate with others whether they be man or machine.

Page 16: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

The second part of the talk discusses a recent workshop carried out by the Europeana User Generated Group.

Who is the end-user in the Europeana ecosystem?

Page 17: B2 susan hazan_endusers_personas

Strategies for user generated content and crowdsourcing in museums and cultural heritage

Workshop DH2013, Marseille

Page 18: B2 susan hazan_endusers_personas

Europeana’s vision and mission

• Europeana is a catalyst for change in the world of cultural heritage.

• Our mission: The Europeana Foundation and its Network create new ways for people to engage with their cultural history, whether it’s for work, learning or pleasure.

• Our vision: We believe in making cultural heritage openly accessible in a digital way, to promote the exchange of ideas and information. This helps us all to understand our cultural diversity better and contributes to a thriving knowledge economy.

Page 19: B2 susan hazan_endusers_personas

29m records from 2,200 European galleries, museums, archives and libraries

Books, newspapers, journals, letters, diaries, archival papers

Paintings, maps, drawings, photographs Music, spoken word, radio broadcasts Film, newsreels, television Curated exhibitions 31 languages

EUROPEANA - Europe’s cultural heritage portal

Page 20: B2 susan hazan_endusers_personas

Goals of the Taskforce

1. Identification and benchmarking of services

and best-practices as building blocks for the

creation of a Europeana UGC ecosystem

2. To be a point of contact for all projects that

want to apply UGC approaches within the

Europeana network and to encourage cross-

fertilization of ideas between projects and

identify duplication of effort

3. To make policy recommendations for the

Europeana Network regarding the role UGC can

play in the context of Europeana.

Page 21: B2 susan hazan_endusers_personas

Europeana User Generated Group

Marion DupeyratInteracting with audiences: overview of participatory practices implemented by memory institutions

James BrusuelasAncient Lives

Erwin VerbruggenWaisda? Making videos findable with Crowdsourced annotations

Julia FallonLegal aspects of UGC

Cristine SauterResults of the Europeana taskforce

Ad PolléEuropeana 1914-18Europeana 1989

Roei AmitCase studies from la réunion des musées nationaux-Grand Palais

Stuart DunnAn emerging field(?): defining the fundamentals of humanities crowdsourcing

Workshop DH2013, Marseille

Page 22: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Europeana User Generated GroupStuart Dunn, King’s College London, UK

An emerging field(?): defining the fundamentals of humanities crowdsourcing

• Contributory projects

• Collaborative projects

• Co-created projects

Workshop DH2013, Marseille

Page 23: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

What is humanities crowd-sourcing used for?

What does it produce?• Original text• Transcribed text• Corrected text• Enhanced text• Transcribed music• Metadata• Structured data• Knowledge and awareness• Funding

Europeana User Generated GroupStuart Dunn, King’s College London, UK

Workshop DH2013, Marseille

Page 24: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Europeana User Generated GroupStuart Dunn, King’s College London, UK

Workshop DH2013, Marseille

Page 25: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Oxford Papyrologists Researchers, The Imaging Papyri ProjectThe Oxyrhynchus Papyri Project

http://ancientlives.org

Europeana User Generated Group

James Brusuelas, Oxford UniversityAncient Lives

Workshop DH2013, Marseille

Page 26: B2 susan hazan_endusers_personas

26

LE GRANDATELIER DU MIDI

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 27: B2 susan hazan_endusers_personas

27

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 28: B2 susan hazan_endusers_personas

28

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 29: B2 susan hazan_endusers_personas

29

• 267.107 visiteurs au 10/09/2013 • 5.607 téléchargements • 550 photos partagées

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 30: B2 susan hazan_endusers_personas

30

BRAQUE

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 31: B2 susan hazan_endusers_personas

31

BRAQUE

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 32: B2 susan hazan_endusers_personas

BRAQUE

Au 13/10/2013, après 26 jours d’ouverture:•113.103 visiteurs •12.586 téléchargements, et 484 téléchargements par jour

Europeana User Generated Group

Roei Amit, La réunion des musées nationaux-Grand Palais

Workshop DH2013, Marseille

Page 33: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Europeana User Generated GroupAd Pollé

Europeana 1914-18Europeana 1989

Workshop DH2013, Marseille

Page 34: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Europeana User Generated GroupAd Pollé

Europeana 1914-18

Workshop DH2013, Marseille

Page 35: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Europeana User Generated GroupAd Pollé

Europeana 1989

Workshop DH2013, Marseille

Page 36: B2 susan hazan_endusers_personas

EVA/Minerva 2013 | End-users, User Generated Content, and Personas: Testing the European Waters | Dr. Susan Hazan

Most successful crowdsourcing projects are not about large anonymous masses of people. They are not about crowds. They are about inviting participation from interested and engaged members of the public. These projects can continue a long standing tradition of volunteerism and involvement of citizens in the creation and continued development of public goods [T. Owens 2012]

Europeana User Generated GroupStuart Dunn, King’s College London, UK

Workshop DH2013, Marseille

Page 37: B2 susan hazan_endusers_personas

E V A / M I N E R V A 2 0 1 3

EVA/Minerva 2013Jerusalem Conference on the Digitisation of Cultural Heritage

End-users, User Generated Content, and Personas: Testing the European Waters

Dr. Susan Hazan, The Israel Museum, JerusalemChair, UGC Task Force, Europeana