Top Banner
Too Many Varied User Requirements for Digital Humanities Projects Max Kemman - @MaxJ_K (soon: University of Luxembourg) Martijn Kleppe - @MartijnKleppe
26

Too Many Varied User Requirements for Digital Humanities Projects

Nov 29, 2014

Download

Technology

MaxKemman

Presentation at CLARIN Annual Conference 2014
24 October 2014, Soesterberg, The Netherlands
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Too Many Varied User Requirements for Digital Humanities Projects

Too Many Varied User Requirements for Digital Humanities Projects

Max Kemman - @MaxJ_K(soon: University of Luxembourg)

Martijn Kleppe - @MartijnKleppe

Page 2: Too Many Varied User Requirements for Digital Humanities Projects

Problem

We want to develop tools that will be used byscholars

• User-centred design

But do users know what they want or need?

• Not according to Jakob Nielsen (2001) orSteve Jobs (Reinhardt, 1998)

• Innovation is technology-driven (Norman, 2010)

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects2

Page 3: Too Many Varied User Requirements for Digital Humanities Projects

Question

Do humanities scholars know what they want from computational tools?

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects3

Page 4: Too Many Varied User Requirements for Digital Humanities Projects

Context - Two projects

PoliMedia (CLARIN-NL call 3)

• Automatically creating links betweendebates of the Dutch parliament to mediaitems, made available in a search userinterface in which debates of theDutch parliament can be explored

• www.polimedia.nl

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects4

Page 5: Too Many Varied User Requirements for Digital Humanities Projects

PoliMedia - Search

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects5

Page 6: Too Many Varied User Requirements for Digital Humanities Projects

PoliMedia - Debate

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects6

Page 7: Too Many Varied User Requirements for Digital Humanities Projects

PoliMedia – Link to radio

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects7

Page 8: Too Many Varied User Requirements for Digital Humanities Projects

PoliMedia – Link to newspaper

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects8

Page 9: Too Many Varied User Requirements for Digital Humanities Projects

Context - Two projects

Oral History Today (CLARIAH seeddemonstrator)

• A search user interface similar to Googlein which oral history interviews andcollections can be searched andexplored to discover topics across amultitude of collections

• zoeken.verteldverleden.org

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects9

Page 10: Too Many Varied User Requirements for Digital Humanities Projects

Oral History Today - Search

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects10

Page 11: Too Many Varied User Requirements for Digital Humanities Projects

Oral History Today – Word cloud

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects11

Page 12: Too Many Varied User Requirements for Digital Humanities Projects

Oral History Today – Visual facets

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects12

Page 13: Too Many Varied User Requirements for Digital Humanities Projects

Oral History Today - Interview

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects13

Page 14: Too Many Varied User Requirements for Digital Humanities Projects

Method

PoliMedia

• User requirements elicitation: interviewswith 5 scholars (F2F)

• Evaluation: eye tracking with 24 scholars

Oral History Today

• User requirements elicitation: interviewswith 15 scholars (Skype)

• Evaluation: walkthrough with 5 scholars perupdate (Skype)

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects14

Page 15: Too Many Varied User Requirements for Digital Humanities Projects

Method

Processing

• Categorizing statements

• Feasibility discussion with developers

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects15

Page 16: Too Many Varied User Requirements for Digital Humanities Projects

Results - PoliMedia

39 user requirements

• 21 deemed within-scope

• 18 deemed out-of-scope

• 27 unique user requirements

Most common (3/5):

• Media output from before the debate

• Names of people involved

• Location in the newspaper

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects16

Page 17: Too Many Varied User Requirements for Digital Humanities Projects

Results - PoliMedia

Out-of-scope

• Processing of media items

– Size of headers, number of columns, …

• Processing of television programmes

– Filming techniques, music, length, …

• Processing of debates

– Sentiment analysis, interruption networks, …

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects17

Page 18: Too Many Varied User Requirements for Digital Humanities Projects

Results – Oral History Today

75 user requirements

• 33 deemed within-scope

• 42 deemed out-of-scope

• 34 unique user requirements

• Most common (10/15):

– Filter for time period

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects18

Page 19: Too Many Varied User Requirements for Digital Humanities Projects

Results – Oral History Today

Out-of-scope

• More, more, more metadata

– Interviewee, interviewer, interview, …

• Search technology

– Search operators, synonyms, …

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects19

Page 20: Too Many Varied User Requirements for Digital Humanities Projects

Discussion

Do our results agree with Nielsen, Jobs and Norman?

• Small overlap between user requirements and project goal

• High awareness of what could be easier with a computer

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects20

Page 21: Too Many Varied User Requirements for Digital Humanities Projects

(Obligatory Dilbert comic)

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects21

http://dilbert.com/strips/comic/2001-04-14/

Page 22: Too Many Varied User Requirements for Digital Humanities Projects

Discussion

Out-of-scope requirements show match of project goal with scholarly practices

• Highly individual

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects22

Page 23: Too Many Varied User Requirements for Digital Humanities Projects

Conclusion

Do humanities scholars know what theywant from computational tools?

• Clear idea for their own research

Question → Method → Requirements

• Too varied!

• Repurposing data and tools

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects23

Page 24: Too Many Varied User Requirements for Digital Humanities Projects

Conclusion

Talk of Europe

• www.talkofeurope.eu

• Publishing RDF online

• No tool development ourselves, but inviting others

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects24

Page 25: Too Many Varied User Requirements for Digital Humanities Projects

Conclusion

Creative Camp

• October 2014: NISV, Hilversum

• April/May 2015: At your institution?

24-10-2014CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects25

Page 26: Too Many Varied User Requirements for Digital Humanities Projects

• Extended abstract: http://www.clarin.eu/sites/default/files/cac2014_submission_29_0.pdf

• Dataset: http://dx.doi.org/10.6084/m9.figshare.1170077

• Slides: https://www.slideshare.net/MaxKemman/too-many-varied-user-requirements-for-digital-humanities-projects/

• Nielsen, J. (2001). First Rule of Usability? Don’t Listen to Users. Nielsen Norman Group blog. Retrieved July 01, 2014, from http://www.nngroup.com/articles/first-rule-of-usability-dont-listen-to-users/

• Norman, D. A. (2010). The way I see it: Technology first, needs last. Interactions, 17(2), 38. doi:10.1145/1699775.1699784

• Reinhardt, A. (1998). Steve Jobs on Apple’s Resurgence: “Not A One-Man Show.” Business Week Online. Retrieved October 17, 2014, from http://www.businessweek.com/bwdaily/dnflash/may1998/nf80512d.htm

24-10-2014 26CLARIN Annual Conference 2014 - Too Many Varied User

Requirements for Digital Humanities Projects