Top Banner
Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson, Sarah Phillips and Vincent S. Smith
15

Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Dec 24, 2015

Download

Documents

Mercy Gregory
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Making molehills out of mountains:

Crowdsourcing digital access to natural history collections

Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson, Sarah Phillips

and Vincent S. Smith

Page 2: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Link to full report in Google Docs:

http://goo.gl/g6pBcH

Note: This is the working version of the report and will contain comments, notes and rough edges!

Page 3: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Background

• Dual Digital Collections Programme and SYNTHESYS3 report

• Audience - SYNTHESYS3 Taxonomic Access Facilities and internal NHM

• Aims:

– Review current natural history crowdsourcing platforms;

– Provide case studies of natural history crowdsourcing projects;

– Summarise motivation of volunteers;

– Recommend strategies for crowdsourcing success and future crowdsourcing research.

Page 4: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Crowdsourcing Definition & Context

• Crowd-based activity

• Clear task and goal

• Crowd is rewarded

• Distinct crowdsourcer (e.g. the NHM)

• Benefits the crowdsourcer

• Online and open participatory process

Tasks and goals:

• Majority are transcription based (labels, registers or diaries)

• Tasks are well-suited for human intelligence (handwriting interpretation and data categorisation)

Page 5: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Crowdsourcing Platforms

Page 6: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Platform Comparison

Feature ALA h@h LH NfN SDV: TC

Data Entry single single multi multi single

Review Y Y N N Y

Open source Y N N Y ?

Mobile Partial N N N N

PM + Admin Y N ? N Y

Georef tool Y N N N ?

Projects 232 18** 30 4 139

Community 835 419 200+ 6,721 340+

Contributions 128,135 145,574 1,365,200 1,025,033 ?

Plat. Age 4 years 7 years 3 years 2 years 2 years

Statistics gathered on 08/01/2014 unless other stated in notes

Platform age is rounded up

Laurence Livermore
Underestimate - based on most popular project only
Laurence Livermore
Intention to release as open source
Laurence Livermore
Available upon request
Laurence Livermore
Partially available as open source code
Laurence Livermore
Underestimate - based on most popular project only
Laurence Livermore
Filtered on "Biodiverse planet"
Page 7: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

NHM Case Studies – Science Uncovered

• 3 weeks to make prototype (1 dev)

• AngularJS, nodeJS, MongoDB (open source)

• Images from Flickr

• Live imaging on the night

• Showcased entire digitisation process from collection to Data Portal

• Dataset: http://data.nhm.ac.uk/dataset/crowdsourcing-the-collection

• Stats: http://data.nhm.ac.uk/dataset/crowdsourcing-the-collection/resource/07555c45-ed3f-4178-83a4-dfa0144e35d2?view_id=59d600c4-5539-42ad-8435-a408f724f246

• Demo available from: http://su2014.benscott.co.uk/

Page 8: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

NHM Case Studies – Notes from Nature

• Led by Tim Conyers and Robert Prys-Jones

• Bird register project – initial test project for NfN

• 2,950 pages

• 315,785 transcriptions

• 75% of transcriptions by 1 volunteer!

• Project page: http://www.notesfromnature.org/#/archives/ornithological

• Contributor stats: http://data.nhm.ac.uk/dataset/notes-from-nature/resource/7f8fc5f5-90ae-4959-b286-9cb7951f2875?view_id=ce329dfd-99cb-4223-b615-ce95d6c707c7

Page 9: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

• Collaboration with Oxford, Leicester, Royal Society, RCS

• Project that will help to advance and inform NHM crowdsourcing

• Developing two new projects on Zooniverse platform (Spring 2015):

1. Images of nature within C19th periodicals (BHL) – CAHR & Leicester

2. Orchid phenology – AMC, Origins & Evolution Initiative & Oxford

Page 10: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Motivating the Crowd

• Understanding why volunteers participate in crowdsourcing endeavours and how to support, maintain and reward their involvement is central to success

• Narrative, tasks, supporting resources & feedback all affect participation

• Social aspects of crowdsourcing are critical and should not be ignored

• Motivations of participants vary and can be hard to determine

• Increasing number of studies, but biased coverage

• Report synthesises available evidence and relates this to effective project design

Page 11: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Initial decision to participate:

– Enthusiasm and interest in project topic

– Desire to record, find and discover

– Learning and development of new skills

– Contribution to the greater good (society/science)

– Sense of purpose and belonging to a community (social)

Maintaining volunteer participation (reward mechanisms):

– Rapid feedback

– Discussion with scientists and other contributors (forums)

– Opportunity to develop skills and project responsibility (e.g. transcription to verification)

– Acknowledging contributions made

– Gamification (stats, leaderboards and badges)

Page 12: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Report conclusions: Benefits of Crowdsourcing

• A stronger online presence/brand

• Increased rate of collections digitisation, hence access to data

• Higher scientific output

• An effective way of engaging (dispersed) members of the public

• Deeper and more meaningful engagement with our collections

Page 13: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Report conclusions: project choice and design

• Clear project rationale with both cultural and scientific benefits

• Projects should be actively promoted and monitored

• Scientists should be visible and engaged with volunteers

• Develop best practice for motivating and retaining volunteers (self-establishing community structure and forum, good science, tasks of interest, different rewards etc)

• Platform should use existing data standards – reduce bottle neck for collections management ingestion

• Resulting data should be freely available – projects do not end when all tasks are complete!

Page 14: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Recommended Areas of Organisational Investment

• Technical infrastructure (e.g. software, hardware and developers)

• Communication, outreach and support (e.g. dedicated staff time to develop and provide feedback to an external community, internal project manager and scientists)

• Strategic project selection (e.g. strong narrative, potential scientific outputs, public appeal, well-structured tasks of known complexity)

• Preparation of underlying data (e.g. data for autocomplete fields such as collector names or localities)

• Post-processing of data and subsequent import into institutional collections management system

Page 15: Making molehills out of mountains: Crowdsourcing digital access to natural history collections Laurence Livermore, John Tweddle, Lisa French, Lucy Robinson,

Next steps? Discussion…

• Investigate platforms and differentiators (technical, sustainability, control)

• Consider options for implementation

• Create list of potential projects

• Funding potential

• What is the future of crowdsourcing? Can the “crowd” perform research-orientated activities?