Top Banner
1 http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu ttp://goo.gl/I3tBR
65

British Library Labs Roadshow 2016 Open Data Meetup Bristol

Apr 15, 2017

Download

Education

labsbl
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: British Library Labs Roadshow 2016 Open Data Meetup Bristol

1http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://goo.gl/I3tBRu

Page 2: British Library Labs Roadshow 2016 Open Data Meetup Bristol

2http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.bl.uk/projects/british-library-labsFunded by the Andrew W. Mellon Foundation

21st March 2016 – BL Labs Roadshow 2016Presentation at British Library’s Digital Content and Open Data Meetup, Bristol

Page 3: British Library Labs Roadshow 2016 Open Data Meetup Bristol

3http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.bl.uk/projects/british-library-labsFunded by the Andrew W. Mellon Foundation

21st March 2016 – BL Labs Roadshow 2016Presentation at British Library’s Digital Content and Open Data Meetup, Bristol

Page 4: British Library Labs Roadshow 2016 Open Data Meetup Bristol

4http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Distant Reading – Adam Crymble

https://www.youtube.com/watch?v=tp4y-_VoXdA

Page 5: British Library Labs Roadshow 2016 Open Data Meetup Bristol

5http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Digital research methods

http://labs.bl.uk/Launch+Event (has some examples from researchers)

Corpus analysis toolsText Mining

Visualisations

Location based searching

Geotagging

Annotation

Natural Language Processing

Using Application Programming Interfaces for datasets e.g. Metadata, Images

Transcribing

Crowdsourcing / Human Computation

Page 6: British Library Labs Roadshow 2016 Open Data Meetup Bristol

6http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

One of Largest Library’s in the World180 million* items

1-2 %* digitised

* estimate

Page 7: British Library Labs Roadshow 2016 Open Data Meetup Bristol

7http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

IntersectionYou and the Library

Your research interestsDigital

collections interested in

British LibraryDigital

collections we have

This is where Labs works

It starts with a conversation!

Page 8: British Library Labs Roadshow 2016 Open Data Meetup Bristol

8http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Managing expectations:Looking for very specific things digitally

•Research interests?

•What digital collections are you interested in?

•Only a small amount of content is digitised!

•Might not be the treasure you expect at the end of a digital journey!

Page 9: British Library Labs Roadshow 2016 Open Data Meetup Bristol

9http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

You might get very lucky!Fly fishing by JR Hartley

https://www.youtube.com/watch?v=r2TilNclT8k

Page 10: British Library Labs Roadshow 2016 Open Data Meetup Bristol

10http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.bl.uk/subjects/digital-scholarship

http://labs.bl.uk/Digital+Collections

Soon…http://data.bl.uk

Mini Network Area Storage Device (NAS) guide:http://goo.gl/E8aRyQ

Page 11: British Library Labs Roadshow 2016 Open Data Meetup Bristol

11http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

How?

Page 12: British Library Labs Roadshow 2016 Open Data Meetup Bristol

12http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

•Submit ideas by 11 April 2016.

•Two finalists announced late May 2016.

•Residency June – October 2016.•Up to £3600 support, technical, curatorial etc.

•Showcase @ Symposium Monday 7 Nov 16.

•Winner £3000 & Runner up £1000!

Competition

Page 13: British Library Labs Roadshow 2016 Open Data Meetup Bristol

13http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

•Projects already using BL digital content in interesting and innovative ways.

•Submit projects (previous and new) by 5 September 2016.

•Artistic, Commercial, Research and Learning / Teaching categories.

•Winners announced @Symposium 7 Nov 16.

•£500 Winner & £100 Runner Up.

Awards

Page 14: British Library Labs Roadshow 2016 Open Data Meetup Bristol

14http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Projects & Ideas• Ideas change once you try to access, examine and use the data!

•Talk to us about working on potential ideas / projects.

Page 15: British Library Labs Roadshow 2016 Open Data Meetup Bristol

15http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Competition

Page 16: British Library Labs Roadshow 2016 Open Data Meetup Bristol

16http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Katrina Navickas (2015) Political Meetings Mapper

http://politicalmeetingsmapper.co.ukLabs Symposium 2015 (33 mins)

https://goo.gl/Qq78Oa

Interview 2015 (4 mins)https://goo.gl/BSA3be

The Chartist Newspaperhttp://goo.gl/vOLSnH

Chartist Monster Meeting

Page 17: British Library Labs Roadshow 2016 Open Data Meetup Bristol

17http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Chartists Un-CoveredHistory in London

Chartist’s London Walking Tour 21 Sep 15

The Red Lion Pub, SohoChartists Re-enactment

Chartist’s Meeting Locations in London

Chartist’s Meetings Heatmap in London

Page 18: British Library Labs Roadshow 2016 Open Data Meetup Bristol

18http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Chartists Re-enactment London

https://goo.gl/BSA3be

Page 19: British Library Labs Roadshow 2016 Open Data Meetup Bristol

19http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Victorian Meme Machine (2014)Competition Winner

https://www.youtube.com/watch?v=zK95lzaPNp0Bob Nicholson

http://victorianhumour.tumblr.com/

Page 20: British Library Labs Roadshow 2016 Open Data Meetup Bristol

20http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://victorianhumour.tubmblr.com

Page 21: British Library Labs Roadshow 2016 Open Data Meetup Bristol

21http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Rob WalkerVictorian Mother-in-law Jokes

https://www.youtube.com/watch?v=-GRgj7Q5OM0

Bob Nicholson interviewed on Radio 4 Making History Programmehttp://www.bbc.co.uk/programmes/b07378d1

Page 22: British Library Labs Roadshow 2016 Open Data Meetup Bristol

22http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Awards

Page 23: British Library Labs Roadshow 2016 Open Data Meetup Bristol

23http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Commercial (2015)Etsy project by Dina Malkova

https://www.etsy.com/shop/DinaMalkova

Labs Symposium 2015https://goo.gl/OfJujM

Read more: http://goo.gl/pbxZUv

Page 24: British Library Labs Roadshow 2016 Open Data Meetup Bristol

24http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Commercial (2015) Runner UpSarah Wingate-Gray and Kate Lomax

http://goo.gl/s1dVSC

Page 25: British Library Labs Roadshow 2016 Open Data Meetup Bristol

25http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://www.lancaster.ac.uk/fass/projects/spatialhum.wordpress/

Labs Symposium 2015: https://goo.gl/ZCU56a

Research (2015)Spatial Humanities: Lancaster University

Combining Text and Geographic Informationhttp://goo.gl/yZ3xCJ

Investigating geographical representation of disease in digitised 19th Century newspapers

Page 26: British Library Labs Roadshow 2016 Open Data Meetup Bristol

26http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Projects and Ideas

Page 27: British Library Labs Roadshow 2016 Open Data Meetup Bristol

27http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Creative with Wildlife Sounds

http://goo.gl/s7siv0

Sound Edit Wildlife Films Competition 2013 http://vimeo.com/60401313

'Dave's Wild Life' by Samuel de Ceccatty, won first prize!

http://sounds.bl.uk/Environment

Page 28: British Library Labs Roadshow 2016 Open Data Meetup Bristol

28http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Dave’s Wildlife

Page 29: British Library Labs Roadshow 2016 Open Data Meetup Bristol

29http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

2016 Competition Announcedhttp://gamecity.org/off-the-map

2015 - http://gamecity.org/alices-adventures-off-the-map-winners-announced/

Page 30: British Library Labs Roadshow 2016 Open Data Meetup Bristol

30http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Sound fileshttps://soundcloud.com/the-british-library/sets/shakespeare-off-the-map

Closing dateMonday 6th June 2016

2016 Off The Map Sub-themes

Page 31: British Library Labs Roadshow 2016 Open Data Meetup Bristol

31http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

What can 65,000books tell us?

Image: Artwork by Alicia Martin

Just one digital collection

Page 32: British Library Labs Roadshow 2016 Open Data Meetup Bristol

32http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Snipping out imagesfrom 65,000 Digitised Books

Face recognition

Mechanical Curator

Flickr

Worked better for female faces than men’s

Press

http://mechanicalcurator.tumblr.com>400,000,000 views

> 500,000 tags

http://www.flickr.com/photos/britishlibrary/

1,020,418 imagesneed tagging!

Creative uses of imageshttp://goo.gl/qPPgxX

Page 33: British Library Labs Roadshow 2016 Open Data Meetup Bristol

33http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Tagging a million imagesIterative Crowdsourcing

http://goo.gl/j6fxac

Cardiff University’sLost Visions Project

http://www.metadatagames.org/

James Heald

Mario Klingemann

Chico 45

Use computational methods

Human Tagger

Top British Library Flickr Commons Taggers

Page 34: British Library Labs Roadshow 2016 Open Data Meetup Bristol

34http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Curious Images Event 2014https://goo.gl/ubL0AO

Labs Symposium 2015https://goo.gl/gRZ5Ia

44 Men who Look 44(Notice the direction faces)

Tragic Looking Women

Collage Art

Artistic (2015)Mario Klingeman - Quasimondo

Read more: http://goo.gl/dM8ieAA Hat on the GroundSpells trouble

Page 35: British Library Labs Roadshow 2016 Open Data Meetup Bristol

35http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Interview David Normal

https://youtu.be/Q3SBxO34Zlc

‘It was beyond my wildest dreams’

Page 36: British Library Labs Roadshow 2016 Open Data Meetup Bristol

36http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Finding one image on Flickr

Finding many more!Make collagesMake 4 paintingsExhibit light boxes at Burning Man 2014

In Nevada USA

Work with Labs & British Library to installLight boxes in London

In 2015

Page 37: British Library Labs Roadshow 2016 Open Data Meetup Bristol

37http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Page 38: British Library Labs Roadshow 2016 Open Data Meetup Bristol

38http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Let’s have a party!

Music mix by DJ Yoda using British Library Sounds

Exhibited from June to Nov 2015

20th June 2015

https://soundcloud.com/bbc6music/dj-yodas-library-jamInstallation in Poet’s Circle in Piazza outside at BL in St Pancras London

Images from Burning Man and Flickr brought into the Poet’s Circle

Page 39: British Library Labs Roadshow 2016 Open Data Meetup Bristol

39http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

- https://goo.gl/QilqqT By Kestrel Moon

Animating static images

Page 40: British Library Labs Roadshow 2016 Open Data Meetup Bristol

40http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

- https://goo.gl/QilqqT By Kestrel Moon

Animating static images

Page 41: British Library Labs Roadshow 2016 Open Data Meetup Bristol

41http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Adam Crymble (2015)Crowdsource Arcade

What if crowd sourcing

looked like this?

http://goo.gl/LBfJ4W

Game Jam - http://goo.gl/OH9pOZ30 mins talkLabs Symposium (2015)https://goo.gl/7z0j8p

5 min interview (2015)https://goo.gl/SSRsdd

http://goo.gl/0APpE8

Page 42: British Library Labs Roadshow 2016 Open Data Meetup Bristol

42http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Art Treachery – Januz Druz Tag Attack – Antonio Padial

Art Treachery and Tag Attack

https://www.youtube.com/watch?v=xoCgHo2rwN4

Page 43: British Library Labs Roadshow 2016 Open Data Meetup Bristol

43http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Special Jury’s Prize (2015)James Heald – Wikimedia and Map work

https://goo.gl/WYZCB2

http://goo.gl/HNQq5e

https://goo.gl/VPgffL

https://commons.wikimedia.org/

Labs Symposium (2015)https://goo.gl/djtm1b

Page 44: British Library Labs Roadshow 2016 Open Data Meetup Bristol

44http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Challenges

Page 45: British Library Labs Roadshow 2016 Open Data Meetup Bristol

45http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Starting a ConversationLanguage Problems

•Finding the intersection…

•Misunderstood words–Access–Collections–Content–Crowdsourcing

Page 46: British Library Labs Roadshow 2016 Open Data Meetup Bristol

46http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Data Problems [stuff goes in here]

•Metadata isn’t as clean as many

•Square brackets to indicate inferred information

•Code to plot when a record had square brackets by Ben O’Steen

Page 47: British Library Labs Roadshow 2016 Open Data Meetup Bristol

47http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Page 48: British Library Labs Roadshow 2016 Open Data Meetup Bristol

48http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Optical Character Recognition

Page 49: British Library Labs Roadshow 2016 Open Data Meetup Bristol

49http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Simple Data Structures

•Everything has a URL

•URL links to page which tells you about the thing

•Link to other things

•URL readable by machine not just a human

•Not there yet!

Page 50: British Library Labs Roadshow 2016 Open Data Meetup Bristol

50http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Training / Teaming up with Expert?• Many researchers have the domain knowledge but lack the technical skills to use Digital Research Methods

• Should our support be more focused on training?

• There are plenty of computational experts looking for problems to solve

• Should they be teamed up with those that have problems that need solving

Page 51: British Library Labs Roadshow 2016 Open Data Meetup Bristol

51http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

only in Reading

Rooms due to ©

only on site due to

©

not online – various storage devices

online and open

British Library

online behind paywall

Digital access at the Library

Labs Residency Modelhttps://goo.gl/tvNVRB

http://goo.gl/ii0XHG

Page 52: British Library Labs Roadshow 2016 Open Data Meetup Bristol

52http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Ideas change once you try to examine, access and use

the data!

Page 53: British Library Labs Roadshow 2016 Open Data Meetup Bristol

53http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Why is the Library doing this?

Page 54: British Library Labs Roadshow 2016 Open Data Meetup Bristol

54http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

SupportingDigital Experiments better

BL Labs Git Hub Site Re-OCRing Newspapers Flickr API

BL Explore – Search Catalogue Python Code

Page 55: British Library Labs Roadshow 2016 Open Data Meetup Bristol

55http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Lessons…•Huge appetite to use BL digital content & data (e.g. Flickr Commons stats).

•Identifying / bridging gaps for researchers to use BL data.

•Labs can help researchers navigate through the Library to get the data they want.

Page 56: British Library Labs Roadshow 2016 Open Data Meetup Bristol

56http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Perfection vs Imperfection

•If we focus too much on perfection we will never get anything done!

•Fear of failure seen as a negative thing.

•Just don’t be scared to try experiments!

Page 57: British Library Labs Roadshow 2016 Open Data Meetup Bristol

57http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Jimmy Wales, Founder of Wikipedia

Fail fasterSmall experiments!

https://goo.gl/Vlv3Yu Let yourself reboot!

Page 58: British Library Labs Roadshow 2016 Open Data Meetup Bristol

58http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Finally…

•Try and examine, use our data and talk to us about your ideas and projects!

•Consider entering the Competition and Awards!

•You never know you might….

Page 59: British Library Labs Roadshow 2016 Open Data Meetup Bristol

59http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Change the world with …British Library digital content

Page 60: British Library Labs Roadshow 2016 Open Data Meetup Bristol

60http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Accessing the Mini NASMini Network Area Storage Device (NAS) guide:

http://goo.gl/E8aRyQ

Find the ‘opendata’ wireless access point and join it. The password is ‘opendata’Accessing data foldersUsername:guestPassword:guest

Or use ftp://10.0.0.1/

Page 61: British Library Labs Roadshow 2016 Open Data Meetup Bristol

61http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Page 62: British Library Labs Roadshow 2016 Open Data Meetup Bristol

62http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

What’s on the Mini NAS?• British National Bibliography – 3.5 million records (2 Gb), in RDF XML, other

formats on request

• 90,000 Playbills – 1602 – 1902 (60 Gb), pdfs, OCR XML

• ALTO XML (includes METS and MODS) for OCR of 65,000 volumes, 22 million pages mostly from the 19th Century (909 Gb)

• 1 million images snipped from books put on Flickr (667 Gb), 70,000 tagged images (170 Gb)

• 9,000 digitised book bindings

• 130 digitised maps

• 55,000 music metadata records

• 430,00 PhD abstracts, 170,000 with text

Page 63: British Library Labs Roadshow 2016 Open Data Meetup Bristol

63http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

It’s messy but fascinating!

Page 64: British Library Labs Roadshow 2016 Open Data Meetup Bristol

64http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

Goody bag!

Page 65: British Library Labs Roadshow 2016 Open Data Meetup Bristol

65http://labs.bl.uk @BL_Labs #bldigital [email protected] http://goo.gl/I3tBRu

http://goo.gl/I3tBRu