Open Data: a view from the trenches

Open Dataa view from the trenches

[email protected]

Tim Waters

Tim Waters

Tim Waters

DataOpen Raw

Linked Big

JournalismGovernment

Open Data

Open Definition

Open Definition .org

–Open DefinitionOpen Knowledge

“Open data can be freely used, modified, and shared by anyone for any purpose”

Data that is Open

https://data.cityofchicago.org/

http://maps.met.police.uk/

http://data.police.uk

Open Data promotes Transparency

Open Data is good PR

http://dadesobertes.gencat.cat/

http://opendata.bcn.cat/

http://www.diariocordoba.com/noticias/cordobalocal/nace-plataforma-open-data-cordoba-para-buscar-empleo-o-crear-empresas_625578.html

http://www.opendatacordoba.com/

Open Data should promote Accountability

http://civio.es/

http://DondeVanMisImpuestos.es/

http://www.theguardian.com/news/datablog/2012/dec/04/government-spending-department-2011-12

Data Journalism

http://www.theguardian.com/data

Open Government

Data + Participation

Raw Data

–Every public administration ever

“We’ll release the data once we’ve made sure

that it is of sufficient quality.”

Just give us the Data already

–Those same public administrations

“But it is Too Much Data”

Big Data

gartner.com

Linked Data

-Tim Berners-Lee The Next Web

TED 2009

“When you connect data together, you get power in a way that doesn't happen just with the web, with documents.”

Serendipity

Linking Open Data, 2007

Linking Open Data, 2001

Semantic Web

RDF

Resource Description Framework

Object !

!

Attribute = Value

ERD

Object Object

RDF

Subject ObjectPredicate

RDF

Subject ObjectPredicate

They are all URIs!

SPARQL

SPARQL Example

PREFIX dbo: <http://dbpedia.org/ontology/> !

SELECT ?name ?birth ?death ?person WHERE { ?person dbo:birthPlace :Barcelona . ?person dbo:birthDate ?birth . ?person foaf:name ?name . ?person dbo:deathDate ?death . FILTER (?birth < "1900-01-01"^^xsd:date) . } ORDER BY ?name

Go!

SPARQL ExamplePREFIX dbo: <http://dbpedia.org/ontology/> !

SELECT ?name ?birth ?description ?person WHERE { ?person dbo:birthPlace :Barcelona . ?person <http://purl.org/dc/terms/subject> <http://dbpedia.org/resource/Category:Spanish_composers> . ?person dbo:birthDate ?birth . ?person foaf:name ?name . ?person rdfs:comment ?description . FILTER (LANG(?description) = 'en') . } ORDER BY ?name

Go!

Get Yer Open Data

Private Sector

• Google Public Data Explorer http://www.google.com/publicdata/

• Amazon Web Services Public Data Sets http://aws.amazon.com/datasets

• Socrata http://opendata.socrata.com/

http://www.google.com/publicdata/

https://aws.amazon.com/datasets

Public Sector

• http://data.gov

• http://data.gov.uk

• http://datos.gob.es/

• http://opendata.euskadi.net

• http://dadesobertes.gencat.cat

• http://w20.bcn.cat/opendata

http://datos.gob.es/sites/default/files/infomeopendatasmartcities.pdf

Do It Yourself

Evan Amos

https://morph.io

State of the Data

http://www.opendataresearch.org/barometer

Dave Tarrant / Open Data Institute https://theodi.github.io/open-data-barometer-viz/

http://CatalunyaDades.cat/

http://AbreDatos.es/

Use the Data, Luke

Challenges

More Data

Better Data

Relevant Data

Fresh Data

Known-Good Formats, s'il vous plaît

Privacy

Licences

Where to now?

Open your Data

http://OpenDataHandbook.org/

–Open Data Handbook Documentation, Release 1.0.0Page 1

“This handbook discusses the legal, social and technical aspects of open data. It can be used by anyone but is

especially designed for those seeking to open up data. It discusses the why, what and how of open data – why to

go open, what open is, and the how to ‘open’ data.”

http://catalunyadades.cat/?iniciatives_agenda=guia-de-dades-obertes-per-administracions-locals

Link your Data

Thank you

@codehead [email protected]