DKAN: The Drupal Open Data Distribution (presented at SANDCamp San Diego Drupalcamp)

2013 US Federal Project Open Data

2009 Data.gov

2009 Data.gov.uk

Facili&es

2012 Local Laws....

Facili&es

Resulting in New Open Data Portals

Open  Data:  Government  Opera/ons  Innova/on

Facili/es

Open  Data:  Civic  Empowerment

Facili/es

Open  Data:  Economic  Development  

Facili/es

(Shout-­‐Out:  Portland  CivicApps  <-­‐-­‐>  CitySync)

2013 Civic Open Data Ecosystem: 100s of Companies, 1000s of Governments, 10,000s of Apps, 1,000,000s of Data Sets...

San Diego is Next!

Proprietary SaaS Open Data Portal Market Leaders

CKAN: Open Source Market Leader

More About CKAN

Python

Javascript

ORM: Pylons web framework & SQLAlchemy

PostgrSQL

Jinja2 Template Engine

SOLR

Modular; ~40 extensions

In 2012 CKAN Broke Out...

CKAN In the US

CKAN Worldwide

• No vendor lock-In / choice of consultants / ability to build in-house capacity • Collaborate w/ our peers (White House)

• Security transparency (US DoD is a major consumer for this reason)

• Open-Source platforms often pay more heed to open formats and standards (e.g.: DCAT, RDFa, OData, JSON vs Shapefiles, PDF, etc.)

• Innovation: healthy open-source projects can aggregate more engineering effort than proprietary alternatives, propagate great new extensions faster

• Freedom of Hosting Options: consume as a cloud-hosted service today, change our mind and host in-house tomorrow, etc.

Why Open-Source Matters...

http://flickr.com/photos/rocketqueen/1573565705/

But  Data.gov.uk,  Data.gov,  HealthData.gov,    OpenGovPlaKorm,  etc.  all  added  Drupal  to  CKAN

If  you  Already  Use  Drupal,  Do  You  Really  Need  CKAN?

With  DKAN  Distro,  Drupal  Itself  Now  Also  Becoming  a  Public  Sector  Data  Management  System  (“DMS”)

• Manage content, data, permissions through same platform

• Single software stack to maintain

• Single site to design & theme

• Easy to extend with social features

• Transparent, well-governed upgrade path of Drupal • Extensive Drupal ecosystem of civil service talent, consultants, hosting, support

Why DKAN Instead of Drupal+CKAN?

•  MATURE:  >1  million  sites  (2%  of  all  sites),  3,718  Code  commits/wk,  6,388  issue  comments/wk  •  IN-­‐HOUSE  SKILLS:  24%  of  .gov  sites

•  EXTENSIBLE:    18,489  Modules,  1,512  Themes,  21,009  Contributors

•  FISMA-­‐Cer&fied  Cloud  Hos&ng  Op&ons

•  INTEGRATES  easily  w/  public  websites  lots  of  de  facto  data  is  already  published  as  content

Why Drupal?

Why Drupal? Open Content since 2009...

24

WhiteHouse.gov

NYSenate.gov

h_p://flickr.com/photos/rocketqueen/1573565705/

Content = Data (Legislative Committees)

Open Data Sets Catalog

Custom Search for Special Data Types

http://flickr.com/photos/rocketqueen/1573565705/

Allow Data to be Augmented

Make it Easily Discoverable...

31

And Accessible Everywhere...

http://flickr.com/photos/rocketqueen/1573565705/

...And Easily Shared

Drupal  “DKAN”  Distribu&onOpen-­‐Source  Data  Management  System  (DMS)  

+  Content  Management  System  (CMS)  =  Streamlined  Data  Collabora&on

Open Data is Just “Sharing Your Files”

• Datasets  are  collec&ons  of  resources,  with  some  descrip&ve  metadata

• Resources  are  just  files.  They  can  be  any  kind  of  file,  but  ohen  they  are  CSV  files,  spreadsheets  or  some  other  kind  of  tabular  data  file.

• Organiza&ons  create  datasets  and  upload  resources.

• Data  consumers  can  browse  datasets  and  some&mes  see  visualiza0ons  of  resources.

34

DKAN•  Fully functional data portal housing datasets, Solr search, accessible via JSON and RDF; csv or xml files uploaded through Drupal, stored in *SQL, visualized through Recline.js

• Seeks to replicate CKAN 2.0 functionality, design, standards, & API

• Reuses CKAN components wherever possible (e.g.: Recline.js)

• Built with support and input from the Open Knowledge Foundation

• Fully open project, with code on Drupal.org/project/DKAN

• DKAN  Distribu&on

DKAN Datasetmodule

DKAN Datastoremodule

DKAN Components

DKAN Walkthrough

DKAN Walkthrough

DKAN Walkthrough

DKAN Walkthrough

DKAN Walkthrough

DKAN Walkthrough

DKAN Walkthrough

DKAN Walkthrough

Early Returns: Cologne, Germany

Early Returns: Puerto Rico

Early Returns: CivicInfo British Columbia

Early Returns: Data Wisconsin

•  Adding  feedback  on  datasets,  other  social  features

•  Support  for  addi&onal  file  types

•  Adding  DKAN_DataSet  &  DKAN_DataStore  modules  to  other  Distros  like  OpenCivic  

•Offering  enterprise  support  &  hosted  OpenSaaS  DKAN

Ongoing Development

•  NuData  =  our  DKAN  as  a  turnkey  hosted  24/7  supported  sohware-­‐as-­‐a-­‐service

•  Governments  like  SaaS  like  Socrata  because  it’s  quick,  affordable,  and  no  technology  burden  on  exis&ng  staff

•  Governments  like  open-­‐source  (e.g.:  CKAN)  because  they’re  in  control-­‐-­‐  no  vendor  lock-­‐in,  ability  to  customize,  innovate

•  OpenSaaS  =  the  best  of  both  worlds;  SaaS  but  truly  open-­‐-­‐    you  can  take  your  app  and  your  data  with  you  with  minimal  switching  cost

•  Drupal  is  excep&onally  well  posi&oned  to  enable  OpenSaaS  businesses

“NuData DKAN” OpenSaaS Offering

Drupal Open Data Policy Compliance Recipesadd /data.html & /data.json pages

to existing Drupal site with new Open

Data Module? (sandbox project)

add data management &

publishing features to a Drupal site with

DKAN Data Set & DKAN Data Store

Modules

deploy new Open Data Catalog / Portal

with the DKAN Distribution, on your

own, or as SaaS

Followup

Project Page: http://drupal.org/project/DKAN

“Fully Made” DKAN w/ .js libraries: https://github.com/nuams/dkan

Marketing Site: http://nucivic.com/dkan/

[email protected] | @ahoppin | nuams.com | nucivic.com