2013 US Federal Project Open Data
2009 Data.gov
2009 Data.gov.uk
Facili&es
2012 Local Laws....
Facili&es
Resulting in New Open Data Portals
Open	
  Data:	
  Government	
  Opera/ons	
  Innova/on
Facili&es
Open	
  Data:	
  Civic	
  Empowerment
Facili&es
Open	
  Data:	
  Economic	
  Development	
  
Facili&es
(Shout-­‐Out:	
  Portland	
  CivicApps	
  <-­‐-­‐>	
  CitySync)
2013 Civic Open Data Ecosystem:
100s of Companies, 1000s of Governments,
10,000s of Apps, 1,000,000s of Data Sets...
Proprietary SaaS Open Data Portal
Market Leaders
Open Source Market Leader
In 2012 CKAN Broke Out...
CKAN In the US
CKAN Worldwide
• No vendor lock-In / choice of consultants / ability to build in-
house capacity
• Collaborate w/ our peers (White House)
• Security transparency (US DoD is a major consumer for this
reason)
• Open-Source platforms often pay more heed to open formats
and standards (e.g.: DCAT, RDFa, OData, JSON vs Shapefiles, PDF,
etc.)
• Innovation: healthy open-source projects can aggregate more
engineering effort than proprietary alternatives, propagate great
new extensions faster
• Freedom of Hosting Options: consume as a cloud-hosted
service today, change our mind and host in-house tomorrow, etc.
Why Open-Source Matters...
http://flickr.com/photos/rocketqueen/1573565705/
But	
  Data.gov.uk,	
  Data.gov,	
  HealthData.gov,	
  	
  OpenGovPlaGorm,	
  
etc.	
  all	
  added	
  Drupal	
  to	
  CKAN
If	
  you	
  Already	
  Use	
  Drupal,	
  Do	
  You	
  Really	
  Need	
  CKAN?
With	
  DKAN	
  Distro,	
  Drupal	
  Itself	
  Now	
  Also	
  Becoming	
  a	
  Public	
  
Sector	
  Data	
  Management	
  System	
  (“DMS”)
•	
  MATURE:	
  >1	
  million	
  sites	
  (2%	
  of	
  
all	
  sites),	
  3,718	
  Code	
  commits/wk,	
  
6,388	
  issue	
  comments/wk
	
  
•	
  IN-­‐HOUSE	
  SKILLS:	
  24%	
  of	
  .gov	
  
sites
•	
  EXTENSIBLE:	
  	
  18,489	
  Modules,	
  
1,512	
  Themes,	
  21,009	
  
Contributors
•	
  FISMA-­‐CerZfied	
  Cloud	
  HosZng	
  
OpZons
•	
  INTEGRATES	
  easily	
  w/	
  public	
  
websites	
  lots	
  of	
  de	
  facto	
  data	
  is	
  
already	
  published	
  as	
  content
Why Drupal?
Why Drupal? Open Content since 2009...
21
WhiteHouse.gov
NYSenate.gov
h_p://flickr.com/photos/rocketqueen/1573565705/
Content = Data (Legislative Committees)
Open Data Sets Catalog
Custom Search for Special Data Types
http://flickr.com/photos/rocketqueen/1573565705/
Allow Data to be Augmented
Make it Easily Discoverable...
28
And Accessible Everywhere...
http://flickr.com/photos/rocketqueen/1573565705/
...And Easily Shared
Drupal	
  “DKAN”	
  Distribu&on
Open-­‐Source	
  Data	
  Management	
  System	
  (DMS)	
  
+	
  Content	
  Management	
  System	
  (CMS)	
  
=	
  Streamlined	
  Data	
  Collabora&on
Open Data is Just “Sharing Your Files”
• Datasets	
  are	
  collecZons	
  of	
  resources,	
  with	
  some	
  
descripZve	
  metadata
• Resources	
  are	
  just	
  files.	
  They	
  can	
  be	
  any	
  kind	
  of	
  
file,	
  but	
  ocen	
  they	
  are	
  CSV	
  files,	
  spreadsheets	
  or	
  
some	
  other	
  kind	
  of	
  tabular	
  data	
  file.
• OrganizaZons	
  create	
  datasets	
  and	
  upload	
  
resources.
• Data	
  consumers	
  can	
  browse	
  datasets	
  and	
  
someZmes	
  see	
  visualiza0ons	
  of	
  resources.
31
DKAN
•	
  Fully functional data portal housing datasets, Solr search, accessible
via JSON and RDF; csv or xml files uploaded through Drupal, stored in
*SQL, visualized through Recline.js
• Seeks	
  to	
  replicate	
  CKAN	
  2.0	
  funcZonality,	
  design,	
  standards,	
  &	
  API
• Reuses CKAN components wherever possible (e.g.: Recline.js)
• Built with support and input from the Open Knowledge Foundation
• Fully open project, with code on Drupal.org/project/DKAN
• DKAN	
  DistribuZon
DKAN Dataset
module
DKAN Datastore
module
DKAN Components
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
Early Returns: CivicInfo British Columbia
Early Returns: Data Wisconsin
Early Returns: Puerto Rico
•	
  Adding	
  feedback	
  on	
  
datasets,	
  other	
  social	
  
features
•	
  Support	
  for	
  addiZonal	
  
file	
  types
•	
  Adding	
  DKAN_DataSet	
  
&	
  DKAN_DataStore	
  
modules	
  to	
  other	
  Distros	
  
•Refactoring	
  
DKAN_DataStore	
  to	
  align	
  
with	
  new	
  US	
  Project	
  
Open	
  Data,	
  new	
  
OpenData	
  module
•Offering	
  enterprise	
  
support	
  &	
  hosted	
  SaaS	
  
DKAN
Ongoing Development
Recipes
add /data.html &
/data.json pages
to existing Drupal
site with new Open
Data Module?
(sandbox project)
add data management
&
publishing features
to a Drupal site with
DKAN Data Set &
DKAN Data Store
Modules
deploy new Open
Data Catalog / Portal
with the DKAN
Distribution
Followup
andrew@nuams.com	
  |	
  @ahoppin	
  |	
  nuams.com
aaron@nuams.com	
  |	
  h_ps://drupal.org/user/151868
h_p://drupal.org/project/DKAN
(Contribute!!!)

DKAN Drupal Distribution Presentation at Drupal Gov Days 2013