A lot happened in the US Because of this...
2
Drupal for National OpenGov...
New	
  Open-­‐Source	
  Drupal	
  CMS
h5p://flickr.com/photos/rocketqueen/1573565705/
Sites	
  for	
  Every	
  Commi5ee	
  (Structured	
  Data)
Open	
  Data	
  (all	
  $	
  spent)
LegislaPon	
  as	
  Easy	
  As	
  Google..
“[NY	
  Senate]	
  is	
  taking	
  a	
  criPcally	
  important	
  step	
  to	
  help	
  restore	
  trust	
  in	
  government.	
  
At	
  a	
  Pme	
  when	
  confidence	
  in	
  government	
  in	
  general	
  has	
  hit	
  bo5om,	
  this	
  is	
  an	
  
extraordinarily	
  valuable	
  step	
  forward”	
  -­‐	
  Lawrence	
  Lessig,	
  Harvard	
  Law
“..clearly	
  se]ng	
  the	
  place	
  that	
  all	
  other	
  legislaPve	
  bodies	
  will	
  have	
  to	
  follow.	
  The	
  U.S.	
  
Congress	
  ought	
  to	
  be	
  taking	
  some	
  clue”	
  -­‐Ellen	
  Miller,	
  ExecuPve	
  Director,	
  The	
  Sunlight	
  
FoundaPon.
“..demonstrates	
  the	
  New	
  York	
  State	
  Senate’s	
  commitment	
  to	
  a	
  transparent	
  and	
  
accessible	
  government”	
  -­‐	
  Dave	
  McClure,	
  U.S.	
  GSA	
  Associate	
  Administrator
“With	
  this	
  new	
  system,	
  New	
  York	
  State	
  takes	
  a	
  leadership	
  role	
  in	
  accountability	
  and	
  
transparency”	
  -­‐	
  Craig	
  Newmark,	
  founder,	
  Craigslist.org	
  &	
  Craigslist	
  FoundaPon.
“[We]	
  applaud	
  the	
  State	
  Senate	
  for	
  its	
  efforts	
  to	
  further	
  open	
  the	
  legislaPve	
  process,”	
  
Barbara	
  Bartole],	
  LegislaPve	
  Director,	
  League	
  of	
  Women	
  Voters.
Winner	
  of	
  three	
  “Best	
  of	
  New	
  York”	
  Awards
NY	
  State	
  CIO	
  of	
  the	
  Year
Named	
  to	
  InnovaPon	
  Week	
  Top	
  40	
  US	
  CIOs
Results:	
  Transparency,	
  Yes...
• No technical skill required to
manage content
• Content managed as
mashable data
• Modernize Antiquated
Systems, Terminate
Expensive Software
Licenses
• Open-source platforms &
developer tools, &
collaborative development
• Government-certified
Commercial Cloud hosting
• Net saving $1MM off ~
$8MM budget
But	
  Also	
  More	
  Efficient...
“DistribuPons”	
  are	
  Making	
  Drupal	
  the	
  “Default”	
  CMS	
  for	
  
Governments	
  Worldwide
Drupal	
  “DKAN”	
  DistribuPon
Open-­‐Source	
  Data	
  Management	
  System	
  (DMS)	
  
+	
  Content	
  Management	
  System	
  (CMS)	
  
=	
  Streamlined	
  Data	
  CollaboraPon
The	
  Proprietary	
  SaaS	
  CompePPon...
CKAN	
  Open-­‐Source	
  Market	
  Leader	
  in	
  Europe...
In	
  2012	
  CKAN	
  Broke	
  Out...	
  
Not	
  Just	
  for	
  	
  Europe	
  Anymore...
• No vendor lock-In / choice of consultants / ability to build in-
house capacity
• Collaborate w/ our peers (White House)
• Security transparency (US DoD is a major consumer for this
reason)
• Open-Source platforms often pay more heed to open formats
and standards (e.g.: DCAT, RDFa, OData, JSON vs Shapefiles, PDF,
etc.)
• Innovation: healthy open-source projects can aggregate more
engineering effort than proprietary alternatives, propagate great
new extensions faster
• Freedom of Hosting Options: consume as a cloud-hosted
service today, change our mind and host in-house tomorrow, etc.
Why	
  Does	
  Open-­‐Source	
  Ma5er?
CKAN	
  Worldwide
http://flickr.com/photos/rocketqueen/1573565705/
But	
  Data.gov.uk,	
  Data.gov,	
  HealthData.gov,	
  	
  OpenGovPlaqorm,	
  
etc.	
  all	
  add	
  Drupal	
  to	
  CKAN
And	
  many	
  local	
  gov’ts	
  sPll	
  roll	
  their	
  own...
Drupal	
  Itself	
  Now	
  Also	
  Becoming	
  a	
  Public	
  Sector	
  Data	
  
Management	
  System	
  (“DMS”)
•	
  MATURE:	
  >1	
  million	
  sites	
  (2%	
  of	
  
all	
  sites),	
  3,718	
  Code	
  commits/wk,	
  
6,388	
  issue	
  comments/wk
	
  
•	
  IN-­‐HOUSE	
  SKILLS:	
  24%	
  of	
  .gov	
  
sites
•	
  EXTENSIBLE:	
  	
  18,489	
  Modules,	
  
1,512	
  Themes,	
  21,009	
  
Contributors
•	
  FISMA-­‐CerPfied	
  Cloud	
  HosPng	
  
OpPons
•	
  INTEGRATES	
  easily	
  w/	
  public	
  
websites	
  lots	
  of	
  de	
  facto	
  data	
  is	
  
already	
  published	
  as	
  content
Why Drupal?
Open Data is Just “Sharing Your Files”
• Datasets	
  are	
  collecPons	
  of	
  resources,	
  with	
  some	
  
descripPve	
  metadata
• Resources	
  are	
  just	
  files.	
  They	
  can	
  be	
  any	
  kind	
  of	
  
file,	
  but	
  oxen	
  they	
  are	
  CSV	
  files,	
  spreadsheets	
  or	
  
some	
  other	
  kind	
  of	
  tabular	
  data	
  file.
• OrganizaPons	
  create	
  datasets	
  and	
  upload	
  
resources.
• Data	
  consumers	
  can	
  browse	
  datasets	
  and	
  
somePmes	
  see	
  visualiza0ons	
  of	
  resources.
20
DKAN
•	
  Fully functional data portal housing datasets, Solr search, accessible
via JSON and RDF; csv or xml files uploaded through Drupal, stored in
*SQL, visualized through Recline.js
• Seeks	
  to	
  replicate	
  CKAN	
  2.0	
  funcPonality,	
  design,	
  standards,	
  &	
  API
• Reuses CKAN components wherever possible (e.g.: Recline.js)
• Built with support and input from the Open Knowledge Foundation
• Fully open project, with code on Drupal.org/project/DKAN
• DKAN	
  DistribuPon
DKAN Dataset
module
DKAN Datastore
module
DKAN Components
DKAN Demo
DKAN Demo
DKAN Demo
DKAN Demo
DKAN Demo
DKAN Demo
DKAN Demo
DKAN Demo
Early Returns: CivicInfo British Columbia
Early Returns: Data Wisconsin
Early Returns: Puerto Rico
•	
  Adding	
  feedback	
  on	
  
datasets
•	
  Adding	
  support	
  for	
  
data.json
•	
  Adding	
  DKAN	
  modules	
  
to	
  OpenCivic	
  Distro
Ongoing Development
•	
  18th	
  most	
  “applauded”	
  of	
  
824	
  entries	
  in	
  Knight	
  News	
  
Challenge	
  for	
  Open	
  
Government	
  
•	
  Partnered	
  with	
  Open	
  
Knowledge	
  FoundaPon
•	
  Upcoming	
  deployments	
  by	
  
Revenue	
  Watch	
  InsPtute,	
  
Puerto	
  Rico,	
  City	
  of	
  Cologne,	
  
etc.
•	
  UNDP,	
  Open	
  Gov	
  Partnership,	
  
World	
  Bank	
  ICT,	
  Code	
  for	
  
America	
  key	
  validators
•Low-­‐cost	
  OpenSaaS?
Next
Andrew	
  Hoppin	
  
andrew@nuams.com	
  |	
  @ahoppin	
  |	
  nuams.com

Drupal DKAN CapitalCamp 2013 Presentation

  • 1.
    A lot happenedin the US Because of this...
  • 2.
  • 3.
  • 4.
  • 5.
    Open  Data  (all  $  spent)
  • 6.
    LegislaPon  as  Easy  As  Google..
  • 7.
    “[NY  Senate]  is  taking  a  criPcally  important  step  to  help  restore  trust  in  government.   At  a  Pme  when  confidence  in  government  in  general  has  hit  bo5om,  this  is  an   extraordinarily  valuable  step  forward”  -­‐  Lawrence  Lessig,  Harvard  Law “..clearly  se]ng  the  place  that  all  other  legislaPve  bodies  will  have  to  follow.  The  U.S.   Congress  ought  to  be  taking  some  clue”  -­‐Ellen  Miller,  ExecuPve  Director,  The  Sunlight   FoundaPon. “..demonstrates  the  New  York  State  Senate’s  commitment  to  a  transparent  and   accessible  government”  -­‐  Dave  McClure,  U.S.  GSA  Associate  Administrator “With  this  new  system,  New  York  State  takes  a  leadership  role  in  accountability  and   transparency”  -­‐  Craig  Newmark,  founder,  Craigslist.org  &  Craigslist  FoundaPon. “[We]  applaud  the  State  Senate  for  its  efforts  to  further  open  the  legislaPve  process,”   Barbara  Bartole],  LegislaPve  Director,  League  of  Women  Voters. Winner  of  three  “Best  of  New  York”  Awards NY  State  CIO  of  the  Year Named  to  InnovaPon  Week  Top  40  US  CIOs Results:  Transparency,  Yes...
  • 8.
    • No technicalskill required to manage content • Content managed as mashable data • Modernize Antiquated Systems, Terminate Expensive Software Licenses • Open-source platforms & developer tools, & collaborative development • Government-certified Commercial Cloud hosting • Net saving $1MM off ~ $8MM budget But  Also  More  Efficient...
  • 9.
    “DistribuPons”  are  Making  Drupal  the  “Default”  CMS  for   Governments  Worldwide
  • 10.
    Drupal  “DKAN”  DistribuPon Open-­‐Source  Data  Management  System  (DMS)   +  Content  Management  System  (CMS)   =  Streamlined  Data  CollaboraPon
  • 11.
  • 12.
    CKAN  Open-­‐Source  Market  Leader  in  Europe...
  • 13.
    In  2012  CKAN  Broke  Out...   Not  Just  for    Europe  Anymore...
  • 14.
    • No vendorlock-In / choice of consultants / ability to build in- house capacity • Collaborate w/ our peers (White House) • Security transparency (US DoD is a major consumer for this reason) • Open-Source platforms often pay more heed to open formats and standards (e.g.: DCAT, RDFa, OData, JSON vs Shapefiles, PDF, etc.) • Innovation: healthy open-source projects can aggregate more engineering effort than proprietary alternatives, propagate great new extensions faster • Freedom of Hosting Options: consume as a cloud-hosted service today, change our mind and host in-house tomorrow, etc. Why  Does  Open-­‐Source  Ma5er?
  • 15.
  • 16.
    http://flickr.com/photos/rocketqueen/1573565705/ But  Data.gov.uk,  Data.gov,  HealthData.gov,    OpenGovPlaqorm,   etc.  all  add  Drupal  to  CKAN
  • 17.
    And  many  local  gov’ts  sPll  roll  their  own...
  • 18.
    Drupal  Itself  Now  Also  Becoming  a  Public  Sector  Data   Management  System  (“DMS”)
  • 19.
    •  MATURE:  >1  million  sites  (2%  of   all  sites),  3,718  Code  commits/wk,   6,388  issue  comments/wk   •  IN-­‐HOUSE  SKILLS:  24%  of  .gov   sites •  EXTENSIBLE:    18,489  Modules,   1,512  Themes,  21,009   Contributors •  FISMA-­‐CerPfied  Cloud  HosPng   OpPons •  INTEGRATES  easily  w/  public   websites  lots  of  de  facto  data  is   already  published  as  content Why Drupal?
  • 20.
    Open Data isJust “Sharing Your Files” • Datasets  are  collecPons  of  resources,  with  some   descripPve  metadata • Resources  are  just  files.  They  can  be  any  kind  of   file,  but  oxen  they  are  CSV  files,  spreadsheets  or   some  other  kind  of  tabular  data  file. • OrganizaPons  create  datasets  and  upload   resources. • Data  consumers  can  browse  datasets  and   somePmes  see  visualiza0ons  of  resources. 20
  • 21.
    DKAN •  Fully functionaldata portal housing datasets, Solr search, accessible via JSON and RDF; csv or xml files uploaded through Drupal, stored in *SQL, visualized through Recline.js • Seeks  to  replicate  CKAN  2.0  funcPonality,  design,  standards,  &  API • Reuses CKAN components wherever possible (e.g.: Recline.js) • Built with support and input from the Open Knowledge Foundation • Fully open project, with code on Drupal.org/project/DKAN
  • 22.
    • DKAN  DistribuPon DKANDataset module DKAN Datastore module DKAN Components
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
    Early Returns: CivicInfoBritish Columbia
  • 32.
  • 33.
  • 34.
    •  Adding  feedback  on   datasets •  Adding  support  for   data.json •  Adding  DKAN  modules   to  OpenCivic  Distro Ongoing Development
  • 35.
    •  18th  most  “applauded”  of   824  entries  in  Knight  News   Challenge  for  Open   Government   •  Partnered  with  Open   Knowledge  FoundaPon •  Upcoming  deployments  by   Revenue  Watch  InsPtute,   Puerto  Rico,  City  of  Cologne,   etc. •  UNDP,  Open  Gov  Partnership,   World  Bank  ICT,  Code  for   America  key  validators •Low-­‐cost  OpenSaaS? Next
  • 36.
    Andrew  Hoppin   andrew@nuams.com  |  @ahoppin  |  nuams.com