Free	
  Data	
  Isn’t	
  
the	
  Same	
  as	
  
Freeing	
  Data	
  
September,	
  2013	
  
Mark	
  Madsen	
  
www.ThirdNat...
Copyright	
  Third	
  Nature,	
  Inc.	
  
	
  A	
  Quick	
  Intro	
  
One	
  of	
  my	
  past	
  jobs…	
  
In	
  some	
  w...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Some	
  of	
  the	
  secrets	
  in	
  this	
  session	
  
Open	
  data	
  does	
...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Some	
  open	
  data	
  examples	
  
These	
  projects	
  fall	
  into	
  a	
  f...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
When	
  you	
  first	
  give	
  people	
  access	
  to	
  informa@on	
  
that	
  ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
ADer	
  a	
  while	
  the	
  response	
  is	
  more	
  measured	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Publicdata.eu	
  
Sample	
  app	
  showing	
  staNsNcal	
  data.	
  AKracNve,	
 ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Open	
  data	
  app	
  <>	
  “make	
  data	
  preKy”	
  
There’s	
  more	
  to	
...
Copyright	
  Third	
  Nature,	
  Inc.	
  
What’s wrong with the
City of Oakland
CrimeWatch web site?
Figuring out what to ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Oakland	
  CrimespoNng:	
  Let	
  Your	
  Data	
  Go	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
A	
  Standard	
  Municipal	
  Web	
  Site	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Honolulu	
  Answers	
  
Data that you think is worthless may be useful
Copyright	
  Third	
  Nature,	
  Inc.	
  
Figh@ng	
  Fraud	
  and	
  Corrup@on	
  in	
  Educa@on	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
MassachuseKs	
  Bay	
  Transit	
  Authority	
  (MBTA)	
  
Actionable, immediate
Copyright	
  Third	
  Nature,	
  Inc.	
  
MBTA:	
  Why	
  not	
  sell	
  the	
  data?	
  
Does	
  the	
  government	
  kno...
Crisis	
  Commons	
  Oil	
  Reporter	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Street	
  Bump	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Value	
  from	
  open	
  data:	
  
Private	
  is	
  a	
  cost	
  
Available	
  i...
Copyright	
  Third	
  Nature,	
  Inc.	
  
The	
  benefits	
  of	
  open	
  data	
  fit	
  into	
  a	
  few	
  categories:	
 ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Open	
  data	
  doesn’t	
  mean	
  “data	
  you	
  don’t	
  have	
  to	
  pay	
 ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Data	
  isn’t	
  really	
  “exhaust”	
  
The	
  data	
  exhaust	
  assumpNon	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Open	
  data	
  means	
  “free	
  data”	
  in	
  a	
  different	
  way	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Delivering	
  data	
  consistently	
  isn’t	
  always	
  simple	
  
Most	
  IT	
...
Copyright	
  Third	
  Nature,	
  Inc.	
  
Who	
  bears	
  the	
  cost?	
  	
  
	
   	
  Supplier 	
  Producer 	
  Consumer...
Copyright	
  Third	
  Nature,	
  Inc.	
  
The	
  Economics	
  of	
  Scarcity	
  is	
  About	
  Rivalry	
  for	
  Resources...
Copyright	
  Third	
  Nature,	
  Inc.	
  
The	
  Economics	
  of	
  Networked	
  Data	
  Require	
  New	
  Principles	
  	...
Copyright	
  Third	
  Nature,	
  Inc.	
  
An@-­‐rivalry	
  +	
  Inclusivity	
  =	
  Collabora@on	
  &	
  Co-­‐crea@on	
  
Copyright	
  Third	
  Nature,	
  Inc.	
  
Which	
  would	
  you	
  rather	
  have?	
  
Open	
  data	
  can	
  make	
  the	...
Copyright	
  Third	
  Nature,	
  Inc.	
  
For	
  most	
  public	
  data,	
  public	
  domain	
  
Open	
  data	
  licensing...
Copyright	
  Third	
  Nature,	
  Inc.	
  
How	
  do	
  you	
  get	
  a	
  fancy	
  open	
  data	
  app?	
  
	
  You	
  bui...
Copyright	
  Third	
  Nature,	
  Inc.	
  
How	
  do	
  we	
  get	
  a	
  fancy	
  open	
  data	
  app?	
  
You	
  hire	
  ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
How	
  do	
  we	
  get	
  a	
  fancy	
  open	
  data	
  app?	
  
You	
  open	
  ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
The	
  government’s	
  job	
  isn’t	
  to	
  be	
  a	
  for-­‐profit	
  business....
Copyright	
  Third	
  Nature,	
  Inc.	
  
Some	
  references	
  
Sharing	
  data	
  on	
  the	
  open	
  web	
  -­‐	
  	
 ...
Copyright	
  Third	
  Nature,	
  Inc.	
  
CC	
  Image	
  AKribu@ons	
  
Thanks	
  to	
  the	
  people	
  who	
  supplied	
...
Upcoming SlideShare
Loading in …5
×

Free Data Isn't the Same as Freeing Data - Mark Madsen - Third nature, USA

411 views
317 views

Published on

27.09.2013

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
411
On SlideShare
0
From Embeds
0
Number of Embeds
98
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Free Data Isn't the Same as Freeing Data - Mark Madsen - Third nature, USA

  1. 1. Free  Data  Isn’t   the  Same  as   Freeing  Data   September,  2013   Mark  Madsen   www.ThirdNature.net   @markmadsen  
  2. 2. Copyright  Third  Nature,  Inc.    A  Quick  Intro   One  of  my  past  jobs…   In  some  ways  it  was   similar  to  how  people   view  open  data:  get   free  puppies  and  sell   grown  dogs.   But  selling  data  like  a   data  syndicator  is  a  bad   model  for  public  data.  
  3. 3. Copyright  Third  Nature,  Inc.   Some  of  the  secrets  in  this  session   Open  data  does   not  always  mean   free  data.   Open  data  =  beKer   government     When  you  open   data  you  unlock   value  in  the   market  that  is   more  important   than  gaining   revenue  directly.  
  4. 4. Copyright  Third  Nature,  Inc.   Some  open  data  examples   These  projects  fall  into  a  few  different  types:   ▪ Make  data  available   ▪ Make  data  pre*y   ▪ Make  data  ac-onable  
  5. 5. Copyright  Third  Nature,  Inc.  
  6. 6. Copyright  Third  Nature,  Inc.   When  you  first  give  people  access  to  informa@on   that  was  unavailable…   OH GOD I can see into forever
  7. 7. Copyright  Third  Nature,  Inc.   ADer  a  while  the  response  is  more  measured  
  8. 8. Copyright  Third  Nature,  Inc.   Publicdata.eu   Sample  app  showing  staNsNcal  data.  AKracNve,  but  how  useful?  
  9. 9. Copyright  Third  Nature,  Inc.   Open  data  app  <>  “make  data  preKy”   There’s  more  to  data   than  simply  showing   numbers.   e.g.  many  “data +map”  applicaNons   If  your  data  looks  like   the  populaNon,  you   haven’t  found  the   relevant  parts  yet.  
  10. 10. Copyright  Third  Nature,  Inc.   What’s wrong with the City of Oakland CrimeWatch web site? Figuring out what to do Doing it once you figure out how Many problems with: Navigation Control Display Exceptions City  of  Oakland  Crimewatch     And the reported price was over a quarter of a million dollars for the city, plus annual maintenance.
  11. 11. Copyright  Third  Nature,  Inc.   Oakland  CrimespoNng:  Let  Your  Data  Go  
  12. 12. Copyright  Third  Nature,  Inc.   A  Standard  Municipal  Web  Site  
  13. 13. Copyright  Third  Nature,  Inc.   Honolulu  Answers   Data that you think is worthless may be useful
  14. 14. Copyright  Third  Nature,  Inc.   Figh@ng  Fraud  and  Corrup@on  in  Educa@on  
  15. 15. Copyright  Third  Nature,  Inc.   MassachuseKs  Bay  Transit  Authority  (MBTA)   Actionable, immediate
  16. 16. Copyright  Third  Nature,  Inc.   MBTA:  Why  not  sell  the  data?   Does  the  government  know  how  to  be  in  the  business  of   selling  data?  What  data  is  valuable  and  what  isn’t?  How   to  price  it?  How  to  negoNate  the  contracts?   PrivaNzing  data  is  almost  always  bad:   ▪  Translink  in  Vancouver  sold  their  transit  data  to  Google.  Now   they  have  no  transit  applicaNons  and  can’t  make  any.   ▪  Admin  Office  of  the  US  Courts,  spent  $30M  to  get  digital   access  to  its  own  records,  that  it  sold  for  less   ▪  Same  office  paying  $156M  to  publish  the  same  material  online   ▪  The  US  GAO  and  Thomson  West  legislaNve  history,  similar  tale   ▪  Amazon  and  the  US  naNonal  archives  videos,  similar  tale   ▪  WestLaw  and  LexisNexis  make  ~$2B  annually  from  this  data  
  17. 17. Crisis  Commons  Oil  Reporter  
  18. 18. Copyright  Third  Nature,  Inc.   Street  Bump  
  19. 19. Copyright  Third  Nature,  Inc.   Value  from  open  data:   Private  is  a  cost   Available  is  good   Relevant  is  beKer   AcNonable  is  best  
  20. 20. Copyright  Third  Nature,  Inc.   The  benefits  of  open  data  fit  into  a  few  categories:   Tangible,  direct:   ▪  Save  money  –  less  work,  lowered  cost  of  service   ▪  Make  money  –  direct  revenue  (unlikely)   Intangible,  indirect:   ▪  Improved  services   ▪  Civil  /  Social   ▪  Indirect  revenue  and  benefits  through  market  growth   or  market  efficiencies    
  21. 21. Copyright  Third  Nature,  Inc.   Open  data  doesn’t  mean  “data  you  don’t  have  to  pay  for”  
  22. 22. Copyright  Third  Nature,  Inc.   Data  isn’t  really  “exhaust”   The  data  exhaust  assumpNon  
  23. 23. Copyright  Third  Nature,  Inc.   Open  data  means  “free  data”  in  a  different  way  
  24. 24. Copyright  Third  Nature,  Inc.   Delivering  data  consistently  isn’t  always  simple   Most  IT  organizaNons  have  the  skills  and  tools  to  extract   and  publish  data.   Most  do  not  have  the  skills  and  tools  to  create  applicaNons   on  the  data.   Anthony David Giordano
  25. 25. Copyright  Third  Nature,  Inc.   Who  bears  the  cost?        Supplier  Producer  Consumer   The  cost  quesNon  is  a  red  herring:  different  parNes  benefit   based  on  their  parNcipaNon,  and  costs  vary  by  party.  
  26. 26. Copyright  Third  Nature,  Inc.   The  Economics  of  Scarcity  is  About  Rivalry  for  Resources   Rivalry:  the  more  I  use  the   less  you  have.  Data  is  not  a   finite  resource.   Exclusion:  intellectual   property  law  is  exclusion;   you  can’t  use  it  unless  you   pay  me  first  
  27. 27. Copyright  Third  Nature,  Inc.   The  Economics  of  Networked  Data  Require  New  Principles     An@-­‐rivalry:  there  is  no   consumpNon,  only  use.  Open   licensing  is  a  way  of  addressing   the  change  in  this  dynamic.   Inclusivity:  the  network  effects  of   inclusion  mean  more  use  =  more   value;  and  as  cost  goes  down,   usage  and  value  go  up.   Open  data  value  is  driven  by  network  effects  
  28. 28. Copyright  Third  Nature,  Inc.   An@-­‐rivalry  +  Inclusivity  =  Collabora@on  &  Co-­‐crea@on  
  29. 29. Copyright  Third  Nature,  Inc.   Which  would  you  rather  have?   Open  data  can  make  the  pie  larger,  parNcularly  for   markets  with  many  parNcipants,  like  regional  tourism.   The  ra@onale  for  sharing  and  collabora@ng:   open  data  is  not  a  zero-­‐sum  game  
  30. 30. Copyright  Third  Nature,  Inc.   For  most  public  data,  public  domain   Open  data  licensing  creates  a  network  resource   rather  than  an  arNficially  limited  resource.   With  completely  open  licensing,  there  is  the   possibility  for  many  people  to  explore  and   innovate,  more  quickly,  resulNng  in  more  chances   to  find  the  value  in  data.  
  31. 31. Copyright  Third  Nature,  Inc.   How  do  you  get  a  fancy  open  data  app?    You  build  it  yourself.   ▪  Aler  training  or  hiring   the  staff  and  acquiring   the  technology  to  do  it   repeatably  and  at  scale.  
  32. 32. Copyright  Third  Nature,  Inc.   How  do  we  get  a  fancy  open  data  app?   You  hire  a  vendor  to   build  it  for  you.   ▪  Oakland  showed  how   well  that  usually  works.   ▪  If  you  don’t  have  the   skills  to  do  something,   you  may  not  have  the   skills  to  evaluate  the   vendor  doing  it  either.  
  33. 33. Copyright  Third  Nature,  Inc.   How  do  we  get  a  fancy  open  data  app?   You  open  the  data  and   someone  else  writes  it  for   you.  And  then  someone   else  builds  a  beKer  one.  
  34. 34. Copyright  Third  Nature,  Inc.   The  government’s  job  isn’t  to  be  a  for-­‐profit  business.  It’s  to   maintain  the  infrastructure  of  a  society.  Open  data  can  make   government  more  effecNve,  creaNng  a  public  good.  
  35. 35. Copyright  Third  Nature,  Inc.   Some  references   Sharing  data  on  the  open  web  -­‐    hKps://bmark.us/bmark/ readable/88ce9a65bebc38   ExtracNng,  Linking  and  IntegraNng  Data  from  Public  Sources:  A   Financial  Case  Study,  IEEE  Data  Engineering,  September,  2011     Business  Models  for  PSI  Re-­‐Use:  A  MulNdimensional  Framework,   Enrico  Ferro,  Michele  Osella,  IsNtuto  Superiore  Mario  Boella,  Via   Boggio,  61  –  10138  Torino,  Italy   OpendefiniNon.org  
  36. 36. Copyright  Third  Nature,  Inc.   CC  Image  AKribu@ons   Thanks  to  the  people  who  supplied  the  creaNve  commons  licensed  images  used  in  this  presentaNon:   dog_peek_fence_bw.jpg  -­‐  hKp://www.flickr.com/photos/roome/3031410585/   shady_puppy_sales.jpg  -­‐  hKp://www.flickr.com/photos/brizzlebornandbred/5001120150   child_whisper.jpg  -­‐  hKp://www.flickr.com/photos/cannonball_jane/120325556/   XKCD  Heatmap  -­‐  hKp://xkcd.com/1138/   school  small  world  bank    hKp://www.flickr.com/photos/worldbank/2765585037/sizes/o/   beer_free_beer2.jpg  -­‐  hKp://flickr.com/photos/fzero/173386050   laptop  face.jpg  -­‐  hKp://flickr.com/photos/sd/7746599/   child_alone.jpg  -­‐  hKp://flickr.com/photos/beija-­‐flor/129669668/   children  playing.jpg  -­‐  hKp://www.flickr.com/photos/beija-­‐flor/52292046/  

×