IOGDC - McKeel presentation on mashups and OpenEI


Published on

Intro to mashups as prelude to open gov data conference talk on mashups and "using data".

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

IOGDC - McKeel presentation on mashups and OpenEI

  1. 1. Mashups Ryan McKeel, Digital Assets Applications Engineer, Twitter: @openenergyinfo @rmckeel
  2. 2. What is a mashup? a mashup uses and combines data, presentation or functionality from two or more sources to create new services combination, visualization and aggregation implies easy, fast integration, frequently using open APIs enriched results that were often not the original intent behind the raw source data
  3. 3. A brief history of mashups
  4. 4. Mashup from 1854
  5. 5. 1869 multiple data sources, multiple axes
  6. 6. Mashup from 1945: Heads up displays 1945 British combat aircraft: Radar display projected onto the aircraft’s windscreen 2004 US Navy F-18 HUD
  7. 7. National Geographic 2009 compiled from global server records
  8. 8. Popular mashup
  9. 9. 438 data sources! now, free software
  10. 10. Effort to create a mashup 1854 1945 2009 2020 paper electronic web mobile
  11. 11. Future of mashups
  12. 12. Visual Programming Languages: DIY Mashups Max/MSP – musical random note generator
  13. 13. This visual source code allows a search of NYC apartments that are within n miles of a search item
  14. 14. Displayed are available NYC apartments that are within 1 mile of a hospital
  15. 15. 2005 heads up display Engineer test of DARPA COORDINATORs work 2010 LAYAR on mobile phones a “mobile mashup”
  16. 16. 17 lines of custom code
  17. 17. What’s speeding adoption? Standard data formats Open licensing Reusable software Simply powerful GIS tools Community growth and collaboration
  18. 18. Linked Data 2007 Open Distribution
  19. 19. Linked Data 2008 Open Distribution
  20. 20. Linked Data 2009 Open Distribution
  21. 21. Linked Data 2010
  22. 22. What’s holding us back? Intellectual property rights Security Data quality Data is hard to find Data is challenging to integrate
  23. 23. Which attitudes hold us back? Managers “If we don’t share, we can differentiate ourselves” “We’re too busy to take two days off” “We don’t market our products. If it’s good, it will become known” Developers “This has to be perfect before I release it!” “The IT department won’t let me do much, I better stick with Excel macros” IT Department “God forbid we have custom code on one of our websites!” More concern over losing your job than not making progress
  24. 24. Jumping on the bandwagon
  25. 25. What can we do? Change "we made this all ourselves" to "we helped build something great” Managers, remove legal roadblocks Open licensing Provide a data dictionary Make tasty machine food (XML, RDF, RDFa…) Show developers how to get started with your data
  26. 26. How to host a mashathon Involve people who are enthusiastic and capable Small groups Planning wiki Cut red tape beforehand, then stand back as planner Have potential stories and data sources ready Quick build then fine-tune later Provide free food, snacks and caffeine Social and (if possible) financial incentives
  27. 27. Making a good mashup Follows the FIST philosophy: Fast Inexpensive Simple Tiny For more info on FIST philosophy, search the Internet for “FIST Dan Ward”
  28. 28. Make the mashup quickly Quotes from Lt Col Dan Ward & RPL team: – Creative constraints foster creativity. Adding time and/or money generally does not improve outcomes. – Iteration drives learning, discovery and efficiency. – Complexity is a cost. – Simplicity scales. Complexity doesn’t.
  29. 29. Demo
  30. 30. Peered Production Centralized Production Open Distribution • Web-based submission process • Contributor-only write access • Open read access • Open commenting and rating • Scalable distributed storage • Semantic Wiki • Open write access • Open read access • Forms-based authoring • SPARQL Endpoint • Linked Open Data (RDF/HTTP) • Named Graphs for Segmentation
  31. 31. Crowdsourced Data Entry “EIA does not collect or publish data on electricity rates, or tariffs, for the sale or purchase of electricity, or on demand charges for electricity service, nor does EIA publish retail electricity rates or prices for peak or off-peak periods (sometimes referred to as time-of-use-rates). … EIA is not aware of a publicly available source for this information other than individual utilities.” EIA Electricity FAQ