Future of data

709 views
623 views

Published on

The Future of Data : Making connections so your users don’t have to.

Presented Feb 2013 at Hack+Startup.

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
709
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide
  • In the past (current) all we did was present data in shiny digestible formats (google analytics)
  • As tools matured they allowed us to do this faster (chartbeat) but the result is the same. 
  • http://www.smartchicagocollaborative.org/projects/windy-grid/How can we use realtime data to make better decisions?
  • 911, 311, asset locations (sidewalks, parks, parking, bike storage, etc), building information, tweets and more.
  • Future of data

    1. 1. The Future of Data In 10 minutes
    2. 2. Google 2000Google Inc
Today announced it hasreleased the largest search engine on theInternet. 

Google’s new index, comprisingmore than 1 billion URLs
    3. 3. Google 2008Our indexing system for processing linksindicates that we now count 1 trillion uniqueURLs 

(and the number of individual webpages out there is growing by several billionpages per day).
    4. 4. Data Growth 1,0001000750 500500 250250 120 55 4 10 24 1 0 2000 2001 2002 2003 2004 2005 2006 2007 2008
    5. 5. What are we doing with all this data?
    6. 6. A brief history of data incomplete and mostly inaccurate
    7. 7. Relational databases became a crutch
    8. 8. Memcache, a scooter
    9. 9. Limited by our tools…
    10. 10. Shiny Raw Data
    11. 11. Around 2007The crutches began to snap – Social graph emergence – Substantial data growth – Flexible & rich data structures needed – Open source tools emerged – No longer just Google & Amazon
    12. 12. MongoDB, Hadoop, etc.An empowering exoskeleton
    13. 13. Products built with these new data tools largelyresembled earlier products
    14. 14. The crutch was gone but we acted like it was still there
    15. 15. The data tools today are vastly more powerful Tools built to make sense of our data
    16. 16. Your data is telling you things Are you listening?
    17. 17. We need to do more than reportWe need products that…informeducatereveal
    18. 18. Google analyticsWhat if it provided actual intelligence, like…Steve,Your website currently has higher than usual traffic.Most of the visitors are coming from a blog post onLifehacker which links to your Vim page. Theres quite aconversation happening there so you may want toparticipate. Additionally the conversation seems to havespilled over onto Twitter.
    19. 19. Google analyticsOf the people that go to MongoDB.org: 4% visited DataStax20% visited Amazon Web Services10% searched for cloud hosting…
    20. 20. Its about making connections … so your users don’t have to
    21. 21. City of Chicago
    22. 22. Goals• Bring all the data all in one place• Make it available in realtime• Find relationships in the data
    23. 23. Modern tools like Redis Hadoop MongoDB Storm / SparkR / Ruby / Python / Go empower you
    24. 24. What are you going to do with your data?
    25. 25. Questions @spf13 spf13.com MongoDB.org

    ×