Your SlideShare is downloading. ×
  • Like

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Municipal Government Meets NoSQL

  • 305 views
Published

This talk will describe the development and implementation of WindyGrid, an online geographic information system, that presents a unified view of City of Chicago operations to improve agency …

This talk will describe the development and implementation of WindyGrid, an online geographic information system, that presents a unified view of City of Chicago operations to improve agency coordination, incident monitoring and response, and to identify trends. In lieu of reviewing numerous and disparate reports, WindyGrid gives key personnel access to 911 and 311 service calls, asset locations, building information, tweets, and other critical information in one place. To enable this, data from siloed City source systems are regularly ETLed into MongoDB. The City’s implementation of MongoDB has been architected to support multiple shards along with three tiers to allow for expanding query access and redundancy.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
305
On SlideShare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
8
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Municipal Government meets NoSQL Ryan Briones IT Director - Software Architecture and Design Department of Innovation and Technology City of ChicagoTuesday, November 13, 12
  • 2. This is my boss Brett Goldstein Chief Data Officer Commissioner, DoIT (CIO)Tuesday, November 13, 12
  • 3. This is my boss Brett Goldstein Chief Data Officer Commissioner, DoIT (CIO) Data JunkieTuesday, November 13, 12
  • 4. Crazy Ideas My Job RealityTuesday, November 13, 12
  • 5. Tuesday, November 13, 12
  • 6. 2010Tuesday, November 13, 12
  • 7. 2011Tuesday, November 13, 12
  • 8. 2011Tuesday, November 13, 12
  • 9. 2011 How do we tell the story about a place?Tuesday, November 13, 12
  • 10. How do we tell the story about a place? 911 CPS CTA CFD 311Tuesday, November 13, 12
  • 11. 2012Tuesday, November 13, 12
  • 12. 2012 How can we use realtime data to make better decisions?Tuesday, November 13, 12
  • 13. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  • 14. Tuesday, November 13, 12
  • 15. Spatial / TemporalTuesday, November 13, 12
  • 16. Spatial / TemporalTuesday, November 13, 12
  • 17. Tuesday, November 13, 12
  • 18. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  • 19. Tuesday, November 13, 12
  • 20. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  • 21. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  • 22. { pos: [41.884267623865384, -87.62977480888367] } /* ... */ db.windygrid.ensureIndex({pos: “2d”}) /* ... */ db.windygrid.find({ $within: { $box: [ [41.88227, -87.63208] [41.88499, -87.62838] ] }})Tuesday, November 13, 12
  • 23. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  • 24. 69GB data Router 200K objs Primary Shard 1 Primary Shard 2 Primary Shard 3 C Secondary Shard 1 Secondary Shard 2 Secondary Shard 3 C Secondary Shard 1 Secondary Shard 2 Secondary Shard 3 CTuesday, November 13, 12
  • 25. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  • 26. { type: “311”, shardkey: “2a08c28b3ca3bb65bd...” where: { location: [-180,180], ... }, when: { shardtime: 0, ... }, what: { ... }, who: { ... } }Tuesday, November 13, 12
  • 27. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  • 28. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  • 29. Tuesday, November 13, 12
  • 30. Tuesday, November 13, 12
  • 31. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  • 32. Tuesday, November 13, 12
  • 33. Challenges $within/$box safe scalingTuesday, November 13, 12
  • 34. The FuturePredictive AnalyticsNatural-language ProcessingMachine LearningDistributed ComputingVisualizationsTuesday, November 13, 12
  • 35. github.com/Chicago github.com/ryanbriones @ChicagoCDO @ryanbriones Ryan Briones IT Director - Software Architecture and Design Department of Innovation and Technology City of ChicagoTuesday, November 13, 12