Municipal Government meets NoSQL Ryan Briones IT Director - Software Architecture and Design Department of Innovation and ...
This is my boss  Brett Goldstein  Chief Data Officer  Commissioner, DoIT (CIO)Tuesday, November 13, 12
This is my boss  Brett Goldstein  Chief Data Officer  Commissioner, DoIT (CIO)  Data JunkieTuesday, November 13, 12
Crazy Ideas                    My Job              RealityTuesday, November 13, 12
Tuesday, November 13, 12
2010Tuesday, November 13, 12
2011Tuesday, November 13, 12
2011Tuesday, November 13, 12
2011                  How do we tell the story                         about a place?Tuesday, November 13, 12
How do we tell the story                         about a place?                           911   CPS   CTA   CFD   311Tuesd...
2012Tuesday, November 13, 12
2012    How can we use realtime data         to make better decisions?Tuesday, November 13, 12
Bring all the data all in one place                    Make it available in realtime                    Find relationships...
Tuesday, November 13, 12
Spatial / TemporalTuesday, November 13, 12
Spatial / TemporalTuesday, November 13, 12
Tuesday, November 13, 12
Works well with geospatial data                   Grow elastically                   Loose schemaTuesday, November 13, 12
Tuesday, November 13, 12
Works well with geospatial data                   Grow elastically                   Loose schemaTuesday, November 13, 12
Works well with geospatial data                   Grow elastically                   Loose schemaTuesday, November 13, 12
{          pos: [41.884267623865384,                -87.62977480888367]      }      /* ... */      db.windygrid.ensureInde...
Works well with geospatial data                   Grow elastically                   Loose schemaTuesday, November 13, 12
69GB data                           Router      200K objs               Primary Shard 1        Primary Shard 2         Pri...
Works well with geospatial data                   Grow elastically                   Loose schemaTuesday, November 13, 12
{             type: “311”,             shardkey: “2a08c28b3ca3bb65bd...”             where: { location: [-180,180], ... },...
Bring all the data all in one place                    Make it available in realtime                    Find relationships...
Bring all the data all in one place                    Make it available in realtime                    Find relationships...
Tuesday, November 13, 12
Tuesday, November 13, 12
Bring all the data all in one place                    Make it available in realtime                    Find relationships...
Tuesday, November 13, 12
Challenges                           $within/$box                           safe scalingTuesday, November 13, 12
The FuturePredictive AnalyticsNatural-language ProcessingMachine LearningDistributed ComputingVisualizationsTuesday, Novem...
github.com/Chicago   github.com/ryanbriones   @ChicagoCDO   @ryanbriones    Ryan Briones    IT Director - Software    Arch...
Upcoming SlideShare
Loading in...5
×

Municipal Government Meets NoSQL

362

Published on

This talk will describe the development and implementation of WindyGrid, an online geographic information system, that presents a unified view of City of Chicago operations to improve agency coordination, incident monitoring and response, and to identify trends. In lieu of reviewing numerous and disparate reports, WindyGrid gives key personnel access to 911 and 311 service calls, asset locations, building information, tweets, and other critical information in one place. To enable this, data from siloed City source systems are regularly ETLed into MongoDB. The City’s implementation of MongoDB has been architected to support multiple shards along with three tiers to allow for expanding query access and redundancy.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
362
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Municipal Government Meets NoSQL

  1. 1. Municipal Government meets NoSQL Ryan Briones IT Director - Software Architecture and Design Department of Innovation and Technology City of ChicagoTuesday, November 13, 12
  2. 2. This is my boss Brett Goldstein Chief Data Officer Commissioner, DoIT (CIO)Tuesday, November 13, 12
  3. 3. This is my boss Brett Goldstein Chief Data Officer Commissioner, DoIT (CIO) Data JunkieTuesday, November 13, 12
  4. 4. Crazy Ideas My Job RealityTuesday, November 13, 12
  5. 5. Tuesday, November 13, 12
  6. 6. 2010Tuesday, November 13, 12
  7. 7. 2011Tuesday, November 13, 12
  8. 8. 2011Tuesday, November 13, 12
  9. 9. 2011 How do we tell the story about a place?Tuesday, November 13, 12
  10. 10. How do we tell the story about a place? 911 CPS CTA CFD 311Tuesday, November 13, 12
  11. 11. 2012Tuesday, November 13, 12
  12. 12. 2012 How can we use realtime data to make better decisions?Tuesday, November 13, 12
  13. 13. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  14. 14. Tuesday, November 13, 12
  15. 15. Spatial / TemporalTuesday, November 13, 12
  16. 16. Spatial / TemporalTuesday, November 13, 12
  17. 17. Tuesday, November 13, 12
  18. 18. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  19. 19. Tuesday, November 13, 12
  20. 20. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  21. 21. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  22. 22. { pos: [41.884267623865384, -87.62977480888367] } /* ... */ db.windygrid.ensureIndex({pos: “2d”}) /* ... */ db.windygrid.find({ $within: { $box: [ [41.88227, -87.63208] [41.88499, -87.62838] ] }})Tuesday, November 13, 12
  23. 23. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  24. 24. 69GB data Router 200K objs Primary Shard 1 Primary Shard 2 Primary Shard 3 C Secondary Shard 1 Secondary Shard 2 Secondary Shard 3 C Secondary Shard 1 Secondary Shard 2 Secondary Shard 3 CTuesday, November 13, 12
  25. 25. Works well with geospatial data Grow elastically Loose schemaTuesday, November 13, 12
  26. 26. { type: “311”, shardkey: “2a08c28b3ca3bb65bd...” where: { location: [-180,180], ... }, when: { shardtime: 0, ... }, what: { ... }, who: { ... } }Tuesday, November 13, 12
  27. 27. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  28. 28. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  29. 29. Tuesday, November 13, 12
  30. 30. Tuesday, November 13, 12
  31. 31. Bring all the data all in one place Make it available in realtime Find relationships in the dataTuesday, November 13, 12
  32. 32. Tuesday, November 13, 12
  33. 33. Challenges $within/$box safe scalingTuesday, November 13, 12
  34. 34. The FuturePredictive AnalyticsNatural-language ProcessingMachine LearningDistributed ComputingVisualizationsTuesday, November 13, 12
  35. 35. github.com/Chicago github.com/ryanbriones @ChicagoCDO @ryanbriones Ryan Briones IT Director - Software Architecture and Design Department of Innovation and Technology City of ChicagoTuesday, November 13, 12
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×