SlideShare a Scribd company logo
1 of 23
OSM ERROR MANAGEMENT
SOTM Portland 2012
INTRODUCTION
• John Novak
• Principal Map Engineer, Telenav (8/12)

• Sr Software Engineer, MapQuest (10/10 – 7/12)
• Architect, Telenav (10/08 – 10/10)




                               10/19/2012   © 2012 Telenav, Proprietary and Confidential   2
TELENAV LOCATION




                   10/19/2012   © 2012 Telenav, Proprietary and Confidential   3
TELENAV LOCATION




                   10/19/2012   © 2012 Telenav, Proprietary and Confidential   4
TELENAV LOCATION




                   10/19/2012   © 2012 Telenav, Proprietary and Confidential   5
OVERVIEW
• OSM Data Quality
  –   Assessment
  –   Trending
  –   Improvement Strategy
  –   Lessons Learned
  –   Results




                             10/19/2012   © 2012 Telenav, Proprietary and Confidential   6
QUALITY ASSESSMENT
• Just how good is the data
   – Quality Checks
      •   External Tools (OSMI, Keepright,…)
      •   SQL Scripts
      •   Applications
      •   Multiple Data Sources
   – Example Error Classes
      •   Simple Connectivity
      •   Partial Way Overlaps
      •   Isolated Ways (just added to OSMI ROE as islands)
      •   Routing
      •   GeoCoding


                                          10/19/2012   © 2012 Telenav, Proprietary and Confidential   7
QUALITY TRENDING
• Given the existence of errors, how quickly are they
  being addressed ?
• How does OSM quality today compare with OSM
  quality pre-redaction ?
• How to prevent (or at least detect) significant quality
  regression
   – Vandalism, for example
   – Challenging




                                10/19/2012   © 2012 Telenav, Proprietary and Confidential   8
PRE/POST REDACTION LINKS




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   9
PRE/POST REDACTION LINKS




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   10
PRE/POST REDACTION CONNECTIVITY




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   11
PRE/POST REDACTION CONNECTIVITY




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   12
IMPROVEMENT STRATEGY
• Two Tracks
  – Technology (Top-Down)
  – Telenav Community (Bottom-Up)




                               10/19/2012   © 2012 Telenav, Proprietary and Confidential   13
TECH
• Technology (Top-Down)
  – Leverage map expertise and internal data for detection
  – Identify errors such as
       • Direction of Flow
       • Grade Separation
       • Turn Restrictions
  –   Using internally developed application suite
  –   Publish to OSM community
  –   Leverage existing tools (such as OSMI)
  –   Targeting 24 hour update cycle



                                     10/19/2012   © 2012 Telenav, Proprietary and Confidential   14
TELENAV COMMUNITY
• Telenav Community (Bottom-Up)
  –   Significant proportion of new editors
  –   Training
  –   Edit-a-thon Sessions
  –   Focus on “simple” errors first




                                     10/19/2012   © 2012 Telenav, Proprietary and Confidential   15
LESSONS LEARNED
• “Simple” errors can rapidly become not so simple
   –   Partial Way overlaps
   –   Multiple copies of ways (in some cases, a dozen)
   –   Navigable ways merged with boundaries and areas
   –   Allow error bypass

• Epic Tediousity
   –   The simple is also really boring
   –   Feedback on progress
   –   Bite-sized chunks
   –   Stats


                                          10/19/2012   © 2012 Telenav, Proprietary and Confidential   16
EXAMPLE
•   Simple connectivity fixes
•   Focus on county boundaries
•   About 2.5 months elapsed time
•   Approx 350 person hours




                               10/19/2012   © 2012 Telenav, Proprietary and Confidential   17
OSM US WAY CONNECTIVITY (OSMI 8/23/12)




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   18
OSM US WAY CONNECTIVITY (TNAV 10/12/12)




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   19
OSM US WAY CONNECTIVITY (TNAV 10/12/12)




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   20
MENLO PARK CA ADDRESS POINTS




                      10/19/2012   © 2012 Telenav, Proprietary and Confidential   21
CLOSING REMARKS
•   Generate error status updates as quickly as possible
•   Staleness blunts momentum (tighten the loop)
•   Guidance on what and where to apply effort
•   Provide alternatives
•   It does not take long to effect major improvements




                                 10/19/2012   © 2012 Telenav, Proprietary and Confidential   22
QUESTIONS




            10/19/2012   © 2012 Telenav, Proprietary and Confidential   23

More Related Content

Similar to Osm errors stom_us_2012

Ist africa2012 solution supporting building of global earth observation syste...
Ist africa2012 solution supporting building of global earth observation syste...Ist africa2012 solution supporting building of global earth observation syste...
Ist africa2012 solution supporting building of global earth observation syste...Karel Charvat
 
CMD2012 - Roxanna Zea - Tele2's view on the Industry
CMD2012 - Roxanna Zea - Tele2's view on the IndustryCMD2012 - Roxanna Zea - Tele2's view on the Industry
CMD2012 - Roxanna Zea - Tele2's view on the IndustryTele2
 
June 2012 _ OGC and ISO
June 2012 _ OGC and ISOJune 2012 _ OGC and ISO
June 2012 _ OGC and ISOSteven Ramage
 
STPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has ArrivedSTPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has ArrivedSOASTA
 
Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012
Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012
Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012GeoEnable Limited
 
Session 12 Tony Sandberg
Session 12 Tony SandbergSession 12 Tony Sandberg
Session 12 Tony Sandbergtonysand
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeSumant Tambe
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeReal-Time Innovations (RTI)
 
Emc powerdata
Emc   powerdataEmc   powerdata
Emc powerdataPowerData
 
Yo ho ho and a few billion pageviews of RUM
Yo ho ho and a few billion pageviews of RUMYo ho ho and a few billion pageviews of RUM
Yo ho ho and a few billion pageviews of RUMJosh Fraser
 
Design Frameworks for Analysis and Synthesis of Complex Systems
Design Frameworks for Analysis and Synthesis of Complex SystemsDesign Frameworks for Analysis and Synthesis of Complex Systems
Design Frameworks for Analysis and Synthesis of Complex Systemsdrjanroodt
 
PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment
PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment
PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment PROIDEA
 
The W3C and the web design ecosystem
The W3C and the web design ecosystemThe W3C and the web design ecosystem
The W3C and the web design ecosystemChris Mills
 
Virtual Worlds: A Future History
Virtual Worlds: A Future HistoryVirtual Worlds: A Future History
Virtual Worlds: A Future HistoryRobin Teigland
 
Get the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and Apps
Get the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and AppsGet the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and Apps
Get the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and AppsSL Corporation
 
Collaboro - EclipseCon Europe 2012, Modeling Symposium
Collaboro - EclipseCon Europe 2012, Modeling SymposiumCollaboro - EclipseCon Europe 2012, Modeling Symposium
Collaboro - EclipseCon Europe 2012, Modeling SymposiumHugo Bruneliere
 

Similar to Osm errors stom_us_2012 (20)

Ist africa2012 solution supporting building of global earth observation syste...
Ist africa2012 solution supporting building of global earth observation syste...Ist africa2012 solution supporting building of global earth observation syste...
Ist africa2012 solution supporting building of global earth observation syste...
 
CMD2012 - Roxanna Zea - Tele2's view on the Industry
CMD2012 - Roxanna Zea - Tele2's view on the IndustryCMD2012 - Roxanna Zea - Tele2's view on the Industry
CMD2012 - Roxanna Zea - Tele2's view on the Industry
 
June 2012 _ OGC and ISO
June 2012 _ OGC and ISOJune 2012 _ OGC and ISO
June 2012 _ OGC and ISO
 
STPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has ArrivedSTPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has Arrived
 
Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012
Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012
Towards Geo-Enablement - Location Matters Seminar 29 Mar 2012
 
Session 12 Tony Sandberg
Session 12 Tony SandbergSession 12 Tony Sandberg
Session 12 Tony Sandberg
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
 
Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
 
Emc powerdata
Emc   powerdataEmc   powerdata
Emc powerdata
 
Yo ho ho and a few billion pageviews of RUM
Yo ho ho and a few billion pageviews of RUMYo ho ho and a few billion pageviews of RUM
Yo ho ho and a few billion pageviews of RUM
 
Digital Switchover Experience in Canada and the U.S
Digital Switchover Experience in Canada and the U.SDigital Switchover Experience in Canada and the U.S
Digital Switchover Experience in Canada and the U.S
 
Design Frameworks for Analysis and Synthesis of Complex Systems
Design Frameworks for Analysis and Synthesis of Complex SystemsDesign Frameworks for Analysis and Synthesis of Complex Systems
Design Frameworks for Analysis and Synthesis of Complex Systems
 
PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment
PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment
PLNOG 9: Ron Broersma - Enterprise IPv6 Deployment
 
The W3C and the web design ecosystem
The W3C and the web design ecosystemThe W3C and the web design ecosystem
The W3C and the web design ecosystem
 
Cloud testing v1
Cloud testing v1Cloud testing v1
Cloud testing v1
 
Costi webinar 1
Costi webinar 1Costi webinar 1
Costi webinar 1
 
Costi webinar 1
Costi webinar 1Costi webinar 1
Costi webinar 1
 
Virtual Worlds: A Future History
Virtual Worlds: A Future HistoryVirtual Worlds: A Future History
Virtual Worlds: A Future History
 
Get the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and Apps
Get the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and AppsGet the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and Apps
Get the Big Picture! End-to-End Monitoring of Heterogeneous Middleware and Apps
 
Collaboro - EclipseCon Europe 2012, Modeling Symposium
Collaboro - EclipseCon Europe 2012, Modeling SymposiumCollaboro - EclipseCon Europe 2012, Modeling Symposium
Collaboro - EclipseCon Europe 2012, Modeling Symposium
 

Osm errors stom_us_2012

  • 2. INTRODUCTION • John Novak • Principal Map Engineer, Telenav (8/12) • Sr Software Engineer, MapQuest (10/10 – 7/12) • Architect, Telenav (10/08 – 10/10) 10/19/2012 © 2012 Telenav, Proprietary and Confidential 2
  • 3. TELENAV LOCATION 10/19/2012 © 2012 Telenav, Proprietary and Confidential 3
  • 4. TELENAV LOCATION 10/19/2012 © 2012 Telenav, Proprietary and Confidential 4
  • 5. TELENAV LOCATION 10/19/2012 © 2012 Telenav, Proprietary and Confidential 5
  • 6. OVERVIEW • OSM Data Quality – Assessment – Trending – Improvement Strategy – Lessons Learned – Results 10/19/2012 © 2012 Telenav, Proprietary and Confidential 6
  • 7. QUALITY ASSESSMENT • Just how good is the data – Quality Checks • External Tools (OSMI, Keepright,…) • SQL Scripts • Applications • Multiple Data Sources – Example Error Classes • Simple Connectivity • Partial Way Overlaps • Isolated Ways (just added to OSMI ROE as islands) • Routing • GeoCoding 10/19/2012 © 2012 Telenav, Proprietary and Confidential 7
  • 8. QUALITY TRENDING • Given the existence of errors, how quickly are they being addressed ? • How does OSM quality today compare with OSM quality pre-redaction ? • How to prevent (or at least detect) significant quality regression – Vandalism, for example – Challenging 10/19/2012 © 2012 Telenav, Proprietary and Confidential 8
  • 9. PRE/POST REDACTION LINKS 10/19/2012 © 2012 Telenav, Proprietary and Confidential 9
  • 10. PRE/POST REDACTION LINKS 10/19/2012 © 2012 Telenav, Proprietary and Confidential 10
  • 11. PRE/POST REDACTION CONNECTIVITY 10/19/2012 © 2012 Telenav, Proprietary and Confidential 11
  • 12. PRE/POST REDACTION CONNECTIVITY 10/19/2012 © 2012 Telenav, Proprietary and Confidential 12
  • 13. IMPROVEMENT STRATEGY • Two Tracks – Technology (Top-Down) – Telenav Community (Bottom-Up) 10/19/2012 © 2012 Telenav, Proprietary and Confidential 13
  • 14. TECH • Technology (Top-Down) – Leverage map expertise and internal data for detection – Identify errors such as • Direction of Flow • Grade Separation • Turn Restrictions – Using internally developed application suite – Publish to OSM community – Leverage existing tools (such as OSMI) – Targeting 24 hour update cycle 10/19/2012 © 2012 Telenav, Proprietary and Confidential 14
  • 15. TELENAV COMMUNITY • Telenav Community (Bottom-Up) – Significant proportion of new editors – Training – Edit-a-thon Sessions – Focus on “simple” errors first 10/19/2012 © 2012 Telenav, Proprietary and Confidential 15
  • 16. LESSONS LEARNED • “Simple” errors can rapidly become not so simple – Partial Way overlaps – Multiple copies of ways (in some cases, a dozen) – Navigable ways merged with boundaries and areas – Allow error bypass • Epic Tediousity – The simple is also really boring – Feedback on progress – Bite-sized chunks – Stats 10/19/2012 © 2012 Telenav, Proprietary and Confidential 16
  • 17. EXAMPLE • Simple connectivity fixes • Focus on county boundaries • About 2.5 months elapsed time • Approx 350 person hours 10/19/2012 © 2012 Telenav, Proprietary and Confidential 17
  • 18. OSM US WAY CONNECTIVITY (OSMI 8/23/12) 10/19/2012 © 2012 Telenav, Proprietary and Confidential 18
  • 19. OSM US WAY CONNECTIVITY (TNAV 10/12/12) 10/19/2012 © 2012 Telenav, Proprietary and Confidential 19
  • 20. OSM US WAY CONNECTIVITY (TNAV 10/12/12) 10/19/2012 © 2012 Telenav, Proprietary and Confidential 20
  • 21. MENLO PARK CA ADDRESS POINTS 10/19/2012 © 2012 Telenav, Proprietary and Confidential 21
  • 22. CLOSING REMARKS • Generate error status updates as quickly as possible • Staleness blunts momentum (tighten the loop) • Guidance on what and where to apply effort • Provide alternatives • It does not take long to effect major improvements 10/19/2012 © 2012 Telenav, Proprietary and Confidential 22
  • 23. QUESTIONS 10/19/2012 © 2012 Telenav, Proprietary and Confidential 23