Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Beauty of Mapping Big Data

123 views

Published on

Data Lens is a cloud-based API toolkit for developing web-based geographical data visualizations. Raw data is queried via a REST API from the Data Lens cloud, and transformed and aggregated to provide input to the JavaScript API, which can render map objects, vector shapes and heat maps. This talk is about the beauty behind big data represented by Data Lens heat maps, the beauty behind its accuracy and its engineering.

Published in: Engineering
  • Be the first to comment

  • Be the first to like this

The Beauty of Mapping Big Data

  1. 1. The Beauty of Mapping Big Data Stoimen Popov R&D Lead, Product Innovation Team, HERE IoT| Dec 05, 2016
  2. 2. HERE is the Open Location Platform company • Provides mapping services and location intelligence across the automotive, enterprise and internet industries • Employs 7,000 people in 56 countries • Produces maps for every country on earth • Enables four out of five in-car navigation systems in North America and Europe • Enables mobile, web and enterprise solutions for global industry leaders
  3. 3. Agenda 01. Data Lens 01.1 Cloud Storage 01.2 Rest API & Query Language 01.3 JS API 02. Server-Side Clustering 03. Data Lens Heat Maps 03.1 Averaged Value 03.2 Alpha Mask by Density 03.3 Value Based Heat Map
  4. 4. 01 Data Lens
  5. 5. Data Lens is a cloud-based API toolkit for developing sophisticated visualizations of geographically referenced data, accessible in a web browser. Data is queried via a REST API from the Data Lens cloud, and transformed and aggregated to provide input to the JavaScript API, which renders the visualization.
  6. 6. Cloud Storage • Data storage • Integration with HERE account • Data enrichment
  7. 7. Data Lens REST API • Authentication • Data Upload • Datasets • Queries • Query Language • Access Management • Data Reprojection • ...
  8. 8. Data Lens Query Language • JSON formatted queries • Similar to prepared statements in SQL for later execution • Only dataset owners can create queries for a dataset • Protect sensitive datasets
  9. 9. Presentation title | Month 00, 20169 © 2016 HERE | HERE Internal Use Only Data Lens Query Language
  10. 10. Data Lens JS API • Data Lens JavaScript API is a module of HERE Maps API for JavaScript and connects it to the Data Lens REST API • Provides data-driven styling of data on a map • Solves non-trivial tasks like tiling, caching and rasterizing data
  11. 11. Presentation title | Month 00, 201611 © 2016 HERE | HERE Internal Use Only Data Lens Heat Map Dataset with 11M points of data about taxi rides in NY City
  12. 12. Presentation title | Month 00, 201612 © 2016 HERE | HERE Internal Use Only Data Lens Street Shapes The data is geo-enriched to street geometry in NY City
  13. 13. Presentation title | Month 00, 201613 © 2016 HERE | HERE Internal Use Only Data Lens ZIP Shapes The data is geo-enriched to ZIP code boundaries in NY City
  14. 14. Presentation title | Month 00, 201614 © 2016 HERE | HERE Internal Use Only Data Lens Buildings The data is geo-enriched to building geometries in NY City
  15. 15. 02 Server-Side Clustering How to deal with BIG DATA on the server?
  16. 16. Data Tiling & Grouping in Pixel Space • Data tiling reduces the amount of data received by the client • Data Lens groups the data points per tile pixel
  17. 17. 03 Data Lens Heat Maps • Averaged value • Alpha mask by density • Value-based heat map
  18. 18. Presentation title | Month 00, 201618 © 2016 HERE | HERE Internal Use Only Averaged heat map
  19. 19. Presentation title | Month 00, 201619 © 2016 HERE | HERE Internal Use Only Averaged heat map alone, and with an applied alpha mask
  20. 20. Big Data can be visualized in many ways … Heat Maps Server-Side Clustering Hybrid Clustering (Server-side and client-side)
  21. 21. https://developer.here.com Docs & API Reference Tech Examples Industry Examples  Develop  Code Examples  Data Lens APIs • Detailed Story • JS/HTML Code • Query Definitions • Styles & UI  Develop  Code Examples  Data Lens APIs • Data-Driven Styling • Server-Side Clustering • Hybrid Clustering • …and more!  Develop  Data Lens • Getting Started • Tutorial • Developer Guide • API Reference

×