Big Data, Big Local
•
4 likes•2,928 views
Where 2.0 2011 presentation discussion the use of local businesses and POI as topographical nodes in a complex network
Recommended
Recommended
More Related Content
What's hot
What's hot (19)
Similar to Big Data, Big Local
Similar to Big Data, Big Local (20)
More from Tyler Bell
More from Tyler Bell (7)
Big Data, Big Local
- 1. Big Data, Big Local Tyler Bell @twbell
- 2. 37.7632,-122.4213 Great for machines Coordinates: For people, less so
- 7. While coordinates are regular and convenient, they lack context and character Square
- 9. The Evolving Local Use Case Yellow Pages Local Search Recommendations Social Engagement Brand Engagement Commercial Engagement Navigation Interaction
- 10. Local Businesses and POI – An irregular , but extremely rich topographic network
- 11. Employing POI and Business Listings as topographical nodes brings its own problems…
- 12. Subway Restaurants Subway Sandwich and Salad Subway Sandwich and Salad Shop Subway Subs and Salads Subway Restaurants Subway Subs Subway Shop Subway Sandwich Shops Subway Sandwichs Subway Sandwiches and Salads Subway Restaurant Subway Sandwiches Subway Sandwiches and Salads Subway Sandwich Shop Subway Subway Sandwiches and Salad Subway Sandwich and Salads Subway Sandwich Poor/Absent Canonicalization
- 13. Multiple Electronic Representations of one physical entity
- 15. Webpage URLs have become URIs Identifiers for people, places, things http://developers.facebook.com/docs/opengraph/
- 17. 14.5m entities pointing to over… 1.5b references found across… 4.7m domains US Local Dataset
- 18. http://continuations.com/post/4365211963/the-web-stp-challenge-making-apis-useful We need more STP [Straight Through Processing] for the web so that we have fewer stove pipe services and can move to a seamless web instead. The obstacle is no longer a lack of APIs […] the problem is a lack of data mapping/unification services. - Albert Wenger http://twitter.com/#!/cdixon/status/49906284492881920
- 19. We are able to focus on our core vision of geotagging the web’s content and information while also providing our developers with a great Places Database that is open and free to use.
- 20. How easily men could make things much better than they are -- if they only all tried together - Winston Churchill
Editor's Notes
- These coordinates can map to the US, which has its own array of contextual associations… http://open.mapquestapi.com/nominatim/v1/details.php?place_id=4476130 http://www.flickr.com/photos/mav16/3557076001/ http://www.flickr.com/photos/expressmonorail/2531144122/ http://www.flickr.com/photos/video4net/4079991429/
- They also map to California, which has its own, different context… http://open.mapquestapi.com/nominatim/v1/details.php?place_id=79413431 http://www.flickr.com/photos/muftirythm/5181074455/ http://www.flickr.com/photos/caccamo/1253844134 http://www.flickr.com/photos/the_tahoe_guy/4415371647/
- And of course to San Francisco, which also has its own context independent of others… http://open.mapquestapi.com/nominatim/v1/details.php?place_id=36061747 http://www.flickr.com/photos/alex-s/80040426/ http://www.flickr.com/photos/salim/402618628/ http://www.flickr.com/photos/26063464@N03/3633118346/
- The coordinates actual map directly onto an Adult ‘Novelty’ shop, which of course has entirely different associations… Google streetview Image http://www.flickr.com/photos/mmemarilyn/2021853367/ http://www.flickr.com/photos/netzanette/3822981633/ http://www.flickr.com/photos/preppybyday/5076899310/
- Diff. between grid and graph Coordinates provide location, Businesses and POI provide context Semantic hooks on which we hang activity http://www.flickr.com/photos/iconolith/253426954/
- http://www.flickr.com/photos/silvery/4461519535/ http://www.flickr.com/photos/brettstark/4386550082/
- So we got that going for us…
- Nomalization and canonicalization are huge problem Across all attributes, varying by country. 10 core attributes, 35 countries = 350 rule sets
- Same store on 8 different sites
- http://developers.facebook.com/docs/opengraph/
- Uniform Resource Identifiers accessible via HTTP Dereference: to obtain a copy or representation of the resource it identifies.
- http://blog.fwix.com/our-geodata-just-got-even-better
- Large-scale data engineering is a royal PITA We address this so that your efforts go on the application layer – where differentiation counts