Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Cognitive Cities: City analytics

9,412 views

Published on

Presented at Cognitive Cities in Berlin, February 26th 2011.

http://conference.cognitivecities.com/

Video: http://conference.cognitivecities.com/2011/03/matt-biddulph-on-city-analytics/

Published in: Technology
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Here's the video of this talk

       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Awesome on data, cities and information visualisation
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Cognitive Cities: City analytics

  1. 1. City AnalyticsMatt Biddulph, Nokia
  2. 2. understanding systems by making modelsWe have always tried to understand systems by creating models of them. We create rules thatmatch reality just closely enough that we can study reality by studying the model. MONIAC isone such example, created at the London School of Economics in 1949 by Bill Phillips. It usesfluid dynamics to model an economy, with the flow between water tanks standing in for themonetary flow between the Treasury, Education and so forth.
  3. 3. “The more we learn about biology, the further we find ourselves from a model that can explain it.” Chris Anderson, http://www.wired.com/science/discoveries/magazine/16-07/pb_theory“All models are wrong, but some are useful.” — George Box, Statistician, quoted in http://www.wired.com/science/discoveries/magazine/16-07/pb_theoryAs our knowledge advances in a field like biology, our inaccurate models give us diminishingreturns. In “The End Of Theory”, Chris Anderson argues that the future of science is transitioningto analysing empirical data gathered from observation of the world. He calls this The PetabyteAge, pioneered by companies such as Google who created techniques for large-scale analysis ofdata out of the necessity to analyse the whole internet.Credit: http://www.flickr.com/photos/timo/851027757/
  4. 4. people are city biologyWe can try to study cities with models. But human behaviour, the biology of the city, makescities too complex to model.
  5. 5. Recent visualisations of the movement of hire-bikes through London emphasise for me theorganic, biological nature of human city-data.
  6. 6. “We can’t see how the street is immersed in a twitching, pulsing cloud of data.” Dan Hill: http://www.cityofsound.com/blog/2008/02/the-street-as-p.htmlDan Hill continues, “This is over and above the well-established electromagnetic radiation,crackles of static, radio waves conveying radio and television broadcasts in digital andanalogue forms, police voice traffic.  This is a new kind of data, collective and individual,aggregated and discrete, open and closed, constantly logging impossibly detailed patterns ofbehaviour. The behaviour of the street.”The data that flows through modern cities is not even visible to the human eye. We can’tgather this data with interviews, surveys and clipboards.
  7. 7. city samplersSo at Nokia, we’ve been asking the question, can the phone be the entire source of data thatallows us to know our cities?
  8. 8. This is plausible because so many people carry a phone with them 24 hours a day, whereverthey go in the city. It’s also because the modern mobile phone is packed with sensors. Earlyphones had a microphone and a radio. Phones today know which way up they are, where theyare in the world, can record images and video, and can sense the presence of many otherdevices, networks and signals.
  9. 9. This brings the city into the Petabyte Age. What allows us to process the data is a techniquedeveloped by Google and popularised in open-source in the Hadoop project.Map-Reduce is a system for specifying a data-processing algorithm that allows the work tobe split up and distributed to a network of computers to solve in pieces. It maps raw inputdata to processed output data, then reduces the output data into final results.
  10. 10. With map-reduce, we can run an algorithm on a rack of servers...http://www.flickr.com/photos/johnseb/3425464/
  11. 11. ... or a corridor full of racks of servers ...
  12. 12. ... or data-centre full of corridors full of racks of servers.We can start small and scale up our processing capability to keep pace with the scale of ourdata. It sidesteps the limit we hit with traditional single-machine analytics, when we can nolonger process 24 hours of data in 24 hours of CPU time.
  13. 13. learning from searchMy first example shows what we can learn by looking at what people search for on a map,and where they are when they search.
  14. 14. Ikea Spandau Ikea Schoenefeld Ikea TempelhofThis map of Berlin (made by Nokia’s Josh Devins) aggregates searches made over the lastThursday, January 27, 2011Ikea geo-searches bounded to Berlinfour months for the word “Ikea”. It clearly shows that people all over Berlin look for Ikea, butcan we make any assumptions about whatBerlin Ikea stores.that there are obvious clusters near the 3 the actual locations are?kind of, but not much data hereclearly there is a Tempelhof cluster but the others are not very evidentcertainly shows the relative popularity of all the locationsIkea Lichtenberg was not open yet during this time frame
  15. 15. Prenzl Berg Yuppies Ikea Spandau Ikea Schoenefeld Ikea TempelhofThe fourth obvious cluster is a demographic - the young middle-class families who tend toThursday, January 27, 2011Ikeain the Prenzlauer Berg district of Berlin.live geo-searches bounded to Berlincan we make any assumptions about what the actual locations are?kind of, but not muchalso shows that people don’t search for Ikea on a Sunday as much asIncidentally, the data data hereclearly there is week. This is cluster but the others are not very evident laws and even Ikea isthe rest of the a Tempelhof because Germany still has Sunday-closingcertainly shows the relative popularity of all the locationsnot open on Sundays.Ikea Lichtenberg was not open yet during this time frame
  16. 16. learning from mapsWe can learn plenty about a city just from looking at its maps, and the places on the map.
  17. 17. The “Starbucks Index”, invented by designer Tom Coates, is calculated from the number ofStarbucks cafes per square kilometre of the city. By analysing Nokia’s places registry, we canshow the difference between difference cities, or different parts of a city, by looking at whatcompanies choose to base themselves there. We could equally well calculate a McDonaldsindex, or an Italian food index, or a public parks index.
  18. 18. Searches are goal-driven user behaviour - someone typed something into a search box on aphone. But we can even learn from activity that isn’t so explicit.When someone views a Nokia Ovi map on the web or phone, the visuals for the map areserved up in square “tiles” from our servers. We can analyse the number of requests made foreach tile and take it as a measure of interest or attention in that part of the world.
  19. 19. Searches are goal-driven user behaviour - someone typed something into a search box on aphone. But we can even learn from activity that isn’t so explicit.When someone views a Nokia Ovi map on the web or phone, the visuals for the map areserved up in square “tiles” from our servers. We can analyse the number of requests made foreach tile and take it as a measure of interest or attention in that part of the world.
  20. 20. LA attention heatmapThis is the attention map of Los Angeles, California. We can clearly see several importanthotspots such as Downtown, Hollywood and LAX airport.
  21. 21. LA driving heatmapIf we turn to the navigation logs, we get another map of Los Angeles. This data is recordedwhenever someone requests a car route from one place to another. You can clearly see theroads, and it heavily emphasises major roads because that’s what is favoured by route-planning algorithms. It’s also a map made by people who don’t know where they’re going - ifthey knew exactly what route to take, they wouldn’t be using navigation on their phones.
  22. 22. business perspectiveCity data also reflects business activity. In Berlin our local coffee shop owner uses pen andpaper to record every sale he makes. He uses this to optimise his pricing and the kinds ofcoffee he sells. We can do some of the same analysis on a larger scale.
  23. 23. business contextLooking at the check-in and search patterns around coffee shops, we made this map of theSan Francisco Dolores Park area. Red circles are coffee shops, and blue circles are otherbusinesses. The larger the circle, the more popular the location is to visit.
  24. 24. usage patternsWe discovered we could deduce more than just business information from this data. When welooked at one specific venue, Dolores Park itself, we can tell that San Francisco is cold atnight. No matter the time of year, checkins at the park are much lower in the evening andnight than in daytime.When we looked at the day of the week that people visit the park, we thought we had a bug inour data collection. Why would Thursday be different from other days for popularity of parks?When we cross-referenced the data with weather records, we realised that this particularThursday was wet and cold.Like many other examples in this presentation, we were excited by the fact that we can findverifiable real-world information in pure data, without any human guidance.
  25. 25. “Information is quickly becoming a material to design with.”Mike Kuniavsky: http://orangecone.com/archives/2010/08/information_is_.htmlIn his recent book “Smart Things”, Mike Kuniavsky compares information to traditionalmaterials such as wood and rubber. It has now become a material that we can build with inthe real world, to connect the physical and the digital worlds together.
  26. 26. [nod to Matt Jones, for many conversations we had about cities while working together atDopplr]
  27. 27. Thank you. Matt Biddulph @mattb | matthew.biddulph@nokia.comAfter the talk, there were questions from the audience...
  28. 28. Audience question What about individual privacy, and the ethics of profiting from individual user data?1. We only ever analyse the aggregate, anonymised set of all users’ data. We didn’t track anyindividuals in any part of this work.2. I believe that it could only be unethical to profit from analysing user data if you don’treturn some value by making them a useful, desirable product in return.
  29. 29. Audience question I’m not uncomfortable with services analysing my data, but I am unhappy if I feel like I don’t own my personal data.In my personal opinion, individual data belongs to the individual. Putting your data into alarge service gives you access to economies of scale, allowing it to do useful analysis of theaggregate data that you couldn’t achieve with your data alone. You benefit from this whentheir service gets better the more you use it.A company you deposit data with should act like a bank: hold it in trust, generate somebenefit, give it back when you ask.

×