SlideShare a Scribd company logo
1 of 29
Download to read offline
City Analytics
Matt Biddulph, Nokia
understanding systems
     by making models
We have always tried to understand systems by creating models of them. We create rules that
match reality just closely enough that we can study reality by studying the model. MONIAC is
one such example, created at the London School of Economics in 1949 by Bill Phillips. It uses
fluid dynamics to model an economy, with the flow between water tanks standing in for the
monetary flow between the Treasury, Education and so forth.
“The more we learn about biology,
             the further we find ourselves from
             a model that can explain it.”




 Chris Anderson, http://www.wired.com/science/discoveries/magazine/16-07/pb_theory

“All models are wrong, but some are useful.” — George Box, Statistician, quoted in http://
www.wired.com/science/discoveries/magazine/16-07/pb_theory

As our knowledge advances in a field like biology, our inaccurate models give us diminishing
returns. In “The End Of Theory”, Chris Anderson argues that the future of science is transitioning
to analysing empirical data gathered from observation of the world. He calls this The Petabyte
Age, pioneered by companies such as Google who created techniques for large-scale analysis of
data out of the necessity to analyse the whole internet.

Credit: http://www.flickr.com/photos/timo/851027757/
people are city biology




We can try to study cities with models. But human behaviour, the biology of the city, makes
cities too complex to model.
Recent visualisations of the movement of hire-bikes through London emphasise for me the
organic, biological nature of human city-data.
“We can’t see how the
  street is immersed in a
  twitching, pulsing cloud
  of data.”
  Dan Hill: http://www.cityofsound.com/blog/2008/02/the-street-as-p.html

Dan Hill continues, “This is over and above the well-established electromagnetic radiation,
crackles of static, radio waves conveying radio and television broadcasts in digital and
analogue forms, police voice traffic.  This is a new kind of data, collective and individual,
aggregated and discrete, open and closed, constantly logging impossibly detailed patterns of
behaviour. The behaviour of the street.”

The data that flows through modern cities is not even visible to the human eye. We can’t
gather this data with interviews, surveys and clipboards.
city samplers




So at Nokia, we’ve been asking the question, can the phone be the entire source of data that
allows us to know our cities?
This is plausible because so many people carry a phone with them 24 hours a day, wherever
they go in the city. It’s also because the modern mobile phone is packed with sensors. Early
phones had a microphone and a radio. Phones today know which way up they are, where they
are in the world, can record images and video, and can sense the presence of many other
devices, networks and signals.
This brings the city into the Petabyte Age. What allows us to process the data is a technique
developed by Google and popularised in open-source in the Hadoop project.

Map-Reduce is a system for specifying a data-processing algorithm that allows the work to
be split up and distributed to a network of computers to solve in pieces. It maps raw input
data to processed output data, then reduces the output data into final results.
With map-reduce, we can run an algorithm on a rack of servers...

http://www.flickr.com/photos/johnseb/3425464/
... or a corridor full of racks of servers ...
... or data-centre full of corridors full of racks of servers.

We can start small and scale up our processing capability to keep pace with the scale of our
data. It sidesteps the limit we hit with traditional single-machine analytics, when we can no
longer process 24 hours of data in 24 hours of CPU time.
learning from search




My first example shows what we can learn by looking at what people search for on a map,
and where they are when they search.
Ikea Spandau



                                                                           Ikea Schoenefeld
                             Ikea Tempelhof




This map of Berlin (made by Nokia’s Josh Devins) aggregates searches made over the last
Thursday, January 27, 2011

Ikea geo-searches bounded to Berlin
four months for the word “Ikea”. It clearly shows that people all over Berlin look for Ikea, but
can we make any assumptions about whatBerlin Ikea stores.
that there are obvious clusters near the 3 the actual locations are?
kind of, but not much data here
clearly there is a Tempelhof cluster but the others are not very evident
certainly shows the relative popularity of all the locations
Ikea Lichtenberg was not open yet during this time frame
Prenzl Berg Yuppies




             Ikea Spandau



                                                                           Ikea Schoenefeld
                             Ikea Tempelhof




The fourth obvious cluster is a demographic - the young middle-class families who tend to
Thursday, January 27, 2011

Ikeain the Prenzlauer Berg district of Berlin.
live geo-searches bounded to Berlin
can we make any assumptions about what the actual locations are?
kind of, but not muchalso shows that people don’t search for Ikea on a Sunday as much as
Incidentally, the data data here
clearly there is week. This is cluster but the others are not very evident laws and even Ikea is
the rest of the a Tempelhof because Germany still has Sunday-closing
certainly shows the relative popularity of all the locations
not open on Sundays.
Ikea Lichtenberg was not open yet during this time frame
learning from maps




We can learn plenty about a city just from looking at its maps, and the places on the map.
The “Starbucks Index”, invented by designer Tom Coates, is calculated from the number of
Starbucks cafes per square kilometre of the city. By analysing Nokia’s places registry, we can
show the difference between difference cities, or different parts of a city, by looking at what
companies choose to base themselves there. We could equally well calculate a McDonalds
index, or an Italian food index, or a public parks index.
Searches are goal-driven user behaviour - someone typed something into a search box on a
phone. But we can even learn from activity that isn’t so explicit.

When someone views a Nokia Ovi map on the web or phone, the visuals for the map are
served up in square “tiles” from our servers. We can analyse the number of requests made for
each tile and take it as a measure of interest or attention in that part of the world.
Searches are goal-driven user behaviour - someone typed something into a search box on a
phone. But we can even learn from activity that isn’t so explicit.

When someone views a Nokia Ovi map on the web or phone, the visuals for the map are
served up in square “tiles” from our servers. We can analyse the number of requests made for
each tile and take it as a measure of interest or attention in that part of the world.
LA attention heatmap




This is the attention map of Los Angeles, California. We can clearly see several important
hotspots such as Downtown, Hollywood and LAX airport.
LA driving heatmap




If we turn to the navigation logs, we get another map of Los Angeles. This data is recorded
whenever someone requests a car route from one place to another. You can clearly see the
roads, and it heavily emphasises major roads because that’s what is favoured by route-
planning algorithms. It’s also a map made by people who don’t know where they’re going - if
they knew exactly what route to take, they wouldn’t be using navigation on their phones.
business perspective




City data also reflects business activity. In Berlin our local coffee shop owner uses pen and
paper to record every sale he makes. He uses this to optimise his pricing and the kinds of
coffee he sells. We can do some of the same analysis on a larger scale.
business context




Looking at the check-in and search patterns around coffee shops, we made this map of the
San Francisco Dolores Park area. Red circles are coffee shops, and blue circles are other
businesses. The larger the circle, the more popular the location is to visit.
usage patterns




We discovered we could deduce more than just business information from this data. When we
looked at one specific venue, Dolores Park itself, we can tell that San Francisco is cold at
night. No matter the time of year, checkins at the park are much lower in the evening and
night than in daytime.

When we looked at the day of the week that people visit the park, we thought we had a bug in
our data collection. Why would Thursday be different from other days for popularity of parks?
When we cross-referenced the data with weather records, we realised that this particular
Thursday was wet and cold.

Like many other examples in this presentation, we were excited by the fact that we can find
verifiable real-world information in pure data, without any human guidance.
“Information is
                                                               quickly becoming
                                                               a material to
                                                               design with.”




Mike Kuniavsky: http://orangecone.com/archives/2010/08/information_is_.html
In his recent book “Smart Things”, Mike Kuniavsky compares information to traditional
materials such as wood and rubber. It has now become a material that we can build with in
the real world, to connect the physical and the digital worlds together.
[nod to Matt Jones, for many conversations we had about cities while working together at
Dopplr]
Thank you.
   Matt Biddulph
   @mattb | matthew.biddulph@nokia.com
After the talk, there were questions from the audience...
Audience question
   What about individual privacy, and the ethics of profiting from
   individual user data?
1. We only ever analyse the aggregate, anonymised set of all users’ data. We didn’t track any
individuals in any part of this work.

2. I believe that it could only be unethical to profit from analysing user data if you don’t
return some value by making them a useful, desirable product in return.
Audience question
   I’m not uncomfortable with services analysing my data, but I am
   unhappy if I feel like I don’t own my personal data.
In my personal opinion, individual data belongs to the individual. Putting your data into a
large service gives you access to economies of scale, allowing it to do useful analysis of the
aggregate data that you couldn’t achieve with your data alone. You benefit from this when
their service gets better the more you use it.

A company you deposit data with should act like a bank: hold it in trust, generate some
benefit, give it back when you ask.

More Related Content

Viewers also liked

Is Groovy as fast as Java
Is Groovy as fast as JavaIs Groovy as fast as Java
Is Groovy as fast as JavaRussel Winder
 
Alex Knowles letter of Rec.
Alex Knowles letter of Rec.Alex Knowles letter of Rec.
Alex Knowles letter of Rec.Alex Knowles
 
rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...
rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...
rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...ginocuarite2015
 
Separacion del hogar conyugal abogado en venezuela
Separacion del hogar conyugal abogado en venezuelaSeparacion del hogar conyugal abogado en venezuela
Separacion del hogar conyugal abogado en venezuelamanuel alfredo rodriguez
 
Ppt on how to create your own schoolloop site november 14
Ppt on how to create your own  schoolloop site november 14Ppt on how to create your own  schoolloop site november 14
Ppt on how to create your own schoolloop site november 14marcelo leal
 
Asamblea Extraordinaria Informática 26/04
Asamblea Extraordinaria Informática 26/04Asamblea Extraordinaria Informática 26/04
Asamblea Extraordinaria Informática 26/04cee_info_2012
 
Cerezos
CerezosCerezos
CerezosRuper
 
Publishing staff webpages
Publishing staff webpagesPublishing staff webpages
Publishing staff webpagesmarcelo leal
 
La maquina de vapor. Rosario Carmona Marín.
La maquina de vapor. Rosario Carmona Marín.La maquina de vapor. Rosario Carmona Marín.
La maquina de vapor. Rosario Carmona Marín.RosarioCarmonaMarin98
 
Cronología 1 quincena febrero
Cronología 1 quincena febreroCronología 1 quincena febrero
Cronología 1 quincena febreroyekaortiz
 
Sarajevo PR open - Online reputation
Sarajevo PR open - Online reputationSarajevo PR open - Online reputation
Sarajevo PR open - Online reputationDragana Djermanovic
 
La Adivina
La AdivinaLa Adivina
La AdivinaSole
 
Distancia de marte a la tierra
Distancia de marte a la tierraDistancia de marte a la tierra
Distancia de marte a la tierrayekaortiz
 
Evolucion de los modos y medios de buques
Evolucion  de los modos y medios de buquesEvolucion  de los modos y medios de buques
Evolucion de los modos y medios de buquesmariangelymileidys
 
Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016
Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016
Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016Jorge Vallina Crespo
 
Sugarcane business ranger campus islamia universty bahawalpur
Sugarcane business ranger campus islamia universty bahawalpurSugarcane business ranger campus islamia universty bahawalpur
Sugarcane business ranger campus islamia universty bahawalpurFaiz Ahmed
 

Viewers also liked (20)

Is Groovy as fast as Java
Is Groovy as fast as JavaIs Groovy as fast as Java
Is Groovy as fast as Java
 
Alex Knowles letter of Rec.
Alex Knowles letter of Rec.Alex Knowles letter of Rec.
Alex Knowles letter of Rec.
 
rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...
rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...
rrrrrrrrrrrrrrrrrrrrrrrrreffffffffffv aghhhhhlizacindeseguriddad-130217120348...
 
Separacion del hogar conyugal abogado en venezuela
Separacion del hogar conyugal abogado en venezuelaSeparacion del hogar conyugal abogado en venezuela
Separacion del hogar conyugal abogado en venezuela
 
Ppt on how to create your own schoolloop site november 14
Ppt on how to create your own  schoolloop site november 14Ppt on how to create your own  schoolloop site november 14
Ppt on how to create your own schoolloop site november 14
 
Asamblea Extraordinaria Informática 26/04
Asamblea Extraordinaria Informática 26/04Asamblea Extraordinaria Informática 26/04
Asamblea Extraordinaria Informática 26/04
 
Pawer pelajes de caballos
Pawer pelajes de caballosPawer pelajes de caballos
Pawer pelajes de caballos
 
Cerezos
CerezosCerezos
Cerezos
 
Publishing staff webpages
Publishing staff webpagesPublishing staff webpages
Publishing staff webpages
 
La maquina de vapor. Rosario Carmona Marín.
La maquina de vapor. Rosario Carmona Marín.La maquina de vapor. Rosario Carmona Marín.
La maquina de vapor. Rosario Carmona Marín.
 
Cronología 1 quincena febrero
Cronología 1 quincena febreroCronología 1 quincena febrero
Cronología 1 quincena febrero
 
Sarajevo PR open - Online reputation
Sarajevo PR open - Online reputationSarajevo PR open - Online reputation
Sarajevo PR open - Online reputation
 
La Adivina
La AdivinaLa Adivina
La Adivina
 
Nativos digitales, 2010
Nativos digitales, 2010Nativos digitales, 2010
Nativos digitales, 2010
 
Distancia de marte a la tierra
Distancia de marte a la tierraDistancia de marte a la tierra
Distancia de marte a la tierra
 
Evolucion de los modos y medios de buques
Evolucion  de los modos y medios de buquesEvolucion  de los modos y medios de buques
Evolucion de los modos y medios de buques
 
Cuestión 1
Cuestión 1Cuestión 1
Cuestión 1
 
Pres Web2.0
Pres Web2.0Pres Web2.0
Pres Web2.0
 
Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016
Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016
Seminarios Turismo Sostenible Agrotravel & Formagrupo 2016
 
Sugarcane business ranger campus islamia universty bahawalpur
Sugarcane business ranger campus islamia universty bahawalpurSugarcane business ranger campus islamia universty bahawalpur
Sugarcane business ranger campus islamia universty bahawalpur
 

Similar to Cognitive Cities: City analytics

Place graphs are the new social graphs
Place graphs are the new social graphsPlace graphs are the new social graphs
Place graphs are the new social graphsMatt Biddulph
 
Forskerkurs kristiansand sept 2014 digitale tekster
Forskerkurs kristiansand sept 2014   digitale tekster Forskerkurs kristiansand sept 2014   digitale tekster
Forskerkurs kristiansand sept 2014 digitale tekster Jill Walker Rettberg
 
Interactivity Beyond the Screen
Interactivity Beyond the ScreenInteractivity Beyond the Screen
Interactivity Beyond the ScreenEricsson
 
the near future of tourism services based on digital traces
the near future of tourism services based on digital tracesthe near future of tourism services based on digital traces
the near future of tourism services based on digital tracesnicolas nova
 
Designing for an internet of things
Designing for an internet of thingsDesigning for an internet of things
Designing for an internet of thingsTimo Arnall
 
Changing contexts: museums, audiences and technology
Changing contexts: museums, audiences and technologyChanging contexts: museums, audiences and technology
Changing contexts: museums, audiences and technologyMia
 
The poetics of information architecture
The poetics of information architectureThe poetics of information architecture
The poetics of information architectureAndrea Resmini
 
Possibilities and perils of the data-driven world.
Possibilities and perils of the data-driven world.Possibilities and perils of the data-driven world.
Possibilities and perils of the data-driven world.joshuakauffman
 
Augmented reality @ libraries
Augmented reality @ librariesAugmented reality @ libraries
Augmented reality @ librariesKai Li
 
Way out there tech & implications for libraries
Way out there tech & implications for librariesWay out there tech & implications for libraries
Way out there tech & implications for librariesStephen Abram
 
Web Storytelling and Open Data Publishing for Tourism
Web Storytelling and Open Data Publishing for TourismWeb Storytelling and Open Data Publishing for Tourism
Web Storytelling and Open Data Publishing for TourismAndrea Volpini
 
The web in the world
The web in the worldThe web in the world
The web in the worldTimo Arnall
 
i move and i interact in torino
i move and i interact in torinoi move and i interact in torino
i move and i interact in torinonicolas nova
 
We Are Social: Think Forward 2016
We Are Social: Think Forward 2016We Are Social: Think Forward 2016
We Are Social: Think Forward 2016We Are Social
 

Similar to Cognitive Cities: City analytics (20)

Place graphs are the new social graphs
Place graphs are the new social graphsPlace graphs are the new social graphs
Place graphs are the new social graphs
 
Forskerkurs kristiansand sept 2014 digitale tekster
Forskerkurs kristiansand sept 2014   digitale tekster Forskerkurs kristiansand sept 2014   digitale tekster
Forskerkurs kristiansand sept 2014 digitale tekster
 
Interactivity Beyond the Screen
Interactivity Beyond the ScreenInteractivity Beyond the Screen
Interactivity Beyond the Screen
 
Understanding cities
Understanding citiesUnderstanding cities
Understanding cities
 
Urban lenses
Urban lensesUrban lenses
Urban lenses
 
the near future of tourism services based on digital traces
the near future of tourism services based on digital tracesthe near future of tourism services based on digital traces
the near future of tourism services based on digital traces
 
Orienteering Objects
Orienteering ObjectsOrienteering Objects
Orienteering Objects
 
AHRC CDP Digital Humanities 101
AHRC CDP Digital Humanities 101  AHRC CDP Digital Humanities 101
AHRC CDP Digital Humanities 101
 
Designing for an internet of things
Designing for an internet of thingsDesigning for an internet of things
Designing for an internet of things
 
Changing contexts: museums, audiences and technology
Changing contexts: museums, audiences and technologyChanging contexts: museums, audiences and technology
Changing contexts: museums, audiences and technology
 
The poetics of information architecture
The poetics of information architectureThe poetics of information architecture
The poetics of information architecture
 
Possibilities and perils of the data-driven world.
Possibilities and perils of the data-driven world.Possibilities and perils of the data-driven world.
Possibilities and perils of the data-driven world.
 
Augmented reality @ libraries
Augmented reality @ librariesAugmented reality @ libraries
Augmented reality @ libraries
 
ScienceofCities
ScienceofCitiesScienceofCities
ScienceofCities
 
Way out there tech & implications for libraries
Way out there tech & implications for librariesWay out there tech & implications for libraries
Way out there tech & implications for libraries
 
Web Storytelling and Open Data Publishing for Tourism
Web Storytelling and Open Data Publishing for TourismWeb Storytelling and Open Data Publishing for Tourism
Web Storytelling and Open Data Publishing for Tourism
 
The web in the world
The web in the worldThe web in the world
The web in the world
 
i move and i interact in torino
i move and i interact in torinoi move and i interact in torino
i move and i interact in torino
 
We Are Social: Think Forward 2016
We Are Social: Think Forward 2016We Are Social: Think Forward 2016
We Are Social: Think Forward 2016
 
Urban Screens
Urban ScreensUrban Screens
Urban Screens
 

More from Matt Biddulph

The IoT Conversation
The IoT ConversationThe IoT Conversation
The IoT ConversationMatt Biddulph
 
EAN’s World of Data: Prototyping apps using real data
EAN’s World of Data: Prototyping apps using real dataEAN’s World of Data: Prototyping apps using real data
EAN’s World of Data: Prototyping apps using real dataMatt Biddulph
 
Monkigras 2012: Networks Of Data
Monkigras 2012: Networks Of DataMonkigras 2012: Networks Of Data
Monkigras 2012: Networks Of DataMatt Biddulph
 
Science Hackday: using visualisation to understand your data
Science Hackday: using visualisation to understand your dataScience Hackday: using visualisation to understand your data
Science Hackday: using visualisation to understand your dataMatt Biddulph
 
Prototyping with data at Nokia
Prototyping with data at NokiaPrototyping with data at Nokia
Prototyping with data at NokiaMatt Biddulph
 
Mobile Social Location (Web Directions @media version)
Mobile Social Location (Web Directions @media version)Mobile Social Location (Web Directions @media version)
Mobile Social Location (Web Directions @media version)Matt Biddulph
 
iPhone Coding For Web Developers
iPhone Coding For Web DevelopersiPhone Coding For Web Developers
iPhone Coding For Web DevelopersMatt Biddulph
 
Tinkering with game controllers
Tinkering with game controllersTinkering with game controllers
Tinkering with game controllersMatt Biddulph
 
SXSW 2008: Creative Collaboration
SXSW 2008: Creative CollaborationSXSW 2008: Creative Collaboration
SXSW 2008: Creative CollaborationMatt Biddulph
 
Coding on the Shoulders of Giants
Coding on the Shoulders of GiantsCoding on the Shoulders of Giants
Coding on the Shoulders of GiantsMatt Biddulph
 
Connecting First And Second Life
Connecting First And Second LifeConnecting First And Second Life
Connecting First And Second LifeMatt Biddulph
 
Coders need to learn hardware hacking NOW
Coders need to learn hardware hacking NOWCoders need to learn hardware hacking NOW
Coders need to learn hardware hacking NOWMatt Biddulph
 

More from Matt Biddulph (13)

The IoT Conversation
The IoT ConversationThe IoT Conversation
The IoT Conversation
 
EAN’s World of Data: Prototyping apps using real data
EAN’s World of Data: Prototyping apps using real dataEAN’s World of Data: Prototyping apps using real data
EAN’s World of Data: Prototyping apps using real data
 
Monkigras 2012: Networks Of Data
Monkigras 2012: Networks Of DataMonkigras 2012: Networks Of Data
Monkigras 2012: Networks Of Data
 
Science Hackday: using visualisation to understand your data
Science Hackday: using visualisation to understand your dataScience Hackday: using visualisation to understand your data
Science Hackday: using visualisation to understand your data
 
Prototyping with data at Nokia
Prototyping with data at NokiaPrototyping with data at Nokia
Prototyping with data at Nokia
 
Mobile Social Location (Web Directions @media version)
Mobile Social Location (Web Directions @media version)Mobile Social Location (Web Directions @media version)
Mobile Social Location (Web Directions @media version)
 
iPhone Coding For Web Developers
iPhone Coding For Web DevelopersiPhone Coding For Web Developers
iPhone Coding For Web Developers
 
Tinkering with game controllers
Tinkering with game controllersTinkering with game controllers
Tinkering with game controllers
 
The Realtime Web
The Realtime WebThe Realtime Web
The Realtime Web
 
SXSW 2008: Creative Collaboration
SXSW 2008: Creative CollaborationSXSW 2008: Creative Collaboration
SXSW 2008: Creative Collaboration
 
Coding on the Shoulders of Giants
Coding on the Shoulders of GiantsCoding on the Shoulders of Giants
Coding on the Shoulders of Giants
 
Connecting First And Second Life
Connecting First And Second LifeConnecting First And Second Life
Connecting First And Second Life
 
Coders need to learn hardware hacking NOW
Coders need to learn hardware hacking NOWCoders need to learn hardware hacking NOW
Coders need to learn hardware hacking NOW
 

Recently uploaded

From the origin to the future of Open Source model and business
From the origin to the future of  Open Source model and businessFrom the origin to the future of  Open Source model and business
From the origin to the future of Open Source model and businessFrancesco Corti
 
Scenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenariosScenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenariosErol GIRAUDY
 
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - TechWebinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - TechProduct School
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
 
Explore the UiPath Community and ways you can benefit on your journey to auto...
Explore the UiPath Community and ways you can benefit on your journey to auto...Explore the UiPath Community and ways you can benefit on your journey to auto...
Explore the UiPath Community and ways you can benefit on your journey to auto...DianaGray10
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsDianaGray10
 
UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2DianaGray10
 
CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024Brian Pichman
 
Top 10 Squarespace Development Companies
Top 10 Squarespace Development CompaniesTop 10 Squarespace Development Companies
Top 10 Squarespace Development CompaniesTopCSSGallery
 
Flow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First FrameFlow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First FrameKapil Thakar
 
Patch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updatePatch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updateadam112203
 
EMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarEMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarThousandEyes
 
March Patch Tuesday
March Patch TuesdayMarch Patch Tuesday
March Patch TuesdayIvanti
 
Planetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile BrochurePlanetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile BrochurePlanetek Italia Srl
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
SIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENT
SIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENTSIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENT
SIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENTxtailishbaloch
 
Introduction to RAG (Retrieval Augmented Generation) and its application
Introduction to RAG (Retrieval Augmented Generation) and its applicationIntroduction to RAG (Retrieval Augmented Generation) and its application
Introduction to RAG (Retrieval Augmented Generation) and its applicationKnoldus Inc.
 
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptxGraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptxNeo4j
 
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxEmil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxNeo4j
 
AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024Brian Pichman
 

Recently uploaded (20)

From the origin to the future of Open Source model and business
From the origin to the future of  Open Source model and businessFrom the origin to the future of  Open Source model and business
From the origin to the future of Open Source model and business
 
Scenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenariosScenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenarios
 
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - TechWebinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Explore the UiPath Community and ways you can benefit on your journey to auto...
Explore the UiPath Community and ways you can benefit on your journey to auto...Explore the UiPath Community and ways you can benefit on your journey to auto...
Explore the UiPath Community and ways you can benefit on your journey to auto...
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projects
 
UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2
 
CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024CyberSecurity - Computers In Libraries 2024
CyberSecurity - Computers In Libraries 2024
 
Top 10 Squarespace Development Companies
Top 10 Squarespace Development CompaniesTop 10 Squarespace Development Companies
Top 10 Squarespace Development Companies
 
Flow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First FrameFlow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First Frame
 
Patch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updatePatch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 update
 
EMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarEMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? Webinar
 
March Patch Tuesday
March Patch TuesdayMarch Patch Tuesday
March Patch Tuesday
 
Planetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile BrochurePlanetek Italia Srl - Corporate Profile Brochure
Planetek Italia Srl - Corporate Profile Brochure
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
SIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENT
SIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENTSIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENT
SIM INFORMATION SYSTEM: REVOLUTIONIZING DATA MANAGEMENT
 
Introduction to RAG (Retrieval Augmented Generation) and its application
Introduction to RAG (Retrieval Augmented Generation) and its applicationIntroduction to RAG (Retrieval Augmented Generation) and its application
Introduction to RAG (Retrieval Augmented Generation) and its application
 
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptxGraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
 
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxEmil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
 
AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024AI Workshops at Computers In Libraries 2024
AI Workshops at Computers In Libraries 2024
 

Cognitive Cities: City analytics

  • 2. understanding systems by making models We have always tried to understand systems by creating models of them. We create rules that match reality just closely enough that we can study reality by studying the model. MONIAC is one such example, created at the London School of Economics in 1949 by Bill Phillips. It uses fluid dynamics to model an economy, with the flow between water tanks standing in for the monetary flow between the Treasury, Education and so forth.
  • 3. “The more we learn about biology, the further we find ourselves from a model that can explain it.” Chris Anderson, http://www.wired.com/science/discoveries/magazine/16-07/pb_theory “All models are wrong, but some are useful.” — George Box, Statistician, quoted in http:// www.wired.com/science/discoveries/magazine/16-07/pb_theory As our knowledge advances in a field like biology, our inaccurate models give us diminishing returns. In “The End Of Theory”, Chris Anderson argues that the future of science is transitioning to analysing empirical data gathered from observation of the world. He calls this The Petabyte Age, pioneered by companies such as Google who created techniques for large-scale analysis of data out of the necessity to analyse the whole internet. Credit: http://www.flickr.com/photos/timo/851027757/
  • 4. people are city biology We can try to study cities with models. But human behaviour, the biology of the city, makes cities too complex to model.
  • 5. Recent visualisations of the movement of hire-bikes through London emphasise for me the organic, biological nature of human city-data.
  • 6. “We can’t see how the street is immersed in a twitching, pulsing cloud of data.” Dan Hill: http://www.cityofsound.com/blog/2008/02/the-street-as-p.html Dan Hill continues, “This is over and above the well-established electromagnetic radiation, crackles of static, radio waves conveying radio and television broadcasts in digital and analogue forms, police voice traffic.  This is a new kind of data, collective and individual, aggregated and discrete, open and closed, constantly logging impossibly detailed patterns of behaviour. The behaviour of the street.” The data that flows through modern cities is not even visible to the human eye. We can’t gather this data with interviews, surveys and clipboards.
  • 7. city samplers So at Nokia, we’ve been asking the question, can the phone be the entire source of data that allows us to know our cities?
  • 8. This is plausible because so many people carry a phone with them 24 hours a day, wherever they go in the city. It’s also because the modern mobile phone is packed with sensors. Early phones had a microphone and a radio. Phones today know which way up they are, where they are in the world, can record images and video, and can sense the presence of many other devices, networks and signals.
  • 9. This brings the city into the Petabyte Age. What allows us to process the data is a technique developed by Google and popularised in open-source in the Hadoop project. Map-Reduce is a system for specifying a data-processing algorithm that allows the work to be split up and distributed to a network of computers to solve in pieces. It maps raw input data to processed output data, then reduces the output data into final results.
  • 10. With map-reduce, we can run an algorithm on a rack of servers... http://www.flickr.com/photos/johnseb/3425464/
  • 11. ... or a corridor full of racks of servers ...
  • 12. ... or data-centre full of corridors full of racks of servers. We can start small and scale up our processing capability to keep pace with the scale of our data. It sidesteps the limit we hit with traditional single-machine analytics, when we can no longer process 24 hours of data in 24 hours of CPU time.
  • 13. learning from search My first example shows what we can learn by looking at what people search for on a map, and where they are when they search.
  • 14. Ikea Spandau Ikea Schoenefeld Ikea Tempelhof This map of Berlin (made by Nokia’s Josh Devins) aggregates searches made over the last Thursday, January 27, 2011 Ikea geo-searches bounded to Berlin four months for the word “Ikea”. It clearly shows that people all over Berlin look for Ikea, but can we make any assumptions about whatBerlin Ikea stores. that there are obvious clusters near the 3 the actual locations are? kind of, but not much data here clearly there is a Tempelhof cluster but the others are not very evident certainly shows the relative popularity of all the locations Ikea Lichtenberg was not open yet during this time frame
  • 15. Prenzl Berg Yuppies Ikea Spandau Ikea Schoenefeld Ikea Tempelhof The fourth obvious cluster is a demographic - the young middle-class families who tend to Thursday, January 27, 2011 Ikeain the Prenzlauer Berg district of Berlin. live geo-searches bounded to Berlin can we make any assumptions about what the actual locations are? kind of, but not muchalso shows that people don’t search for Ikea on a Sunday as much as Incidentally, the data data here clearly there is week. This is cluster but the others are not very evident laws and even Ikea is the rest of the a Tempelhof because Germany still has Sunday-closing certainly shows the relative popularity of all the locations not open on Sundays. Ikea Lichtenberg was not open yet during this time frame
  • 16. learning from maps We can learn plenty about a city just from looking at its maps, and the places on the map.
  • 17. The “Starbucks Index”, invented by designer Tom Coates, is calculated from the number of Starbucks cafes per square kilometre of the city. By analysing Nokia’s places registry, we can show the difference between difference cities, or different parts of a city, by looking at what companies choose to base themselves there. We could equally well calculate a McDonalds index, or an Italian food index, or a public parks index.
  • 18. Searches are goal-driven user behaviour - someone typed something into a search box on a phone. But we can even learn from activity that isn’t so explicit. When someone views a Nokia Ovi map on the web or phone, the visuals for the map are served up in square “tiles” from our servers. We can analyse the number of requests made for each tile and take it as a measure of interest or attention in that part of the world.
  • 19. Searches are goal-driven user behaviour - someone typed something into a search box on a phone. But we can even learn from activity that isn’t so explicit. When someone views a Nokia Ovi map on the web or phone, the visuals for the map are served up in square “tiles” from our servers. We can analyse the number of requests made for each tile and take it as a measure of interest or attention in that part of the world.
  • 20. LA attention heatmap This is the attention map of Los Angeles, California. We can clearly see several important hotspots such as Downtown, Hollywood and LAX airport.
  • 21. LA driving heatmap If we turn to the navigation logs, we get another map of Los Angeles. This data is recorded whenever someone requests a car route from one place to another. You can clearly see the roads, and it heavily emphasises major roads because that’s what is favoured by route- planning algorithms. It’s also a map made by people who don’t know where they’re going - if they knew exactly what route to take, they wouldn’t be using navigation on their phones.
  • 22. business perspective City data also reflects business activity. In Berlin our local coffee shop owner uses pen and paper to record every sale he makes. He uses this to optimise his pricing and the kinds of coffee he sells. We can do some of the same analysis on a larger scale.
  • 23. business context Looking at the check-in and search patterns around coffee shops, we made this map of the San Francisco Dolores Park area. Red circles are coffee shops, and blue circles are other businesses. The larger the circle, the more popular the location is to visit.
  • 24. usage patterns We discovered we could deduce more than just business information from this data. When we looked at one specific venue, Dolores Park itself, we can tell that San Francisco is cold at night. No matter the time of year, checkins at the park are much lower in the evening and night than in daytime. When we looked at the day of the week that people visit the park, we thought we had a bug in our data collection. Why would Thursday be different from other days for popularity of parks? When we cross-referenced the data with weather records, we realised that this particular Thursday was wet and cold. Like many other examples in this presentation, we were excited by the fact that we can find verifiable real-world information in pure data, without any human guidance.
  • 25. “Information is quickly becoming a material to design with.” Mike Kuniavsky: http://orangecone.com/archives/2010/08/information_is_.html In his recent book “Smart Things”, Mike Kuniavsky compares information to traditional materials such as wood and rubber. It has now become a material that we can build with in the real world, to connect the physical and the digital worlds together.
  • 26. [nod to Matt Jones, for many conversations we had about cities while working together at Dopplr]
  • 27. Thank you. Matt Biddulph @mattb | matthew.biddulph@nokia.com After the talk, there were questions from the audience...
  • 28. Audience question What about individual privacy, and the ethics of profiting from individual user data? 1. We only ever analyse the aggregate, anonymised set of all users’ data. We didn’t track any individuals in any part of this work. 2. I believe that it could only be unethical to profit from analysing user data if you don’t return some value by making them a useful, desirable product in return.
  • 29. Audience question I’m not uncomfortable with services analysing my data, but I am unhappy if I feel like I don’t own my personal data. In my personal opinion, individual data belongs to the individual. Putting your data into a large service gives you access to economies of scale, allowing it to do useful analysis of the aggregate data that you couldn’t achieve with your data alone. You benefit from this when their service gets better the more you use it. A company you deposit data with should act like a bank: hold it in trust, generate some benefit, give it back when you ask.