SlideShare a Scribd company logo
1 of 31
CityPulse: Large-scale data analytics 
for smart cities 
1 
Payam Barnaghi 
Institute for Communication Systems (ICS) 
University of Surrey 
Guildford, United Kingdom
Smart City Data 
− Data is multi-modal and heterogeneous 
− Noisy and incomplete 
− Time and location dependent 
− Dynamic and varies in quality 
− Crowed sourced data can be unreliable 
− Requires (near-) real-time analysis 
− Privacy and security are important issues 
− Data alone may not give a clear picture -we need 
contextual information, background knowledge, multi-source 
information and obviously better data analytics 
solutions… 
2
Smart City Data 
3 
?
What happens if we only focus on data 
− Number of burgers consumed per day. 
− Number of cats outside. 
− Number of people checking their facebook 
account. 
− What insight would you draw? 
4
What type of problems we expect to solve 
in 
“smart” cities
Back to the future 
6
Future cities: a view from 1998 
Source LAT Times, http://documents.latimes.com/la-2013/ 7
Source: http://robertluisrabello.com/denial/traffic-in-la/#gallery[default]/0/ 8 
Source: wikipedia
9
The IoT and its applications 
10 
Diffusion of innovation 
IoT 
image source: Wikipedia 
The Most Hyped Technology 
image source: Forbes via Gartner
Moving fast forward 
11 
Source: AdamKR via Flicker, http://www.flickr.com/photos/adamkr/5045295251/in/photostream/
12 
We need an Integrated Approach
13 
CityPulse Consortium 
Partners: 
Industrial 
SIE (Austria, 
Romania), 
ERIC 
SME AI 
Higher 
Education 
UNIS, NUIG, 
UASO, WSU 
City BR, AA 
Duration: 36 months
14 
Processing steps
CityPulse – what we are going to 
deliver 
... 
Data Streams 
a) Software tools/libraries 
in an integrated framework 
b) Back-end support servers 
Smart City Framework 
Smart City Scenarios 
a) 101 scenarios 
b) 10 will be chosen to be prototyped 
a) Data portals/ real-time access 
interfaces 
b) Interoperable formats 
c) Common interfaces (REST/annotated) 
a) Proof-of- 
Concepts and 
demonstrators 
and evaluations; 
Applications/App 
s/Demos 
Link: http://www.ict-citypulse.eu/page/content/smart-city-use-cases-and-requirements
Stream Processing 
... 
Data Streams 
CityPulse
Some of the key issues 
− Data collection, representation, interoperability 
− Indexing, search and selection 
− Storage and provision 
− Stream analysis, fusion and integration of multi-source, 
multi-modal and variable-quality data 
− Aggregation, abstraction, pattern extraction and 
time/location dependencies 
− Adaptive learning models for dynamic data 
− Reasoning methods for uncertain and incomplete data 
− Privacy, trust, security 
− Scalability and flexibility of the solutions 
17
Some of our recent in this domain 
18
Use cases
Scenario ranking
101 Smart City Use-case Scenarios 
http://www.ict-citypulse.eu/page/content/smart-city-use-cases-and-requirements
101 Scenarios 
− http://www.ict-citypulse.eu/page/content/smart-city- 
use-cases-and-requirements
Data abstraction 
23 
F. Ganz, P. Barnaghi, F. Carrez, "Information Abstraction for Heterogeneous Real World Internet Data", IEEE Sensors Journal, 2013.
Ontology learning from real world data 
24
Adaptable and dynamic learning 
methods 
http://kat.ee.surrey.ac.uk/
Social media analysis (collaboration with Kno.e.sis, 
Wright State University) 
26 
Tweets from a city 
City Infrastructure 
https://osf.io/b4q2t/ 
P. Anantharam, P. Barnaghi, K. Thirunarayan, A. Sheth, "Extracting city events from social streams,“, under review, 2014.
Correlation analysis 
27
28
Data analytics framework 
Ambient 
Intelligence 
Social 
systems Interactions Interactions 
29 
Data Data 
Data: 
Domain 
Knowledge 
Domain 
Knowledge 
Social 
systems 
Open 
Interfaces 
Open 
Interfaces 
Ambient 
Intelligence 
Quality and 
Trust 
Quality and 
Trust 
Privacy and 
Security 
Privacy and 
Security 
Open Data Open Data
In Conclusion 
− Smart cities are complex social systems and no technological and data-analytics- 
driven solution alone can solve the problems. 
− Combination of data from Physical, Cyber and Social sources can give more 
complete, complementary data and contributes to better analysis and 
insights. 
− Intelligent processing methods should be adaptable and handle dynamic, 
multi-modal, heterogeneous and noisy and incomplete data. 
− Effective visualisation and interaction methods are also key to develop 
successful solutions. 
− There are several solution for different parts of a data analytics framework in 
smart cities. An integrated approach is more effective in which IoT devices, 
communication networks, data analytics and learning algorithms and 
methods, services and interaction and visualistions and methods (and their 
optimisation algorithms) can work and cooperate together. 
30
Q&A 
− Thank you. 
− EU FP7 CityPulse Project: 
http://www.ict-citypulse.eu/ 
@ictcitypulse 
p.barnaghi@surrey.ac.uk

More Related Content

What's hot

Discovering Things and Things’ data/services
Discovering Things and  Things’ data/servicesDiscovering Things and  Things’ data/services
Discovering Things and Things’ data/servicesPayamBarnaghi
 
CityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applicationsCityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applicationsPayamBarnaghi
 
Information Engineering in the Age of the Internet of Things
Information Engineering in the Age of the Internet of Things Information Engineering in the Age of the Internet of Things
Information Engineering in the Age of the Internet of Things PayamBarnaghi
 
Internet of Things and Large-scale Data Analytics
Internet of Things and Large-scale Data Analytics Internet of Things and Large-scale Data Analytics
Internet of Things and Large-scale Data Analytics PayamBarnaghi
 
Dynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsDynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsPayamBarnaghi
 
Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things PayamBarnaghi
 
Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things PayamBarnaghi
 
Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things PayamBarnaghi
 
Data Analytics for Smart Cities: Looking Back, Looking Forward
Data Analytics for Smart Cities: Looking Back, Looking Forward Data Analytics for Smart Cities: Looking Back, Looking Forward
Data Analytics for Smart Cities: Looking Back, Looking Forward PayamBarnaghi
 
Smart Cities: How are they different?
Smart Cities: How are they different? Smart Cities: How are they different?
Smart Cities: How are they different? PayamBarnaghi
 
Internet of Things and Data Analytics for Smart Cities
Internet of Things and Data Analytics for Smart CitiesInternet of Things and Data Analytics for Smart Cities
Internet of Things and Data Analytics for Smart CitiesPayamBarnaghi
 
CityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applications CityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applications PayamBarnaghi
 
Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things PayamBarnaghi
 
What makes smart cities “Smart”?
What makes smart cities “Smart”? What makes smart cities “Smart”?
What makes smart cities “Smart”? PayamBarnaghi
 
Internet of Things and Data Analytics for Smart Cities and eHealth
Internet of Things and Data Analytics for Smart Cities and eHealthInternet of Things and Data Analytics for Smart Cities and eHealth
Internet of Things and Data Analytics for Smart Cities and eHealthPayamBarnaghi
 
Internet of Things: The story so far
Internet of Things: The story so farInternet of Things: The story so far
Internet of Things: The story so farPayamBarnaghi
 
How to make data more usable on the Internet of Things
How to make data more usable on the Internet of ThingsHow to make data more usable on the Internet of Things
How to make data more usable on the Internet of ThingsPayamBarnaghi
 
The impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart citiesThe impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart citiesCityPulse Project
 
The Future is Cyber-Healthcare
The Future is Cyber-Healthcare The Future is Cyber-Healthcare
The Future is Cyber-Healthcare PayamBarnaghi
 
Smart Cities and Data Analytics: Challenges and Opportunities
Smart Cities and Data Analytics: Challenges and Opportunities Smart Cities and Data Analytics: Challenges and Opportunities
Smart Cities and Data Analytics: Challenges and Opportunities PayamBarnaghi
 

What's hot (20)

Discovering Things and Things’ data/services
Discovering Things and  Things’ data/servicesDiscovering Things and  Things’ data/services
Discovering Things and Things’ data/services
 
CityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applicationsCityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applications
 
Information Engineering in the Age of the Internet of Things
Information Engineering in the Age of the Internet of Things Information Engineering in the Age of the Internet of Things
Information Engineering in the Age of the Internet of Things
 
Internet of Things and Large-scale Data Analytics
Internet of Things and Large-scale Data Analytics Internet of Things and Large-scale Data Analytics
Internet of Things and Large-scale Data Analytics
 
Dynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsDynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT Environments
 
Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things
 
Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things
 
Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things Intelligent Data Processing for the Internet of Things
Intelligent Data Processing for the Internet of Things
 
Data Analytics for Smart Cities: Looking Back, Looking Forward
Data Analytics for Smart Cities: Looking Back, Looking Forward Data Analytics for Smart Cities: Looking Back, Looking Forward
Data Analytics for Smart Cities: Looking Back, Looking Forward
 
Smart Cities: How are they different?
Smart Cities: How are they different? Smart Cities: How are they different?
Smart Cities: How are they different?
 
Internet of Things and Data Analytics for Smart Cities
Internet of Things and Data Analytics for Smart CitiesInternet of Things and Data Analytics for Smart Cities
Internet of Things and Data Analytics for Smart Cities
 
CityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applications CityPulse: Large-scale data analysis for smart city applications
CityPulse: Large-scale data analysis for smart city applications
 
Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things Semantic technologies for the Internet of Things
Semantic technologies for the Internet of Things
 
What makes smart cities “Smart”?
What makes smart cities “Smart”? What makes smart cities “Smart”?
What makes smart cities “Smart”?
 
Internet of Things and Data Analytics for Smart Cities and eHealth
Internet of Things and Data Analytics for Smart Cities and eHealthInternet of Things and Data Analytics for Smart Cities and eHealth
Internet of Things and Data Analytics for Smart Cities and eHealth
 
Internet of Things: The story so far
Internet of Things: The story so farInternet of Things: The story so far
Internet of Things: The story so far
 
How to make data more usable on the Internet of Things
How to make data more usable on the Internet of ThingsHow to make data more usable on the Internet of Things
How to make data more usable on the Internet of Things
 
The impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart citiesThe impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart cities
 
The Future is Cyber-Healthcare
The Future is Cyber-Healthcare The Future is Cyber-Healthcare
The Future is Cyber-Healthcare
 
Smart Cities and Data Analytics: Challenges and Opportunities
Smart Cities and Data Analytics: Challenges and Opportunities Smart Cities and Data Analytics: Challenges and Opportunities
Smart Cities and Data Analytics: Challenges and Opportunities
 

Viewers also liked

Multi-resolution Data Communication in Wireless Sensor Networks
Multi-resolution Data Communication in Wireless Sensor NetworksMulti-resolution Data Communication in Wireless Sensor Networks
Multi-resolution Data Communication in Wireless Sensor NetworksPayamBarnaghi
 
Semantic Sensor Service Networks
Semantic Sensor Service NetworksSemantic Sensor Service Networks
Semantic Sensor Service NetworksPayamBarnaghi
 
Data Modeling and Knowledge Engineering for the Internet of Things
Data Modeling and Knowledge Engineering for the Internet of ThingsData Modeling and Knowledge Engineering for the Internet of Things
Data Modeling and Knowledge Engineering for the Internet of ThingsPayamBarnaghi
 
Spatial Data on the Web
Spatial Data on the WebSpatial Data on the Web
Spatial Data on the WebPayamBarnaghi
 
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingA Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingPayamBarnaghi
 
IoT-Lite: A Lightweight Semantic Model for the Internet of Things
IoT-Lite:  A Lightweight Semantic Model for the Internet of ThingsIoT-Lite:  A Lightweight Semantic Model for the Internet of Things
IoT-Lite: A Lightweight Semantic Model for the Internet of ThingsPayamBarnaghi
 
Semantic Technologies for the Internet of Things: Challenges and Opportunities
Semantic Technologies for the Internet of Things: Challenges and Opportunities Semantic Technologies for the Internet of Things: Challenges and Opportunities
Semantic Technologies for the Internet of Things: Challenges and Opportunities PayamBarnaghi
 
Internet of Things: Concepts and Technologies
Internet of Things: Concepts and TechnologiesInternet of Things: Concepts and Technologies
Internet of Things: Concepts and TechnologiesPayamBarnaghi
 
How to make cities "smarter"?
How to make cities "smarter"?How to make cities "smarter"?
How to make cities "smarter"?PayamBarnaghi
 
Case study: #GoogleMoLang
Case study: #GoogleMoLangCase study: #GoogleMoLang
Case study: #GoogleMoLangnoreensayoc
 

Viewers also liked (11)

Multi-resolution Data Communication in Wireless Sensor Networks
Multi-resolution Data Communication in Wireless Sensor NetworksMulti-resolution Data Communication in Wireless Sensor Networks
Multi-resolution Data Communication in Wireless Sensor Networks
 
Semantic Sensor Service Networks
Semantic Sensor Service NetworksSemantic Sensor Service Networks
Semantic Sensor Service Networks
 
Data Modeling and Knowledge Engineering for the Internet of Things
Data Modeling and Knowledge Engineering for the Internet of ThingsData Modeling and Knowledge Engineering for the Internet of Things
Data Modeling and Knowledge Engineering for the Internet of Things
 
Spatial Data on the Web
Spatial Data on the WebSpatial Data on the Web
Spatial Data on the Web
 
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingA Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
 
IoT-Lite: A Lightweight Semantic Model for the Internet of Things
IoT-Lite:  A Lightweight Semantic Model for the Internet of ThingsIoT-Lite:  A Lightweight Semantic Model for the Internet of Things
IoT-Lite: A Lightweight Semantic Model for the Internet of Things
 
Semantic Technologies for the Internet of Things: Challenges and Opportunities
Semantic Technologies for the Internet of Things: Challenges and Opportunities Semantic Technologies for the Internet of Things: Challenges and Opportunities
Semantic Technologies for the Internet of Things: Challenges and Opportunities
 
Internet of Things: Concepts and Technologies
Internet of Things: Concepts and TechnologiesInternet of Things: Concepts and Technologies
Internet of Things: Concepts and Technologies
 
How to make cities "smarter"?
How to make cities "smarter"?How to make cities "smarter"?
How to make cities "smarter"?
 
Case study: #GoogleMoLang
Case study: #GoogleMoLangCase study: #GoogleMoLang
Case study: #GoogleMoLang
 
How To Promote Your Business On Pinterest
How To Promote Your Business On PinterestHow To Promote Your Business On Pinterest
How To Promote Your Business On Pinterest
 

Similar to Large-scale Data Analytics for Smart City Insights

IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...
IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...
IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...MicheleNati
 
Big Data & Smart City Applications
Big Data & Smart City ApplicationsBig Data & Smart City Applications
Big Data & Smart City ApplicationsAmit Sheth
 
Large scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use casesLarge scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use casesPayamBarnaghi
 
Making Sense of the Urban Future: Recommendation Systems in Smart Cities
Making Sense of the Urban Future: Recommendation Systems in Smart CitiesMaking Sense of the Urban Future: Recommendation Systems in Smart Cities
Making Sense of the Urban Future: Recommendation Systems in Smart CitiesDirk Ahlers
 
Smart City from the Data Perspective
Smart City from the Data PerspectiveSmart City from the Data Perspective
Smart City from the Data PerspectiveCharles Mok
 
Towards a Smart (City) Data Science. A case-based retrospective on policies, ...
Towards a Smart (City) Data Science. A case-based retrospective on policies, ...Towards a Smart (City) Data Science. A case-based retrospective on policies, ...
Towards a Smart (City) Data Science. A case-based retrospective on policies, ...Enrico Daga
 
u world 2012, Dalian, China
u world 2012, Dalian, China u world 2012, Dalian, China
u world 2012, Dalian, China Arpan Pal
 
Smart Cities from the systems point of view
Smart Cities from the systems point of viewSmart Cities from the systems point of view
Smart Cities from the systems point of viewAlexander SAMARIN
 
Big Data in a Digital City. Key Insights from the Smart City Case Study
Big Data in a Digital City. Key Insights from the Smart City Case StudyBig Data in a Digital City. Key Insights from the Smart City Case Study
Big Data in a Digital City. Key Insights from the Smart City Case StudyBYTE Project
 
Opportunities and methodological challenges of Big Data for official statist...
Opportunities and methodological challenges of  Big Data for official statist...Opportunities and methodological challenges of  Big Data for official statist...
Opportunities and methodological challenges of Big Data for official statist...Piet J.H. Daas
 
A Web of Things Based Eco-System for Urban Computing - Towards Smarter Cities
A Web of Things Based Eco-System for Urban Computing - Towards Smarter CitiesA Web of Things Based Eco-System for Urban Computing - Towards Smarter Cities
A Web of Things Based Eco-System for Urban Computing - Towards Smarter CitiesAndreas Kamilaris
 
To trust, or not to trust: Highlighting the need for data provenance in mobil...
To trust, or not to trust: Highlighting the need for data provenance in mobil...To trust, or not to trust: Highlighting the need for data provenance in mobil...
To trust, or not to trust: Highlighting the need for data provenance in mobil...Jon Lazaro Aduna
 
Big data and smart cities: Key data issues
Big data and smart cities: Key data issuesBig data and smart cities: Key data issues
Big data and smart cities: Key data issuesrobkitchin
 
Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...
Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...
Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...FIA2010
 
Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...
Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...
Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...Diego López-de-Ipiña González-de-Artaza
 
Big data: uncovering new mobility patterns and redefining planning practices
Big data: uncovering new mobility patterns and redefining planning practicesBig data: uncovering new mobility patterns and redefining planning practices
Big data: uncovering new mobility patterns and redefining planning practicesMickael Pero
 

Similar to Large-scale Data Analytics for Smart City Insights (20)

IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...
IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...
IoTMeetupGuildford#4: CityPulse Project Overview - Sefki Kolozali, Daniel Pus...
 
Big Data & Smart City Applications
Big Data & Smart City ApplicationsBig Data & Smart City Applications
Big Data & Smart City Applications
 
Large scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use casesLarge scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use cases
 
Making Sense of the Urban Future: Recommendation Systems in Smart Cities
Making Sense of the Urban Future: Recommendation Systems in Smart CitiesMaking Sense of the Urban Future: Recommendation Systems in Smart Cities
Making Sense of the Urban Future: Recommendation Systems in Smart Cities
 
EU FP7 CityPulse Project
EU FP7 CityPulse ProjectEU FP7 CityPulse Project
EU FP7 CityPulse Project
 
Smart City from the Data Perspective
Smart City from the Data PerspectiveSmart City from the Data Perspective
Smart City from the Data Perspective
 
Towards a Smart (City) Data Science. A case-based retrospective on policies, ...
Towards a Smart (City) Data Science. A case-based retrospective on policies, ...Towards a Smart (City) Data Science. A case-based retrospective on policies, ...
Towards a Smart (City) Data Science. A case-based retrospective on policies, ...
 
u world 2012, Dalian, China
u world 2012, Dalian, China u world 2012, Dalian, China
u world 2012, Dalian, China
 
Smart Cities from the systems point of view
Smart Cities from the systems point of viewSmart Cities from the systems point of view
Smart Cities from the systems point of view
 
Big Data in a Digital City. Key Insights from the Smart City Case Study
Big Data in a Digital City. Key Insights from the Smart City Case StudyBig Data in a Digital City. Key Insights from the Smart City Case Study
Big Data in a Digital City. Key Insights from the Smart City Case Study
 
Opportunities and methodological challenges of Big Data for official statist...
Opportunities and methodological challenges of  Big Data for official statist...Opportunities and methodological challenges of  Big Data for official statist...
Opportunities and methodological challenges of Big Data for official statist...
 
A Web of Things Based Eco-System for Urban Computing - Towards Smarter Cities
A Web of Things Based Eco-System for Urban Computing - Towards Smarter CitiesA Web of Things Based Eco-System for Urban Computing - Towards Smarter Cities
A Web of Things Based Eco-System for Urban Computing - Towards Smarter Cities
 
To trust, or not to trust: Highlighting the need for data provenance in mobil...
To trust, or not to trust: Highlighting the need for data provenance in mobil...To trust, or not to trust: Highlighting the need for data provenance in mobil...
To trust, or not to trust: Highlighting the need for data provenance in mobil...
 
Big data and smart cities: Key data issues
Big data and smart cities: Key data issuesBig data and smart cities: Key data issues
Big data and smart cities: Key data issues
 
Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...
Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...
Real World Internet, Smart Cities and Linked Data: Mirko Presser (Alexandrea ...
 
Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...
Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...
Internet of Things, Web of Data & Citizen Participation as Enablers of Smart ...
 
Building a City Dashboard
Building a City DashboardBuilding a City Dashboard
Building a City Dashboard
 
Smart_City
Smart_CitySmart_City
Smart_City
 
Big data: uncovering new mobility patterns and redefining planning practices
Big data: uncovering new mobility patterns and redefining planning practicesBig data: uncovering new mobility patterns and redefining planning practices
Big data: uncovering new mobility patterns and redefining planning practices
 
Presentación InnoLab Bilbao BetaBeers: Smart Cities DeustoTech
Presentación InnoLab Bilbao BetaBeers: Smart Cities DeustoTechPresentación InnoLab Bilbao BetaBeers: Smart Cities DeustoTech
Presentación InnoLab Bilbao BetaBeers: Smart Cities DeustoTech
 

More from PayamBarnaghi

Academic Research: A Survival Guide
Academic Research: A Survival GuideAcademic Research: A Survival Guide
Academic Research: A Survival GuidePayamBarnaghi
 
Reproducibility in machine learning
Reproducibility in machine learningReproducibility in machine learning
Reproducibility in machine learningPayamBarnaghi
 
Search, Discovery and Analysis of Sensory Data Streams
Search, Discovery and Analysis of Sensory Data StreamsSearch, Discovery and Analysis of Sensory Data Streams
Search, Discovery and Analysis of Sensory Data StreamsPayamBarnaghi
 
Internet Search: the past, present and the future
Internet Search: the past, present and the futureInternet Search: the past, present and the future
Internet Search: the past, present and the futurePayamBarnaghi
 
Scientific and Academic Research: A Survival Guide 
Scientific and Academic Research:  A Survival Guide Scientific and Academic Research:  A Survival Guide 
Scientific and Academic Research: A Survival Guide PayamBarnaghi
 
Lecture 8: IoT System Models and Applications
Lecture 8: IoT System Models and ApplicationsLecture 8: IoT System Models and Applications
Lecture 8: IoT System Models and ApplicationsPayamBarnaghi
 
Lecture 7: Semantic Technologies and Interoperability
Lecture 7: Semantic Technologies and InteroperabilityLecture 7: Semantic Technologies and Interoperability
Lecture 7: Semantic Technologies and InteroperabilityPayamBarnaghi
 
Lecture 6: IoT Data Processing
Lecture 6: IoT Data Processing Lecture 6: IoT Data Processing
Lecture 6: IoT Data Processing PayamBarnaghi
 
Lecture 5: Software platforms and services
Lecture 5: Software platforms and services Lecture 5: Software platforms and services
Lecture 5: Software platforms and services PayamBarnaghi
 
Internet of Things for healthcare: data integration and security/privacy issu...
Internet of Things for healthcare: data integration and security/privacy issu...Internet of Things for healthcare: data integration and security/privacy issu...
Internet of Things for healthcare: data integration and security/privacy issu...PayamBarnaghi
 
Scientific and Academic Research: A Survival Guide 
Scientific and Academic Research:  A Survival Guide Scientific and Academic Research:  A Survival Guide 
Scientific and Academic Research: A Survival Guide PayamBarnaghi
 
Semantic Technolgies for the Internet of Things
Semantic Technolgies for the Internet of ThingsSemantic Technolgies for the Internet of Things
Semantic Technolgies for the Internet of ThingsPayamBarnaghi
 
Smart Cities….Smart Future
Smart Cities….Smart FutureSmart Cities….Smart Future
Smart Cities….Smart FuturePayamBarnaghi
 

More from PayamBarnaghi (13)

Academic Research: A Survival Guide
Academic Research: A Survival GuideAcademic Research: A Survival Guide
Academic Research: A Survival Guide
 
Reproducibility in machine learning
Reproducibility in machine learningReproducibility in machine learning
Reproducibility in machine learning
 
Search, Discovery and Analysis of Sensory Data Streams
Search, Discovery and Analysis of Sensory Data StreamsSearch, Discovery and Analysis of Sensory Data Streams
Search, Discovery and Analysis of Sensory Data Streams
 
Internet Search: the past, present and the future
Internet Search: the past, present and the futureInternet Search: the past, present and the future
Internet Search: the past, present and the future
 
Scientific and Academic Research: A Survival Guide 
Scientific and Academic Research:  A Survival Guide Scientific and Academic Research:  A Survival Guide 
Scientific and Academic Research: A Survival Guide 
 
Lecture 8: IoT System Models and Applications
Lecture 8: IoT System Models and ApplicationsLecture 8: IoT System Models and Applications
Lecture 8: IoT System Models and Applications
 
Lecture 7: Semantic Technologies and Interoperability
Lecture 7: Semantic Technologies and InteroperabilityLecture 7: Semantic Technologies and Interoperability
Lecture 7: Semantic Technologies and Interoperability
 
Lecture 6: IoT Data Processing
Lecture 6: IoT Data Processing Lecture 6: IoT Data Processing
Lecture 6: IoT Data Processing
 
Lecture 5: Software platforms and services
Lecture 5: Software platforms and services Lecture 5: Software platforms and services
Lecture 5: Software platforms and services
 
Internet of Things for healthcare: data integration and security/privacy issu...
Internet of Things for healthcare: data integration and security/privacy issu...Internet of Things for healthcare: data integration and security/privacy issu...
Internet of Things for healthcare: data integration and security/privacy issu...
 
Scientific and Academic Research: A Survival Guide 
Scientific and Academic Research:  A Survival Guide Scientific and Academic Research:  A Survival Guide 
Scientific and Academic Research: A Survival Guide 
 
Semantic Technolgies for the Internet of Things
Semantic Technolgies for the Internet of ThingsSemantic Technolgies for the Internet of Things
Semantic Technolgies for the Internet of Things
 
Smart Cities….Smart Future
Smart Cities….Smart FutureSmart Cities….Smart Future
Smart Cities….Smart Future
 

Recently uploaded

call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSJoshuaGantuangco2
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxChelloAnnAsuncion2
 

Recently uploaded (20)

call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
 

Large-scale Data Analytics for Smart City Insights

  • 1. CityPulse: Large-scale data analytics for smart cities 1 Payam Barnaghi Institute for Communication Systems (ICS) University of Surrey Guildford, United Kingdom
  • 2. Smart City Data − Data is multi-modal and heterogeneous − Noisy and incomplete − Time and location dependent − Dynamic and varies in quality − Crowed sourced data can be unreliable − Requires (near-) real-time analysis − Privacy and security are important issues − Data alone may not give a clear picture -we need contextual information, background knowledge, multi-source information and obviously better data analytics solutions… 2
  • 4. What happens if we only focus on data − Number of burgers consumed per day. − Number of cats outside. − Number of people checking their facebook account. − What insight would you draw? 4
  • 5. What type of problems we expect to solve in “smart” cities
  • 6. Back to the future 6
  • 7. Future cities: a view from 1998 Source LAT Times, http://documents.latimes.com/la-2013/ 7
  • 9. 9
  • 10. The IoT and its applications 10 Diffusion of innovation IoT image source: Wikipedia The Most Hyped Technology image source: Forbes via Gartner
  • 11. Moving fast forward 11 Source: AdamKR via Flicker, http://www.flickr.com/photos/adamkr/5045295251/in/photostream/
  • 12. 12 We need an Integrated Approach
  • 13. 13 CityPulse Consortium Partners: Industrial SIE (Austria, Romania), ERIC SME AI Higher Education UNIS, NUIG, UASO, WSU City BR, AA Duration: 36 months
  • 15. CityPulse – what we are going to deliver ... Data Streams a) Software tools/libraries in an integrated framework b) Back-end support servers Smart City Framework Smart City Scenarios a) 101 scenarios b) 10 will be chosen to be prototyped a) Data portals/ real-time access interfaces b) Interoperable formats c) Common interfaces (REST/annotated) a) Proof-of- Concepts and demonstrators and evaluations; Applications/App s/Demos Link: http://www.ict-citypulse.eu/page/content/smart-city-use-cases-and-requirements
  • 16. Stream Processing ... Data Streams CityPulse
  • 17. Some of the key issues − Data collection, representation, interoperability − Indexing, search and selection − Storage and provision − Stream analysis, fusion and integration of multi-source, multi-modal and variable-quality data − Aggregation, abstraction, pattern extraction and time/location dependencies − Adaptive learning models for dynamic data − Reasoning methods for uncertain and incomplete data − Privacy, trust, security − Scalability and flexibility of the solutions 17
  • 18. Some of our recent in this domain 18
  • 21. 101 Smart City Use-case Scenarios http://www.ict-citypulse.eu/page/content/smart-city-use-cases-and-requirements
  • 22. 101 Scenarios − http://www.ict-citypulse.eu/page/content/smart-city- use-cases-and-requirements
  • 23. Data abstraction 23 F. Ganz, P. Barnaghi, F. Carrez, "Information Abstraction for Heterogeneous Real World Internet Data", IEEE Sensors Journal, 2013.
  • 24. Ontology learning from real world data 24
  • 25. Adaptable and dynamic learning methods http://kat.ee.surrey.ac.uk/
  • 26. Social media analysis (collaboration with Kno.e.sis, Wright State University) 26 Tweets from a city City Infrastructure https://osf.io/b4q2t/ P. Anantharam, P. Barnaghi, K. Thirunarayan, A. Sheth, "Extracting city events from social streams,“, under review, 2014.
  • 28. 28
  • 29. Data analytics framework Ambient Intelligence Social systems Interactions Interactions 29 Data Data Data: Domain Knowledge Domain Knowledge Social systems Open Interfaces Open Interfaces Ambient Intelligence Quality and Trust Quality and Trust Privacy and Security Privacy and Security Open Data Open Data
  • 30. In Conclusion − Smart cities are complex social systems and no technological and data-analytics- driven solution alone can solve the problems. − Combination of data from Physical, Cyber and Social sources can give more complete, complementary data and contributes to better analysis and insights. − Intelligent processing methods should be adaptable and handle dynamic, multi-modal, heterogeneous and noisy and incomplete data. − Effective visualisation and interaction methods are also key to develop successful solutions. − There are several solution for different parts of a data analytics framework in smart cities. An integrated approach is more effective in which IoT devices, communication networks, data analytics and learning algorithms and methods, services and interaction and visualistions and methods (and their optimisation algorithms) can work and cooperate together. 30
  • 31. Q&A − Thank you. − EU FP7 CityPulse Project: http://www.ict-citypulse.eu/ @ictcitypulse p.barnaghi@surrey.ac.uk