This document discusses smart city concepts and technologies from the Distributed Systems and Internet Technologies Lab. It covers major topics like smart city architecture, data collection and mining, reasoning and decision support. Specific areas like smart health, education, mobility, energy and governmental services are examined in terms of monitoring usage and behavior, providing personalized services, and improving efficiency. The overall aim is to enhance quality of life for citizens through innovative digital technologies and data-driven solutions.
Complexity of IOT/IOE Architectures for Smart Service Infrastructures Panel:...Paolo Nesi
The complexity of smart and sentient applications in smart cities is progressively increasing.
to reach higher precision.
time series prediction artificial intelligent, machine learning
Single data sets multi data sets, and big data: addressing heterogeneity, low quality and discontinuity, etc.
integration of open data, real time data and private IOT / personal data is increasing complexity of cyber-physical-social aspects:
to have the full control on the rights associated to their content
GDPR normative (since May 2018 in force) to regulate the access and control of privacy
I am bringing the experience of addressing
GDPR and Security and into Smart City Solutions with IOT
-----smart city impact----------------
Signed Consent vs Informed Consent
Smart Applications exploit personal data about (for example)
user position and actions for providing geolocated suggestions
home/work position, trajectories,
Payments and traces from bike sharing, from navigators, etc.
body signals/data for monitoring healthiness (glucose, temperature, etc.), for training sport, ..
User actions on applications: choices on menu, queries performed, mobile phones, requested paths, payments, etc.
IOT Devices data: mobile, buttons, trackers, but also temperature in house; position of our dogs, children, cars, bikes, …
etc.
----GDPR: General Data Protection Regulation ---
Users are going to decide to:
provide access to who, for do what, until we consent
accept terms of use by signed consent for each data management service, before was a simple informed consent
from each service, the user has to be capable to
See what the provider collect in terms of its Data Type: traces, logs, paths, profiles, accesses, IOT devices, sensors, maps, etc.
Download, delete, inspect each single Data Type
Auditing and Revoke access or grant access right to each single Data Type
Delete all Data Types in single shot or singularly (forget all about me)
Smart City at DISIT Lab, step two after smart city for beginnersPaolo Nesi
Smart City Concepts
Architecture of Smart City Infrastructures
Peripheral processors
Data ingestion and mining
Reasoning and Deduction
Data Acting processors
SmartCity Project Coll@bora
SmartCity Project Sii-Mobility
Data Mining and smart City problematic
DISIT Smart City Ontology
Data ingestion and integration
Service Map and Linked Open Graph
Blog Vigilance via Natural Language Processing
Mobile Emergency
Smart Health
Smart Education
Smart Mobility
Smart Energy
Smart Governmental
Smart economy
Smart people
Smart environment
Smart living
Smart Telecommunication
Overview on Smart City: Smart City for BeginnersPaolo Nesi
Smart City Concepts
Architecture of Smart City Infrastructures
Peripheral processors
Data ingestion and mining
Reasoning and Deduction
Data Acting processors
SmartCity Project Coll@bora
SmartCity Project Sii-Mobility
Data Mining and smart City problematics
DISIT Smart City Ontology
Data ingestion and integration
Service Map and Linked Open Graph
Blog Vigilance via Natural Language Processing
Smart City and Open Data Projects and tools of DISIT LabPaolo Nesi
Current research topics
• Social media, collaborative work, Mobile computing, OpenData, LOD
• SmartCity, BigData, data analytics
• Railway signaling, autonomous driving systems, formal methods
• Cloud Computing, grid computing, smart cloud
• Data Mining, Knowledge Acceleration, natural language processing
Main research results
• Knowledge Management and Natural Language Processing: OSIM, CoSkoSAM
• Content and Protection Management, grid computing: AXMEDIS AXCP
• Social Media, recommendations and tool: ECLAP.eu, MyStoryPlayer, Social Graph, IPR Wizard…
• Mobile Computing: Mobile Medicine, Mobile Emergency, etc.….
• Music Transcode, winner of MIREX for piano
• Awards: IEEE ICECCS, DMS, Italia degli Innovatori, etc.
Main sources of funding
• European Commission: ECLAP (social media, Cultural Heritage, open data), AXMEDIS (DRM, protection, automation e grid computing), WEDELMUSIC, IMAESTRO, VARIAZIONI, IMUTUS, MUSICNETWORK, MOODS, MUPAAC, OFCOMP, etc. ……
• Italian Ministry: Smart Cities COLL@BORA (collaborative work, social media), FIRB e PRIN
• Regional: SACVAR (knowledge mining and reasoning), TRACE‐IT (Railway signalling), RAISSS (Railway signalling), ICARO (cloud)
• Fondations: MatchMaking (NLP), OSIM (Knowledge Acceleration, NLP)
DISIT Potential challenges and interests
DISIT is interested in participating in the next calls of the European Commission and in particular for:
• Working on open data and linked open data for smart city, smart cloud, smart manufacturing, smart museum, etc.
• Creating semantic models and reasoning engines
• Creating data mining and natural language processing tools as SACVAR/OSIM
• Working on defining big data solutions and infrastructures
• Working on data analytics algorithms computing:
• Predictions and trends,
• unexpected correlations,
• data inconsistencies and incompleteness,
• etc.
Km4City: una soluzione aperta per erogare servizi Smart CityPaolo Nesi
Km4City: Integrated Urban Platform, Open Source
Aggregate & integrate data
Multiple protocols from urban operators, ....
open data, IOT, sensors, internet of everything, cloud, mobile devices, Wi-Fi, social media, ...
Data Exploitation performing
predictions, reasoning, business intelligence, ..
users behavior analysis, decision support system, ..
Control Room, Real Time Monitoring tools, ….
Produce value from data enabling to
Stimulate virtuous behavior, influence City Users!
Put in action CITY Strategies
DISIT: Competenze per Industria 4.0
Technical Areas:
Industrial Internet: integrazione di fabbrica, ..
Smart/Advanced manufacturing: mobility, delivering, optimization, etc.
(Smart City: mobility and transport, energy, IOT/IOE, analytics, …)
(Smart Retail: user behavior analysis, engagement, …)
Technologies:
Big Data and Analytics: data management, user analysis, user engagement, prediction, early detection, data intelligence, …
Data Mining: artificial intelligence, semantic computing, semantic reasoner, expert systems, statistic analysis, ..
IOT/IOE: internet of things/everything, brokers, microservices, ..
Cloud: smart cloud, cloud simulation, optimization, ..
Mobile Computing: mobile application, user behavior analysis, ..
NLP and Sentiment Analysis: response Vigilance, interaction, answering, ..
See projects on: http://www.disit.org/5501
Big Data analytics Aree Applicative
-Smart manufacturing
-Personal assistants
-Autonomous engine, semantic reasoners
-Experts systems
-Smart Cloud
-Services and microservices integration
-Industrie farmaceutiche
-Mobilità e Trasporti
-Turismo e Cultura
-Smart City, Innovation Lab
Servizi alla persona
Big Data Smart City processes and tools, Real Time data processing toolsPaolo Nesi
Big Data Smart City Architecture
Smart-city Ontology
Data Ingestion and Mining
-Data Ingestion Manager
-DataSets already integrated
-Static Data: harvesting
-Data Quality Improvement
-Data mapping to Triples
Distributed and real time processes
-Distributed Scheduler
-Real Time Data Ingestion
-Blog Vigilance, NLP, Text Mining
-Parallel and distributed processing
RDF processing
-RDF Store Indexing
-RDF Store Validation
-Semantic Interoperability, reconciliation
-RDF Store Enrichment, for link discovering
-RDF Store Enrichment, for service discovering via web crawling
Smart City Engine
-Service Level Agreements
-Distributed SPARQL queries
-Decision Support System Processes
Development Interfaces
-Service map: http://servicemap.disit.org
service based on OpenStreetMaps that allows to search services available in a preset range from the selected bus stop.
-Linked Open Graph: http://log.disit.org
a tool developed to allow exploring semantic graph of the relation among the entities. It can be used to access to many different LOD repository.
-Ontology Documentation: http://www.disit.org/6507,
http://www.disit.org/5606, http://www.disit.org/6461
-Data Status Web pages: active
Visual Query Graph: under development
Sii-Mobility
A Smart City Development kit for designing Web and Mobile AppsPaolo Nesi
Presentation of some of the Km4City development tools: ServiceMap and App Development Kit, ADK.
ServiceMap is focused on providing information to the developers, to help them learning how to access to the data model, to exploit and use the API
ADK is a drafted modular web and mobile application based on HTML5 and JavaScript (apache Cordova) that can be used to exploit Smart City API to develop a large range of applications.
It is modular, flexible, etc. and allow performing users behavior analysis.
The solutions are currently in use on several EC and national Projects such as: Sii-Mobility, RESOLUTE, REPLICATE, Weee, …
Cities aims at providing new Smart Services to city users:
operators, final users, etc.
In most cases via Web and Mobile Apps which exploit data:
Structural data, open data, real time data, etc., private data from companies
to be aggregated and transformed in services (providing: prediction, information, early warning, relations)
at reasonable cost for: developers, operators, and SME to realize new Apps and services.
If cost is not affordable, Services and Apps are not developed, in most cases the Apps are also provided for free, so that high costs are not sustainable Public Private Partnership
Scenarious vs SmartCity API
Search data: by text, near, along, etc...
Resolving text to GPS and formal city nodes model
Empowering the city users
Access to event information
Supporting City Users in using Public Mobility
Supporting City Users in using Private Mobility
New Experience to access at Cultural and Touristic info
New way to access at health services
Access at Environmental information
Profiled Suggestions to City Users
Personal Assistant
Sharing knowledge among cities
ServiceMap tool
with Km4City are substantially a Smart City Expert System, SCES
includes the Smart City API
is a for developers to: search and browse on Smart City Knowledge, also to generate examples of the Smart City API call to be used in the development of Web and Mobile Apps
The IEEE Smart World Congress originated from the 2005 Workshop on Ubiquitous Smart Worlds (USW, Taipei) and the 2005 Symposium on Ubiquitous Intelligence and Smart World (UISW, Nagasaki). SmartWorld 2017 in San Francisco is the next edition after the successful SmartWorld 2016 in Toulouse France and SmartWorld 2015 in Beijing China. SmartWorld 2017 is to provide a high-profile, leading-edge platform for researchers and engineers to exchange and explore state-of-art advances and innovations in graceful integrations of Cyber, Physical, Social, and Thinking Worlds for the theme
http://ieee-smartworld.org/2017/smartworld/
Complexity of IOT/IOE Architectures for Smart Service Infrastructures Panel:...Paolo Nesi
The complexity of smart and sentient applications in smart cities is progressively increasing.
to reach higher precision.
time series prediction artificial intelligent, machine learning
Single data sets multi data sets, and big data: addressing heterogeneity, low quality and discontinuity, etc.
integration of open data, real time data and private IOT / personal data is increasing complexity of cyber-physical-social aspects:
to have the full control on the rights associated to their content
GDPR normative (since May 2018 in force) to regulate the access and control of privacy
I am bringing the experience of addressing
GDPR and Security and into Smart City Solutions with IOT
-----smart city impact----------------
Signed Consent vs Informed Consent
Smart Applications exploit personal data about (for example)
user position and actions for providing geolocated suggestions
home/work position, trajectories,
Payments and traces from bike sharing, from navigators, etc.
body signals/data for monitoring healthiness (glucose, temperature, etc.), for training sport, ..
User actions on applications: choices on menu, queries performed, mobile phones, requested paths, payments, etc.
IOT Devices data: mobile, buttons, trackers, but also temperature in house; position of our dogs, children, cars, bikes, …
etc.
----GDPR: General Data Protection Regulation ---
Users are going to decide to:
provide access to who, for do what, until we consent
accept terms of use by signed consent for each data management service, before was a simple informed consent
from each service, the user has to be capable to
See what the provider collect in terms of its Data Type: traces, logs, paths, profiles, accesses, IOT devices, sensors, maps, etc.
Download, delete, inspect each single Data Type
Auditing and Revoke access or grant access right to each single Data Type
Delete all Data Types in single shot or singularly (forget all about me)
Smart City at DISIT Lab, step two after smart city for beginnersPaolo Nesi
Smart City Concepts
Architecture of Smart City Infrastructures
Peripheral processors
Data ingestion and mining
Reasoning and Deduction
Data Acting processors
SmartCity Project Coll@bora
SmartCity Project Sii-Mobility
Data Mining and smart City problematic
DISIT Smart City Ontology
Data ingestion and integration
Service Map and Linked Open Graph
Blog Vigilance via Natural Language Processing
Mobile Emergency
Smart Health
Smart Education
Smart Mobility
Smart Energy
Smart Governmental
Smart economy
Smart people
Smart environment
Smart living
Smart Telecommunication
Overview on Smart City: Smart City for BeginnersPaolo Nesi
Smart City Concepts
Architecture of Smart City Infrastructures
Peripheral processors
Data ingestion and mining
Reasoning and Deduction
Data Acting processors
SmartCity Project Coll@bora
SmartCity Project Sii-Mobility
Data Mining and smart City problematics
DISIT Smart City Ontology
Data ingestion and integration
Service Map and Linked Open Graph
Blog Vigilance via Natural Language Processing
Smart City and Open Data Projects and tools of DISIT LabPaolo Nesi
Current research topics
• Social media, collaborative work, Mobile computing, OpenData, LOD
• SmartCity, BigData, data analytics
• Railway signaling, autonomous driving systems, formal methods
• Cloud Computing, grid computing, smart cloud
• Data Mining, Knowledge Acceleration, natural language processing
Main research results
• Knowledge Management and Natural Language Processing: OSIM, CoSkoSAM
• Content and Protection Management, grid computing: AXMEDIS AXCP
• Social Media, recommendations and tool: ECLAP.eu, MyStoryPlayer, Social Graph, IPR Wizard…
• Mobile Computing: Mobile Medicine, Mobile Emergency, etc.….
• Music Transcode, winner of MIREX for piano
• Awards: IEEE ICECCS, DMS, Italia degli Innovatori, etc.
Main sources of funding
• European Commission: ECLAP (social media, Cultural Heritage, open data), AXMEDIS (DRM, protection, automation e grid computing), WEDELMUSIC, IMAESTRO, VARIAZIONI, IMUTUS, MUSICNETWORK, MOODS, MUPAAC, OFCOMP, etc. ……
• Italian Ministry: Smart Cities COLL@BORA (collaborative work, social media), FIRB e PRIN
• Regional: SACVAR (knowledge mining and reasoning), TRACE‐IT (Railway signalling), RAISSS (Railway signalling), ICARO (cloud)
• Fondations: MatchMaking (NLP), OSIM (Knowledge Acceleration, NLP)
DISIT Potential challenges and interests
DISIT is interested in participating in the next calls of the European Commission and in particular for:
• Working on open data and linked open data for smart city, smart cloud, smart manufacturing, smart museum, etc.
• Creating semantic models and reasoning engines
• Creating data mining and natural language processing tools as SACVAR/OSIM
• Working on defining big data solutions and infrastructures
• Working on data analytics algorithms computing:
• Predictions and trends,
• unexpected correlations,
• data inconsistencies and incompleteness,
• etc.
Km4City: una soluzione aperta per erogare servizi Smart CityPaolo Nesi
Km4City: Integrated Urban Platform, Open Source
Aggregate & integrate data
Multiple protocols from urban operators, ....
open data, IOT, sensors, internet of everything, cloud, mobile devices, Wi-Fi, social media, ...
Data Exploitation performing
predictions, reasoning, business intelligence, ..
users behavior analysis, decision support system, ..
Control Room, Real Time Monitoring tools, ….
Produce value from data enabling to
Stimulate virtuous behavior, influence City Users!
Put in action CITY Strategies
DISIT: Competenze per Industria 4.0
Technical Areas:
Industrial Internet: integrazione di fabbrica, ..
Smart/Advanced manufacturing: mobility, delivering, optimization, etc.
(Smart City: mobility and transport, energy, IOT/IOE, analytics, …)
(Smart Retail: user behavior analysis, engagement, …)
Technologies:
Big Data and Analytics: data management, user analysis, user engagement, prediction, early detection, data intelligence, …
Data Mining: artificial intelligence, semantic computing, semantic reasoner, expert systems, statistic analysis, ..
IOT/IOE: internet of things/everything, brokers, microservices, ..
Cloud: smart cloud, cloud simulation, optimization, ..
Mobile Computing: mobile application, user behavior analysis, ..
NLP and Sentiment Analysis: response Vigilance, interaction, answering, ..
See projects on: http://www.disit.org/5501
Big Data analytics Aree Applicative
-Smart manufacturing
-Personal assistants
-Autonomous engine, semantic reasoners
-Experts systems
-Smart Cloud
-Services and microservices integration
-Industrie farmaceutiche
-Mobilità e Trasporti
-Turismo e Cultura
-Smart City, Innovation Lab
Servizi alla persona
Big Data Smart City processes and tools, Real Time data processing toolsPaolo Nesi
Big Data Smart City Architecture
Smart-city Ontology
Data Ingestion and Mining
-Data Ingestion Manager
-DataSets already integrated
-Static Data: harvesting
-Data Quality Improvement
-Data mapping to Triples
Distributed and real time processes
-Distributed Scheduler
-Real Time Data Ingestion
-Blog Vigilance, NLP, Text Mining
-Parallel and distributed processing
RDF processing
-RDF Store Indexing
-RDF Store Validation
-Semantic Interoperability, reconciliation
-RDF Store Enrichment, for link discovering
-RDF Store Enrichment, for service discovering via web crawling
Smart City Engine
-Service Level Agreements
-Distributed SPARQL queries
-Decision Support System Processes
Development Interfaces
-Service map: http://servicemap.disit.org
service based on OpenStreetMaps that allows to search services available in a preset range from the selected bus stop.
-Linked Open Graph: http://log.disit.org
a tool developed to allow exploring semantic graph of the relation among the entities. It can be used to access to many different LOD repository.
-Ontology Documentation: http://www.disit.org/6507,
http://www.disit.org/5606, http://www.disit.org/6461
-Data Status Web pages: active
Visual Query Graph: under development
Sii-Mobility
A Smart City Development kit for designing Web and Mobile AppsPaolo Nesi
Presentation of some of the Km4City development tools: ServiceMap and App Development Kit, ADK.
ServiceMap is focused on providing information to the developers, to help them learning how to access to the data model, to exploit and use the API
ADK is a drafted modular web and mobile application based on HTML5 and JavaScript (apache Cordova) that can be used to exploit Smart City API to develop a large range of applications.
It is modular, flexible, etc. and allow performing users behavior analysis.
The solutions are currently in use on several EC and national Projects such as: Sii-Mobility, RESOLUTE, REPLICATE, Weee, …
Cities aims at providing new Smart Services to city users:
operators, final users, etc.
In most cases via Web and Mobile Apps which exploit data:
Structural data, open data, real time data, etc., private data from companies
to be aggregated and transformed in services (providing: prediction, information, early warning, relations)
at reasonable cost for: developers, operators, and SME to realize new Apps and services.
If cost is not affordable, Services and Apps are not developed, in most cases the Apps are also provided for free, so that high costs are not sustainable Public Private Partnership
Scenarious vs SmartCity API
Search data: by text, near, along, etc...
Resolving text to GPS and formal city nodes model
Empowering the city users
Access to event information
Supporting City Users in using Public Mobility
Supporting City Users in using Private Mobility
New Experience to access at Cultural and Touristic info
New way to access at health services
Access at Environmental information
Profiled Suggestions to City Users
Personal Assistant
Sharing knowledge among cities
ServiceMap tool
with Km4City are substantially a Smart City Expert System, SCES
includes the Smart City API
is a for developers to: search and browse on Smart City Knowledge, also to generate examples of the Smart City API call to be used in the development of Web and Mobile Apps
The IEEE Smart World Congress originated from the 2005 Workshop on Ubiquitous Smart Worlds (USW, Taipei) and the 2005 Symposium on Ubiquitous Intelligence and Smart World (UISW, Nagasaki). SmartWorld 2017 in San Francisco is the next edition after the successful SmartWorld 2016 in Toulouse France and SmartWorld 2015 in Beijing China. SmartWorld 2017 is to provide a high-profile, leading-edge platform for researchers and engineers to exchange and explore state-of-art advances and innovations in graceful integrations of Cyber, Physical, Social, and Thinking Worlds for the theme
http://ieee-smartworld.org/2017/smartworld/
Twitter Vigilance: a Multi-User platform for Cross-Domain Twitter Data Analyt...Paolo Nesi
Citizens as sensors to
Assess sentiment on services, events, …
Response of consumers wrt…
Early detection of critical conditions
Information channel
Opinion leaders
Communities
Formation
Predicting volume of visitors for tuning the services
Collecting Tweets
on the basis of several criterial, searches
Multiple users may have multiple searches and multiple purposes (views on those searches) minimization of searches
With high reliable model exploiting Twitter Search and/or Stream API
Performing NLP and Sentiment Analysis
Real time or daily
Multiple languages
Compute Metrics:
different kinds, etc.: volume, users, etc..
Low and High Level,
Work on daily, hourly and real time
Downloading data: raw data and derived metrics
Providing support for drilling down on data
to perform inspection and analysis, faceted search for instance
perform data analytics
exploiting metrics on Machine Learning and predictive tools
Providing API for querying, dashboard
The IEEE Smart World Congress originated from the 2005 Workshop on Ubiquitous Smart Worlds (USW, Taipei) and the 2005 Symposium on Ubiquitous Intelligence and Smart World (UISW, Nagasaki). SmartWorld 2017 in San Francisco is the next edition after the successful SmartWorld 2016 in Toulouse France and SmartWorld 2015 in Beijing China. SmartWorld 2017 is to provide a high-profile, leading-edge platform for researchers and engineers to exchange and explore state-of-art advances and innovations in graceful integrations of Cyber, Physical, Social, and Thinking Worlds for the theme
http://ieee-smartworld.org/2017/smartworld/
Keynote: Making Smarter Tuscany and Florence with Km4CityPaolo Nesi
Keynote at International Summit on Smart World and Smart Cities, In Conjunction With 2017 IEEE Smart World Congress
August 5, 2017, San Francisco, USA
http://smart-city-conference.com/summit2017/
Sentient Urban Platform for Smart City
Set up an ICT based Urban Platform integrated and unified data management among services, city operators and city users:
Control Room, Real Time Monitoring
decision support, assessing and monitoring risk and resilience
Data analytics and business intelligence
predictions, reasoning, city users behavior analysis, ….
Reading the city: big data, users behavior and needs, ...
IOT, Open data sensors, private data, static and real time data.
City Strategies: stimulate virtuous behavior of City Users
participation, totem, twitter, Apps, etc.
Transform Data into value
Put in action smart city innovative solutions and services, development tools
What is enabling and providing smart services
Smart Parking, in Tuscany
Smart First Aid in Tuscany
Smart Fuel pricing in Tuscany
Smart search for POI and public transport srv.
Public Transportation in Tuscany
Routing and multimodal in Tuscany
Social Media Monitoring and acting
Traffic events and Resilience in Florence
Bike Sharing in Pisa and Siena
Recharge stations for e-vehicles
Entertainment Events in Florence
Traffic Sensors in Tuscany
Weather forecast/condition in Tuscany
Pollution and Pollination in Tuscany
People Monitoring Assessment in the City, in Florence via WiFi
People Monitoring, in Tuscany via App
All Point of Interests, cultural activities, IOT, …
Over than 1.2 Million of complex events per day!
Functional Resonance Analysis Method based- Decision Support tool for Urban T...Paolo Nesi
Today, managing critical infrastructure resilience in smart city is a challenge that can be undertaken by adopting a new class of smart tools, which are able to integrate modeling capability with evidence driven decision support. The Resilience Decision Support tool, as presented in this article, is an innovative and powerful tool that aims at managing critical infrasctructure resilience through a more complex and expressive model based on the Functional Resonance Analysis Method and through the connection of such a model with a system thinking based decision support tool exploiting smart city data. Thanks to ResilienceDS, FRAM model becomes computable and the functional variability that is at the core of the resilience analysis can be quantified. Such quantification allows the decision support tool to compute specific strategies and recommendations for variability dampening at strategic, tactic and operational stage. The solution has been developed in the context of RESOLUTE H2020 project of the European Commission. Keywords—smart city, Functional Resonance Analysis Method; Decision Support System; Resilience; Urban Stransport System;
SEMANTIC TECHNIQUES FOR IOT DATA AND SERVICE MANAGEMENT: ONTOSMART SYSTEMijwmn
In 2020 more than50 billions devices will be connected over the Internet. Every device will be connected to
anything, anyone, anytime and anywhere in the world of Internet of Thing or IoT. This network will
generate tremendous unstructured or semi structured data that should be shared between different
devices/machines for advanced and automated service delivery in the benefits of the user’s daily life. Thus,
mechanisms for data interoperability and automatic service discovery and delivery should be offered.
Although many approaches have been suggested in the state of art, none of these researches provide a fully
interoperable, light, flexible and modular Sensing/Actuating as service architecture. Therefore, this paper
introduces a new Semantic Multi Agent architecture named OntoSmart for IoT data and service
management through service oriented paradigm. It proposes sensors/actuators and scenarios independent
flexible context aware and distributed architecture for IoT systems, in particular smart home systems.
Presentació a càrrec de Maria Isabel Gandia, cap de Comunicacions del CSUC, duta a terme al 10è SIG-NOC Meeting, celebrat els dies 13 i 14 de novembre de 2019 a Praga.
invited talk at iPHEM16, Innovation in Pre-hospital Emergency Medicine, Kent Surrey and Sussex Air Ambulance Trust, July 2016, Brighton, United Kingdom
IETF's Role and Mandate in Internet Governance by Mohit BatraOWASP Delhi
1. Internet Governance (IG) Primer
2. I-* Organizations
3. IANA function -Names, Numbers and Protocol Parameters
4. IANA Transition
5. WHOIS for names and numbers
6. Need for Standardization and Standardization Bodies
7. How IETF Works
8. TLS Protocol
9. Increasing Indian participation in global Internet Governance activities and structures
On Computer Science Trends and Priorities in PalestineMustafa Jarrar
On Computer Science Trends and Priorities in Palestine,
by Mustafa Jarrar
Computer Science
Birzeit University, Palestine
Personal Page: http://www.jarrar.info
At Workshop on ّIT Research Trends and Priorities
Islamic University of Gaza, Palestine
28 March, 2015
Semantic Web Methodologies, Best Practices and Ontology Engineering Applied t...Ghislain ATEMEZING
This talk presents some best practices and ontology engineering applied to internet of things. The talk was presented during the 2nd IEEE World Forum on Internet of Things held in Milan, from December 14th to December 16th, 2015.
Km4City: Smart City Ontology Building for Effective Erogation of ServicesPaolo Nesi
Provides a unique point of service with integrated and aggregated data and tools for
-- Qualified users: public administrations à developers
-- Operators: mobility, energy, SME, shops, ….. à developers
-- Final users à citizens, students, pendular, tourists
Problems:
--Aggregated Data are not available:
not semantically interoperable, heterogeneous for: format, vocabulary, structure, velocity, volume, ownership/control, access / license, …
---As OD, LD, LOD, private data, ..
---Lack of Services and tools to make the adoption simple
Final Users tools:
--Km4City mobile app with personal assistant is coming…
--Km4City mobile applications: Google Play, Apple Store, …
--Km4City web application: http://www.km4city.org
--Open Source Mobile Application, FODD: an example in open source http://www.disit.org/6595
Public administrator tools:
--Smart decision support system, http://smartds.disit.org
--Developers http://www.disit.org/km4city tools:
--Service Map Server, plus API, http://servicemap.disit.org
--LOG LOD browser: an ultimate visual tool to browse the RDF Store.
--Ontology Documentation: an ultimate tool to understand,
if needed !!
The dirty work of Km4City service
--Data Ingestion Manager, DIM
--RDF Indexer Manager, RIM
--RDF Store Methodology
--RDF store enricher with dbPedia
--Distributed SCE Scheduler, DISCES
--SCE: Smart City Engine
--Doc and info on http://www.disit.org/km4city
Km4City White Paper: Production tools for Smart City, from data to services f...Paolo Nesi
In the Smart City context, hundreds of data sets are available. Many of them are open data, accessible from local, regional, national, European public administrations, national institute of statistics, etc. These data can be static, statistical data or real time. In addition, many other data are produced by other institutions like Europeana, ECLAP, Getty, Voc, dbPedia, etc. Typically most of the data are geolocated and can be accessed as files in various formats (CSV, XLS, KMZ, JSON, XML, HTML, MySQL, ZIP, LSMA, SHP, etc.), other are accessible as Linked Data, Linked Open Data or via RDF Store end points (see dpPedia, Europeana, Senate of the Republic, Chamber of Deputies, ECLAP, km4city, etc.). Personal, private and critical data can be added to these open data. Some private data are produced by companies, like for example the position of car sharing vehicles, the position of taxis, busses, flows in the city, energy consumption data in a neighborhood, etc. Many of these data can be useful for public administrations to take decisions and to provide services. Personal data are related to a person, include personal identifications, the position of the person, its profile, etc., and need to be managed in accordance with terms of use and privacy policies. Finally, critical and personal data may be used by bad-intentioned to take actions against citizens security and infrastructures, and thus licensing and conditional access solutions are adopted.
Data are typically produced by central data producers, and many of these can provide their data in different ways and formats. Among them: traffic management systems, fleet management, LTZ management, hospitals, weather, social network, etc. These data have to be accessible by an aggregator that makes queries, understanding and data integration. This is not a trivial operation since it implies the semantic understanding of the data that have to be uniformed in a single data model. A single and unified model of aggregated data allows making integrated queries to provide these data via API, and the possibility to realize services and applications. Examples of services could be those that allow geographical search, the production of suggestions based on statistical evaluations, geographic structure, similarities, etc., also on the basis of citizen behaviors on the city and with respect to the available services.
Data aggregation and provision services enable the development of apps for tourism, cultural heritage, transport and mobility, personal services, wellness, energy saving, etc. actually these opportunities are difficult to be exploited for public administrations and companies. Mainly obstacles are related to the high costs of data integration and aggregation, due the limited interoperability among data that are produced in different periods by different entities and companies.
Km4City Smart City API: an integrated support for mobility servicesPaolo Nesi
AbstractThe main technical issues regarding smart city solutions are related todata gathering, aggregation, reasoning, access, and service delivering via Smart City APIs (Application Program Interfaces). Aggregated and re-conciliated data (open and private, static and real time) should be exploitable by reasoning/smart algorithms for enabling sophisticated service delivering. Different kinds of Smart City APIs enable Smart City Services and Applications, while their effectiveness depends on the architectural solutions to pass from data to services for city users and operators. To this end, a comparison of the state of the art solutions for data aggregation was performed, by putting in evidence the needs of semantic interoperable aggregated data, to provide smart services. This paper presents the work performed in the context of the Sii-Mobility national smart city project on mobility and transport integrated with services. Sii-Mobility is grounded on Km4City ontology and tools for smart city data aggregation and service production. To this end, Sii-Mobility/Km4City APIs have been compared to the state of the art solutions. Finally, the API consumption related data in the recent period are presented. Keywords smart city, smart city ontology, smart city API, smart mobility, multidomain smart city, smart services.
IEEE Smartcomp
Twitter Vigilance: a Multi-User platform for Cross-Domain Twitter Data Analyt...Paolo Nesi
Citizens as sensors to
Assess sentiment on services, events, …
Response of consumers wrt…
Early detection of critical conditions
Information channel
Opinion leaders
Communities
Formation
Predicting volume of visitors for tuning the services
Collecting Tweets
on the basis of several criterial, searches
Multiple users may have multiple searches and multiple purposes (views on those searches) minimization of searches
With high reliable model exploiting Twitter Search and/or Stream API
Performing NLP and Sentiment Analysis
Real time or daily
Multiple languages
Compute Metrics:
different kinds, etc.: volume, users, etc..
Low and High Level,
Work on daily, hourly and real time
Downloading data: raw data and derived metrics
Providing support for drilling down on data
to perform inspection and analysis, faceted search for instance
perform data analytics
exploiting metrics on Machine Learning and predictive tools
Providing API for querying, dashboard
The IEEE Smart World Congress originated from the 2005 Workshop on Ubiquitous Smart Worlds (USW, Taipei) and the 2005 Symposium on Ubiquitous Intelligence and Smart World (UISW, Nagasaki). SmartWorld 2017 in San Francisco is the next edition after the successful SmartWorld 2016 in Toulouse France and SmartWorld 2015 in Beijing China. SmartWorld 2017 is to provide a high-profile, leading-edge platform for researchers and engineers to exchange and explore state-of-art advances and innovations in graceful integrations of Cyber, Physical, Social, and Thinking Worlds for the theme
http://ieee-smartworld.org/2017/smartworld/
Keynote: Making Smarter Tuscany and Florence with Km4CityPaolo Nesi
Keynote at International Summit on Smart World and Smart Cities, In Conjunction With 2017 IEEE Smart World Congress
August 5, 2017, San Francisco, USA
http://smart-city-conference.com/summit2017/
Sentient Urban Platform for Smart City
Set up an ICT based Urban Platform integrated and unified data management among services, city operators and city users:
Control Room, Real Time Monitoring
decision support, assessing and monitoring risk and resilience
Data analytics and business intelligence
predictions, reasoning, city users behavior analysis, ….
Reading the city: big data, users behavior and needs, ...
IOT, Open data sensors, private data, static and real time data.
City Strategies: stimulate virtuous behavior of City Users
participation, totem, twitter, Apps, etc.
Transform Data into value
Put in action smart city innovative solutions and services, development tools
What is enabling and providing smart services
Smart Parking, in Tuscany
Smart First Aid in Tuscany
Smart Fuel pricing in Tuscany
Smart search for POI and public transport srv.
Public Transportation in Tuscany
Routing and multimodal in Tuscany
Social Media Monitoring and acting
Traffic events and Resilience in Florence
Bike Sharing in Pisa and Siena
Recharge stations for e-vehicles
Entertainment Events in Florence
Traffic Sensors in Tuscany
Weather forecast/condition in Tuscany
Pollution and Pollination in Tuscany
People Monitoring Assessment in the City, in Florence via WiFi
People Monitoring, in Tuscany via App
All Point of Interests, cultural activities, IOT, …
Over than 1.2 Million of complex events per day!
Functional Resonance Analysis Method based- Decision Support tool for Urban T...Paolo Nesi
Today, managing critical infrastructure resilience in smart city is a challenge that can be undertaken by adopting a new class of smart tools, which are able to integrate modeling capability with evidence driven decision support. The Resilience Decision Support tool, as presented in this article, is an innovative and powerful tool that aims at managing critical infrasctructure resilience through a more complex and expressive model based on the Functional Resonance Analysis Method and through the connection of such a model with a system thinking based decision support tool exploiting smart city data. Thanks to ResilienceDS, FRAM model becomes computable and the functional variability that is at the core of the resilience analysis can be quantified. Such quantification allows the decision support tool to compute specific strategies and recommendations for variability dampening at strategic, tactic and operational stage. The solution has been developed in the context of RESOLUTE H2020 project of the European Commission. Keywords—smart city, Functional Resonance Analysis Method; Decision Support System; Resilience; Urban Stransport System;
SEMANTIC TECHNIQUES FOR IOT DATA AND SERVICE MANAGEMENT: ONTOSMART SYSTEMijwmn
In 2020 more than50 billions devices will be connected over the Internet. Every device will be connected to
anything, anyone, anytime and anywhere in the world of Internet of Thing or IoT. This network will
generate tremendous unstructured or semi structured data that should be shared between different
devices/machines for advanced and automated service delivery in the benefits of the user’s daily life. Thus,
mechanisms for data interoperability and automatic service discovery and delivery should be offered.
Although many approaches have been suggested in the state of art, none of these researches provide a fully
interoperable, light, flexible and modular Sensing/Actuating as service architecture. Therefore, this paper
introduces a new Semantic Multi Agent architecture named OntoSmart for IoT data and service
management through service oriented paradigm. It proposes sensors/actuators and scenarios independent
flexible context aware and distributed architecture for IoT systems, in particular smart home systems.
Presentació a càrrec de Maria Isabel Gandia, cap de Comunicacions del CSUC, duta a terme al 10è SIG-NOC Meeting, celebrat els dies 13 i 14 de novembre de 2019 a Praga.
invited talk at iPHEM16, Innovation in Pre-hospital Emergency Medicine, Kent Surrey and Sussex Air Ambulance Trust, July 2016, Brighton, United Kingdom
IETF's Role and Mandate in Internet Governance by Mohit BatraOWASP Delhi
1. Internet Governance (IG) Primer
2. I-* Organizations
3. IANA function -Names, Numbers and Protocol Parameters
4. IANA Transition
5. WHOIS for names and numbers
6. Need for Standardization and Standardization Bodies
7. How IETF Works
8. TLS Protocol
9. Increasing Indian participation in global Internet Governance activities and structures
On Computer Science Trends and Priorities in PalestineMustafa Jarrar
On Computer Science Trends and Priorities in Palestine,
by Mustafa Jarrar
Computer Science
Birzeit University, Palestine
Personal Page: http://www.jarrar.info
At Workshop on ّIT Research Trends and Priorities
Islamic University of Gaza, Palestine
28 March, 2015
Semantic Web Methodologies, Best Practices and Ontology Engineering Applied t...Ghislain ATEMEZING
This talk presents some best practices and ontology engineering applied to internet of things. The talk was presented during the 2nd IEEE World Forum on Internet of Things held in Milan, from December 14th to December 16th, 2015.
Km4City: Smart City Ontology Building for Effective Erogation of ServicesPaolo Nesi
Provides a unique point of service with integrated and aggregated data and tools for
-- Qualified users: public administrations à developers
-- Operators: mobility, energy, SME, shops, ….. à developers
-- Final users à citizens, students, pendular, tourists
Problems:
--Aggregated Data are not available:
not semantically interoperable, heterogeneous for: format, vocabulary, structure, velocity, volume, ownership/control, access / license, …
---As OD, LD, LOD, private data, ..
---Lack of Services and tools to make the adoption simple
Final Users tools:
--Km4City mobile app with personal assistant is coming…
--Km4City mobile applications: Google Play, Apple Store, …
--Km4City web application: http://www.km4city.org
--Open Source Mobile Application, FODD: an example in open source http://www.disit.org/6595
Public administrator tools:
--Smart decision support system, http://smartds.disit.org
--Developers http://www.disit.org/km4city tools:
--Service Map Server, plus API, http://servicemap.disit.org
--LOG LOD browser: an ultimate visual tool to browse the RDF Store.
--Ontology Documentation: an ultimate tool to understand,
if needed !!
The dirty work of Km4City service
--Data Ingestion Manager, DIM
--RDF Indexer Manager, RIM
--RDF Store Methodology
--RDF store enricher with dbPedia
--Distributed SCE Scheduler, DISCES
--SCE: Smart City Engine
--Doc and info on http://www.disit.org/km4city
Km4City White Paper: Production tools for Smart City, from data to services f...Paolo Nesi
In the Smart City context, hundreds of data sets are available. Many of them are open data, accessible from local, regional, national, European public administrations, national institute of statistics, etc. These data can be static, statistical data or real time. In addition, many other data are produced by other institutions like Europeana, ECLAP, Getty, Voc, dbPedia, etc. Typically most of the data are geolocated and can be accessed as files in various formats (CSV, XLS, KMZ, JSON, XML, HTML, MySQL, ZIP, LSMA, SHP, etc.), other are accessible as Linked Data, Linked Open Data or via RDF Store end points (see dpPedia, Europeana, Senate of the Republic, Chamber of Deputies, ECLAP, km4city, etc.). Personal, private and critical data can be added to these open data. Some private data are produced by companies, like for example the position of car sharing vehicles, the position of taxis, busses, flows in the city, energy consumption data in a neighborhood, etc. Many of these data can be useful for public administrations to take decisions and to provide services. Personal data are related to a person, include personal identifications, the position of the person, its profile, etc., and need to be managed in accordance with terms of use and privacy policies. Finally, critical and personal data may be used by bad-intentioned to take actions against citizens security and infrastructures, and thus licensing and conditional access solutions are adopted.
Data are typically produced by central data producers, and many of these can provide their data in different ways and formats. Among them: traffic management systems, fleet management, LTZ management, hospitals, weather, social network, etc. These data have to be accessible by an aggregator that makes queries, understanding and data integration. This is not a trivial operation since it implies the semantic understanding of the data that have to be uniformed in a single data model. A single and unified model of aggregated data allows making integrated queries to provide these data via API, and the possibility to realize services and applications. Examples of services could be those that allow geographical search, the production of suggestions based on statistical evaluations, geographic structure, similarities, etc., also on the basis of citizen behaviors on the city and with respect to the available services.
Data aggregation and provision services enable the development of apps for tourism, cultural heritage, transport and mobility, personal services, wellness, energy saving, etc. actually these opportunities are difficult to be exploited for public administrations and companies. Mainly obstacles are related to the high costs of data integration and aggregation, due the limited interoperability among data that are produced in different periods by different entities and companies.
Km4City Smart City API: an integrated support for mobility servicesPaolo Nesi
AbstractThe main technical issues regarding smart city solutions are related todata gathering, aggregation, reasoning, access, and service delivering via Smart City APIs (Application Program Interfaces). Aggregated and re-conciliated data (open and private, static and real time) should be exploitable by reasoning/smart algorithms for enabling sophisticated service delivering. Different kinds of Smart City APIs enable Smart City Services and Applications, while their effectiveness depends on the architectural solutions to pass from data to services for city users and operators. To this end, a comparison of the state of the art solutions for data aggregation was performed, by putting in evidence the needs of semantic interoperable aggregated data, to provide smart services. This paper presents the work performed in the context of the Sii-Mobility national smart city project on mobility and transport integrated with services. Sii-Mobility is grounded on Km4City ontology and tools for smart city data aggregation and service production. To this end, Sii-Mobility/Km4City APIs have been compared to the state of the art solutions. Finally, the API consumption related data in the recent period are presented. Keywords smart city, smart city ontology, smart city API, smart mobility, multidomain smart city, smart services.
IEEE Smartcomp
Km4City, Smart City Urban Platform, From Data to Services for the Sentient Ci...Paolo Nesi
Km4City From Data to Services for the Sentient Cities
Open Source and inter-operable tools to keep city under control via personalized dashboards
- monitoring services’ status of city operators
- monitoring and understanding the city users behaviour
- collecting moods, contributions and data from the city users
- monitoring social media for city services and events, event predictions
improve city resilience, reducing risks and decision support by:
- assessing city resilience level
- improving city resilience, providing objective hints
- improving city users awareness with personal city assistants and participatory tools
transform data in value for the city:
- enabling commercial and business applications
- aggregating multi-domain data and services for SMEs and city operators
- enabling integrated city services into third party web portal for all
- providing suggestion on demand services for SMEs and city operators
- accelerating and simplifying the implementation of business and service oriented Apps
Follow the Km4City City Smartener Process
Smart City Strategic Forecast, SmartCity360, BratislavaPaolo Nesi
Smart City strategy, city smartening, big data amanagement,
-Taking into account results of participatory actions
-Smart city strategic plan, city agenda: prioritizing interventions
-Agreements for collaborations with main actors:
main research centers, main City Operators, etc.
-Direct collaborations on specific projects on:
ICT, Mobility, Culture, Energy, etc.
Experimenting on specific projects of the Smart City Strategic Plan
-Needs of harmonizing results and aggregating data towards dashboards
ICARO: soluzioni e strumenti smart per avere maggiore flessibilità sul Cloud; adattare soluzioni software alle nuove esigenze cloud-based; produrre e gestire servizi a consumo: Business Process as a Service.
ICARO: Tramite modelli, strumenti e algoritmi per la gestione della configurazione e del deploy dei servizi e processi cloud; Il middleware e l’astrazione dei servizi sul cloud; l’ottimizzazione dei costi per le PMI e per la gestione del cloud.
ICARO permette: automatizzare il processo di pubblicazione e vendita delle applicazioni a consumo su cloud; automatizzare il processo di monitoraggio di basso ed alto livello e l'impostazione di strategie di smart cloud; automatizzare il controllo sulle SLA (service level agreement) in modo da associare ad evetuali disfuzioni azioni di scaling, riconfigurazione, etc.
ICARO ha sviluppato: modello descrittivo per servizi e applicazioni;
sistema automatico di configurazione;
motore di intelligence per il cloud e reasoner che prendere decisioni su configurazioni: consistenza e completezza (sulla base din un ontologia Cloud per lo Smart Cloud);
soluzione di produzione del business, config automatica;
algoritmi per il monitoraggio del comportamento di servizi e applicazioni: IaaS, PaaS, SaaS,…;
soluzione PaaS di tipo evoluto; algoritmi per la valutazione di modelli di costo e di business;
adeguamento dell’architettura su alcune applicazioni; algoritmi di ottimizzazione della gestione del cloud.
RESOLUTE: Resilience management guidelines and Operationalization applied to ...Paolo Nesi
--Conducting a systematic review and assessment of the state of the art of the Resilience assessment and Management concepts, national guidelines and their implementation strategies in order to develop a conceptual framework for resilience within Urban Transport Systems
--Development of European Resilience Management Guidelines (ERMG)
--Operationalize and validate the ERMG by implementing the RESOLUTE Collaborative Resilience Assessment and Management Support System (CRAMSS) for Urban Transport System (UTS) addressing Roads and Rails Infrastructures
--Enhancing resilience through improved support to human decision making processes, particularly through increased focus on the training of final users (first responders, civil protections, infrastructure managers) and population on ERMG and RESOLUTE system
--ERMG wide dissemination, acceptance and adoption at EU and Associated Countries level
DRS-7-2015 - RIA – start 1/5/2015 - end 30/4/2018 Budget 3.8M
Aggregatore di Open Data del territorio fiorentino e toscano Paolo Nesi
Dati statici e dinamici
Dati da: comune, Digital Location
Dati Real time: eventi, MIIC, Gestore (AVM, Sensori traffico, Parcheggi), LAMMA METEO, ..
Dati da UNIFI: OSIM service in LOD, RDF Store.
Dati da Social media: twitter, non ancora
Dati da Camera di Commercio: … non ancora…
Dati di flusso: da Wifi, beacom, IOT, etc.
Obiettivi e Progetti
Architettura di riferimento: in, proc, out, services
servizi, deduzioni, correlazioni, predizioni, etc.
Applicazioni: Smart City e mobilita’, energia e Smart grid, Cultural Heritage, Turismo, Decision Support Systems, Risk Assessment, Smart School, Smart Health, etc.
Progetti UNIFI: Sii-mobility SCN, Coll@bora SIN
La sfida dell’aggregazione
A che servono: Query per servizi di base e complessi:
geografiche, near to here; per comune;
NOW dati Real Time; …………………..con inferenza, per text ..
Next relevant event, …. What may happen here………
Why this event occurred….
Cloud be this feasible ???
Problematiche:
Dati di limitata interoperabilita’ semantica e qualita’ –> con molti si ottiene maggiore qualita’, l’interoperabilita’ va conquistata
Gestione grosse moli di dati, flussi, etc.
Soluzioni
Ontologia + Dati, knowledge base, inferenza, ragionamento, Ontologia Km4City
Processi di Processi di quality improvement, riconciliazione
Processi di valutazione e di supporto alle decisioni
Servizi per l’accesso ai dati
LD e RDF Store: ECLAP, OSIM, ICARO Cloud, Km4City, etc..
RDF Store, and RDF SPARQL query
LOG: Linked Open Graph, query integrate e navigazione fra store di varie istituzioni: dbpedia, Europeana, Senato, Camera, Comune, Getty, Geonames, etc. etc.
Service map
Architettura
aggregazione servizi di calcolo, parallel and distributed: Scheduler as GRID, Hadoop
NLP, quality improvement, etc.
Arricchimenti per Link e per Location
Processi di data mining, semantic computing, DSS
Graph Databases Lifecycle Methodology and Tool to Support Index/Store Versio...Paolo Nesi
Abstract— Graph databases are taking place in many different applications: smart city, smart cloud, smart education, etc. In most cases, the applications imply the creation of ontologies and the integration of a large set of knowledge to build a knowledge base as an RDF KB store, with ontologies, static data, historical data and real time data. Most of the RDF stores are endowed of inferential engines that materialize some knowledge as triples during indexing or querying. In these cases, deleting concepts may imply the removal and change of many triples, especially if the triples are those modeling the ontological part of the knowledge base, or are referred by many other concepts. For these solutions, the graph database versioning feature is not provided at level of the RDF stores tool, and it is quite complex and time consuming to be addressed as black box approach. In most cases the indexing is a time consuming process, and the rebuilding of the KB may imply manually edited long scripts that are error prone. Therefore, in order to solve these kinds of problems, this paper proposes a lifecycle methodology and a tool supporting versioning of indexes for RDF KB store. The solution proposed has been developed on the basis of a number of knowledge oriented projects as Sii-Mobility (smart city), RESOLUTE (smart city risk assessment), ICARO (smart cloud). Results are reported in terms of time saving and reliability.
Keywords — RDF Knowledge base versioning, graph stores versioning, RDF store management, knowledge base life cycle.
Monitoring Public Attention on Environment Issues with Twitter VigilancePaolo Nesi
DISIT Twitter Vigilance is an intelligent multi user tool for creating personal dashboards and study events and trends on Twitter that becomes a mining tool to "Twitter channels" contents. Each channel can be tuned to monitor one or more Search Queries on Twitter with a sophisticated and expressive syntax. Registered users of DISIT Twitter Vigilance tool and service are abled to:
• Create one or more channels (“canale”), as reported in the figure each channel can be tuned to monitor one or more Search Queries on Twitter with a sophisticated and expressive syntax. The simplest query can be the single keyword, tag or user.
• Create and activate multiple channels, that may use new or the same Search Queries;
• Provide public access to their channels analysis (as in the channels accessible without registration);
• Download data sets (trough API service ) for refined analysis;
• Full access at the channel history of User's content per channel, per search, per users, etc.;
• Perform visual view throughput graphs and to export them in different graphic format;
• Perform analyses at level of channel, search, users, tweets, retweets, etc.:
o trends of the Search Queries as reported in the above figure;
o distributions on population and activities of users;
o distributions about other tags/keywords;
o geographic distribution of twitters of single or multiple channels;
o distributions regarding tweet and re-tweets.
A number of research activities on these data area under development.
Km4City: Knowledge Model 4 the City: molti dati + km4city = +conoscenza e se...Paolo Nesi
Dati statici e dinamici
Obiettivi e Progetti
La sfida dell’aggregazione
Servizi per l’accesso ai dati
Lo Sviluppo di Applicazioni Web e mobile con modello Km4city
FODD 2015 Mobile App based on ServiceMap, http://www.disit.org/foddPaolo Nesi
FODD, Florence Open Data Day
Salone de’ Dugento, Palazzo Vecchio, Firenze
21/02/2015, http://www.disit.org/fodd
Ing. Ph.D Ivan Bruno
Obiettivo
Utilizzare i servizi (API REST) esposti da servicemap.disit.org
Visualizzare informazioni tempo reale / dinamiche
Realizzare un app per l’evento
Non solo una demo ma un’app estendibile e modificabile
Semplificazione
Menu configurabile
Gestione viste: una logica di gestione delle viste statiche e di quelle dinamiche da costruire a runtime sui dati JSON provenienti dalle chiamate REST via AJAX
Semplificare la gestione delle viste costruite sui dati JSON utilizzando soluzioni template-based
Rilevazione stato connessione internet del dispositivo
Notifica di anomalie (connessione assente, errori di connessioni al server....)
Portabilità su diversi dispositivi mobili
Km4City: A reusable example of a Metropolitan-Wide Data Platform, MAJORCITIES...Paolo Nesi
Open Source and inter-operable tools to: (i) keep city under control via personalized dashboards - monitoring services status of city operators; - monitoring and understanding the city users behaviour; - collecting moods, contributions and data from the city users; - monitoring social media for city services and events, event predictions; (ii) improve city resilience, reducing risks and decision support by: - assessing city resilience level; - improving city resilience, providing objective hints; - improving city users awareness with personal city assistants and participatory tools; (iii) transform data in value for the city: - enabling commercial and business applications; - aggregating multi-domain data and services for SMEs and city operators; - enabling integrated city services into third party web portal for all; - providing suggestion on demand services for SMEs and city operators; - accelerating and simplifying the implementation of business and service oriented Apps. Follow the Km4City City Smartener Process
Smart Cloud Engine and Solution based on Knowledge BasePaolo Nesi
Complexity of cloud infrastructures needs models and tools for process management, configuration, scaling, elastic computing and healthiness control. This paper presents a Smart Cloud solution based on a Knowledge Base, KB, with the aim of modeling cloud resources, Service Level Agreements and their evolution, and enabling the reasoning on structures by implementing strategies of efficient smart cloud management and intelligence. The solution proposed provides formal verification tools and intelligence for cloud control. It can be easily integrated with any cloud configuration manager, cloud orchestrator, and monitoring tool, since the connections with these tools are performed by using REST calls and XML files. It has been validated in the large ICARO Cloud project with a national cloud service provider.
Basi di dati, SQL
Casi: Analisi della struttura di documenti
Intelligenza Artificiale
Apprendimento, clustering, alberi decisionali
Web crawling, XML, analisi dei testo
Casi di studio: OSIM
Reasoning and inferential
Big data introduction: NoSQL, graph database, ..
Social Media: user profiling, recommendations
Caso di Studio: Twitter Vigilance, sentiment analysis
Architetture parallele
Casi di studio: smart city
Casi di studio: Smart Cloud
Estrazione e Deduzione della Conoscenza via Modelli Semantici: From Social N...Paolo Nesi
Slides for the PHD course at the DINFO dept of the University of Florence, 2014
Social Networking and knowledge, Semantic and Social Networks, Recommendations and Suggestions, Natural Language Processing System, Knowledge Representation System, Reasoning System, Sistema OSIM, Smart Cities, Open Data, LOD, Linked Open Graph, Data Mining, data modeling, knowledge management, reasoning, smart city
Knowledge Management and Natural Language Processing: OSIM, CoSkoSAM
Content and Protection Management, grid computing: AXMEDIS AXCP
Social Media, recommendations and tool: ECLAP.eu, MyStoryPlayer, Social Graph, IPR Wizard…
PROJECTS: sii-mobility, OSIM, SACVAR, ECLAP, Coll@bora.
Twitter Vigilance: Modelli e Strumenti per l’Analisi e lo Studio di Dati Soci...Paolo Nesi
Twitter Vigilance: le analisi http://www.disit.org
Analisi e caratterizzazione della comunicazione
Percezione sociale, eventi pubblici, naturali..
Scoprire, identificare e calcolare
Nascita / crescita di nuove occorrenze in tempo reale: eventi, fatti, meteo, condizioni critiche, etc.
Supporto alla decisioni, ridurre i tempi di reazione, valutare la percezione, ridurre i costi, incrementare la resilienza come capacità di reagire, diagnosi precoce
Chi influenza la comunicazione, le comunità e come: i pusher, gli attori, i follower, le sorgenti, etc.
Predizione su eventi periodici, per esempio presenze ad eventi, presenze sui canali televisivi, vendite aziende, etc.
Misure indirette basate sulla popolazione: rischio sicurezza, degrado, neve, grandine, vento, fallimenti, etc.
The data!
Services from Data via Smart City API
IOT Applications and IOT
Personal Data vs Open
Big Data Analytics
App as data collection and User Engagement
Social Media Analysis
Visual Analytics and Dashboards
The Living Lab Approach
DISIT lab Overview on Tourism and Training, June 2014Paolo Nesi
Semantic Model and Tools
• OSIM, knowledge mining, competence management
• RDF stores, Open Data, Linked Open Data management
• Content Tools
• Content modeling, indexing and querying, recommendations
• Content management and distribution
• Intellectual property management and conditional access (enabling
and actuating legal control)
• Devices:
• iOS Apple, Android, Windows Phone, Smart TV
• Tourism
• Open Data and Smart City data
• Training E‐learning
• Tools for e‐learning/distance/blended learning, anywhere learning,
certified e‐learning, social learning and networking
KM4city, Il Valore degli #OpenData: Esperienze a confrontoPaolo Nesi
le città si stanno adeguando alle crescenti necessità cercando di: garantire elevati livelli di qualità della vita, fornire nuovi servizi; limitando i costi, aumento di efficienza; allestire strutture decisionali adeguate; facilitare la creazione di nuovi servizi anche da parte di terzi:
-Pubblicazione Open Data
-Creare i presupposti per un mercato dei dati anche privati ma connessi agli -OpenData
->per una la crescita sostenibile da vari punti di vista
I dati, statici e real time sono stati resi interoperabili tramite algoritmi di data mining che possono essere applicati anche alle vostre problematiche
I dati aggregati ora sono accessibili in modo semplice tramite degli strumenti di sviluppo ed accesso che permettono di abbattere I costi di sviluppo delle applicazioni web e mobili
Service Map:http://servicemap.disit.org
Permette allo sviluppatore di realizzare delle query in modo visuale e farsi mandare il codice di richiesta tramite email.
Questo codice può essere utilizzato in App mobili e web per semplificare la programmazione e realizzare app che non devono essere manutenute quanto il server cambia…
La selezione effettuata può essere richiamata e anche inserita in pagine web di terzi, l’applicazione web è già pronta.
Manteniamo le App Vive, la complessità sta sul server e non sulle App !!
LOG: http://log.disit.org
Permette allo sviluppatore di navigare nelle strutture complesse di uno o più database RDF accessibili per formulare dei grafici e delle query in modo visuale e farsi mandare il codice di richiesta tramite email.
Questo codice può essere utilizzato in App mobili e web per semplificare la programmazione e realizzare app che non devono essere manutenute quanto il server cambia…
Il grafo puo’ essere richiamato e anche inserito in pagine web di terzi, l’applicazione web è già pronta.
Manteniamo le App Vive !!
Snap4City November 2019 Course: Smart City IOT Geernal overview, from dashboa...Paolo Nesi
• Overview
• Urban Platform (main concepts vs Living Lab)
• Snap4City Architecture, roadmap, logos, innovations
• Dashboards: from City Dashboards to Applications
• Trajectories and real time tracking
• Dashboards Intelligence and web and mobile devices
• Dashboard chatrooms and notifications
• Smart City Control Room
• Dashboards production
• Data Gathering and City Data Knowledge Management
• Protocol vs Data
• Data Gathering processes
• GIS Data Import, Export and Exploitation
• Semantic Modeling and City Knowledge Base: Km4CIty
• IOT Applications, Devices and Dashboards
• IOT Devices
• Forging & Managing Flexible Mobile Apps, Web App, MicroApplications
• Web and Mobile App with Open Development Kit
• Understanding how city users are using the city services
• Engaging City Users Towards Virtuous Behaviour
• Data Analytic, Big Data Science
• Data Analytics: predictions
• Smart Parking: predictions
• User behaviour Analysis via Wi-Fi, OD Matrices, Trajectories
• Recognition of Used Transportation Means
• Traffic Flow Reconstruction, from traffic sensors data
• Quality of Public Transport
• Origin Destination Matrices
• Demand of Mobility vs Offer of Transportation
• Modal and Multimodal Routing for Navigation and Travel Planning
• Environmental Data Predictions
• Prediction of Qir Quality
• Anomaly Detection
• Environmental data prediction
• Social Media Analysis
• Snap4City Living Lab for Collaborative Work
• Development Life Cycle
• Development tools
• Data protection, personal da vs GDPR
• Snap4City and Km4City Projects
• Acknowledgment
Open Urban Platform for Smart City: Technical View Paolo Nesi
Km4City Roadmap
Data and Model
Control Room
Monitoring Traffic Flow and Parking
Monitoring City Users via Wi-Fi
Engaging Users Via Mobile App
Development Tools
Who is using it
City Resilience and DSS
Info and Documents
Knowledge mining and Semantic Models: from Cloud to Smart CityPaolo Nesi
Course for the Doctorate in Information Technologies, DIST, at DINFO UNIFI
Pierfrancesco Bellini, Paolo Nesi, DISIT Lab
Dipartimento di Ingegneria dell’Informazione, DINFO
Università degli Studi di Firenze,Via S. Marta 3, 50139, Firenze, Italy
Tel: +39-055-2758511, fax: +39-055-2758570
http://www.disit.dinfo.unifi.it alias http://www.disit.org
Pierfrancesco.bellini@unifi.it , Paolo.nesi@unifi.it
.
program:
From RDF to OWL
Knowledge engineering for Beginners
Smart Cloud Application (ICARO Case)
Big Data Smart City Architecture
Smart-city Ontology
Data Ingestion and Mining
Distributed and real time processes
RDF processing
Smart City Engine
Development Interfaces
Sii-Mobility
Km4City: Smart City Model and Tools for City Knowledge ExploitationPaolo Nesi
The proposed presentation is going to expose the integrated solutions around Km4City model which has been set up by the DISIT lab in Florence (http://www.disit.org/6056 ) and adopted in some EC and national smart city projects (Sii-Mobility Smart City MIUR project, RESOLUTE H2020, Km4City service and tools in place in the Florence Area, with many industrial partners as Thales, Swarco, ECM, etc.). The solution is based on Km4City model that is capable to model a large set of the above data kind and provides support for inference and reasoning, on time and space, on public and private data, on static and real time data. In more details, the solution developed is open and accessible for city providing models and tools for its adoption and exploitation, also enabling the full customization. It includes a set of tools:
• Service map: http://servicemap.disit.org is a tool for PA administrators and for developers. For the PA administrators provide access to several kinds of geospatial queries in Florence and in the whole Tuscany region, taking as a results static and real time data, geo-localized. The ServiceMap is also a tool for developers, which can be used to understand the usage of API to access at the Km4City services http://www.disit.org/6597 . The ServiceMap facility allows the visual creation of queries on the city, and may send to the connected user via email the SPARQL code of the visual queries performed, and in addition also a simple Query ID. The Query ID can be used to pose the query without writing it, from any Mobile and Web applications without the needs of learning complex ontological and SPARQL models;
• Linked Open Graph for browsing LOD RDF Stores model including the Km4City Smart City model in Florence and Tuscany and thus for learning how to formulate SPARQL queries http://LOG.disit.org. See for example a view of Florence http://log.disit.org/service/?graph=0f50fffc5bcfc205de5a19b606b61310
• Demonstrative mobile application exploiting ServiceMap API, also presented at the Florence Open Data Day and accessible as open source via: http://www.disit.org/6595 .
• Km4City ontology model and documentation [1], http://smartcity.linkeddata.es/, document http://www.disit.org/5606 , http://www.disit.org/km4city/schema/
• Parallel and distributed architecture based on ETL, scheduler, HBase, Hadoop, for massive big data ingestion (static, quasi static, and real time data), reconciliation, data enrichment (for connecting Km4City URI to dbPedia, geonames, etc. [3]) and for making decision: [1], slide http://www.disit.org/6566 with thousands of accesses on SlideShare. Several examples are accessible about the ETL transformation for data ingestion, quality improvement, conversion in triples, reconciliation in SILK, [1], etc. This engine is also adopted in other Smart City Projects as SMST national cluster.
CINI icitie workshop on smart city and communities, palermo, ottobre 2015
DAI DATI INTELLIGENTI AI SERVIZI Smart City API HackathonPaolo Nesi
DAI DATI INTELLIGENTI AI SERVIZI
Smart City API Hackathon
Premi per 14.000 euro
Data: 7 e 8 aprile 2017
Luogo: Scuola di Ingegneria, Università degli Studi di Firenze
Il progetto Sii-Mobility, Smart City nazionale (MIUR), organizza il primo hackathon per promuovere lo sviluppo di applicazioni fisse e mobili sulla base delle http://www.disit.org/6991che si basano sul modello http://www.km4city.org .
Scopo dell'evento di hackathon è identificare nuove applicazioni che possano essere sviluppate sulla base di dati ed elaborazioni messi disposizione dalle smart city API di Sii-Mobility. I Dati sono in tutta la toscana e come dagli scenari http://www.disit.org/6995, sono relativi alla mobilità pubblica e privata, alla partecipazione, alle informazioni geolocalizzate dei punti di interesse, della salute, ambiente, e servizi di suggerimento e di coinvolgimento e assistenza.
Le tematiche affrontate dalle App proposte dovranno essere relative ad aspetti di mobilità, e in particolare ai seguenti 5 temi: Trasporto pubblico; Coinvolgimento dei cittadini, mobilità e turismo, mobilità e servizi, giochi in mobilità.
http://www.sii-mobility.org/index.php/eventi/hackathon-sii-mobility/registrati-all-evento-del-7-mattina
Documentazione e informazioni dalla pagina: http://www.sii-mobility.org/
Scadenza sottomissione delle proposte: 31 marzo 2017.
Premi per 14.000 euro, #hackathon #smartcity API, #bigdata #opendata della #Toscanadigitale #firenze #pisa #arezzo #direfare #forumpa
#hackathon #smartcity #bigdata #opendata #Toscanadigitale #firenze #pisa #arezzo #direfare #forumpa
Smart City API, 14.000 euro di premi, Hackathon
RESOLUTE: Governing for Resilience – Implementation Challenges Paolo Nesi
Conducting systematic review and assessment of the state of the art of Resilience Assessment and management concepts, national guidelines and their implementation strategies in order to develop a
conceptual framework for resilience with Urban Transport Systems, UTS
Development of European Resilience Management Guidelines, ERMG
Operationalize and validate the ERMG by implementing the Collaborative Resilience Assessment and Management Support System (CRAMSS) for UTS addressing Roads and Rails infrastructures
Enhancing resilience through improved support to human decision making processes, particularly through increased focus on the training of first responders and population on ERMG and RESOLUTE System
ERMG wide dissemination promoting acceptance and adoption at EU and Associate Countries level
DISIT Lab overview: smart city, big data, semantic computing, cloudPaolo Nesi
Smart City
• Projects: http://www.disit.org/5501
– Sii-Mobility, http://www.sii-mobility.org
– Service Map: http://servicemap.disit.org
– Social Innovation: Coll@bora http://www.disit.org/5479
– Navigation Indoor/outdoor: Mobile Emergency http://www.disit.org/5404
– Mobility and Transport: TRACE-IT, RAISSS, TESYSRAIL
• Tools: http://www.disit.org/5489
– Data gathering, data mining and reconciliation
– Data reasoning, deduction, prediction
– Smart city ontology and reasoning tools
– Service analysis and recommendations
– Autonomous train operator, train signaling
– Risk analysis, decision support systems
– Mobile Applications
Data Analytics - Big data
• Projects: http://www.disit.org/5501
– Linked Open Graph: http://LOG.disit.org
– Sii-Mobility, http://www.sii-mobility.org
– Service on a number of projects
• Tools: http://www.disit.org/5489
– Open data and Linked Open Data
– LOG LOD service and tools
– Data mining and reconciliation
– Data reasoning, deduction, prediction, decision support
– SN Analysis and recommendations
– User behavior monitoring and analysis
Smart Cloud - Computing
• Projects: http://www.disit.org/5501
– ICARO: http://www.disit.org/5482
– Cloud ontology: http://www.disit.org/5604
– Cloud simulator:
– Smart Cloud: http://www.disit.org/6544
• Tools: http://www.disit.org/5489
– Cloud Monitoring
– Smart Cloud Engine and reasoner,
– Service Level Analyzer and control
– Configuration analysis and checker
– Cloud Simulation
Text and Web Mining
• Projects: http://www.disit.org/5501
– OSIM: http://www.disit.org/5482
– SACVAR: http://www.disit.org/5604
– Blog/Twitter Vigilance
• Tools: http://www.disit.org/5489
– Text and web mining, Natural Language Processing
– Service localization
– Web Crawling
– Competence analysis
– Blog Vigiliance, sentiment analysis
Social Media and e-Learning
• Projects: http://www.disit.org/5501
– ECLAP, http://www.eclap.eu
– ApreToscana: http://www.apretoscana.org
– Others: AXMEDIS, VARIAZIONI, SMNET, etc.
– Samsung Smart TV: http://www.disit.org/6534
• Tools: http://www.disit.org/5489
– XLMS, Cross Media Learning System
– IPR and content protection and distribution
– Mobile and SmartTv Applications
– Suggestions and recommendations
– Matchmaking solutions
– Media Tools for cross media content
Mobile Computing
• Projects:
– ECLAP: http://www.eclap.eu
– Mobile Medicine: http://mobmed.axmedis.org
– Mobile Emergency: http://www.disit.org/5500
– Smart City, FODD 2015: http://www.disit.org/6593
– Resolute: Mobiles as sensors
• Tools and support:
– Content distribution: e-learning
– Integrated Indoor/outdoor navigation
– User networking and collaboration
– Service localization
– Smart city and services
– OS: iOS, Android, Windows Phone, etc.
– Tech: IOT, iBeacoms, NFC, QR, ….
Open Urban Platform: Technical View 2018: Km4CityPaolo Nesi
Aggregate & integrate data
Multiple protocols from urban operators, ....
open data, IOT, sensors, internet of everything, cloud, mobile devices, Wi-Fi, social media, ...
Data Exploitation performing
predictions, reasoning, business intelligence, ..
users behavior analysis, decision support system, ..
Control Room, Real Time Monitoring tools, ….
Produce value from data enabling to
Stimulate virtuous behavior, influence City Users!
Put in action CITY Strategies
Snap4City a Solution for highly collaborative Smart Cities Environments Paolo Nesi
Snap4City has been created in response to Select4Cities PCP (http://www.select4cities.eu/) call as an open, standardized, data-driven, service-oriented, user-centric platform enabling large-scale co-creation IOT/IOE applications and services for Helsinki, Copenhagen and Antwerp. Snap4City is a fully open source, robust, scalable, easy to use solution, provides tools for co-creation of mixt data driven, stream and batch processing, extending the powerful semantic reasoner of Km4City https://www.km4city.org, with IOT/IOE, GDPR, and city dashboards. Snap4City (Https://www.snap4city.org ) is a solution for setting up Living Labs engaging different all kinds of stakeholders (city operators, researchers, city users, in house, industries) in contributing to the city evolutions, with a platform providing online tools for developing IOT applications, web and mobile Apps, data analytics, micro Applications, external services, KPI, POI, dashboards, IOT edge, etc.
Snap4City/Km4City has been validated in multiple devices (PC, Android, Raspberry, IOT Button, Arduino, ..), and domains: mobility and transport, tourism, health, welfare, social and cities such as Florence, Pisa, Arezzo, and large area of millions on inhabitants as Tuscany and millions of data per day. The innovation is mainly related to semantic reasoning, IOT interoperability, microservices, automated dashboard production, end-2-end encrypted secure communications, GDPR, .. thus setting up in a Snap smart city solutions.
hackathon smart city API, dai dati ai serviziPaolo Nesi
DAI DATI INTELLIGENTI AI SERVIZI
Smart City API Hackathon
Premi per 14.000 euro
Data: 7 e 8 aprile 2017
Luogo: Scuola di Ingegneria, Università degli Studi di Firenze
Il progetto Sii-Mobility, Smart City nazionale (MIUR), organizza il primo hackathon per promuovere lo sviluppo di applicazioni fisse e mobili sulla base delle http://www.disit.org/6991che si basano sul modello http://www.km4city.org .
Scopo dell'evento di hackathon è identificare nuove applicazioni che possano essere sviluppate sulla base di dati ed elaborazioni messi disposizione dalle smart city API di Sii-Mobility. I Dati sono in tutta la toscana e come dagli scenari http://www.disit.org/6995, sono relativi alla mobilità pubblica e privata, alla partecipazione, alle informazioni geolocalizzate dei punti di interesse, della salute, ambiente, e servizi di suggerimento e di coinvolgimento e assistenza.
Le tematiche affrontate dalle App proposte dovranno essere relative ad aspetti di mobilità, e in particolare ai seguenti 5 temi: Trasporto pubblico; Coinvolgimento dei cittadini, mobilità e turismo, mobilità e servizi, giochi in mobilità.
http://www.sii-mobility.org/index.php/eventi/hackathon-sii-mobility/registrati-all-evento-del-7-mattina
Documentazione e informazioni dalla pagina: http://www.sii-mobility.org/
Scadenza sottomissione delle proposte: 31 marzo 2017.
Premi per 14.000 euro, #hackathon #smartcity API, #bigdata #opendata della #Toscanadigitale #firenze #pisa #arezzo #direfare #forumpa
#hackathon #smartcity #bigdata #opendata #Toscanadigitale #firenze #pisa #arezzo #direfare #forumpa
Smart City API, 14.000 euro di premi, Hackathon
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...Paolo Nesi
Final Users tools:
-Km4City mobile applications
-Km4City web application: http://www.km4city.org
Public administrator tools:
-ServiceMap Server, plus API, http://servicemap.disit.org
-Smart decision support system, http://smartds.disit.org
-Twitter Vigilance connection, http://www.disit.org/tv
Developers tools: http://www.disit.org/km4city
-ServiceMap Server, plus API, http://servicemap.disit.org
-Ontology Documentation
-LOG LOD browser
-Open Source Mobile Application, FODD
Back Office tools for Public Administrations
-Data Ingestion Manager, DIM
-Smart City Engine, SCE, the reasoned with scheduled processes
-RDF Indexer Manager, RIM
-Distributed Scheduler
-RDF store enricher with dbPedia
Adopted on projects and real scenarios
Snap4City has been created in response to Select4Cities PCP (http://www.select4cities.eu/) call as an open, standardized, data-driven, service-oriented, user-centric platform enabling large-scale co-creation IOT/IOE applications and services for Helsinki, Copenhagen and Antwerp.
Snap4City is a fully open source, robust, scalable, easy to use solution, provides tools for co-creation of mixt data driven, stream and batch processing, extending the powerful semantic reasoner of Km4City https://www.km4city.org, with IOT/IOE, GDPR, and city dashboards.
Km4City has been validated in multiple devices (PC, Android, Raspberry, ..), and domains: mobility and transport, tourism, health, welfare, social and cities such as Florence, Pisa, Arezzo, and large area of millions on inhabitants as Tuscany and million of data per day.
The innovation is mainly related to semantic reasoning, IOT interoperability, microservices, automated dashboard production, .. thus setting up smart city solutions in a snap
Open Data Day 2016, Km4City, L’universita’ come aggregatore di Open Data del ...Paolo Nesi
Open Data Day, UNIMORE, Modena, 5 Marzo 2016.
Aggregazione dati, experienza di Firenze,
Smart City, Km4City,
Smart Decision Support,
Data Ingestion manager,
Data aggregation,
User profiling on demand.
Mobilità: inter-modalità, bigliettazione integrata, sostenibile, scambiatori, sfruttamento stazioni, etc.,
Servizi: gov ..SUAP, edu, turismo, beni culturali, salute, etc.,
Energia: risparmio energetico, riduzione amissioni, inquinamento, etc.,
Ambiente: qualità dell’aria, fiumi, meteo, rifiuti, etc.,
… commercio, industria, etc.
... Infrastrutture critiche. resilienza
Collezionamento dati statici, quasi statici e real time, stream
Dati open: geo localizzati, servizi, statistiche, censimenti, etc.
Dati privati degli operatori: con licenze limitate per non permettere di fare profitto ad altri operatori sulla base dei loro dati
Dati personali delle persone: profili, comportamenti tramite APP, IOT, sensori, web, etc.
Integrazione dati per renderli semanticamente interoperabili, ed operare deduzioni (time, space… )
I tradizionali collettori di open data danno visioni statistiche ma non sono adatti a produrre servizi integrati
Integrazione con modelli semantici unificanti come Km4City
Control Room delle Città Metropolitane devono:
arrivare a supervisionare domini multipli e le interdipendenze fra mobilità, energia, comunicazione, servizi, flussi traffico, flussi pedonali, turismo, etc.
Migliorare la loro Resilienza, capacità di reazione ed assorbimento
ridurre i costi sociali della mobilità per le persone
consentendo minori disagi, maggiore efficienza,
maggiore sensibilità verso le necessità del cittadino,
minori emissioni, migliori condizioni ambientali;
percorsi info-formativi in modo che il cittadino cambi le abitudini non virtuose;
ridurre i costi di trasporto ed i tempi di percorrenza per gli utenti, per i gestori e le amministrazioni, tramite soluzioni di ottimizzazione.
Snap4City has been created in response to Select4Cities PCP (http://www.select4cities.eu/) call as an open, standardized, data-driven, service-oriented, user-centric platform enabling large-scale co-creation IOT/IOE applications and services for Helsinki, Copenhagen and Antwerp.
Snap4City is 100% open source:
robust, scalable, easy to use solution, provides tools for co-creation of mixt data driven, stream and batch processing, GDPR, and city dashboards.
extending with IOT/IOE the semantic reasoner of Km4City https://www.km4city.org
Km4City has been validated in multiple devices (PC, Android, Raspberry, ..), and domains: mobility and transport, tourism, health, welfare, social and cities such as Florence, Pisa, Arezzo, and large area of millions on inhabitants as Tuscany and million of data per day.
The innovation is mainly related to semantic reasoning, IOT interoperability, microservices, automated dashboard production, .. thus
setting up smart city solutions in a snap
Serve as a City Dashboard, App User Interface, etc.
Real time and historical data, any device, sensors and actuators
Sensors, KPI, maps, data trends, real time data, charts, etc.
Referral / historical data, and Open Data:
shadow, access (API, storage, any protocol), production of OD, export
Data Driven Real Time communication & processing:
IOT Applications, IOT edge, multiple operating systems, embedded systems, MicroServices
in/out data driven from/to the field into: applications, notifications, etc.
Data Analytics: Machine Learning, statistics, reasoning, …
Serve as Living Lab: open innovation, coworking; collaborative work; sharing: data, processes, dashboard, experiences, solutions, ….
Experimented on large scale cases
Technologies for Enhancing Knowledge and Training, the future of e-learning t...Paolo Nesi
E-learning infrastructure
Tools for e-learning/distance learning
References
Support for blended learning
Distance testing and assessment
Advanced aspects with respect to Moodle, Atutor, etc.
Content production and development
Content management and distribution
anywhere learning
certified e-learning
social learning and networking
Knowledge management
Legal, Intellectual property management and conditional access (enabling and actuating legal control)
Scalability: Hardware/Software
ECLAP: life long learning, social learning
http://www.eclap.eu
FirstClass: certified blended learning, paid courses
http://fad.fclass.it
IUF.Csavri: blended learning for entrepreneurs incubation and spin-offs
http://iuf.csavri.org
APRETOSCANA: formation for researchers
http://www.apretoscana.org
DISIT.DINFO.UNIFI.IT: research management and dissemination
http://www.disit.dinfo.uinifi.it
OSIM.UNIFI: knowledge management for UNIFI
http://openmind.disit.org
Similar to Overview on Smart City, DISIT lab solution for beginners, 2015, Part 7: Distributed Systems (20)
Presentation by Jared Jageler, David Adler, Noelia Duchovny, and Evan Herrnstadt, analysts in CBO’s Microeconomic Studies and Health Analysis Divisions, at the Association of Environmental and Resource Economists Summer Conference.
This session provides a comprehensive overview of the latest updates to the Uniform Administrative Requirements, Cost Principles, and Audit Requirements for Federal Awards (commonly known as the Uniform Guidance) outlined in the 2 CFR 200.
With a focus on the 2024 revisions issued by the Office of Management and Budget (OMB), participants will gain insight into the key changes affecting federal grant recipients. The session will delve into critical regulatory updates, providing attendees with the knowledge and tools necessary to navigate and comply with the evolving landscape of federal grant management.
Learning Objectives:
- Understand the rationale behind the 2024 updates to the Uniform Guidance outlined in 2 CFR 200, and their implications for federal grant recipients.
- Identify the key changes and revisions introduced by the Office of Management and Budget (OMB) in the 2024 edition of 2 CFR 200.
- Gain proficiency in applying the updated regulations to ensure compliance with federal grant requirements and avoid potential audit findings.
- Develop strategies for effectively implementing the new guidelines within the grant management processes of their respective organizations, fostering efficiency and accountability in federal grant administration.
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOChristina Parmionova
The 2024 World Health Statistics edition reviews more than 50 health-related indicators from the Sustainable Development Goals and WHO’s Thirteenth General Programme of Work. It also highlights the findings from the Global health estimates 2021, notably the impact of the COVID-19 pandemic on life expectancy and healthy life expectancy.
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
ZGB - The Role of Generative AI in Government transformation.pdfSaeed Al Dhaheri
This keynote was presented during the the 7th edition of the UAE Hackathon 2024. It highlights the role of AI and Generative AI in addressing government transformation to achieve zero government bureaucracy
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...OECDregions
Preliminary findings from OECD field visits for the project: Enhancing EU Mining Regional Ecosystems to Support the Green Transition and Secure Mineral Raw Materials Supply.
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
Donate to charity during this holiday seasonSERUDS INDIA
For people who have money and are philanthropic, there are infinite opportunities to gift a needy person or child a Merry Christmas. Even if you are living on a shoestring budget, you will be surprised at how much you can do.
Donate Us
https://serudsindia.org/how-to-donate-to-charity-during-this-holiday-season/
#charityforchildren, #donateforchildren, #donateclothesforchildren, #donatebooksforchildren, #donatetoysforchildren, #sponsorforchildren, #sponsorclothesforchildren, #sponsorbooksforchildren, #sponsortoysforchildren, #seruds, #kurnool
Overview on Smart City, DISIT lab solution for beginners, 2015, Part 7: Distributed Systems
1. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
1
Overview on Smart City
DISIT lab solution for beginner
2015 Part 7: Distributed Systems
Distributed Data Intelligence and Technologies Lab
Distributed Systems and Internet Technologies Lab
Prof. Paolo Nesi
DISIT Lab
Dipartimento di Ingegneria dell’Informazione
Università degli Studi di Firenze
Via S. Marta 3, 50139, Firenze, Italia
tel: +39-055-4796523, fax: +39-055-4796363
http://www.disit.dinfo.unifi.it
paolo.nesi@unifi.it
DISIT Lab (DINFO UNIFI), May 2015
2. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 2
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
4. FORUM‐PA, Maggio 2015
• le città si stanno adeguando alle
crescenti necessità cercando di
– garantire elevati livelli di qualità della vita
– fornire nuovi servizi
– limitando i costi, aumento di efficienza
– allestire strutture decisionali adeguate
– facilitare la creazione di nuovi servizi anche
da parte di terzi
• Pubblicazione Open Data
• Creare i presupposti per un mercato dei dati
anche privati ma connessi agli OpenData
• per una la crescita sostenibile da vari
punti di vista
5. • I cittadini «imparano» a vivere in città
più tecnologiche in ambienti:
– interattivi: si aspettano azioni dagli utenti
– proattivi: agiscono in riferimento al
contesto: movimenti o ad altro
– collaborativi: fra persone e sistemi
• Servizi intelligenti – suggeriscono!
• Per esempio:
– riconoscimento della persona quando accede
ai servizi pubblici, in banca, al supermercato,
entra in casa
– parcheggi che conoscono i posti liberi
6
7. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
8
Privati Tempo reale Pubblici Tempo reale (open data)
Pubblici statici (open data)Privati Statici
statistiche: incidenti, censimenti, votazioni
• Codice fiscale
• Foto non condivise
• Aspetti legali
• Cartella clinica
• ..
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
8. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Interoperabilità: valore o vincolo
• Moltissimi e con
– svariati domini: grafo strutturali, geografici, energia,
ambiente, salute, servizi, mobilità, etc.
– Velocità: Statici, quasi statici, real time
– Modelli multipli per: Formati file, ontologie usate in LD/LOD
• Accessibili ad un costo elevato:
– Difficoltà nell’identificazione del modello di business
– Difficoltà rispetto ad alcune Licenze di uso
– OD abilitano valore se abbinati con #privatedata
– Mancanza di Interoperabilità
– Mancanza di Servizi per dati interoperabili
FORUM‐PA, Maggio 2015
9. I profili degli utenti
• Gli utenti possono:
– fornire informazioni preziose sulla citta come
«sensori intelligenti» per tenere sotto
controllo il livello dei servizi della città e/o
nuove necessità
– essere profilati per ricevere dei servizi
personalizzati, benefici diretti
• Informazioni anonime:
– velocità degli spostamenti: auto a piedi, code e
flussi cittadini, temperature, meteo
– Uso dei servizi
• private in consenso informato, statistiche e
attuali:
– Azioni e dati personali
– Relazioni con altre persone
– Movimenti puntuali
10
10. Le buone pratiche “Smart city”
– forniscono nuovi servizi e valutano sulla base della risposta del cittadino
• Le PA, per stare al passo con la competizione aprono canali di
comunicazione ed ascolto:
– media tradizionali sono validi per propagare l’informazione
– canali basati su internet, come social network, mobile,.. per la raccolta di
informazioni dalla popolazione, e per informare
– canali specifici: interviste dirette, totem interattivi, etc.
• Stabilire un processo di miglioramento virtuoso:
– Informare su disservizi o problemi, e vederli risolti:
• le buche nella strada, i muri sporchi dei palazzi, la nettezza sulla strada, gli uffici che
presentano poco personale, infrastrutture non accessibili, …
– In certi casi, le informazioni utili possono essere ricompensate con
bonus/sconti su: taxi, entrate in ZTL, parcheggi, etc.
11
11. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 13
12. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 14
13. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smartness, smart city needs 6 features
• Smart Health
• Smart Education
• Smart Mobility
• Smart Energy
• Smart Governmental
– Smart economy
– Smart people
– Smart environment
– Smart living
– Smart Risk management, Resilience
• Smart Telecommunication
DISIT Lab (DINFO UNIFI), May 2015 18
14. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart health
(can be regarded as smart governmental)
• Online accessing to health services:
– booking and paying
– selecting doctor
– access to EPR (Electronic Patient Record)
• Monitoring services and users for,
– learn people behavior, create collective
profiles
– personalized health
– Inform citizens to the risks of their habits
– Improve efficiency of services
– redistribute workload, thus reducing the
peak of consumption
DISIT Lab (DINFO UNIFI), May 2015 19
15. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart Education
(can be regarded as smart governmental)
• Diffusion of ICT into the schools:
– LIM, PAD, internet connection, tables, ..
• Primary and secondary schools university
industry & services
• Monitoring the students and quality of
service,
– learn student behavior, create collective profiles,
– personalized education
• suggesting behavior to
– Informing the families
– moderate the peak of consumption
– increase the competence in specific needed
sectors, etc.
– Increase formation impact and benefits
DISIT Lab (DINFO UNIFI), May 2015 20
16. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart Mobility
• Public transportation:
– bus, railway, taxi, metro, etc.,
• Public transport for services:
– garbage collection, ambulances,
• Private transportation:
– cars, delivering material, etc.
• New solutions (public and/or
private):
– electric cars, car sharing, car
pooling, bike sharing, bicycle paths
• Online:
– ticketing, monitoring travel,
infomobility, access to RTZ, parking,
etc.
DISIT Lab (DINFO UNIFI), May 2015 21
17. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart Mobility and urbanization
• Monitoring the city status,
– learn city behavior on mobility
– learn people behavior
– create collective profiles
– tracking people flows
• Providing Info/service
– personalized
– Info about city status to
– help moving people and
material
– education on mobility,
– moderate the peak of
consumption
• Reasoning to
– make services sustainable
– make services accessible
– Increase the quality of service
DISIT Lab (DINFO UNIFI), May 2015 22
18. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart Energy
• Smart building:
– saving and optimizing energy consumption,
district heating
– renewable energy: photovoltaic, wind energy,
solar energy, hydropower, etc.
• Smart lighting:
– turning on/off on the basis of the real needs
• Energy points for electric: c
– ars, bikes, scooters,
• Monitoring consumption, learn people/city
behavior on energy consumption, learn
people behavior, create collective profiles
• Suggesting consumers
– different behavior for consumption: different
time to use the washing machine
• Suggesting administrations
– restructuring to reduce the global
consumption,
– moderate the peak of consumption
DISIT Lab (DINFO UNIFI), May 2015 23
19. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart Governmental Services
• Service toward citizens:
– on‐line services:
• register, certification, civil
services,
taxes, use of soil, …
– Payments and banking:
• taxes, schools, accesses
– Garbage collection:
• regular and exceptional
– Quality of air:
• monitoring pollution
– Water control:
• monitoring water quality,
water dispersion, river status
DISIT Lab (DINFO UNIFI), May 2015 24
20. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart Governmental Services
• Service toward citizens:
– Cultural Heritage: ticketing on museums,
– Tourism: ticketing, visiting, planning, booking
(hotel and restaurants, etc. )
– social networking: getting service feedbacks,
monitoring
• Social sustainability of services:
– crowd services
• Social recovering of infrastructure,
– New services, exploiting infrastructures
• Monitoring consumption and exploitation of
services, learn people behavior, create collective
profiles
– Discovering problems of services,
– Finding collective solutions and new needs…
DISIT Lab (DINFO UNIFI), May 2015 25
21. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Telecommunication, broadband
• Fixed Connectivity:
– ADSL or more, fiber,
• Mobile Connectivity:
– Public wifi, Services on WiFi,
HSPDA, LTE
• Monitoring communication
infrastructure
• Providing information and
formation on:
– how to exploit the
communication infrastructure
– Exploiting the communication
for the other services,
– moderate the peak of
consumption
DISIT Lab (DINFO UNIFI), May 2015 26
22. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 27
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
23. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart‐City
• Main Aim
– Provide a platform able to ingest and take advantage a large
number of the above data, big data:
• Exploit data integration and reasoning
• Deliver new services and applications to citizens,
Leverage on the ongoing Semantic Web effort
• Problems & Challenges
– Data are provided in many different formats and protocols
and from many different institutions, different convention
and protocols, a different time, …. !
– Data are typically not aligned (e.g., street names, dates,
geolocations, tags, … ). That is, they are not semantically
interoperable
– resulting a big data problem: volume, velocity, variability,
variety, …..
DISIT Lab (DINFO UNIFI), May 2015 28
24. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Data: Public and Private, Static and Real Time
Private: user movements, social media, crowd sources, commercial (retail)
Public: infomobility, traffic flow, TV cameras, flows, ambient, weather,
statistic, accesses to LTZ, services, museums, point of interests, …
Commercial: customers
prediction and profiles,
promotions via ads
Smart City
Solution
Services & Suggestions
Transport, Mobility,
Commercial (retail),
Tourism, Cultural
Public
Admin.
Mobility
Operators
Retails
Tourism
Museums User Behavior
Crowd Sources
Personal Time Assistant
dynamic ticketing,
whispers to save time and
money, geoloc
information, offers, etc.
Pub. Admin: detection
of critical conditions,
improving services
Tune the service, reselling
data and services , prediction
Tune the service,
prediction
Challenges: Requests and Deductions
API for SME
User profiling
Collective profiles
User segmentation
DISIT Lab (DINFO UNIFI), May 2015
25. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Profiled
Services
Profiled
Services
DISIT Smart City Paradigm
DISIT Lab (DINFO UNIFI), May 2015 30
Interoperability
Data
processing
Smart City
Engine
Data
Harvesting
Data / info
Rendering
Data / info
Exploitation
Suggestions
and Alarms
Real Time
Data
Social Data
trends
Data
Sensors
Data Ingesting
and mining
Reasoning and
Deduction
Data Acting
processors
Real Time
Computing
Traffic
control
Social
Media
Sensors
control
Peripheral
processors
Energy
central
eHealth
Agency
eGov Data
collection
Telecom.
Services
…….
Citizens
Formation
Applications
26. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 31
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
27. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Challenges (addressed by DISIT)
• Social Media blog analysis
• Energy Control for bike sharing
• Wi‐Fi as a sensor for people mobility
• Internet of Things as sensors
– Low costs Bluetooth monitoring
devices
– Vehicle kits with sensors
– Sensors networks spread in the city
and managed by centrals
– Traffic flow sensors
• ..
DISIT Lab (DINFO UNIFI), May 2015 32
Traffic
Control
Social
Media
Sensors
control
Peripheral
processors
Energy
Central
eHealth
Agency
eGov Data
collection
Telecom.
Services
…….
28. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Sorgenti Sul Territorio di Firenze e Toscana
• Open Data delle PA (oltre 700 data set):
– Open Data del Comune di Firenze, Provincia, etc.
– Open Data della Regione, grafo regionale, ..
– Open Data da altre citta’, dalla commissione europea, da svariati HUB:
CKAN,
– LOD Universita’ di Firenze: Servizio OSIM
• Dati Real Time (centinaia di servizi real time):
– Osservatorio: AVM, Sensori Parcheggi, Flussi traffico
– LAMMA: Meteo
– Social Media: Twitter, blog, etc.
– Comune: eventi, scuola, protezione civile, ospedali,
– etc.
• Km4City: Circa 120 milioni di dati fra Statici e Dinamici, con
un flusso di circa 6‐10 milioni al mese
FORUM‐PA, Maggio 2015
29. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Altre Sorgenti: Toscana e Firenze
• Dati Aggregati e Linked Open Data:
– Da altre citta’, a livello regionale, nazionale, …
– Dalla Commissione europea
– RDF Store aperti: dbPedia, Europeana, Getty, Camera
Senato, Cultura Italia,
• ECLAP.eu, http://www.eclap.eu
• UNIFI, OSIM http://osim.disit.org
– Web Crawling GeoLocator ..
– Social Media Blog Vigilance ..
– Link Discovering riconciliazione, LOD Enricher
• Molti altri dati …. http://log.disit.org
FORUM‐PA, Maggio 2015
30. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
NLP e Blog Vigiliance
• Recuperare informazioni
dagli utenti
• Validare le informazioni
fornite da siti e utenti in
relazione a quelle divulgate
da siti istituzionali
• Inserire le informazioni
estratte nella base di
conoscenza semantica
km4city per arricchire i dati
• Fornire le informazioni
arricchite agli utenti
attraverso il ServiceMap, un
portale web, un blog o i
social network come Twitter
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
35
Twitter
Facebook
Blog
‐ Search
‐ Q&A
‐ Graph
of Relations
‐ Social Platform
Semantic
Repository
Semantic
Computing
NLP
Inference
& Reasoning
Recommendations
& Suggestions
Link
Discovering
Reconciliation &
Disambiguation
(Names, Geo Tags etc.)
31. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Crawling Strategies:Web‐Crawler
Architecture:
Document / Pages Parsing:Robot Exclusion Protocol
DISIT Lab (DINFO UNIFI), May 2015 36
Web Crawling and Data Mining
# Robots.txt for
http://www.springer.com (fragment)
User-agent: Googlebot
Disallow: /chl/*
Disallow: /uk/*
Disallow: /italy/*
Disallow: /france/*
User-agent: MSNBot
Disallow:
Crawl-delay: 2
User-agent: scooter
Disallow:
# all others
User-agent: *
Disallow: /
32. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
37
Twitter Vigilance
http://www.disit.org/tv
33. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
38
Natural Language
Text
Syntactical Analysis
Tokenizer
Morphologic Analysis
Part‐of‐Speech Tagger
Chunker
Syntactical Parse
Semantic Analysis
Natural Language sentences are subsequently processed
and coded into a semantic representation (by means of
logic formalisms, semantic networks and ontologies)
Text is segmented into sequences of characters
(tokens).
A grammar category is assigned to each token
Each word of a sentence/period is annotated
with its logical rule (subject, predicate,
complement etc.)
This phase uses previous annotations to group
nominal and verbal phrases for each sentence
Produces the Syntactic Parse Tree for each
sentence
NLP ‐ Natural Language Processing Phases
DISIT Lab (DINFO UNIFI), May 2015
34. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 39
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
35. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Ricerche sui dati
• Geografiche: near
to here; per
comune; per area
• Nel Tempo: dati
Real Time
• Testuali: ………
• RDF Store esterni,
internazionali ….
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
40
36. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Problematiche integrazione
• Dati di limitata
interoperabilita’
semantica e
qualita’
• l’interoperabilit
a’ va
conquistata
dato su dato,
modello su
modello
• Gestione grosse
moli di dati,
flussi, etc.
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
41
Creare una base di conoscenza unica fondata su
un'ontologia comune per combinare tutti i dati
provenienti da diverse fonti e renderli semanticamente
interoperabili
• Creare query coerenti indipendentemente dalla fonte,
il formato, la data, l'ora, fornitore, etc.
• Arricchire i dati, renderli più completi, più affidabili,
ed accessibili
• Ridurre il rumore e la dipendenza dalla qualità
• Abilitare l’inferenza come materializzazione triple da
alcune delle relazioni
• consentire la realizzazione di nuovi servizi integrati
connessi alla mobilità
• fornire accesso alla base di conoscenza alle PMI di
creare nuovi servizi
37. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Challenges (addressed by DISIT)
• OD/LOD, Open Data/Linked Open Data:
– gathering, collection,
• Data Mining:
– ontology mapping, integration,
semantically interoperable
– reconciliation, enrichment,
– quality assessment and improvement
• Data Filtering on Streaming
DISIT Lab (DINFO UNIFI), May 2015 42
Data
Harvesting
Real Time
Data
Social Data
trends
Data
Sensors
Data Ingesting
and mining
38. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Data Ingestion and Mining
DISIT Lab (DINFO UNIFI), May 2015 43
Static Data
harvesting
Data
Mapping
To triple
Quality
Improve
ment
Indexin
g
Real Time
Data
Ingestion
Store
Validation
Semantic
Interoperability
Reconciliation
Ontolog
ie
triple
triple
‐ Sensors
‐ Meteo
‐ AVM
‐ Parcking
Blog & SN
Vigilance
Indexin
g
Ontolog
ie
RDF
Store +
indexes:
SPARQL
Text
Mining
NLP
OSIM based tools
http://osim.disit.org
RDF
Store +
indexes:
SPARQL
RDF Store
Enrichment
RDF Indexing ReasoningData Ingestion and Mining
Data
Mapping
To triple
39. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Other
SPARQL
End points
DISIT Lab (DINFO UNIFI), May 2015 44
Data Ingestion Manager
Admin. Interface
Distributed Scheduler
Admin. Interface
RDF Store Indexer
Admin. Interface
Indexing
Configuration
Database
Data Ingestion
Configuration
Database
Distributed
Scheduler Database
Static Data
harvesting Data
Mapping
To triple
Quality
Improve
ment
Indexing
Real Time
Data
Ingestion
RDF Store
Validation
Semantic
Interoperability
Reconciliation
Km4City
Ontology
triple
triple
RDF
Store +
indexes:
SPARQL
End point
Distributed
Bigdata store
R2RML
Models
Distributed processing
Data Ingestion and Mining RDF Indexing
Sporadic:
‐Validation
‐Reconciliation
‐Enrichment
RDF Store
Enrichment
Reasoning
Data Status
web pages
Data Ingestion and Mining
40. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
http://192.168.0.100/processManager/DISIT Lab (DINFO UNIFI), May 2015 45
Data Ingestion Manager
41. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
• From MIIC web services (real time via DATEX2)
o Parking payloadPublication (updated every h)
o Traffic sensors payloadPublication (updated every 5‐10min)
o AVM client pull service (updated every 24h)
o Street Graph
• From Municipality of Florence:
o Tram lines: KMZ file that represents the path of tram in Florence
o Statistics on monthly access to the LTZ, tourist arrivals per year, annual
sales of bus tickets, accidents per year for every street, number of
vehicles per year
o Municipality of Florence resolutions
• From Tuscany Region:
o Museums, monuments, theaters, libraries, banks, courier services,
police, firefighters, restaurants, pubs, bars, pharmacies, airports, schools,
universities, sports facilities, hospitals, emergency rooms, doctors'
offices, government offices, hotels and many other categories
o Weather forecast of the consortium Lamma (updated twice a day)
DISIT Lab (DINFO UNIFI), May 2015 47
DataSet already integrated
42. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Static Data: harvesting
• Ingesting a wide range of OD/PD: public and private data, static, quasi
static and/or dynamic real time data.
• For the case of Florence, we are addressing about 150 different data
sources of the 564 available, plus the regional, province, other
municipalities, ….
• Using Pentaho ‐ Kettle for data integration (Open source tool)
– using specific ETL Kettle transformation processes (one or more for each
data source)
– data are stored in HBase (Bigdata NoSQL database)
• Static and semi‐static data include: points of interests, geo‐referenced
services, maps, accidents statistics, etc.
– files in several formats (SHP, KML, CVS, ZIP, XML, etc.)
• Dynamic data mainly data coming from sensors
– parking, weather conditions, pollution measures, bus position, etc.
– using Web Services. DISIT Lab (DINFO UNIFI), May 2015 49
43. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Example of Ingestion process
50DISIT Lab (DINFO UNIFI), May 2015
44. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Data Quality Improvement
• Problems kinds:
– Inconsistencies, incompleteness, duplications and
redundancy, ..
• Problems on:
– CAPs vs Locations
– Street names (e.g., dividing names from numbers and
localities, normalize when possible)
– Dates and Time: normalizing
– Telephone numbers: normalizing
– Web links and emails: normalizing
• Partial Usage of
– Certified and accepted tables and additional knowledge
DISIT Lab (DINFO UNIFI), May 2015 51
45. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Data Quality Improvement
Class %QI Total rows Class %QI Total rows
Accoglienza 34,627 13256 Georeferenziati 38,754 2016
Agenzie delle Entrate 27,124 306 Materne 41,479 539
Arte e Cultura 37,716 3212 Medie 42,611 116
Visite Guidate 38,471 114 Mobilità Aerea 41,872 29
Commercio 42,105 323 Mobilità Auto 38,338 196
Banche 41,427 1768 Prefetture 39,103 449
Corrieri 42,857 51 Sanità 42,350 1127
Elementari 42,004 335 Farmacie 42,676 2131
Emergenze 42,110 688 Università 42,857 43
Enogastronomia 42,078 5980 Sport 52,256 1184
Formazione 42,857 70 Superiori 42,467 183
Accoglienza 34,627 13256 Tempo Libero 25,659 564
54DISIT Lab (DINFO UNIFI), May 2015
Service data from Tuscany region.
%QI = improved service data percentage after QI phase.
46. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 55
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
47. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart‐city Ontology
• The data model provided have been mapped into
the ontology, it covers different aspects:
– Administration
– Street‐guide
– Points of interest
– Local public transport
– Sensors
– Temporal aspects
– Metadata on the data
DISIT Lab (DINFO UNIFI), May 2015 56
Temporal
Macroclass
Point of
Interest
Macroclass
Sensors
Macroclass
Local public
transport
Macroclass
Administration
Macroclass
Street‐guide
Macroclass
PA hasPublicOffice OFFICE
SENSOR measuredTime TIME
SERVICE isInRoad ROAD
CARPARKSENSOR
observeCarPark CARPARK
BUS hasExpectedTime TIME
CARPARK
isInRoad
ROAD
BUSSTOPFORECAST
atBusStop BUSSTOP
WEATHERREPORT refersTo PA
BUSSTOP isInRoad ROAD
ADMINISTRATIVEROAD
ownerAuthority PA
MetaData
48. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Km4City
– DC: Dublin core, standard
metadata
– OTN: Ontology for Transport
Network
– FOAF: for the description of
the relations among people
or groups
– Schema.org: for a description
of people and organizations
– wgs84_pos: for latitude and
longitude, GPS info
– OWL‐Time: reasoning on
time, time intervals
– GoodRelations: commercial
activities models
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
57
P. Bellini, M. Benigni, R. Billero, P. Nesi and N. Rauch, "Km4City Ontology Building vs Data Harvesting and Cleaning for
Smart‐city Services", International Journal of Visual Language and Computing, Elsevier,
http://dx.doi.org/10.1016/j.jvlc.2014.10.023
• Amministrazione
• Aspetti Sociali
• Strade ed elementi
• Punti di Interesse, turismo e
cultura
• Trasporti
• Sensori
• Aspetti Temporali
• Eventi: sportivi e culturali
• Spetti legali e descrittori
• Aspetti spaziali
• Servizi pubblici e salute
• ….
49. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Km4City
• Ontologia di dominio che modella molti aspetti:
geografico, mobilità, trasporti beni culturali, etc
• Classificata la migliore a livello Europeo
http://smartcity.linkeddata.es/
FORUM‐PA, Maggio 2015
50. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
FORUM‐PA, Maggio 2015
Servicemap front end
51. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 62
Smart‐city Ontology
km4city
84 Classes
93 ObjectProperties
103 DataProperties
Ontology Documentation:
http://www.disit.org/6507,
http://www.disit.org/5606,
http://www.disit.org/6461
52. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Smart‐city Ontology
• Metadata: modeling the additional information associated with:
– Descriptor of Data sets that produced the triples: data set ID, title, description,
purpose, location, administration, version, responsible, etc..
– Licensing information
– Process information: IDs of the processes adopted for ingestion, quality improvement,
mapping, indexing,.. ; date and time of ingestion, update, review, …;
When a problem is detected, we have the information to understand when and how the
problem has been included
• Including basic ontologies as:
– DC: Dublin core, standard metadata
– OTN: Ontology for Transport Network
– FOAF: for the description of the relations among people or groups
– Schema.org: for a description of people and organizations
– wgs84_pos: for latitude and longitude, GPS info
– OWL‐Time: reasoning on time, time intervals
– GoodRelations: commercial activities models
DISIT Lab (DINFO UNIFI), May 2015 63
P. Bellini, M. Benigni, R. Billero, P. Nesi and N. Rauch, "Km4City Ontology Building vs Data Harvesting and Cleaning for
Smart‐city Services", International Journal of Visual Language and Computing, Elsevier,
http://dx.doi.org/10.1016/j.jvlc.2014.10.023
53. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Why an Ontology
• On the basis of Km4City Ontology, via a data mining
process, it is possible to built a knowledge base, KB,
(and RDF Store) adding instances
– This process creates inferences on the concepts, making
deductions
• KB is query‐able via SPARQL exploiting and referring
to:
– hundreds of relationships kind: is‐a, is‐part‐of, is‐located,
is‐near‐by, …
– Patterns among entities and relations
• Specific queries can be simplified by adding special
and additional indexes and/or relations
DISIT Lab (DINFO UNIFI), May 2015 64
54. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
FORUM‐PA, Maggio 2015
Development tools for km4city
http://servicemap.disit.org
Smart City API: http://www.disit.org/6597
km4City Browser: http://log.disit.org
Mobile App Demo: http://www.disit.org/6595
Documentation: http://www.disit.org/6056
• Open Ontology: Km4City
• Aggregation Tools, Dev. Tools, Tutorials, ..
• Open Roadmap, connected projects:
• Sii‐Mobility SCN, Resolute H2020
• Florence / Tuscany
• Static Data + Real Time Data
• > 120 Millions of triples
• Data: streets, sensors, services of several
kind (Gov and commercial), parking,
busses, digital locations, charge points,
events, weather forecast, cultural, ….
Km4City in short
Aggregation tools: http://www.disit.org/6566
• Smart City Engine & Data Analytics
• DSS: Extended System Thinking
• Execution of algorithms and strategies
• Open Tools and APIs
http://www.disit.org/6056
55. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
FORUM‐PA, Maggio 2015
Km4city roadmap
km4city
Sii‐Mobility
Smart City
National
Km4city 1.1
RESOLUTE H2020 2015‐2017:
‐ Risk analysis
‐ Territorial, areas and paths in the city
‐ Environmental: water, hearth, …
‐ People flow tracking
‐ iBeacom
‐ Social media: Twitter Vigilance
‐ ..
Weather
Cultural Heritage
Energy: recharge pillar
WiFi
Events in the city
• http://servicemap.disit.org
• Smart City API
• http://log.disit.org
• http://www.disit.org/fodd
• Tuscany Map
• Services
• AVM
• Sensors
• Parking
• …
• …
Cultural Heritage
Enrichment‐cites
…….
‐Embed
‐more API
DSSKm4city 1.4
today Km4city 1.5
56. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 67
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
57. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Data mapping to Triples
• Transforms the data from HBase to RDF triples
• Using Karma Data Integration tool, a mapping model
from SQL to RDF on the basis of the ontology was
created
– Data to be mapped first temporarily passed from Hbase to
MySQL and then mapped using Karma (in batch mode)
• The mapped data in triples have to be uploaded (and
indexed) to the RDF Store (OpenRDF – sesame with
OWLIM‐SE)
DISIT Lab (DINFO UNIFI), May 2015 68
58. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RDF Triples generation
69
The triples are generated with the km4city
ontology and then loaded on OWLIM RDF store.
DISIT Lab (DINFO UNIFI), May 2015
59. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.itRDF Triples generated
Macro Class Static Triples
Reconciliation
Triples
Real Time Triples
Loaded
Total on 1.5
months
Administration 2.431 0 ‐‐ 2.431
Metadata of DataSets 416 0 ‐‐ 416
Point of Interest
(35.273 POIs in Tuscany) 471.657 34.392 ‐‐ 506.049
Street‐guide
(in Tuscany) 68.985.026 0 ‐‐ 68.985.026
Local Public
Transport (<5 lines of FI) 644.405 2.385
135.952
per line per day, to be filtered, read
every 30 s, they respond in minutes
(static) 646.790
51.111.078
Sensors (<201 road sensors,
63 scheduled every two hours) ‐‐ 4.240
102
per sensor per read, every 2 hours,
they are very slow in responding
Parking (<44 parkings,
12 scheduled every 30min) ‐‐ 1.240
7920
per park per day, 3 read per hour,
they respond in seconds
Meto (286 municipalities,
all scheduled every 6 hours) ‐‐ ‐‐
185
per location per update,
1‐2 updates per day
Temporal events,
time stamp ‐‐ ‐‐
6
for each event 1.715.105
Total 70.103.935 42.257 122.966.893
71DISIT Lab (DINFO UNIFI), May 2015
60. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RDF Store Indexer, versioning
• RDF Store Indexer enables administrator to select ‐ step by step ‐
triples to be loaded from:
– Ontologies: several of them as explained before
– Triples produced from static data
– Triples produced from real time data, taking into account historical
windows of data (from‐to)
– Triples obtained by procedures of:
• reconciliation
• Enrichment
• Keeping under control incremental indexing for adding new static and
historical data without re‐indexing..
• An indexing process takes several hours or days
• The new indexing can be performed while a current index is in
production with real time data…
• If you do not index, you cannot perform reconciliations, neither
enrichments
DISIT Lab (DINFO UNIFI), May 2015 72
61. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RDF Store Validation
• Some of the produced and addressed triples in indexing
could not be loaded and indexed since the code can be
wrong or for the presence of noise and process failure
• A set of queries applied to verify the consistency
and completeness, after new
re‐indexing and new data integration
– I.e.: the KB regression testing !!!!!
– Success rate is presently of the 99,999%!
• Non loaded: 0,00000638314%
DISIT Lab (DINFO UNIFI), May 2015 73
62. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
• After the loading and indexing into the RDF store a dataset may
be connected with the others if entities refer to the same triples
– Missed connections strongly limit the usage of the knowledge base,
– e.g. the services are not connected with the road graph.
– E.g., To associate each Service with a Road and an Entity on the basis of
the street name, number and locality
• Data are coming from different sources, created in different
dates, from different archives, by using different standards and
codes.
• In the case of conflicting information the reputation of sources
has to guide in the data fusion.
DISIT Lab (DINFO UNIFI), May 2015 74
Semantic Interoperability,
reconciliation
63. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 76
Method Precision Recall F1
SPARQL –based reconciliation 1,00 0,69 0,820
SPARQL ‐based reconciliation + additional manual
review 0,985 0,722 0,833
Link discovering ‐ Leveisthein 0,927 0,508 0,656
Link discovering ‐ Dice 0,968 0,674 0,794
Link discovering ‐ Jaccard 1,000 0,472 0,642
Link discovering + heuristics based on data
knowledge + Leveisthein 0,925 0,714 0,806
QI ‐ Link discovering – Dice 0,945 0,779 0,854
QI ‐ Link discovering – Jaccard 1,000 0,588 0,740
QI ‐ Link discovering + heuristics based on data
knowledge + Leveisthein 0,892 0,839 0,865
Comparing different reconciliation approaches based on
• SILK link discovering language
• SPARQL based reconciliation described above
Thus automation of reconciliation is possible and produces
acceptable results!!
64. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RDF Store Enrichment, for service
Localization via web crawling
• Using the Ge(o)Lo(cator) framework:
– Mining, retrieving and geolocalizing web‐domains
associated to companies in Tuscany (thanks to a
Distribute Web Crawler based on Apache Nutch +
Hadoop)
– Extraction of geographical information based on a hybrid
approach (thanks to Open Source GATE Framework +
using external gazetteers)
– Validation in 2 steps: Evaluation of Complete Address
Array Extraction, Evaluation of Geographic Coordinate
Extraction
• New services found, can be transformed into RDF
triples and added to the repository!
DISIT Lab (DINFO UNIFI), May 2015 77
65. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
78
Ge(o)Lo(cator) System Description – Architecture
DISIT Lab (DINFO UNIFI), May 2015
66. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
79DISIT Lab (DINFO UNIFI), May 2015
Precision rate for geographic coordinates extraction (employing the Smart City Semantic
Repository) has increased, with respect to the value obtained in the evaluation of address array
extraction.
Slightly decreasing TN rate for Test (2a) with respect to Test (1): exploiting the extraction of high
level features (such as building names) allows the system to obtain correct coordinates even for
domains with incomplete Address Array.
Recall rate for Test (2a) significantly decrease with respect to Test (1). This is due mainly to the
noise generated by the supplementary logic and the extended semantic queries required to obtain
the geographical coordinates.
Higher Recall rate achieved when using the Google Geocoding APIs: Google Repository is by far
larger than DISIT Smart City RDF datastore, so that it is able to index a huge amount of resources,
even if this can affect the precision rate.
RDF Store Enrichment, for service
Localization via web crawling
67. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
81
RDF Store Enrichment,
VIP names identification
• Searching RDF and/or MySQL stores looking for
VIP names (citations) into strings:
– Via Leonardo Da Vinci
– Piazza Lorenzo il Magnifico
– Palazzo Medici Riccardi
– Etc.
• The idea is to link those entities with LD/LOD
information as dbPedia information and
DISIT Lab (DINFO UNIFI), May 2015
68. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
82
RDF Store Enrichment,
VIP names identification
DISIT Lab (DINFO UNIFI), May 2015http://www.disit.org/5507
69. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 83
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
70. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Real Time Data Ingestion
• Sensors on Traffic flow data: Florence, Empoli, Piombino,
Arezzo
– number of catalogs: 63
• Parkings status: Florence (14), Empoli (6), Arezzo (9),
Grosseto (4), Livorno (5), Lucca (5), Massa‐Carrara (3),
Prato (1)
– Total number: 48
• AVM busses 5 lines, in Florence:
– 816 rides for Line 4, 1210 rides for Line 6
• Weather conditions and forecast for
– Municipalities in Tuscany: about 285 cities
• Attualmente sul grafo sono riconciliati solo I parcheggi
di Firenze, Empoli, …, ma tutti mandano dati.
DISIT Lab (DINFO UNIFI), May 2015 85
71. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Example for Parking
86
• To process the parking data for Sii‐Mobility
– real time data from Osservatorio Trasporti of
Tuscany region (MIIC).
• 2 phases:
– INGESTION phase;
– TRIPLES GENERATION phase.
DISIT Lab (DINFO UNIFI), May 2015
72. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Example for AVM data
• AVM data area obtained via DATEX2 protocol for all
CodeRace (only a small part of them may be active):
– A CodeRace identifies a Bus race on a given line
• At the same time, on a single Line:
– A number of Busses (with their code race) are running.
• For each of them a forecast for each bus‐stop is provided.
– At every new forecast, all obsolete forecasts for next and
passed predictions have to be deprecated,
• thus filtering is needed to avoid growing of not useful data
into the RDF Store ….
• A different approach on the server side would be much more efficient
providing for each line the forecast only for the active races.
DISIT Lab (DINFO UNIFI), May 2015 87
73. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Distributed Scheduler
• Use of a scheduler to manage periodic execution of
ingestion and triple generation processes.
– This tool throws the processes with predefined interval
determined in phase of configuration.
• Static Data: as Sporadic processes:
– scheduled every months or week
• Real Time data (car parks, road sensors, etc.)
– ingestion and triple generation processes should be
performed periodically (no for static data).
DISIT Lab (DINFO UNIFI), May 2015 88
http://192.168.0.72
74. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.itDistributed Scheduler
DISIT Lab (DINFO UNIFI), May 2015 89
http://192.168.0.72
75. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.itDistributed Scheduler
DISIT Lab (DINFO UNIFI), May 2015 90
http://192.168.0.72
76. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 91
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
77. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Challenges
• Reasoning and Data processing
– Data analytics, Semantic computing
– Link Discovering
– Inferential reasoning
– Identification of critical condition
– unexpected correlations
– predictions, etc.
• “Real time” Computing out of peripherals
– Action / reaction
• Activation of rules
– Firing conditions for activating computing
– Acceptance of external rules
DISIT Lab (DINFO UNIFI), May 2015 92
Data
processing
Smart City
Engine
Reasoning and
Deduction
Real time
Computing
78. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Data processing
Distributed
Scheduler Database
Distributed Scheduler
Admin. Interface
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
94
Service Map
http://servicemap.disit.org
Linked Open Graph
http://log.disit.org
Smart City Engine
Admin. Interface
RDF Store
+ indexes:
SPARQL End point
Distributed processing
Reasoning and Deduction
Development Interfaces & Srv.
Decision Support
System
Servizi e strumenti
Data Analytics
Data Status
web pages
Other SPARQL
End points
sviluppatori
use
sviluppo
Km4City Strumenti e Servizi
RDF Query interface
http://log.disit.org/spqlquery/
ServiceMap API
79. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 97
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
80. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Challenges (addressed by DISIT)
• User profiling, collective profiles
• Computing Suggestions:
– Information and formation
– Virtuous behavior stimulation
– For citizens and administrators
– …
• Data export:
– API, LOD, ..
– Connection with other Smart City
DISIT Lab (DINFO UNIFI), May 2015 98
Profiled
Services
Profiled
Services
98
Data / info
Rendering
Data / info
Exploitation
Suggestions
and Alarms
Data Acting
processors
Citizens
Formation
Applications
Interoperability
81. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Development Interfaces
• Service map: http://servicemap.disit.org
– service based on OpenStreetMaps that allows to search services available in a preset range from
the selected bus stop.
• Linked Open Graph: http://log.disit.org
– a tool developed to allow exploring semantic graph of the relation among the entities. It can be
used to access to many different LOD repository.
– To query Europeana, ECLAP, Getty, Camera, Senato, Cultura Italia, ….‐> digital location
• Ontology Documentation: http://www.disit.org/6507,
– http://www.disit.org/5606, http://www.disit.org/6461
• Data Status Web pages:
– active, you have to be registered on www.disit.org, smart city group, send an email to
info@disit.org with the request
• LOD UNIFI as RDF Stores:
– OSIM: to access at UNIFI open data as RDF store on UNIFI competence: http://osim.disit.org
– ECLAP: to provide access to Performing arts data http://www.eclap.eu
• Visual Query Graph: under development
• SCE as Decision Support System: under development
DISIT Lab (DINFO UNIFI), May 2015 99
82. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
http://log.disit.org/spqlquery/
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
100
83. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
• Linked Open Graph (LOG): a tool developed to
allow exploring semantic graph of the relation
among the entities. It can be used to access to
many different LOD repository.
(http://log.disit.org/)
• Maps: service based on OpenStreetMaps that
allows to search services available in a preset
range from the selected bus stop.
(http://servicemap.disit.org/)
DISIT Lab (DINFO UNIFI), May 2015 101
Data access and applications
84. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
km4city status and progress, march 2015
Servicemap front end
85. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
• Service Map:http://servicemap.disit.org
– Permette allo sviluppatore di realizzare delle query in
modo visuale e farsi mandare il codice di richiesta
tramite email.
– Questo codice può essere utilizzato in App mobili e web
per semplificare la programmazione e realizzare app che
non devono essere manutenute quanto il server
cambia…
– La selezione effettuata può essere richiamata e anche
inserita in pagine web di terzi, l’applicazione web è già
pronta.
– Manteniamo le App Vive, la complessità sta sul server e
non sulle App !!
FORUM‐PA, Maggio 2015
86. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
104
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
87. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
105
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
Service Map
http://servicemap.disit.org
88. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Linea 4
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
106
89. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
107
Linked Open Graph
http://log.disit.org
A bus stop info….
90. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
• LOG: http://log.disit.org
– Permette allo sviluppatore di navigare nelle strutture
complesse di uno o più database RDF accessibili per
formulare dei grafici e delle query in modo visuale e
farsi mandare il codice di richiesta tramite email.
– Questo codice può essere utilizzato in App mobili e
web per semplificare la programmazione e realizzare
app che non devono essere manutenute quanto il
server cambia…
– Il grafo puo’ essere richiamato e anche inserito in
pagine web di terzi, l’applicazione web è già pronta.
– Manteniamo le App Vive !!
FORUM‐PA, Maggio 2015
91. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Linked Open Graph
http://log.disit.org
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
109
92. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
110
http://log.disit.org
93. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Matrice Origine Destinazione
http://www.disit.org/6694
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
111
94. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Decision Support System,
System Thinking example
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
112
95. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Strumenti: km4city e DISIT
• Service Map: http://servicemap.disit.org
• Linked Open Graph, Multiple RDF Store Visual
Browser: http://log.disit.org
• RDF Store SPARQL query tool:
http://log.disit.org/spqlquery/
• FODD 2015 applicazione dimostrativa:
– http://www.disit.org/6595 (pagina)
– Google Play
https://play.google.com/store/apps/details?id=org.disit.f
odd
– Sorgenti: http://www.disit.org/6596
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
113
96. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Documentazione Km4City e DISIT
• API Service Map: http://www.disit.org/6597
• Grafo ontologia: http://www.disit.org/6507
• descrizione ITA: http://www.disit.org/6461
• descrizione ENG: http://www.disit.org/5606
• ontologia: http://www.disit.org/6506
• articolo: http://www.disit.org/6573
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
114
97. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
https://play.google.com/store/apps/deta
ils?id=org.disit.fodd
DISIT Lab (DINFO UNIFI), FODD: 21 Feb
2015
119
98. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 120
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
99. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Sii-Mobility
• Title: Support of Integrated Interoperability for Services
to Citizens and Public Administration
• Objectives:
1. Reduction of social costs of mobility;
2. Simplify the use of mobility systems;
3. Developing working solutions and application, with testing methods;
4. Contribute to standardization organs, and establishing relationships with
other smart cities’ management systems.
The Sii‐Mobility platform will be capable to provide support for SME and Public
Administrations. Sii‐Mobility consists in a federated/integrated interoperable
solution aimed at enabling a wide range of specific applications for private
services to citizen and commercial services to SME.
• Coordinatore Scientifico: Paolo Nesi, DISIT DINFO UNIFI
• Partner: ECM; Swarco Mizar; University of Florence (svariati gruppi+CNR); Inventi In20;
Geoin; QuestIT; Softec; T.I.M.E.; LiberoLogico; MIDRA; ATAF; Tiemme; CTT Nord;
BUSITALIA; A.T.A.M.; Sistemi Software Integrati; CHP; Effective Knowledge; eWings; Argos
Engineering; Elfi; Calamai & Agresti; KKT; Project; Negentis.
• Link: http://www.disit.dinfo.unifi.it/siimobility.html
DISIT Lab (DINFO UNIFI), May 2015 121
102. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Sii‐Mobility
DISIT Lab (DINFO UNIFI), May 2015 125
103. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 126
• Experimentations and validation in Tuscany
• Integration with present central station and subsystems
Sii‐Mobility
104. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Support of Integrated Interoperability
Sii‐Mobility Architecture
DISIT Lab (DINFO UNIFI), May 2015 128
Data analytics Support
Social Intelligence
Operation Center Support
Timetables, routes, stops,
actual values , poli cal
action, etc..
profiles, cost
models,
users,…
Simulation Support
Control Interface
Monitoring Interface
Data publication API toward other
Services center or users
Decision Support
Data validation
Data integration
Geo Referencing
other Sii‐Mobility API
API for other SC Cent.
Fleet Manager API
AVM Manager API
TPL Manager API
ZTL Manager API
Parking Manager API data aggregation, actions
propagation
Highways Manager API
national central API
Environmental Data acq.
Ordinances Data acq.
Social Media Data acq.
Mobile Operator Data acq
Sensible Data acq
Data ingestion and
pre processing
Emergency Data acq
Open Data acquisition
Ticketing Support
Booking Support
Additional algorithms…..
Big Data processing grid
Management Systems
Data integrated from/to the area
Interoperability to and from other
integrated management systems
Infomobility and publication
Path Planing Support
participation and awareness
platform
Info. Services for
Totem, Mobile, ..
Web App and
Totem
Mobile App
Sii‐Mobility HW Infrastructure
Sensors and
Detection
Equipment
Kit for vehicle and actuators
105. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 129
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
106. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
130
Sii‐Mobility (Smart City) new technologies and smart solutions for improving
the interoperability of management and control systems of urban infomobility,
mobility and transport in the city and metropolis. (terrestrial transport and
mobility)
Coll@bora (Smart City Social Innovation) collaborative tools for the
protection of information and data among health care institutions and families
for people with imparities. (Welfare and inclusion technologies)
Smart City solutions
DISIT Lab (DINFO UNIFI), May 2015
107. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Coll@bora
• Title: Collaborative Support for Parents and Operators of Disabled
• Objectives: providing strong advantages for
1. Relatives interested in facilitating relations with the
management team;
2. Associations in order to offer a better service to the families
and people with disabilities by providing a collaborative
support to the involved teams, but also to manage the
wealth of knowledge, to support the training of the staff,
etc.
Coll@bora provides a secure collaboration tool for the teams and
for the association to support the families and the disabled
people.
• Link: http://www.disit.dinfo.unifi.it/collabora.html
DISIT Lab (DINFO UNIFI), May 2015 131
108. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 132
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
109. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RESOLUTE
Resilience management guidelines and
Operationalization applied to
Urban Transport Environment
DISIT Lab (DINFO UNIFI), 2015 133
DRS‐7‐2015 ‐ RIA – start 1/5/2015 ‐ end 30/4/2018 Budget 3.8M
http://www.disit.org/6695
110. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RESOLUTE
Balanced Consortium
(avoiding overlaps)
134
Infrastructure
Provider Data Provider
Resilience
Transport
DisseminationServices
Big Data Mining
Smart City
111. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Obj1- Conducting a systematic review and assessment of the state of the art of the
Resilience assessment and Management concepts, national guidelines and their
implementation strategies in order to develop a conceptual framework for resilience within
Urban Transport Systems
Obj2 - Development of European Resilience Management Guidelines (ERMG)
Obj3 - Operationalize and validate the ERMG by implementing the RESOLUTE
Collaborative Resilience Assessment and Management Support System
(CRAMSS) for Urban Transport System (UTS) addressing Roads and Rails Infrastructures
Obj4 – Enhancing resilience through improved support to human decision making
processes, particularly through increased focus on the training of final users (first
responders, civil protections, infrastructure managers) and population on ERMG and
RESOLUTE system
Obj5 – ERMG wide dissemination, acceptance and adoption at EU and Associated
Countries level
DISIT Lab (DINFO UNIFI), 2015 135
RESOLUTE Objectives
112. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RESOLUTE Pilots
DISIT Lab (DINFO UNIFI), 2015 136
98Km metro line
65 stations
1M passenges daily
Over 70% of the city
infrastructures
are at Hidrogeological risk
113. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
RESOLUTE Solution
DISIT Lab (DINFO UNIFI), 2015 137
ERMG
114. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Major topics addressed
• Smart City Concepts
• Architecture of Smart City
Infrastructures
• Peripheral processors
– Data collectors and Managers
– Blog Vigilance via Natural Language
Processing
– Twitter vigilance
• Data ingestion and mining
– Data Mining and smart City
problematic
– Km4City: Smart City Ontology
– RDF production, reconciliation
– Parallel and distributed processing
DISIT Lab (DINFO UNIFI), May 2015 139
Reasoning and Deduction
Smart City Engine
Decision Support System
Data Acting processors
Smart City Tools and API
Service Map and Linked Open
Graph
Mobile applications
Projects
SmartCity Project Sii‐Mobility
SCN
SmartCity Project Coll@bora SIN
SmartCity Project RESOLUTE
H2020
Mobile Emergency
115. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Context
• Complex and large systems of buildings
with activities of maintenance and
emergency
– implies movements of people in a
non fully known environment.
– Hospitals, industrial plan, airports,
etc.
• Personnel does not know the position of
every room and service device or tool
(POI, Point of Interest) that can be
needed to perform activities of rescue or
maintenance
• Conditions and positions can change,
and teams and people may be not aware
about those changes in real timeDISIT Lab (DINFO UNIFI), May 2015 140
116. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
State of the art
• Digital documentation Aug. Reality, ..
• Present solutions for navigation
– Tables and books for navigation
– RFID, QR codes for making points and devices
– Paper and wall maps for indoor navigation
– Navigators for outdoor navigation
– Pedometer for indoor inertial navigator
• Lack of:
– integrated indoor/outdoor navigation
– Precision in the indoor inertial navigation
DISIT Lab (DINFO UNIFI), May 2015 141
117. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Overview and aim of Mob Emerg.
• Managing team and singles
– Communication, collaborative work,
access to on line documentation,
recovering people, Creating Teams, etc.
• Moving teams and singles
– pushing them towards meeting points,
POI, emergency points, recalling them,
etc.
– help them to get the exists !!
• Aim:
– Reduction of Costs!!
– Reduction of the intervention time!!
– Access to updated information in real
time!! (maps, manuals, guidelines, …)
DISIT Lab (DINFO UNIFI), May 2015 142
118. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
How they use
• Improving the coordination among
personnel (medical and/or for
maintenance)
– Sending instruction to form teams and
join other colleagues
– Signaling about critical conditions and
intervention
– Continuous connection and
communication with the central station
for monitoring and emergency
• Delivering fresh and updated
information
– Documentation, exits,
– positions of POI and colleagues
DISIT Lab (DINFO UNIFI), May 2015 143
119. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
MOBILEEMERGENCYFRONTEND
CENTRAL STATION
DATABASE
Action Manager
Messaging in Push
User Management
Map Manager
User Interface
MOBILE EMERGENCY PRO
COMMUNICATIONMANAGEMENT
Event Manager
Media Acquisition and Delivering
Collaboration Discovering
QR acquisition Map Consulting
MOBILE MEDICINE
Best Practice Network and Services
http://mobmed.axmedis.org
MOBILEDEVICESANDSENSORS
Content database
Information and
history database
Content
Indexer,
Semantic
Ingestion and
processing
Mobile
Medicine
Reach Location
Path Manager
Indoor Path
Manager
Outdoor Path
Manager
Indoor Navigation System
General Architecture
DISIT Lab (DINFO UNIFI), May 2015 144
120. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Central Station
• receives alarms/requests for intervention with a
suitable protocol
• supports people involved in the event:
– Providing: event status, viable exits, position of
personnel, POIs,
– Moving people and patients, moving materials,
establishing teams
• Sends messages in push via APN, or polling to
recall personnel, interrupts, etc.
DISIT Lab (DINFO UNIFI), May 2015 145
121. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 146
122. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 147
123. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
DISIT Lab (DINFO UNIFI), May 2015 148
124. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Indoor / Outdoor Navigation
• Outdoor navigation based on GPS: Google Map,
Open Street view, etc.
• Indoor navigation based on Markers and Fields:
– RFID, QR, Laser, Wi‐Fi, images,..
• Detection of Indoor/outdoor passages:
– changes in signal power of GPS
– presence of markers: QR, NFC (on android)
– Hyp: Access to specific knowledge and maps integrating
outdoor and indoor connected points (doors, windows,
etc.)
DISIT Lab (DINFO UNIFI), May 2015 149
125. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Get position
DISIT Lab (DINFO UNIFI), May 2015 150
QR code aspect Description and meaning of the QR
code for location, an example
Map provided to
standard QR readers
“00039”: position identifier of QR
“n”: control code based on SHA‐1
algorithm.
String BarCode:
http://mobmed.axmedis.org/me/ID00
039n
126. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Indoor navigation
• Once marked a point in an indoor Map, a precise inertial
navigation support is needed to reach the successive
point,
for example by using internal sensors of the mobile
device:
– gyroscopes, magnetic compass, accelerometers
– as an Inertial Navigation System
• STOA lead to cumulative error
in space and time:
– step counters, dead reckoning
– traditional Kalman filter
DISIT Lab (DINFO UNIFI), May 2015 151
127. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Dear Reckoning vs Kalman filtering
DISIT Lab (DINFO UNIFI), May 2015 152
dead reckoning
Kalman filtering
128. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Extended Kalman Filtering
• First Kalman was with
costant Q
• Extended Kalman addresses
the non linearity
• Adaptive Ext. Kalman
adapted Q using
– Q at the previous time instant
and a corrective scale factor
(estimated on the basis of
the ratio from the innovation
covariance and the predicted
value)
– Q reported at Qo when
singularity are detected.
DISIT Lab (DINFO UNIFI), May 2015 153
Extended Kalman
Adaptive Ext. Kalman
129. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
Mobile emergency
• A solution for integrated indoor/outdoor
inertial navigation has been proposed,
addressing
– map and knowledge modeling
– adaptive Extended Kalman filtering
• Compared with state of the art solutions, the
proposed solution obtained
– errors < 20 cm at the end of the path, 40mt.
– saving 18% in time to reach the target point for
team that do not know the area
DISIT Lab (DINFO UNIFI), May 2015 154
130. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.itSome References
• Smart City Group on DISIT and several slides: www.disit.org
• P. Bellini, M. Benigni, R. Billero, P. Nesi and N. Rauch, "Km4City Ontology Bulding vs Data Harvesting
and Cleaning for Smart‐city Services", International Journal of Visual Language and Computing,
Elsevier, http://dx.doi.org/10.1016/j.jvlc.2014.10.023, P. Bellini, P. Nesi, A. Venturi, "Linked Open
Graph: browsing multiple SPARQL entry points to build your own LOD views", International Journal of
Visual Language and Computing, Elsevier, 2014, DOI information:
http://dx.doi.org/10.1016/j.jvlc.2014.10.003 ,
• A. Bellandi, P. Bellini, A. Cappuccio, P. Nesi, G. Pantaleo, N. Rauch, "ASSISTED KNOWLEDGE BASE
GENERATION, MANAGEMENT AND COMPETENCE RETRIEVAL", International Journal of Software
Engineering and Knowledge Engineering, World Scientific Publishing Company, press, vol.32, n.8,
pp.1007‐1038, Dec. 2012, DOI: 10.1142/S021819401240013X
• P. Bellini, M. Di Claudio, P. Nesi, N. Rauch, "Tassonomy and Review of Big Data Solutions Navigation",
as Chapter 2 in "Big Data Computing", Ed. Rajendra Akerkar, Western Norway Research Institute,
Norway, Chapman and Hall/CRC press, ISBN 978‐1‐46‐657837‐1, eBook: 978‐1‐46‐657838‐8, july
2013, pp.57‐101, DOI: 10.1201/b16014‐4
• P. Nesi, G. Pantaleo and M. Tenti, "Ge(o)Lo(cator): Geographic Information Extraction from
Unstructured Text Data and Web Documents", SMAP 2014, 9th International Workshop on Semantic
and Social Media Adaptation and Personalization, November 6‐7, 2014, Corfu/Kerkyra, Greece.
technically co‐sponsored by the IEEE Computational Intelligence Society and technically supported by
the IEEE Semantic Web Task Force. www.smap2014.org
• P. Bellini, P. Nesi and N. Rauch, "Smart City data via LOD/LOG Service", LOD2014, Workshop Linked
Open Data: where are we?, organized by W3C Italy and CNR, Rome, 2014
DISIT Lab (DINFO UNIFI), May 2015 156
131. DISIT Lab, Distributed Data Intelligence and Technologies
Distributed Systems and Internet Technologies
Department of Information Engineering (DINFO)
http://www.disit.dinfo.unifi.it
157
Overview on Smart City
DISIT lab solution for beginner
Distributed Data Intelligence and Technologies Lab
Distributed Systems and Internet Technologies Lab
Prof. Paolo Nesi
DISIT Lab
Dipartimento di Ingegneria dell’Informazione
Università degli Studi di Firenze
Via S. Marta 3, 50139, Firenze, Italia
tel: +39-055-4796523, fax: +39-055-4796363
http://www.disit.dinfo.unifi.it
paolo.nesi@unifi.it
DISIT Lab (DINFO UNIFI), May 2015