Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Citizen Science, Geocrowdsourcing and Big Data in Urban Context
1. Citizen Science, Geo-Crowd-
Sourcing and Big Data in Urban
Context
Politecnico di Milano, DICA – GEO Laboratory at Como Campus
Maria Antonia Brovelli
Osaka, 8th
September 2015
大阪市北区梅田 1-2-2-600 (大阪駅前第2
ビル6階 ) 大阪市立大学梅田サテライト
101
POLITECNICO DI MILANO
GEOlab - COMO Campus
9. 9
✔ Set of practices in which citizens participate in data collection, analysis
and dissemination of a scientific project (Cohn 2008)
✔ Active or passive
✔ Explicit or implicit
✔ Classification (Haklay 2013)
Citizen science
✗ volunteered computing: citizens download data, run analyses on their own
computers and send back data to the server
✗ volunteered thinking: citizens perform classification works
✗ participatory sensing: applications centered on mobile phones capabilities
➔ 'classic' citizen science: amateurs engaged in traditional scientific activities
➔ community science: measurements and analysis carried out by amateurs in
order to set action plans to deal with environmental problems
➔ citizen cyberscience: use of computers, GPS receivers and mobile phones
10. 10
✔ Set of practices in which citizens participate in data collection, analysis
and dissemination of a scientific project (Cohn 2008)
✔ Active or passive
✔ Explicit or implicit
✔ Classification (Haklay 2013)
Citizen science – Our experience
➔ 'classic' citizen science: amateurs engaged in traditional scientific activities
➔ community science: measurements and analysis carried out by amateurs in
order to set action plans to deal with environmental problems
➔ citizen cyberscience: use of computers, GPS receivers and mobile phones
✗ volunteered computing: citizens download data, run analyses on their own
computers and send back data to the server
✗ volunteered thinking: citizens perform classification works
✗ participatory sensing: applications centered on mobile phones capabilities
bit.ly/foss4game
11. 11
Citizen Science and Europe
✔ JRC Summit Technical Report “Citizen Science
and Smart Cities” - February 2014
(Max Craglia and Carlos Granell)
https://ec.europa.eu/jrc/en/publication/eur-scientific-and-
technical-research-reports/citizen-science-and-smart-cities
15. 15
Other Projects (just a selection...)
TU- Wien
http://cartography.tuwien.ac.at/emomap/
www.everyaware.eu/
Sound pollution
Air quality
http://www.opalexplorenature.org/
Open Air Lab
16. 16
➔ field-data collection from mobile devices
➔ data access and interaction based on user privileges
➔ data Web publication and sharing
➔ data access through multi-dimensional (2D and 3D) Web interfaces
➔ data participative enrichment
✔ To build an architecture for participatory sensing applications enabling:
Our experience in VGI
✔ To use FOSS (Free and Open Source Software)
➔ Involvement in OSGeo (Open Source For Geospatial)
➔ Involvement in GeoForAll
ICA-OSGeo-ISPRS initiative http://www.geoforall.org/
102 Labs as of 6 September 2015
http://geomobile.como.polimi.it/
http://wiki.osgeo.org/wiki/Geocrowdsourcing_CitizenScience_FOSS4G
18. 18
Report of potholes
➔ classification of the type of damage and its severity degree
➔ open to everyone, advertised through local media (TV and newspapers)
✔ Report of road pavement damages, winter 2012-13 (Brovelli et al. 2014a)
19. 19
Report of potholes
➔ classification of the type of damage and its severity degree
➔ open to everyone, advertised through local media (TV and newspapers)
✔ Report of road pavement damages, winter 2012-13 (Brovelli et al. 2014a)
22. 22
Report of architectural barriers
➔ physical obstacles for the mobility of people (stairs, ramps, pathways)
➔ verification of the compliance with the current Italian legislation
➔ performed by students within a collaboration action with a local high school
✔ Report of architectural barriers, fall 2013
23. 23
Report of architectural barriers
➔ obstacles for physically impaired people (stairs, ramps, pathways)
➔ verification of the compliance with the current Italian legislation
➔ performed by students within a collaboration action with a local high school
✔ Report of architectural barriers, fall 2013
25. 25
Mapping street furniture
➔ benches, litter bins, waste bells, fountains
➔ performed by students within a collaboration action with a local high school
✔ Report of street furniture elements, spring 2014
26. 26
AdbPo report of water-related elements
➔ VGI campaign managed by AdbPo (Autorità di Bacino del fiume Po – Po river
basin Authority) to enlarge consciousness of its territory through collection and
valorisation of user local knowledge and experience
✔ Report of water-related elements, ongoing (Brovelli et al. 2014b)
28. 28
ABC
ABC : a way to map, monitor and
discover the surrounding
environment and the biodiversity
Where ?
-Agri River Valley – Basilicata Region (Italy)
What ?
- Map and monitor data related to
surroundings of operative oil&gas
facilities and natural environment
- Long term monitoring of some Biodiversity
mitigation&restoration actions performed
since 2009 with Biodiversity Action Plan
Thesis Project (Marco Pelucchi) developed
in collaboration between:
- PoliMI – GEO Lab
- eni s.p.a.
29. 29
ABC
Who?
- students of Agri Valley area
- common citizens and local stakeholder
- eni staff and specific environmental contractors
How?
- mapping and prioritization interventions:
- fencing conditions in well clusters and restoration
areas
- status/maintenance of access road and pathway to
production facilities, restoration areas and nursery of
local trees and plants
- pruning (legal and illegal) of plants
- Census of plants in natural and restorations areas
STEP 1 - collect data using
smartphone or different mobile device
30. 30
ABC
Download this Free App from Google Play: ODK Collect
Input Server: ODK Aggregate
Input URL: http://geomobile.como.polimi.it:8080/ODKAggregate
Select Form from list: AgriBiodiversityCollector
User: agricollector
Password: rosacanina22
STEP 1 - collect data using smartphone or different
mobile device
31. 31
ABC
STEP 2 - data visualization in a geo referenced map
using ABC web-GIS
LINK: http://geomobile.como.polimi.it/abc/webgis.html
32. 32
I CAMMINI DELLA VIA REGINA
The Regina's Paths
INTERREG project
(Cross-border Co-
operation Operational
Programme Italy –
Switzerland 2007-
2013) which aims at
valorizing the cross-
border area between
Italy and Switzerland
covered by many
historical paths
departing from the old
Via Regina.
33. 33
Mapping elements along cultural paths
✔ Map parties within INTERREG project “The paths of Via Regina”
SVIZZERA
34. 34
Via Regina
Via Regina is one of the oldest paths for
historical and cultural exchanges
between Italy and Switzerland.
Via Regina is one of the oldest paths for
historical and cultural exchanges
between Italy and Switzerland.
35. Nowadays it represents a fundamental transalpine
system of soft mobility links especially for slow
tourism
Nowadays it represents a fundamental transalpine
system of soft mobility links especially for slow
tourism
What is Via Regina?
36. 36
Mapping elements along cultural paths
➔ user report of points of interest related to history, culture, tourism and other
services along the paths connected to the ancient Via Regina
➔ one-day events (jointly organized with a cultural association of hikers) which
target local communities and are advertised ad hoc
✔ Map parties within INTERREG project “The paths of Via Regina”, ongoing
40. 40
PoliCrowd – A social World Wind platform
➔ Born for tourism, culture, sports & transportation Points Of Interest (POIs)
➔ POIs 3D visualization on NASA World Wind virtual globe
➔ participative functionalities: POIs collaborative enrichment & project creation
✔ Web-based 3D participatory platform
41. 41
PoliCrowd2.0 – A social World Wind platform
➔ multithematic-thematic application – connection to any WMS and ODK server
➔ customizable data styling & multimedia support
➔ support for time dimension (4D visualization)
✔ Web-based 3D participatory platform
42. 42
PoliCrowd 2.0 architecture
In addition to the WMS servers, PoliCrowd 2.0 has also an innovative capability
to directly connect with any Open Data Kit (ODK) server available on the
network and publish the related data collected by the community
WMS Servers ODK Servers
Restful
API
Application
Server
MOBILE CLIENT
It allows to collect the
geo-data on the field
POLICROWD 2.0 CLIENT
It allows to interact with the data
uploaded by the users
POLICROWD 2.0 SERVER
Management of: accounts (authentications,
authorizations), projects, mutimedia
contents
44. 44
Geomatics Laboratory, Politecnico di Milano – Como Campus
Policrowd 2.0: POIs information
● Clickable POIs placemarks
● Visualization of the ODK Collect-reported information (including picture)
45. 45
Policrowd 2.0: ODK Layer customization
● ODK layers are fully customizable, thanks to a suitable layer management
interface
● Users select the fields they want to display for each layer of a given project, and
personalize marker icons by picking them from a default collection or providing
them manually
● Styles are also shareable, so that users can take advantage of the already
available icons provided by other users in their own projects
46. 46
Geomatics Laboratory, Politecnico di Milano – Como Campus
Policrowd 2.0: Collaborative POIs characterization
Every marker is open to collaborative contribution: everyone can add his POI-
related textual (comments) and multimedia contents (images, audios and videos)
47. 47
Policrowd 2.0: the 4th dimension (time)
● The time bar enables temporal filtering of all the POIs on the globe, just by
picking a given date or setting a range
● More in-depth navigation through the content
● The same capabilities are also made available for multimedia data, which can
be independently filtered according to the date of the content upload or (if
provided) to the actual date of the element, e.g. useful to filter historical data
48. 48
Implicit or Passive Volunteering
http://www.internetlivestats.com/
9,890 Tweets sent in 1 second
2,528 Instagram photos uploaded in 1 second
2,153 Tumblr posts in 1 second
1,843 Skype calls in 1 second
29,290 GB of Internet traffic in 1 second
50,232 Google searches in 1 second
106,299 YouTube videos viewed in 1 second
2,420,172 Emails sent in 1 second
49. 49
Geo Big Data: Milano GRID
● Two months of data, with a temporal step of 10
minutes
● Grid of 100 x 100 cells with size = 235 m
https://dandelion.eu/datamine/open-big-data/
50. 50
✔ Received SMS: a Call Detail Record (CDR) is generated each
time a user receives an SMS
✔ Sent SMS: a CDR is generated each time a user sends an SMS
✔ Incoming Calls: a CDR is generated each time a user receives
a call
✔ Outgoing Calls: CDR is generated each time a user issues a
call
✔ Internet: a CDR is generate each time
a user starts an internet connection
a user ends an internet connection
during the same connection one of the following limits is
reached:
● 15 minutes from the last generated CDR
● 5 MB from the last generated CDR
✔ Geolocalized Tweets (Anonymized twitter users)
Geo Big Data: Milano GRID
51. 51
Sensing the City - 1
Students: Emanuele Mariani, Jacopo Mossina;
Supervisors: Giorgio Zamboni, Maria A Brovelli
http://landcover.como.polimi.it/BGDV/
52. 52
Sensing the City - 2
Student: Anna Trofimova
Supervisors: Carolina Arias, Maria A Brovelli
http://landcover.como.polimi.it/socialmedia_rasdaman/
53. 53
Sensing the City - 3
http://landcover.como.polimi.it/BigNetCDF/
Carolina Arias, Maria A Brovelli,
Simone Corti
54. 54
Sensing the City - 3
Filtering
Interactive
multidimensional
web visualisation -
ESTWA
Maria A Brovelli, Giorgio Zamboni
56. 56
Osaka Mapping Party: OSAKA Bike Parking
Aim: to collect information about room for parking biycles
What are we going to take into account?
Informal parking
Racks
Corrals Rack
Indoor Bike Parking
New proposal
Sheltered Bike
Parking
57. 57
Open Data Kit (ODK)
✔ ODK is a suite of tools for planning, executing and managing
collection campaign
✔ It was developed by Washington University – Department of
ComputerScience & Engineering and Change
(http://change.washington.edu)
✔ open source under the Apache2 license
(http://www.apache.org/licenses/LICENSE-2.0)
✔ based on open standards
✔ http://opendatakit.org
58. 58
Components of ODK
✔ Create the form for data collection
– ODK Build: HTML5 Web interface (for simple forms)
– XLSForm: converter of forms created in Excel (for complex
forms)
✔ Fill in the form on the field
– ODK Collect: Android app
✔ Store, visualize and export the collected data
– ODK Aggregate: server platform (Apache Tomcat)
59. 59
XLSForm (http://opendatakit.org/use/xlsform)
✔ XLSForm converts forms created from an .xls file in the XML
Xforms standard.
✔ The .xls file must have a structure described here:
http://xlsform.org
✔ The file must have 3 worksheets, with the following names:
– survey: contains the structure of the form, including the list of
questions and the related options
– choices: contains the list of the possible answers for multiple
choice questions
– settings (optional): contains additional options for the form
✔ The worksheet formatting (cell dimension, background color,
font type/color/dimension, etc.) will be ignored by XLSForm and
thus can be customized. Optional columns may be left out
completely. Any number of rows may be left blank.
60. 60
The survey worksheet
✔ Each row corresponds to a question.
✔ Our questions are:
– Select the type of parking (“new proposal” included) (M)
– Ask the address
– Ask the location (which can be obtained by the mobile device
geolocation services – GPS/cellular network/Wi-Fi). This will take
time and therefore we can suggest, in the meantime, to start
counting the number of racks (M)
– Ask the number of racks (M)
– Ask the date (M)
– Ask a picture of the bike parking (M)
– Ask a video of the bike parking
– Ask an audio of the bike parking
– (M) = Mandatory
61. 61
The survey worksheet
✔ We can decide if we want to create a form only in one language or
in more languages. In our case we want to have it in: English,
Italian, Japanese.
✔ The default language we choose is: English
✔ If the form is in ONE language the required columns are:
– type|name|label
✔ If it is multi-language (e.g. 3 languages) the columns are
– type|name|label::Language1|label::Language2|label::Language3|
–
– Where
● type specifies the type of question (text, number,
date,selection, etc)
● name specifies the unique identifier of the question
● label specifies the text of the question
62. 62
The survey worksheet
We can (optional) add the hint that will be presented to the user
together with each question by adding a hint column or,better, as
many colums as the languages we have chosen:
hint::Language1| hint::Language2|hint::Language3|
We can point out which elements are required, introducing a
column "required". In the rows yes has to be written in
correspondence of these elements.
type name label::English label::Japanese hint::English hint::Japanese required
select_
one
type_p
ark
type_p
ark
Type of parking 駐輪場の種類 Select the type
of parking
タイプの駐輪場を選
択してください
yes
text addres
s_nam
e
Address 住所 Enter the
address
住所を入力して
ください
geopoi
nt
locatio
n
Location 場所 Enter the
location
場所を入力して
ください
yes
63. 63
type name label::Englis
h
label::Japanes
e
hint::Englis
h
hint::Japanes
e
required
integer number
_rack
Total number
of racks
自転車ラックの
総数
Enter the
total number
of racks
自転車ラックの
総数を入力して
ください
yes
date date_sur
vey
Date of survey 日付 Enter the
date of
survey
調査日の日付を
入力してくださ
い
yes
image picture Picture 写真 Upload a
picture of
the parking
area
駐輪場の写真を
アップロードして
ください
yes
video video Video ビデオ Upload a
video of the
parking area
駐輪場のビデオ
をアップロードし
てください
audio audio Audio オーディオ Record the
desription of
the parking
area
駐輪場の詳細を
録音してくださ
い
The survey worksheet
64. 64
✔ As told, it contains the list of possible multiple answers
✔ An image can also be added
The choices worksheet
list name name label::English label::Japanese image::English image::Japanese
type_park informal_
parking
Informal
Parking
ポール informal.png informal.png
type_park bike_rac
k
Rack ラック rack.png rack.png
type_park bike_corr
als
Bike Corral
(rows of racks)
複数ラック corral.png corral.png
type_park shel_par
king
Sheltered
Parking
屋根付き駐輪場 shelter.png shelter.png
type_park indoor_p
ark
Indoor Parking 屋内・地下駐輪場 indoor.png indoor.png
type_park new_par
king
Proposal of a
new parking
駐輪場の提案場所 proposal.png proposal.png
65. 65
The settings worksheet
✔ The settings worksheet is optional, but it allows you to further
customize your form, including encrypting your form or setting
an overall style theme to your form, among others.
form_title form_id default_language
Osaka Bike
Parking Report
Osaka_Bike_Parking_Report English
66. 66
Question types/ Answer inputs
integer Integer (i.e., whole number) input.
decimal Decimal input.
text Free text response.
select_one
[options]
Multiple choice question; only one answer can be
selected.
select_multiple
[options]
Multiple choice question; multiple answers can be
selected.
note Display a note on the screen, takes no input.
geopoint Collect a single GPS coordinates.
geotrace Record a line of two or more GPS coordinates.
geoshape Record a polygon of multiple GPS coordinates; the last
point is the same as the first point.
67. 67
Question types/ Answer inputs
date Date input.
time Time input.
dateTime Accepts a date and a time input.
image Take a picture.
audio Take an audio recording.
video Take a video recording.
barcode Scan a barcode, requires the barcode scanner app to be
installed.
calculate Perform a calculation
acknowledge Acknowledge prompt that sets value to “OK” if selected.
68. 68
ODK Aggregate
ODK Aggregate is a server platform written in Java, which
✔ provides blank forms to ODK Collect
✔ accepts finalized forms from ODK Collect
✔ stores the data collected
✔ visualizes the data collected (simple maps, graphs)
✔ exports the data collected (in the CSV, KML and JSON
formats)
✔ publishes the data collected in other formats (like Google
Spreadsheets and Google FusionTables)
✔ manages users and the related permissions
There are different ways of installing ODK Aggregate (on a cloud
platform/on a virtual machine/on a local Tomcat server).
We are using the third option with PostgreSQL database
synchronization
http://opendatakit.org/use/aggregate
69. 69
Upload the Osaka Bike Parking Report form
✔ Connect to http://131.175.143.49/ODKAggregate
✔ click on Log In on the top right corner
✔ click on Sign in with Aggregate password
✔ write: username: XXXXX, password: YYYYY
✔ in the Form Management section, click on Add New Form
in the top left corner (yellow +)
✔
✔ clik on Upload Form button and wait for the upload
All in the
same folder
70. 70
Other relevant ODK Aggregate functionalities
To verify if the form has been uploaded,
✔ go to the Submissions section/Filter Submissions subsection
✔ select the form of interest from the Form menu on the top left.
✔ At the beginning you will see only the header. Then as far as users
sent their surveys, the content of their submissions appears. If
provided the permissions, you will be able to delete the single
user's submission
To export user's submissions:
✔ go to the Submissions section/Filter Submissions subsection
✔ click on Export on the top right
✔ select the extension of the file (CSV, KML, JSON) and click
Export
✔ Exported submissions will be listed in the Submissions
section/ Exported Submissions subsection.
72. 72
To publish user's submissions:
✔ go to the Submissions section/Filter Submissions subsection
✔ click on Publish on the top right
✔ select the type of publication (Google FusionTables,
Google Spreadsheet, etc)
✔ click Publish.
To visualize user's submissions in graphs and in a simple map:
✔ go to the Submissions section/Filter Submissions subsection
✔ click Visualize on the top right
✔ select the type of graph (Pie Chart/Bar Graph/Map) in the
Type menu and the attribute of interest in the Column to
Visualize menu
Other relevant ODK Aggregate functionalities
73. 73
To visulize users' submissions:
✔ go to the Submissions section/Filter Submissions subsection
✔ click on Visualize on the top right
Other relevant ODK Aggregate functionalities
Pie Chart & type_park
77. 77
✔ ODK Collect is an Android app which downloads blank forms
from ODK Aggregate and uploads the finalized forms.
Compilation can be also offline and forms can be uploaded at a
later time.
✔ It is possible to download ODK Collect on an Android device:
– from the official Google Play store
https://play.google.com/store/apps/details?
id=org.odk.collect.android
– as an Android application package (.apk) from
http://opendatakit.org/downloads/download-info/odk-collect-apk
✔ To connect ODK Collect to the ODK Aggregate server:
● hit the Options device button, then select General Settings
● select Configure platform settings and insert:
– URL: http://131.175.143.49/ODKAggregate
– Username: maria - Password: osaka2015
ODK Collect
82. 82
ODK Aggregate/PostgreSQL
✔ Collected data are stored on the PostgreSQL database
synchronized with ODK Aggregate. While configurating ODK
Aggregate, a predefined set of tables was created in the
database to store general information (server preferences,
security options, user credentials, etc.)
✔ for each form created in ODK Aggregate, the database has
have:
– one main table to store all the contents except multimedia
– 3 additional tables for each multimedia (picture, video or
audio) present in the form
83. 83
2D Viewer
✔ The data will be diplayed here:
http://geomobile.como.polimi.it/Osaka
SERVER CLIENT
template form
GeoJSON
AGGREGAT
E
COLLEC
Tcompiled form
DATA
STORAGE
DATA ACQUISITION
DATA WEB PUBLICATION
DATA WEB VISUALIZATION
84. Accessing it with Java Webstart
http://viaregina2.como.polimi.it/Osaka/
OPEN
OSAKA 4D Platform
95. 95
Contacts
Thanks for your attention!
Politecnico di Milano
GEOlab Como Campus
Via Valleggio 11, 22100 Como (Italy)
maria.brovelli@polimi.it
Thanks to all people of my team contributing on these
topics: Carolina Arias, Simone Corti, Eylul Candan
Kilsedar, Marco Minghini, Monia Molinari, Giorgio
Zamboni