GeoNode for Humanitarian Crisis and Risk Reduction
1. Simone Dalmasso European Comission JRC
Paolo Corti UN World Food Programme
Ariel Nunez The World Bank
GEONODE FOR HUMANITARIAN
CRISIS AND RISK REDUCTION
2. World Food Programme
Emergency Preparedness Branch, The World Food Programme
UN - WFP
4. World Food Programme
Everyone wants one, let’s stop reinventing the wheel
GEOPORTAL
5. World Food Programme
Web site: http://geonode.org/
GitHub: https://github.com/GeoNode/geonode
Issue tracker: https://github.com/GeoNode/geonode/issues
Documentation: http://docs.geonode.org/
Demo site: http://demo.geonode.org/
An excuse to partner with organizations working on the same field
OPEN SOURCE
6. World Food Programme
GIS power users can upload data in bulk or directly to PostGIS
BULK UPLOAD
7. World Food Programme
When half your office uses ESRI and the other half uses FOSS4F
INTEGRATION
Okay we are here to tell about how the geonode project is used by big orgs like ….
I am Paolo Corti and I work with the World Food Prgroamme and together with me there is Ariel Nunez and Simone Dalmasso,
The idea on this presentation is to give an introduction to geonode and at the same time show you how our organizations are having success using it.
As the first part of the presentation we are going to see the benefit the WFP is having from geonode
It is the largest UN organization and is fighting the hunger in the world, has more than one thousand people working around the world, more than seventy country offices, especially in the areas that are most subject to crisis and emergencies.
Inside WFP we have several people that are working with GIS tools, about 10 in the headquarter but more people in the country offices, mostly open source and also Commercial software
One of the problems we are facing is the data formats because we have proprietary formats and open formats and they need to be integrated in the context of the SDI
10 people at the HQ (in Rome, Italy), more people at Regional Bureaux (6) and Country Offices (70+)
Many other people using statistical data and interested in geospatial technologies
software: both Open Source (GeoNodeGDALQGIS) and ESRI (very variegated, depending on users)
developers: using mainly Python with GDAL/QGIS and in some case ArcPy
analysts: using QGIS, GDAL and ArcGIS desktop
mappers: using mainly ArcGIS desktop but recently QGIS is gaining popularity
UN WFP is the world’s largest humanitarian agency fighting hunger worldwide
in emergencies (natural disasters, war, civil conflict) WFP get food to where it is needed
after the emergency, WFP use food to help communities rebuild their shattered lives
WFP is part of the United Nations systems, it is voluntarily funded and was born in 1961
on average WFP, through the work of about 11,500 people – most of them in remote areas - reaches more than 80 million people with food assistance in 75 countries each year
There are many crisis during the year, every time there is a crisis, links to datasets are shared via email among the different teams, and if the data receives updates, then the links stay current with the additions.
Since several years we have had the need to build a geoportal that could provide a unified access to our spatial database infrastructure,
We first started building our open source with the postgis, geoserver …
At some point we realized that reinventing the wheel was not a good idea and started looking for similar initiatives in other organization and started contributing to GeoNode and we get a lot of contribution from the open source community and when we see a benefit to deploy a given component we give back.
We started using GeoNode 3 years and now we have a geonode application that ties together all of our data.
GeoNode is a geospatial CMS
a platform for the management and publication of geospatial data (SDI)
open source platform built on other open source components
allows non-specialized users to share data and create interactive maps
data management tools for integrated creation of data, metadata, and map visualizations
each dataset in the system can be shared publicly or restricted to allow access to only specific users
social features like user profiles and commenting and rating systems allow for the development of communities
easily customizable
Many organizations are taking part in the geonode project, in this case our organizations are trying to do a common effort in order to provide common features to geonode in the context of the humanitaries
It was started at the world bank together with OpenGeo at that time the geonode open soruce community started to grow and now it has it’s own life without a need for dedicated contributions.
Each organization has a core developer , yours truly, that dedicate time for taking care of the community, organizing code sprints, adding features, test new releases and fix bugs.
The three agencies have one GeoNode core developer each which, taking advantage of the high level of interaction with the users, provides feedback and active development.
We regularly do meetings and code sprints (at least once a year)
We contribute to geonode/master and from there we create custom projects (using the geonode-project).
We all can clearly see the benefits of open source: work for one and get for more, better software, continuous evolution, fast issue resolution.
Organizations using it: World Bank, European Commission - JRC, UN WFP, Ithaca, Harvard University, MapStory
70+ contributors, 10+ core developers with 8000+ commits: https://github.com/GeoNode/geonode/graphs/contributors
Web site: http://geonode.org/
GitHub: https://github.com/GeoNode/geonode
Issue tracker: https://github.com/GeoNode/geonode/issues
Documentation: http://docs.geonode.org/
Demo site: http://demo.geonode.org/
One of the nice thing we are using inside WFP’s GeoNode is the bulk upload feature that letà’s the user upload data to the SDI through the web interface or through the command line.
One of the big benefits of the command line utilities is that we can at some point import a lot of raster and vector datasets together and the command takes care of uploading those datasets to the database that is based on posgis and publishing the layer.
Metadata and Styles can be uploaded either via the web form or by pointing the command line utilities to a folder on the network drive.
GeoNode helps developers and administrators build an SDI without putting too many constraints on the format of the dataset.
In our case we have a database with postgis but also other other databases, especially in propietary formats like ArcSDE that can be exposed to GeoNode no mi piace
GeoNode can use remote services, we publish data in ArcGIS using REST and then are able to publish it using GeoNode.
GeoNode acts as a single GeoSpatial collector, CMS and access point and glues together of all the WFP geospatial information and (eterogeneal) technologies, providing features such as:
unified metadata catalog (based on pyWCS)
data stores (PostGIS, ESRI ArcSDE/PostGIS)
web map engine (GeoServer, REST ArcGIS Server using GeoNode remote services)
web map publishing environment (layer upload, map composition, styling, editing via WFS-T)
different access and permission mechanism such as in CMS (for example an user can edit a layer but cannot modify its style - highly configurable)
OGC web services for external applications
API to integrate geospatial information in other WFP systems
One of the features we like the most of GeoNode is that it provides the implementation of OGC Services, this is provided thanks to the embedded GeoServer instance and the PyCSW library for metadata.
We are able to let our users in a country office in Africa using the QGIS desktop client to edit data in GeoNode via WFS-T
We are providing services to other WFP internal applications, for
Remote editing
Metadata editing
API for other web services.
OGC WMS - Web Map Service (GeoServer)
OGC WFS/WFS-T - Web Feature Service (GeoServer)
OGC WCS - Web Coverage Service (GeoServer)
OGC CSW - Catalog Service for the Web (pycsw, GeoNetwork)
OGC WMST - Web Map Tiling Service (GeoWebCache)
REST GeoServer API
GeoNode uses the ISO 19115 standard for metadata, users can use web based forms to input the metadata for any type of files.
It is possible to use the QGIS metasearch plugin to get the results out from GeoNode
The Joint Research Centre is the European in house science service. Is where all the european scienfic research is done, it stands for the joint research center of the european commission.
It is centered in Italy, but has offices in other parts of europe.
Is organized in 7 institutes, each of them is divided in units and actions, I belong to the office of the protection and security of the citize and specifically, to the Global Emergency Management and Mapping Action
Since we deal with emergency management support, my unit needed a place where the donors, users and analysts could meet to coordinate and share data on the topic of the syria crisis post disaster needs assessment, we used GeoNode customized .
The work with remote sensing images and they also manage data, they conenct information about landslides, fires, etc.
They are creating situation maps made with the spatial data that was loaded on specific locations in Syria.
Donors can see results of the money ….
GeoNode has a nice permission system. The GeoNode is publicly accessible but the layers are not public.
Collect and share spatial and non spatial data which relate to the impact assessment of the Syrian crisis
Contains ~80 spatial layers, ~20 maps, ~35 documents and ~30 users.
A donor has for example access only to data related to his topic, and only authorized users get access.
We can assign permissions granularly, the next version of geonode will allow users to for example, view datasets but not be able to download it, or be able to add spatial features but not change the styles used.
We created a customized instance, using Django template projects, that allowed to change specific parts of GeoNode at the html or python level.
CSS override
Python override
Without breaking original functionality.
I installed this on CentOS easily.
The analyst that upload data in GeoNode also manage styles, they were uploaded as shapefiles without style, all the styling is done through the GeoExplorer interface, it took a while because we there is scale dependent styling.
Styles can be afterwards reused for other layers. Once we reached the limits of the web based interface, we had the opportunity to do advanced SLD edditing directly on the GeoServer administration backend.
The cached tiles are regenerated when we update styles.
This is the biggest customization we did on our instance, we created a plugin that is based on ODK collect, an android application that runs on an android phone. You can pick a location in a photo. Analysts create an XLS form that reflects the layer structure and …. It is sent to ODK ..
We developed a middleware between A and B and integrates feature by feature the picture the form with the photos
THIS IS CROWDSOURCING BABY!
Since in geonode 2.0 there will be a contrib package that is called dynamic and allowsthe user to create dynamic models … we will update
This is installed by the main django project.
The platform has an experimental feature which integrates mobile data collection through Formhub and ODK.
It requires to upload an xls form with the same structure of the target layer to formhub.
The layer becomes available on the mobile phone and is possible to add new points with geotagged photos.
The new point is integrated into the postgis database through geoserver
Documents matter a lot to us, because GeoNode allows the end user to upload data presentation about collapsed buildings. The can be uploaded in geonode and linked to the data they are talking about.
You can also upload donor coordination meets and minutes, that are related to a project but not specific layrees. We have 14 documents and they are accesible based on ….
Hi everyone I am ariel nunez I am with the world bank global facility for disaster reduction and recovery and we started the geonode protect 5 years ago when the haiti crisis happened.
Our unit, gfdrr labs, is involved in disaster reduction, not in the actual humanitarian process but in reducing disaster risk
Geoonode can be used as a tool for preparedness. For example in bolivia was used. A series of geonode was setup in several ministries. Each of them set up a geonode to share their internal datasets. A series of workshops were given where partivcipants started to meet each other and use the geonode platform to then replicate the experience back to thei offices. I bolivia in 20134 flood came there were really importand datasets in geonode about the rivers that were floded in previous events and the admin bou ndaries. Helped to understant the situation before and after the floodò. After theint charter has been activated and many datasets were available it was matter of ingest new data into osm and geonode acted as a central repository to access
Talk about bolivia
Talk about yemen
Talk about open data for the horn
Groups and groups permissions
New permissions system
Services aka federation
REST GeoNode API
Full text search enabled (haystack)
New layout (with bootstrap3)
2.4+: support for other web map engine (MapServer, Mapnik)
One of the main goals –results of GeoNode is that it requires people at the country level to define the point of contact for different dataset and to define a person to be responisble for collection-aggregation of a dataset
These processes of taking people together results in a stronger network very useful when crunch time comes and datasets are needed
GN has social features, that allow users to see list of activities, which layer are uploaded, which map is created, as if it was a social netwokr
Datasets are also tagged and they can be rated to allow different modes of sorting
100% Open Source!http://docs.geonode.org/en/latest/reference/architecture.html#architecture
Python, Django, WSGI, Apache, OWSlib, gsconfig
GDAL, OGR, GEOS, PROJ.4
Tomcat, GeoServer, GeoTools
PostgreSQL, PostGIS
pycsw, GeoNetwork
jQuery, OpenLayers, ExtJS, GeoExt, GeoExplorer
HTML, CSS, Bootstrap
GeoGit enabled
Platform of reference: linux Ubuntu (debian package)
End users starts to learn Linux. In many cases is the first experience with Linux, and they are more and more introduced to OS Software, such as QGIS, GRASS etc etc