Manolis Koubarakis (UoA) presentation for Big Data in Secure Societies Workshop - Brussels, 3rd October 2017 -

1. THE BDE PILOT FOR SECURE
SOCIETIES
3rd Workshop on “Big Data in Secure Societies”3/10/2017
Manolis Koubarakis
National and Kapodistian University of Athens

2. SC7 – Secure Societies
SC7 societal challenge is about protecting freedom and security of Europe
and its citizens. In other words:
 enhance resilience against natural and man-made disasters
 develop novel solutions for the protection of critical infrastructure
 fight crime and terrorism
 improve border security
 provide enhanced cyber-security
16-oct.-17www.big-data-europe.eu

3. Main Objective of the SC7 Pilot
Automatically detect land cover evolution, caused by physical or
human activities, and alert users accordingly.
16-oct.-17www.big-data-europe.eu

4. Technical Objectives
Track changes on land cover/land use by integrating
heterogeneous information sources:
 Detect changes using satellite images
 Monitor related information in news feeds and social media
16-oct.-17www.big-data-europe.eu

5. High-level Architecture
16-oct.-17www.big-data-europe.eu
Remote Sensing Big Data Platform Social Sensing
Change
Detection
Workflow
Event
Detection
Workflow

6. Pilot Data Sources
◎ Sentinel-1
o Free and open data (radar images)
o Satellites operated by ESA in the framework of the Copernicus
programme funded and managed by EC
o Same area acquired every 6 days with 2 satellites
◎ Reuters
o News articles through RSS feeds in XML format
◎ Twitter
o Free Twitter Public Streams API and specific user accounts
o Plain text along with metadata in JSON format
16-oct.-17www.big-data-europe.eu

7. Pilot Architecture
16-oct.-17www.big-data-europe.eu
Event Detection
Change Detection
Entity
Extractor

8. Pilot Details
◎ Change Detection Workflow
o System able to search, download and (pre-)process images in parallel (Spark)
o Operators used: Subset, DBscan, Terrain Correction (from SNAP to Spark)
◎ Event Detection Workflow
o System able to periodically monitor social media and news agencies
o Events clustered (Spark)
o Events mapped to geolocations (Lucene)
◎ Common workflow
o GIS interface (Sextant) allows users to activate the two workflows
o Geographic information stored in RDF store Strabon and queried through stSPARQL
o Linked geospatial data as the integration technology (Strabon, SemaGrow and Sextant)
16-oct.-17www.big-data-europe.eu

9. Pilot Details (cont’d)
◎ Authentication and authorization through
user accounts.
◎ All components and workflows run on the
BDE infrastructure
16-oct.-17www.big-data-europe.eu

10. Big Data Challenges Addressed
 Volume
 Velocity (high volume of images and media
information arriving)
 Variety (two kinds of data sources)
 Veracity (quality of source information and results
important)
16-oct.-17www.big-data-europe.eu

11. Big Geodata@UoA
 Previous projects on semantic and linked data technologies for EO data:
TELEIOS, LEO, Melodies, Optique (FP7), ProdTrees (ESA)
 Current project (H2020): Copernicus App Lab http://www.app-lab.eu/
o Make Copernicus services data (Land, Marine, Atmosphere) available on
the Web as linked data
o Enable their use by developers that are not EO experts
o ESA App Camp in September 2017 (http://www.app-
camp.eu/frascati/)
16-oct.-17www.big-data-europe.eu

12. Big Geodata@UoA (cont’d)
 Contribution to very recent OGC white paper on
big geospatial data
http://docs.opengeospatial.org/wp/16-131r2/16-
131r2.html
 See the web page of my group for more details:
http://kr.di.uoa.gr/
16-oct.-17www.big-data-europe.eu

13. Demo
◎ Video to avoid internet delays
◎ The video is available on youtube:
https://www.youtube.com/watch?v=H9LatoCDarQ
16-oct.-17www.big-data-europe.eu

14.  Thank You!
 For more details, see
https://www.big-data-europe.eu/
 Questions?
16-oct.-17www.big-data-europe.eu