In this session, you will learn how you can set up a scalable infrastructure for your business and make data covering thematic streams like marine, land, climate, emergency… valuable and useful for your business.

2. PRESENTEDBYHOW TO STORE, ORGANIZE AND USE
PETABYTES OF HETEROGENOUS DATA
ROOM 4
1.30 PM

3. PRESENTEDBY
EMBRACE THE DIGITAL WORLD
LAURENT GARCIA
OVH - DIRECTOR, GLOBAL CLOUD CHANNEL
@culture_cloud
ROOM 4
1.30 PM

4. 4
Deep Learning
IoT Platform
Artificial Intelligence
Smart cities
Edge
Computing
Autonomous Vehicules
Cryptocurrencies
Biochips
Smart robots/drones
By 2025, 163Zb produced = 34Tb per human
that’s x10 the datasphere produced till 2016…*
Exponential growth of structured & unstructured data
* « Data Age 2025 » - IDC Survey (2017)

5. 5
VOLUME
New business
usages
RISKS
Data Loss, hacking,
compliance rules change
COMPLEXITY
Unstructured data
types
COSTS
Hardware/Software
& human resources
Complexity, volumes and content types
to index are growing exponentially.
Data loss is company assets destruction while
IT related costs are growing « out of control ».
PROBLEM : What Data Storage means today

6. 6
78%of organizations have little
or no understanding of
what is going on*
40%growth year-over year*
80%of entreprise data is
unstructured data*
* Innovation Insight for Unstructured Data
Classification - Gartner (May 2017)

7. 7
OVH Cloud Storage
Satellites images
& any unstructed data types
• 10+ PB data storage average per year
• Up to 60 TB data injection per day
• « infinite » scale-out capabilities
• Wep/app/mobile access
• Millions of user queries per hour

8. PRESENTEDBY
How to store, organize and use
petabytes of heterogenous data
•GUIDO VINGIONE
• SERCO ITALY - DIRECTOR, COPERNICUS SERVICES
• ROOM 4
• 1.30 PM

9. 9
About Copernicus
▪ The Copernicus is a flagship Space programme of the European Union’s efforts to
monitor the Earth and its ecosystems.
▪ Copernicus places a world of insight about our planet at the disposal of citizens, public
authorities and policy makers, scientists, entrepreneurs and the general public on a full,
free and open basis.
▪ Copernicus collects, processes, and archives massive amounts of heterogeneous data
▪ Copernicus is a tool for economic development and a driver for digital economy. Due to
its services, decision makers and citizens today are provided with better, more complete,
consistent, timely and reliable information
▪ Ref: http://copernicus.eu/

10. 10
About the DIAS
Data and Information Access Services
funded by the European Commission (DG GROW)
under the aegis of the European Space Agency (www.esa.int)
• The DIAS Services represent a key tool for the implementation of Copernicus exploitation strategy
by providing the European data access and cloud processing service, open to entrepreneurs,
developers and the general public to build, access and exploit Copernicus-based services.

11. 11
What is ONDA?
▪ A one stop shop to ease of access and use massive amounts of data an information
▪ An open platform enabling users to build
#peopleondata
@ondadias
ONDA (group)
ONDA DIAS
Follow us

12. 12
Key benefits
Simple
Only few clicks
to access data &
services
and to predict the
costs
Flexible
Custom Solutions to
all levels of needs
and requirements
Open
Open and Free
Access
to all geospatial
data and
information
Fast to market
Market leading
Cloud solutions and
pricing
Cutting edge
technologies
of custom services
Secure
Compliant with
International
Standards and
Regulations
Reliable
Guaranteed
Resources
Optimised
performance

13. 13
ONDA Users
We support all types of users at various levels of expertise
in exploiting geospatial data for a wide range of diverse purposes
▪ individuals, students and researchers
▪ professionals and start-ups
▪ SMEs and research companies
▪ Space Enterprises and service
providers

14. 14
ONDA provides: Data and Information
▪ Free and open access
to geospatial data & information
▪ Growing archive of datasets
▪ Data Agnostic More to
come…

15. 15
ONDA provides: Data Access
▪ Browse, View and Download
geospatial datasets from our
Catalogue
▪ Advanced API: innovative
data access technology
through ENS

16. 16
ONDA provides: Cloud resources
▪ Large range of cloud services with geo information services natively available
▪ Large economies of scale for storage and computing
▪ Performance and high availability
▪ Cost efficiency: pay per use or subscription pricing model

17. 17
ONDA provides: Managed Services
Engineering
services to
support the
development &
management of
the front-end
services
Store your data
and make it
available through
our interfaces
with specific
access rights
High level
technical support
with dedicated
Service Desk and
Engineering
support for
troubleshooting

18. 18
ONDA provides: User Support
▪ Online documentation
▪ Service Desk
▪ Multi-lingual web content
▪ ONDA for Education
✓ Webinars
✓ Lectures
✓ Video tutorials

19. 19
Marketplace
Publish and promote your service developed on ONDA platform

20. PRESENTEDBY
Elastic Node Service (ENS)
•CHRISTOPHE DEMANGE
• CEO – GAEL SYSTEMS
• ROOM 4
• 1.30 PM

21. Elastic Node Service (ENS)
Christophe Demange
GAEL Systems

22. Agenda
• Introduction
– About GAEL Systems
– What is ENS ?
– ENS in ONDA
• Features & Benefits
• Architecture Overview
• Virtual File System
• Data structure as Nodes
• Use-cases:
– Simplified data extraction
– Cross objects analysis
– NDVI Processing chain
• Further evolutions
• Ready for your Business
• Find more & contact us
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 22

23. Observed
Segment
Data & Telemetry
Satellite
About GAEL Systems
Founded in 1990, GAEL Systems is a French innovative company developing
Earth Observation Applications and running Operational Services.
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 23
Software Development
Service Operations
Ground Segment
archives processing products
Expertise
Quality Control
Catalogue & Data Dissemination
Added-Value Products
Distributors End-users

24. What is ENS ?
• A scalable front-end to discover and to access large archives of
heterogeneous data (geospatial or any other)
• A catalogue UI and API to browse data collections,
to query metadata and to download products
• A virtual file system to expose backend data through standard
interfaces, breaking down data structure into a logical tree of
nodes, up to the tiniest piece of information
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 24

25. ENS in ONDA
ENS is accessible on
ONDA platform
www.onda-dias.eu
The service is free of
charge for users who
order a Virtual Server
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 25

26. ENS Features and Benefits
Standard interfaces
Access data via
HTTP, OData and NFS
No need for specific library
Unified Data Model
XML-like Tree of Nodes with
Logical Path to data elements,
types and values
Multi Storage
Transparent support of
Object Storage and
regular file systems
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 26
Cost effective & performance
Seamless access to native and
compressed data
More science, less data access
engineering
Scalable & Reliable
High-Availability architecture
with multiple front-ends,
database replication & sharding
Open & Secure
Data agnostic engine with add-ons
No direct and read-only access
to storage backend

27. ENS Architecture Overview
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 27
Catalogue
Storage
Data harvesting and
ingestion toolbox
Data sources
Database
and Index
Virtual File
System
Users

28. ENS Virtual File System
• From storage containers to
organized directories
• Logical path based on data types
& metadata
• Customizable views
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 28
Container A
Container B
Container C
Virtual FS

29. Breaking down data structure into nodes
• ENS extends traditional data access by exposing the File or
Object Storage content as a tree of nodes, presenting it like a
File System
• ENS manages underlying complexity of using heterogeneous
datasets, format-specific libraries and compressed packages
• Seamless and optimized access to zip files
• Easy discovery of the data inner content with logical path
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 29

30. Breaking down data structure into nodes
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 30
Image_01
18/10/2018
generic
specific
header
title
date
document-01.dat
WGS84
48°53'56" N
crs
latitude
02°23'20" Elongitude
measures
properties
4800
6400
line_number
pixel_number
line_1
line_2
line_3
…
168,170,182,184,190,183,…
165,168,180,182,184,190,…
34,15,8,20,36,51,172,185,…
…
indexedimage_type
Example of ENS logical path to the 'latitude' file :
/ens_mnt/images/france/2018/10/document-01.dat/header/specific/latitude
Virtual File System
Nodes = directories
Leaves = files
Values = file content
header
Image_01
18/10/2018
measures
generic specific
WGS84
48°53'56" N
02°23'20" E
propertiescolormap
Size: 4800 x 6400
Line 1
Line 2
Line 3
…
Native file (document-01.dat)

31. Simplified data extraction
• Large set of data types
already supported
• Access from all programming
languages
• Straightforward integration
into Jupyter notebook
• Fewer lines of code
• Stay focused to science or
business, less data access
engineering
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 31
import glob
import pandas
import matplotlib.pyplot as plt
ens_path = '/home/debian/ens_mnt'
s3_path = ens_path + '/S3/OLCI/LEVEL-1/OL_1_EFR___/2018/10/16'
prod_pattern = s3_path + '/S3A_OL_1_EFR____20181015T233714_20181015T234014_201
prod_path = glob.glob(prod_pattern)
line_path = prod_path[0] + '/Oa01_radiance.nc/root/dataset/Oa01_radiance/rows
pandas.read_csv(line_path,sep=' ',header=None).T.rename(columns={0:'S3A OLCI
plt.show()
1
2
3
4
5
6
7
8
9
10
ens_demo_S3_remote http://localhost:8888/notebooks/ens_demo_S3_remote.ipy
Seamless access to
netCDF datasets
inside a zip file

32. Cross objects analysis
• Extract values from multiple
objects, time series, area of
interest…
• No need to read fully or copy
the objects, only access the
required content
• Easy to monitor changes, to
compare, superimpose and
merge values
• Make reports faster
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 32

33. NDVI processing chain
Thanks to the huge archive, processing can be applied to time
series with multiple products covering the same area:
• Filter unwanted cloud coverage
• Monitor crops growth and harvest
• Change detection
• Precision agriculture
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 33
Use a
virtual server
in ONDA
Customize UI
using ONDA
Catalogue API
Access to
archive
via ENS VFS
Only read
needed data
subset
Compute
NDVI
Apply custom
color palette
21/04
21/05
30/06
19/08
08/09
Red
NIR
NDVI
Online demo service will be available soon !

34. Further Evolutions
• Enrich data offer supporting new datasets
• Values with multiple flavours (raw, text, CSV…)
• Customized NFS mount point (user’s selection)
• Auto-scaling
• Data cube interface
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 34

35. Ready for your own Business
• Open to any data format
• Innovative data mining
• Customizable to your needs
• Dedicated deployment
• Platform as a Service
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 35

36. Thank you !
Find more:
www.gael-systems.com/products/ens
Contact us:
info@gael-systems.com
sales@gael.fr
Elastic Node Service - GAEL Systems - OVH Summit Paris - October 2018 36

37. One more thing...

38. OVH Quiz
What does mean???

39. Thanks for your attention!
Any questions?
Visit ONDA to learn more!
@ondadias
ONDA (group)
ONDA DIAS