Join us for this special webinar featuring two of the most anticipated talks from this year's European Peak of Data Integration Conference, the largest FME User Conference to date. Whether you're a seasoned FME user or new to the world of data integration, these presentations will provide valuable insights and practical tips to elevate your data workflows. Featured talks will include: 1. Unlocking Eurostat's Rich Data Resources with FME by Jan Bliki, European Environment Agency (FME Customer) & Ulf Månsson, Sweco (FME Platnum Partner) - Dive deep into Eurostat's vast data resources and learn how FME simplifies access and pre-processing - Gain insights from the collaboration between EEA and Sweco in the newly developed reader by the EEA, allowing effortless Eurostat website data access - See firsthand how FME can empower you to effortlessly harness data for your projects 2. Deploy your FME integration through Azure Pipelines in 10 minutes by Martin Koch, Avineon–Tensing (FME Silver Partner) - Discover how to streamline your FME workflows by integrating them into Azure Pipelines, enabling automated deployment and testing. - Learn from FME experts as they demonstrate the seamless integration of FME into your development and operations toolchain. - Explore real-world examples and best practices to accelerate your FME projects. This encore-style webinar will equip you with the knowledge and skills to make the most of FME for seamless data access and advanced integration. Don't miss this opportunity to learn from FME experts and join a community of data integration enthusiasts. Register now to secure your spot!

1. Eurostat, a New Reader to Easily get all
the European Statistical Data you
Want!

2. Presenters
The
Peak
of
Data
Integration
20
23
Jan
Bliki
Head of Group
European Environment
Agency
Ulf
Månsson
Project Manager
Sweco
Sweden

3. The
Peak
of
Data
Integration
20
23
Introduction

4. The
Peak
of
Data
Integration
20
23 The European Environment Agency is …
• An independent EU agency delivering integrated
assessments on the state of Europe’s
environment and climate.
• Dependent upon strong networks to carry out its
work connecting institutions across Europe
delivering benchmarking, capacity building,
streamlining and exchange of best practic
• Analysing, assessing and providing information
using the broader and most up-to-date data
collection and innovative e-reporting
infrastructures

5. The
Peak
of
Data
Integration
20
23 EEA in numbers
TÜRKIYE
• 300 Staff in Copenhagen
• 38 countries
• 482 institutions
• 2320 experts
Legend
Member countries
Cooperating countries
* This designation is without prejudice to
position on status, and is inline with
UNSCR 1244/99 and the ICJ Opinion on
the Kosovo Declaration of independence.

6. The
Peak
of
Data
Integration
20
23 EEA data domain
Air pollution,
transport and noise
Industrial
pollution
Climate change
mitigation and energy
Climate change impacts,
vulnerability and
adaptation
Water management,
resources and
ecosystems
Marine and maritime,
fisheries and coastal
Biodiversity, ecosystems,
agriculture and forests
Urban, land use
and soil
Waste and material
resources

7. The
Peak
of
Data
Integration
20
23 State Of the Environment Report (SOER)
The European Environment Agency
produce a report every five years
2
0
2
0

8. The
Peak
of
Data
Integration
20
23 FME is our backbone for data processing
Extract Clean Conform Deliver
FME Form / FME Flow
QC
...
IT
FR
BE
Cleansing/Wrangling data is the biggest
cost

9. The
Peak
of
Data
Integration
20
23 FME Flow currently runs 55,000 jobs daily
• 1 FME Flow server
• 6 FME Flow engine hosts
• 56 FME Engines

10. The
Peak
of
Data
Integration
20
23
Format 2005 2023 2030
XML + Shape 80% 47% 10%
XML + GML 0% 1% 0%
CSV + Shape 2% 11% 21%
GeoPackage 0% 3% 21%
JSON + GeoJSON 1% 5% 2%
JSON + WKT 0% 0% 8%
CSV + WKT 0% 0% 8%
Parquet + WKB 0% 0% 5%
EXCEL + Shape 15% 18% 18%
Access + Shape 1% 0% 0%
Transformations on data EEA receive
x
x
Storage in EEA
AAIGRID, AIG, BIL, GeoTIFF, netCDF, GML, SHP, KML,
SpatialLite, Postgis, Geopackage, JSON, Pgeo, Access,
Excel, SQLLite, ASCII, Dbase, Fgeo, RST
FME most used formats transformations in EEA
Data dissemination

11. The
Peak
of
Data
Integration
20
23
Why the Eurostat Reader?
1. Data enrichment!
Data can increase in value if merged with other.
(Example Air quality and population)
2. A common aggregation “administrative regions”
A geographic European layer that has a common agreed
coding system.
3. Reduce reporting cost
Data collection is sometimes reported by more than one
EU institution. (Example Energy data)
4. A reader ensures consistency
EEA has many data custodians implementing different
processes.
5. EEA and Eurostat transfer lots of data
EEA provides Environmental statistics to Eurostat.

12. The
Peak
of
Data
Integration
20
23
More than 7000
dataflows

13. The
Peak
of
Data
Integration
20
23 Implementing ”Select file from Web” in FME

14. The
Peak
of
Data
Integration
20
23
Example usage:

15. The
Peak
of
Data
Integration
20
23

16. Deploy your FME integration through Azure pipelines

17. Presenter
The
Peak
of
Data
Integration
20
23
Martin Koch
Geospatial Evangelist
Avineon Tensing

18. The
Peak
of
Data
Integration
20
23
Introduction

19. The
Peak
of
Data
Integration
20
23

20. The
Peak
of
Data
Integration
20
23

21. The
Peak
of
Data
Integration
20
23
Too many options!!!! How does it fit in my workflow?
What does it actually do?

22. The
Peak
of
Data
Integration
20
23

23. The
Peak
of
Data
Integration
20
23
Pipelines: What do they do?

24. The
Peak
of
Data
Integration
20
23
Commit Triggers Script Running on Agent
AUTOMATE!

25. The
Peak
of
Data
Integration
20
23
Can it deploy FME?

26. The
Peak
of
Data
Integration
20
23
Put in GIT – Deploy through REST

27. The
Peak
of
Data
Integration
20
23
When pushing to main
Start the FME Server
Deploy workspace(s)
Run a test
Stop the FME Server

28. The
Peak
of
Data
Integration
20
23

29. The
Peak
of
Data
Integration
20
23
YES it can!

30. The
Peak
of
Data
Integration
20
23
To do
● Dress up your own Agent
○ Deploy tooling and libraries
○ Deploy to FME Server on-prem
● Integrate with Azure DevOps flow
○ Build pipeline
○ Release pipeline

31. Visit Maartens Lightningtalk
15:45 Bangkok 1
How to implement this as a team in a real life project

32. The
Peak
of
Data
Integration
20
23
One more thing

33. The
Peak
of
Data
Integration
20
23

34. And…
Wondering what the ‘artifact’ is in a FME integration
What is ‘the thing’ which can be
1. Build
2. Deployed with ease

35. FME Server Projects
Build pipeline should build FME Server package
Release pipeline should post / put this to every environent
https://[our-FMEFlow]/fmeapiv4/docs/index.html#/projects

37. Thank You!
mkoch@tensing.com