Enabling Data-Driven Services
Emanuele BALDACCI
Director Digital Services
DG Informatics - DIGIT
European Commission
0
① Policy and governance framework
② Data Strategy
③ Roadmap
④ Key actions
⑤ Catalogue of Services
⑥ Community of Practice
⑦ Digital Pole
⑧ Conclusions
Emanuele BALDACCI
Director Digital Services, DIGIT
1
Agenda
2
Agreement on the free flow of non-personal data: "Data is the backbone of today's digital
economy. The European data economy can become a powerful driver for growth, create
new jobs and open up new business models and innovation opportunities. With this
agreement we are one step closer to completing the Digital Single Market"
Commissioner for Digital Economy and Society, Mariya Gabriel
Unlocking the power of data
Communication
to the Commission on
Data, Information and
Knowledge Management
at the European Commission
adopted on the 18th October 2016
1 2
Data, information and
knowledge should be shared
Collaborative working
practices
Mandated by the College to
implement the strategy
described in the Data,
Information and Knowledge
Management communicationIMT
Information
Management Team
Data4Policy
group
Sherpa
group
HoU
DGx
DGx
HoU
SG | AGRI | BUDG | CNECT |
COMP | DEVCO | DGT | DIGIT |
ENV | ESTAT | GROW | HR | JRC |
OP | REGIO | RTD | TAXUD |
EACEA
IMSB
Information Management Steering Board
Governance
Data-Driven Organisation
To make better decisions based on
evidence, by using internal and external
data more effectively and by enhancing our
data analytics technologies.
To transform the European Commission in a
Challenge
DATA ECOSYSTEM
a system of interconnected
resources and services
for capturing, curating, storing,
protecting, elaborating, accessing,
using, re-using, consuming, analysing,
disseminating and sharing data
Set-up a Commission
dataStrategy@EC
Solution
Data
IMSB
CoordinationofWorkingGroupsAI@EC
Data4Policy
DATA
ecosystem
EC
Data
DataPurchase,
Access&Collection
CommunitiesofPractice
Strategic Goals
Data
Technology
Organisation
People
Policy
Data Identification Data Access
Data Analytics Data Infrastructure
Data Roles &
Responsibilities
Data Labs
Data Skills Acquisition Data Literacy
Internal Data
Management Policies
External Data
Sharing&Reuse Policies
Infrastructure
Data Lake
Data Corporate Services
Implementation Projects
Key actions
2020
Big Data Test Infrastructure
full implementation
2017
Budget for
Results first
implementation
Q2
2018
One business case
for HR implemented
2019
Generic EC Data Lake
Federated Catalogue of Services
Q1
2018
& DORIS / BRP Integration
Set-up corporate web analytics
service
end
2018
Q2
2018
Blue Economy
Indicators Prototype
(DG MARE)
2020
Analytics for the design of
educational policies
(DG EAC)
2018
Big Data Test Infrastructure
platform as a service
DORIS: analysing feedback from EU citizens
10
Why a solution was needed?
The solution
• To analyse data from open and closed questions
• Dashboard to visualise and further analyse the
results of the consultation
• Text analysis, sentiment analysis, data mining and
reporting techniques to facilitate the analysis of
structured and unstructured information
• Optimisation of the time required for the analysis
• Different analytics techniques (clustering, keyword
extraction, name entity recognition, sentiment
analysis and campaign detection)
• Web interface to access the results of the analysis
with basic functionalities such as filters, maps,
translation and automatic charts
Data4Policy
Data Lake at Work – EU Results
11
Why a solution was needed?
The solution
• Manual collection of information on project funded
by the European Commission
• Different information system for the EC programmes
• Need to communicate to citizens
• Huge potential number of projects not manageable
by hand
• Data lake infrastructure
• Structured and unstructured data input
• Data Labs
• Data Products
• Reusable data for different purposes
• Automatic treatment
• Increased capabilities
Some results…
 From 2000 project treated manually in 2 years to 172000 project ingested
by the data lake in 3 months
 No need to force a data model for data ingested
 Set-up of a data model for the final product
 Ingestion from Information systems but also from already available web
portals
 Considerable gain in the time of treatment
Infrastructure
Federated Catalogue of Services
12
The Federated Catalogue of Services provides a full range of Data & Analytics service offering to the end-users and
to the practitioners of big data and data analytics within the European Commission.
Users
Departments providing services
Beyond technology – community of practices
Collaborate
Federate
Capacity
Experiment
Together
Ongoing
cross-DG
Projects
Federated
Catalogue of
Data Services
Communities of
Practices
Use mature data and
analytics services,
including data, tools
and/or expertise,
federated across the
Commission Services
Join forces between
DGs to uplift innovation
through domain-specific
implementation projects
Find expertise, connect and share experience with
other DGs through the Data4Policy community
Location
leveraging on Luxembourg's strong digital ecosystem
Close collaboration
between the Commission and Luxembourg
Organisation
with a tight integration between the different components,
maximising synergies and mutual added value
CRITICAL SUCCESS FACTORS
DIGITAL
POLE
4 takeaways
Cooperation
& Data Sharing
Setting up the right
frameworks for data quality
the first steps in building a data-driven
culture
Experimentation and piloting
are key to boost innovation It’s always about people
Conclusions
skills and literacy
curate and trust data
boost innovation and build expertise
Collaborative platform
Offers services to e-
Government professionals
to share experiences and
solutions
Repository of
shared & reused
solutions
Reusable Source
Code for setup own
platform
Federation with
other repositories
software, IT specifications,
data models, common
principles, business process
Observatory
News, events, documents
on interoperability such as
studies
Contact us
© European Union, 2018. All rights reserved. Certain parts are licensed
under conditions to the EU.
Reproduction is authorized provided the source is acknowledged.
DIGIT-D@ec.europa.eu
Q&A
Emanuele.Baldacci@ec.europa.eu

E. Baldacci, Enabling Data-Driven Services

  • 1.
    Enabling Data-Driven Services EmanueleBALDACCI Director Digital Services DG Informatics - DIGIT European Commission 0
  • 2.
    ① Policy andgovernance framework ② Data Strategy ③ Roadmap ④ Key actions ⑤ Catalogue of Services ⑥ Community of Practice ⑦ Digital Pole ⑧ Conclusions Emanuele BALDACCI Director Digital Services, DIGIT 1 Agenda
  • 3.
    2 Agreement on thefree flow of non-personal data: "Data is the backbone of today's digital economy. The European data economy can become a powerful driver for growth, create new jobs and open up new business models and innovation opportunities. With this agreement we are one step closer to completing the Digital Single Market" Commissioner for Digital Economy and Society, Mariya Gabriel Unlocking the power of data
  • 4.
    Communication to the Commissionon Data, Information and Knowledge Management at the European Commission adopted on the 18th October 2016 1 2 Data, information and knowledge should be shared Collaborative working practices
  • 5.
    Mandated by theCollege to implement the strategy described in the Data, Information and Knowledge Management communicationIMT Information Management Team Data4Policy group Sherpa group HoU DGx DGx HoU SG | AGRI | BUDG | CNECT | COMP | DEVCO | DGT | DIGIT | ENV | ESTAT | GROW | HR | JRC | OP | REGIO | RTD | TAXUD | EACEA IMSB Information Management Steering Board Governance
  • 6.
    Data-Driven Organisation To makebetter decisions based on evidence, by using internal and external data more effectively and by enhancing our data analytics technologies. To transform the European Commission in a Challenge
  • 7.
    DATA ECOSYSTEM a systemof interconnected resources and services for capturing, curating, storing, protecting, elaborating, accessing, using, re-using, consuming, analysing, disseminating and sharing data Set-up a Commission dataStrategy@EC Solution Data
  • 8.
  • 9.
    Strategic Goals Data Technology Organisation People Policy Data IdentificationData Access Data Analytics Data Infrastructure Data Roles & Responsibilities Data Labs Data Skills Acquisition Data Literacy Internal Data Management Policies External Data Sharing&Reuse Policies
  • 10.
    Infrastructure Data Lake Data CorporateServices Implementation Projects Key actions 2020 Big Data Test Infrastructure full implementation 2017 Budget for Results first implementation Q2 2018 One business case for HR implemented 2019 Generic EC Data Lake Federated Catalogue of Services Q1 2018 & DORIS / BRP Integration Set-up corporate web analytics service end 2018 Q2 2018 Blue Economy Indicators Prototype (DG MARE) 2020 Analytics for the design of educational policies (DG EAC) 2018 Big Data Test Infrastructure platform as a service
  • 11.
    DORIS: analysing feedbackfrom EU citizens 10 Why a solution was needed? The solution • To analyse data from open and closed questions • Dashboard to visualise and further analyse the results of the consultation • Text analysis, sentiment analysis, data mining and reporting techniques to facilitate the analysis of structured and unstructured information • Optimisation of the time required for the analysis • Different analytics techniques (clustering, keyword extraction, name entity recognition, sentiment analysis and campaign detection) • Web interface to access the results of the analysis with basic functionalities such as filters, maps, translation and automatic charts Data4Policy
  • 12.
    Data Lake atWork – EU Results 11 Why a solution was needed? The solution • Manual collection of information on project funded by the European Commission • Different information system for the EC programmes • Need to communicate to citizens • Huge potential number of projects not manageable by hand • Data lake infrastructure • Structured and unstructured data input • Data Labs • Data Products • Reusable data for different purposes • Automatic treatment • Increased capabilities Some results…  From 2000 project treated manually in 2 years to 172000 project ingested by the data lake in 3 months  No need to force a data model for data ingested  Set-up of a data model for the final product  Ingestion from Information systems but also from already available web portals  Considerable gain in the time of treatment Infrastructure
  • 13.
    Federated Catalogue ofServices 12 The Federated Catalogue of Services provides a full range of Data & Analytics service offering to the end-users and to the practitioners of big data and data analytics within the European Commission. Users Departments providing services
  • 14.
    Beyond technology –community of practices Collaborate Federate Capacity Experiment Together Ongoing cross-DG Projects Federated Catalogue of Data Services Communities of Practices Use mature data and analytics services, including data, tools and/or expertise, federated across the Commission Services Join forces between DGs to uplift innovation through domain-specific implementation projects Find expertise, connect and share experience with other DGs through the Data4Policy community
  • 15.
    Location leveraging on Luxembourg'sstrong digital ecosystem Close collaboration between the Commission and Luxembourg Organisation with a tight integration between the different components, maximising synergies and mutual added value CRITICAL SUCCESS FACTORS DIGITAL POLE
  • 16.
    4 takeaways Cooperation & DataSharing Setting up the right frameworks for data quality the first steps in building a data-driven culture Experimentation and piloting are key to boost innovation It’s always about people Conclusions skills and literacy curate and trust data boost innovation and build expertise
  • 17.
    Collaborative platform Offers servicesto e- Government professionals to share experiences and solutions Repository of shared & reused solutions Reusable Source Code for setup own platform Federation with other repositories software, IT specifications, data models, common principles, business process Observatory News, events, documents on interoperability such as studies
  • 18.
    Contact us © EuropeanUnion, 2018. All rights reserved. Certain parts are licensed under conditions to the EU. Reproduction is authorized provided the source is acknowledged. DIGIT-D@ec.europa.eu Q&A Emanuele.Baldacci@ec.europa.eu