EUROPEANA IMPACT
ASSESSMENT
Georgia Angelaki
Europeana AGM IA Workshop, 3.11.2015
What are the measurable outcomes arising from
the existence of Europeana that can demonstrate a
significant change – social & cultural, economic
and innovation-related – on its stakeholders?
France, Public Domain
1588, Bibliothèque municipale de Lyon
Hendrik Goltzius
Le dragon dévorant les compagnons
de Cadmus
Why are we measuring impact?
•  To justify continued yearly investment of €10M by the EU
•  To reinforce the feeling of engagement by the network
•  To understand where our strengths and weaknesses lie
and to inform further our planning of activities
•  To acquire the global picture of the effects of our activities
•  To get a framework that we can consistently use in the
future to monitor the impact of our activities
Impact Assessment Review
CC BY-SA
Background Work
What is the social economic
value of continued investment
in Europeana to maintain and
extend its current ambition
level in terms of services and
infrastructure in the years 2015
- 2020?
Impact Assessment Review
CC BY-SA
Main findings
•  Europeana reduces transaction costs, creates positive spill-
over effects and being a forerunner in areas such as
standardisation it helps reduce the costs for followers
•  In the best case scenario the benefits of the existence of
Europeana outweigh the cost by € 21.5 million (or 37%) in
terms of net present value, exclusive of any benefits for the
creative industries, education and research for which there
is no exact data
Impact Assessment Review
CC BY-SA
From KPIs to measuring Impact
•  5m visits to the portal
•  45m records
•  2.500 API keys
•  1.200 Association
Members
•  …
Impact Assessment Review
CC BY-SA
•  Have we contributed to
building a common
European identity?
•  Have we helped produce
economic growth?
•  Have we helped cultural
institutions to adapt to the
needs of the 21st century?
Europeana’s Impact Framework Model
•  Uses Simon Tanner’s Balanced Value Impact Model
•  Relates to the mission of Europeana
•  Derives from Europeana values: usable, reliable, mutual
•  Follows a controlled process for analysing the context of the
resource
•  Maps the actions, the outcome of these actions, and ultimately the
impact we have on real people
•  Identifies the appropriate qualitative & quantitative impact measures
as well as the methods and techniques that would be most effective
to define the outcomes of the activities
•  Balances the economic incentives we generate with the cultural and
social benefits we deliver
Title here
CC BY-SA
Impact Assessment Review
2 Components:
•  Impact Assessment Framework Review:
Detailed analysis of the context & the ecosystem
(stakeholders/ activities/ expected outcomes)
•  Impact Assessment Indicators Report
SMART indicators to measure impact
Title here
CC BY-SA
IA Review Approach
•  Balanced Value Impact Model
•  Desk research and analysis
•  2 stakeholder focus groups
•  Paperplane activity
•  Input from the Impact Assessment Taskforce
•  Reports: 7 January- annex to the Business Plan
Impact Assessment Review
CC BY-SA

Presentation Impact Assessment workshop, Europeana AGM 2015

  • 1.
  • 2.
    What are themeasurable outcomes arising from the existence of Europeana that can demonstrate a significant change – social & cultural, economic and innovation-related – on its stakeholders? France, Public Domain 1588, Bibliothèque municipale de Lyon Hendrik Goltzius Le dragon dévorant les compagnons de Cadmus
  • 3.
    Why are wemeasuring impact? •  To justify continued yearly investment of €10M by the EU •  To reinforce the feeling of engagement by the network •  To understand where our strengths and weaknesses lie and to inform further our planning of activities •  To acquire the global picture of the effects of our activities •  To get a framework that we can consistently use in the future to monitor the impact of our activities Impact Assessment Review CC BY-SA
  • 4.
    Background Work What isthe social economic value of continued investment in Europeana to maintain and extend its current ambition level in terms of services and infrastructure in the years 2015 - 2020? Impact Assessment Review CC BY-SA
  • 5.
    Main findings •  Europeanareduces transaction costs, creates positive spill- over effects and being a forerunner in areas such as standardisation it helps reduce the costs for followers •  In the best case scenario the benefits of the existence of Europeana outweigh the cost by € 21.5 million (or 37%) in terms of net present value, exclusive of any benefits for the creative industries, education and research for which there is no exact data Impact Assessment Review CC BY-SA
  • 7.
    From KPIs tomeasuring Impact •  5m visits to the portal •  45m records •  2.500 API keys •  1.200 Association Members •  … Impact Assessment Review CC BY-SA •  Have we contributed to building a common European identity? •  Have we helped produce economic growth? •  Have we helped cultural institutions to adapt to the needs of the 21st century?
  • 8.
    Europeana’s Impact FrameworkModel •  Uses Simon Tanner’s Balanced Value Impact Model •  Relates to the mission of Europeana •  Derives from Europeana values: usable, reliable, mutual •  Follows a controlled process for analysing the context of the resource •  Maps the actions, the outcome of these actions, and ultimately the impact we have on real people •  Identifies the appropriate qualitative & quantitative impact measures as well as the methods and techniques that would be most effective to define the outcomes of the activities •  Balances the economic incentives we generate with the cultural and social benefits we deliver Title here CC BY-SA
  • 9.
    Impact Assessment Review 2Components: •  Impact Assessment Framework Review: Detailed analysis of the context & the ecosystem (stakeholders/ activities/ expected outcomes) •  Impact Assessment Indicators Report SMART indicators to measure impact Title here CC BY-SA
  • 10.
    IA Review Approach • Balanced Value Impact Model •  Desk research and analysis •  2 stakeholder focus groups •  Paperplane activity •  Input from the Impact Assessment Taskforce •  Reports: 7 January- annex to the Business Plan Impact Assessment Review CC BY-SA