This document discusses Europeana's plans to measure its impact through an impact assessment. Europeana wants to measure its impact to justify continued yearly investment, reinforce stakeholder engagement, understand its strengths and weaknesses, and acquire data to inform future planning. Europeana will develop an impact assessment framework based on a balanced value model to analyze context and map actions, outcomes, and impacts on stakeholders. The impact assessment will have two components: a review analyzing context and ecosystem, and an indicators report establishing SMART metrics to quantify impact. Data collection will include desk research, stakeholder focus groups, and input from an impact assessment taskforce.
2. What are the measurable outcomes arising from
the existence of Europeana that can demonstrate a
significant change – social & cultural, economic
and innovation-related – on its stakeholders?
France, Public Domain
1588, Bibliothèque municipale de Lyon
Hendrik Goltzius
Le dragon dévorant les compagnons
de Cadmus
3. Why are we measuring impact?
• To justify continued yearly investment of €10M by the EU
• To reinforce the feeling of engagement by the network
• To understand where our strengths and weaknesses lie
and to inform further our planning of activities
• To acquire the global picture of the effects of our activities
• To get a framework that we can consistently use in the
future to monitor the impact of our activities
Impact Assessment Review
CC BY-SA
4. Background Work
What is the social economic
value of continued investment
in Europeana to maintain and
extend its current ambition
level in terms of services and
infrastructure in the years 2015
- 2020?
Impact Assessment Review
CC BY-SA
5. Main findings
• Europeana reduces transaction costs, creates positive spill-
over effects and being a forerunner in areas such as
standardisation it helps reduce the costs for followers
• In the best case scenario the benefits of the existence of
Europeana outweigh the cost by € 21.5 million (or 37%) in
terms of net present value, exclusive of any benefits for the
creative industries, education and research for which there
is no exact data
Impact Assessment Review
CC BY-SA
6.
7. From KPIs to measuring Impact
• 5m visits to the portal
• 45m records
• 2.500 API keys
• 1.200 Association
Members
• …
Impact Assessment Review
CC BY-SA
• Have we contributed to
building a common
European identity?
• Have we helped produce
economic growth?
• Have we helped cultural
institutions to adapt to the
needs of the 21st century?
8. Europeana’s Impact Framework Model
• Uses Simon Tanner’s Balanced Value Impact Model
• Relates to the mission of Europeana
• Derives from Europeana values: usable, reliable, mutual
• Follows a controlled process for analysing the context of the
resource
• Maps the actions, the outcome of these actions, and ultimately the
impact we have on real people
• Identifies the appropriate qualitative & quantitative impact measures
as well as the methods and techniques that would be most effective
to define the outcomes of the activities
• Balances the economic incentives we generate with the cultural and
social benefits we deliver
Title here
CC BY-SA
9. Impact Assessment Review
2 Components:
• Impact Assessment Framework Review:
Detailed analysis of the context & the ecosystem
(stakeholders/ activities/ expected outcomes)
• Impact Assessment Indicators Report
SMART indicators to measure impact
Title here
CC BY-SA
10. IA Review Approach
• Balanced Value Impact Model
• Desk research and analysis
• 2 stakeholder focus groups
• Paperplane activity
• Input from the Impact Assessment Taskforce
• Reports: 7 January- annex to the Business Plan
Impact Assessment Review
CC BY-SA