The document outlines the 21st EARMA Conference focusing on tools for Responsible Research and Innovation (RRI) held in Leiden, Netherlands. It emphasizes the importance of engaging various stakeholders in the research and innovation process to create socially impactful outcomes and discusses the development of RRI tools that promote ethical practices, inclusivity, and public dialogue. The proposal aims for a collaborative approach in science with societal needs, aligning researchers, policymakers, and the public.

1. 21st EARMA Conference
28th June – 1st July, 2015. Leiden, The Netherlands
Tools for Responsible Research and Innovation
Ignasi López Verdeguer, La Caixa Foundation
@ignasilopezv / ilopez@fundaciolacaixa.es

2. | Index
- Responsible Research and innovation (RRI).
Why?
- RRI, what in practice? RRI Tools
- RRI, how?
1st session
2nd session
- Interactive session: Obstacles,
opportunities and tools

3. • We promote excellent research by giving
support to projects -in the areas of Life and
Health sciences and Social sciences and the
Humanities- and individuals -PhD students
fellowships-
• We give priority to research and innovation of
high social impact and we stimulate technology
transference.
• We foster Responsible Research and
Innovation and a closer and efficient relation
between science and society
Research
Innovation
Society
Science Programs

4. |
“We need ambition at a policy
level to support the best
science for the world and not
just the best science in the
world”
!
Morten Østergaard “Science in Dialogue
Conference”.
Opening session. Denmark
Why Responsible research
and innovation (RRI)?

5. |
The biggest part
of the world
farmaceutical
research goes to
diseases of the
rich world
The Guardian.
Special Report. Aids.
...not all voices are equally
heard...

6. |
Special Eurobarometer 401. Responsible Research and
Innovation (RRI), Science and Technology
What is the level of involvement citizens should have
when it comes to decisions made about science and
technology?
Answer: Public dialogue is required (Req: 55% - Not Req:
37%)
77% of Europeans
believe that science and
technology have a
positive impact
!
62% agree that science
makes our way of life
change too fast
55% think that
public dialogue is
recquired!
... Society wants to participate
in the decisions of science

7. |
... From technology acceptance
to technology acceptability
SMART METERS IN THE NETHERLANDS

8. |
Scientific
Misbehavior in
Economics. LSE
Impact of Social
Sciences Blog
...R&I assessment.
Preasure for
publishing -
>
Scientific
misconduct?
Reproducibility

9. | Political impulse
• Endorsed by private research foundations.
http://www.efc.be/news_events/Pages/news_EFC-Research-Forum-Statement-
on-Responsible-Research-and-Innovation.aspx
• A cross cutting issue in Horizon 2020
• RRI Rome Declaration endorsed by the
Council of Competitiveness http://ec.europa.eu/
research/swafs/pdf/rome_declaration_RRI_final_21_November.pdf
!
• Endorsed by research councils as the EPSRC
and the NWO

10. |
What is Responsible
research and innovation
(RRI)?
!
RRI Tools

11. | RRI Tools, the “problem”
Engagement
Science
Education
EthicsGender Equality
Open
Access

12. |
COORDINATOR
DEPUTY
COORDINATOR
HUBS
COORDINATOR
WP1 LEADER
WP2 LEADER
WP4 LEADER
WP5 LEADER
WP6 LEADER
NETWORKS
www.rri-tools.eu
Budget: 6,9 Milion €. Funded by the EC under the 7th FM
Program
The proposal: RRI Tools

13. |
•The AB provides strategic guidance and
support to the project coordinator and the
Management Board to ensure excellence and
relevance of the project. Meets on a yearly
basis.
• Composed by 12 renowned experts on RRI or
RRI key issues:
• Richard Owen (RRI)
• Carsten Mann (Governance)
• Lars Klüver (Governance, Engagement)
• Inés Sánchez de Madariaga (Gender)
• Lut Mergaert (Gender)
• Claudia Neubauer (Engagement)
• Justin Dillon (Education)
• Roser Pintó (Education)
• Pere Puigdomenech (Ethics)
• Prof. Jeroen van den Hoven (Ethics)
• Maria Cassella (Open Access)
• David Lynn / David Carr (Open Access)
The proposal: RRI Tools

14. |
University
College
London
Science
Gallery
Vetenskap &
Allmänhet
AHHAA Science
Centre Founda
Experimentarium
Polish Science
Foundation
Science
Animation
IrsiCaixa
Ciencia Viva
Fendazione
Cariplo
Ellinogermaniki
Agegi
RUSE Chamber of
Commerce and
Industry
Centre
fot the Premotien
of Science
Techmania
Science Centre
Bonn
Science
Shop
Athena Institute
King
Baudeuin
Foundation
Zentrum for
Social Innovation
MOBILIS
INNOVATIVE
TOOLS
TRANSFORMATIV
E
TRAINNING
WIDE
DISSEMINATION
RRI Hubs

15. | Where we are
WP1
- An RRI working definition
- A set of quality criteria for good
practice standards
- A catalogue of RRI promising
practices
WP2
- A wide PanEuropean
consultation on the
obstacles and
motivations for
stakeholders to
implement RRI
1 2
THE TOOLKIT

16. |
Engagement
Science
Education
Ethics
Open
Access/
Open
science
Gender Equality
!
- Context adapted. European
vision.
- Builds on ongoing efforts
- Some policy agendas normative,
some not.
!
- Conceptually robust
- Universal
- Too recent, not fully
developed
!
RRI working definition – Two visions: Academic vs.
political
And beyond...

17. |
Ethics
Gender
Equality
Governance
Public
Engagement
Open
Access
Science
Education
RRI Key Issues
RRI working definition (WP1)

18. |
Science
Education
Ethics
Gender
Equality
Governance
Public
Engagement
Open
Access
PROCESS REQUIREMENTS
Responsible research and innovation is a dynamic,
iterative process by which all stakeholders involved
in the research and innovation practice (researchers,
policy makers, industry, citizens, educators) become
mutually responsive to each other and share
responsibility regarding the R&I outcomes and
processes.

19. |
Science
Education
Ethics
Gender
Equality
Governance
Public
Engagement
Open
Access
OUTCOME
REQUIREMENTS
LEARNING
Outcomes
· Engaged publics
· Responsible actors
· Responsible Institutions
R&I Outcomes
· Ethically acceptable
· Sustainable
· Socially desirable
Solutions to Societal
challenges
· Health & demographics
· Innovative & reflective
societal
· Food & water
· Climate & resources
· Energy
· Transport
PROCESS REQUIREMENTS
Responsible research and innovation is a dynamic,
iterative process by which all stakeholders involved
in the research and innovation practice (researchers,
policy makers, industry, citizens, educators) become
mutually responsive to each other and share the
responsibility regarding the R&I outcomes and
processes.

20. |
Conditions for the research and innovation system
structures for governance
structures for public engagement
research integrity and research ethics
open access policy
gender policy
diversity policy
Science
Educatio
n
Ethics
Gender
Equalit
y
Governanc
e
Public
Engagemen
t
Open
Access
PROCESS REQUIREMENTS
POLICY AGENDAS /
CONDITIONS
R&I Outcomes
LEARNING Outcomes
Societal challenges
OUTCOMES / IMPACTS

21. | What is Responsible Research
and innovation
• It is Europe’s bet to overcome grand challenges and to provide
new opportunities for research and innovation.
!
• It is about doing science with and for society in a permanent
dialogue between different stakeholders (researchers, industry,
CSO’s...) to align research and innovation towards the needs of
society and to become mutually responsive about its outcomes.
!
• It is about research and innovation processes which are more divers
and inclusive, open and transparent, anticipatory reflexive,
responsive and adaptative.
!
• It is a wide umbrella to the agendas of public engagement with
science, science education, open access to scientific results,
gender equality and ethics in research.
!
• It is a cross-cutting issue in Horizon2020

22. | Where are we
WP1
- An RRI working definition (seen but
work in progress)
- A set of quality criteria for good
practice standards
- A catalogue of RRI promising
practices
1

23. |
!
- Based in literature, the consultation workshops, the
promising practices collected by the hubs, feedback from project
partners and RRI experts
!
- Basic building blocks for developing a self-evaluating tool (or
self-reflection tool)
!
- Outcome: a set of quality criteria and sub criteria
specified in the form of questions to enable reflection. Linked
to Policy agendas
!
!
!
D1.3 The quality criteria of
Good Practice Standards in RRI

24. |Diversity and Inclusion
Engaging a
variety of
stakeholder
groups
Variety of
means of
stakeholder
engagement
Engagement of
publics
Attention for
appropriate
R&I models
Institutional
diversity

25. |
Engaging a
variety of
stakeholde
r groups
Wide
range
Demographi
c diversity
Sufficien
t
amount
Relevant
voices
Is there a wide variety of
stakeholders involved, such that
there is a diversity of values and
a diversity of types of knowledge/
expertise?
Is there diversity in the
stakeholders engaged such that
all relevant voices are heard –
silent as well as loud?
Is there diversity within the
stakeholder groups involved in
terms of gender, ethnicity, class,
age and other demographics?
Are sufficiently many perspectives and
participants included, such that eventual
outcomes are robust (ScienceWise, 2013)?
Self-reflection tool

26. | What are we going to see today
D1.4 - A catalogue of Good Practice Standards in RRI
!
• 51 completed surveys from 18 European countries. 31
selected.
!
• Analysis and extensive description of: geographical impact,
policy agenda addressed, stakeholders involved, grand challenge
and research theme, process requirement fulfilled.
Several or all
rope in a changing world - inclusive, innovative and reflective societies
5. Climate action, environment, resource efficiency and raw materials
1. Health, demographic change and wellbeing
y, marine and maritime and inland water research, and the Bioeconomy
3. Secure, clean and efficient energy
re societies - protecting freedom and security of Europe and its citizens
4. Smart, green and integrated transport
0 4 7 11 14

27. | What are we going to see today
D1.4 - A catalogue of Good Practice Standards in RRI

28. |

29. |
Offshore windmills design (Siemens – U
Delft - NWO)
- Value sensitive design
!
- Institutional design
!
- Stakeholder analysis
!
- Participatory integrated
assesment
!
- Social acceptance/ social
acceptability
!
!

30. |
UGO, LA
CERTIFICAZIONE PER
L'INNOVAZIONE
RESPONSABILE
Socio-Technical
integration Research
NWO program for RRI

31. |Remarkable patterns
1. Practices do not (have to) incorporate all RRI processes + outcomes
2. Most projects further away from R&I process. Selection bias or
fact?
3. Many RRI projects receive funding for a limited time (EC); difficult
to maintain the project or the product afterwards (continuity,
commitment)
4. There is more awareness/ consultation than participation
5. Inclusive deliberation in place, but what about policy impact and
change?
6. It's either Responsible Research or Responsible Innovation

32. |
!
D2.2 - Report on the analysis of needs and constraints of the
stakeholder groups in RRI practices in Europe
(to be developed by M. Smallman –UCL- in next session)

33. |
!
D3.2 (forthcoming)
The Toolkit.

34. |
Self-reflection toolSearch
engine
Toolkit structure
STK landing pages PA landing pages

35. | Toolkit structure
STK landing
pages
PA landing
pages
Consortium experts + Advisory
board + coordination
STK
“rationales”
Policy Agenda
Perspectives

36. | Toolkit structure
Very brief intro
text with links to
main documents
Short video
specially
developed for the
target
A number of
inspiring
practices
Main tools
To know more... Go to the toolkit!
Work in
progress!!!

37. | Toolkit structure
Work in
progress!!!

38. |
!
The Toolkit.
!
1) 1rst phase of tools.
- Many useful resources have been developed on the different Policy
agendas (and on RRI) in FP6, FP7 that are useful to apply RRI ... So
first: a Collection of existing resources compiled by the project
by
type of resource / Policy agenda tackled / stakeholder
involved / grand challenge and/or research theme / others
!
And
- The 36 inspiring practices collected and thoroughly described in
relation to RRI by the project

39. |

40. |
!
The Toolkit.
tools

41. |
Self-assessment tools
Tools
to plan &
implement
Training & awareness
tools
Dissemination
& advocacy tools
Dedicated
portals
Catalogues
of tools

42. |
I need a tool for
assessment of RRI
Sustsanability: Users
will be able to upload
new resources.
Moderation?

43. |
Practitioners / experts
!
Search engine
Toolkit structure
I need a tool for
training CSOs
staff on Open
Science in
Biotechnology
I need a guide to
implement RRI in
my research
proposal
My university
needs a Gender
equality plan an
a Code for
research
integrity

44. |
!
The Toolkit.
!
2nd phase of tools.
!
- Tools developed by WP3 after a gap analysis of the Toolkit V.0,
the needs of stakeholders and the ongoing efforts of new
H2020 projects (as guidelines for researchers/research centres
to implement RRI in their proposals...) and
- Tools developed by WP4, WP5 and WP6:
Advocacy
Training
Dissemination tools.
and Self-assessment tool
!
!
!
!
?

45. |
Open questions

46. | Some open controversies...
!
Too top-down?
Before... ...during the R&I process... ...after
- Community based
research
- Citizen science
- Open science
- Value sensitive design
...
- Evidence
based policy
- R&I impact
assessment
- Participatory
research
agendas
- Technology
foresight
...
research
Industry and bussinness
educators
Civil society

47. |
All research problem-oriented? And what about basic science?
Project /
individua
l
research
er
Institutio
n /
centre
R+D
System /
country /
region
RRI

48. |
“We need ambition at a policy
level to support the best
science for the world and not
just the best science in the
world”
!
Morten Østergaard “Science in Dialogue
Conference”.
Opening session. Denmark
Why Responsible research
and innovation (RRI)?

49. |
Thank you!
Ignasi LópezVerdeguer
Belen Perat / Eva Zuazua
Guillermo Santamaría
Daniel García
Paola Isseta
!
And:
IrsiCaixa (Rosina Malagrida, Josep
Carreras) and