Michael Mulvany Presentation in Istanbul EPHAR2016

1. Michael Mulvany
ORPHEUS tools for assisting institutions in implementing
best practices for responsible research training
Professor emeritus
Department of Biomedicine
Aarhus University, Denmark
Head Graduate Studies, 2002-2011
Chairman, ORPHEUS Labelling Board
ORPHEUS Vice-president 2010-2014
mm@farm.au.dk
ORPHEUS workshop
29 June, Istanbul
Key slides

2. • What is responsible research training?
ORPHEUS tools for assisting institutions in implementing best practices for
responsible research training
Outline
• Research integrity
• Developing and implementing best practices
The ORPHEUS tools
International initiatives
• Ensuring good careers

3. • Many pressures encourage irresponsible research
• Pressure to publish … career … grant
• Pressure for results from leader/supervisor
Why training in responsible research?
• Increasingly, published results cannot be repeated
• The need for Rigour and Reproducibility

4. Training in responsible research
“Importance of fostering and maintaining a culture of research integrity
through teaching, training, and supervision” (Copenhagen U.)
• Weekly group supervisor-PhD student meetings
• Presentation of raw data
Courses:
Fabrication, Falsification, Plagiarism.
Principles for handling Scientific Misconduct
Documentation of scientific results, Authorship, Intellectual property rights
The basics:
• Honesty, Transparency, Accountability

5. The changing PhD training model
Apprenticeship model from the 1800s
The team model

6. Report of the
Royal Society,
UK, 2010
What happens to PhD graduates?
Careers outside
science
Non-university
research (industry,
government etc.)
Post-doc Academic
research
staff
Professor
53%
17%
47%
44%
3.5%
0.45%
80%
27%

7. • academic research
• clinical research
• industrial research
• contract research organization
• etc., etc.
Research
• clinical positions
• higher education teaching
• funding organizations
• scientific writing
• scientific consultant
• in vitro diagnostics, specialist
laboratories
• research management
• evidence-based policy making
• own spin-off business
• etc., etc.
Research-based opportunities
• marketing, sales,
• customer support
• technical support,
• patents
• communications
• regulatory, QC&QA
• administration
• human resources
• investment banking
• etc., etc.
Outside the box
How are PhD graduates using their talents?
20%
80%

8. PhD Career
Competence development
Career development
Ensuring good careers for PhD graduates

9. Research skills
• Ability to conceive, design,
implement and adapt a
substantial process of original
research
• with scholarly integrity
• at a level that merits international
refereed publication
Competences that should be provided by a PhD
Communication skills
• Ability to present research
• … also to non-academic audiences
• Ability to teach
• Linguistic skills
Management skills
• Project management
• Ability to work in a team
• Ability to supervise technicians
and research students
• Ability to apply (and obtain) grants
• Ability to network
• Ablility to plan career

10. • establishing scientific careers
• making effective career decisions
• building and maintaining professional relationships
• Industrial internships
• video series – interviews with alumni.
https://medschool.vanderbilt.edu/aspire/
Support for career development

11. Best Practice documents
Document number
of words
Salzburg I: Bologna Seminar on
“Doctoral Programmes for the
European Knowledge Society”, 2005
850
Salzburg II: Implementing the
Salzburg Principles, 2010
1,700
EU Commission: Principles for
Innovative Doctoral Training, 2011
700
The Quality Assurance Agency for
Higher Education Doctoral degree
characteristics in UK, 2011
17,000
League of European Research
Universities, LERU: Good Practice
Elements in Doctoral Training, 2014
18,500
ORPHEUS Best Practices 4,500

12. The Best Practices document
www.orpheus-med.org
ORPHEUS
conference
number
delegates institutions countries
2004, Zagreb 53 25 16
2005, Zagreb 71 33 21
2007, Helsinki 80 43 26
2009, Aarhus 165 72 33
2010, Vienna 196 114 39
2011, Izmir 250 98 42
2012, Bergen 195 156 36
2013, Prague 181 40
2014, Lausanne 300 100 40
2015, Belgrade 135 79 35
2016, Cologne ca. 200 ca. 100 ca. 35

13. Contents
• Research environment
• Outcomes
• Admission policy and criteria
• PhD training programme
• Supervision
• PhD thesis
• Assessment
• Graduate school structure
General format
• Basic recommendations (40)
• Quality development
• recommendations that are in
accordance with international best
practice (28)
• Annotations (31):
• explanations and flexibility
www.orpheus-med.org
The Best Practices document

14. Contents
• Research environment
• Outcomes
• Admission policy and criteria
• PhD training programme
• Supervision
• PhD thesis
• Assessment
• Graduate school structure
General format
• Basic recommendations (40)
• Quality development
• recommendations that are in
accordance with international best
practice (28)
• Annotations (31):
• explanations and flexibility
www.orpheus-med.org
The Best Practices document

15. Some recommendations concerned with research integrity

16. Some recommendations concerned with career development

17. www.orpheus-med.org
How to implement these?
The Best Practices document

18. www.orpheus-med.org
Self-evaluation questionnaire

19. Some recommendations concerned with research integrity
Self-evaluation questionnaire

20. Some recommendations concerned with research integrity
Self-evaluation questionnaire

21. Some recommendations concerned with career development
Self-evaluation questionnaire

22. head graduate school
head PhD
administration
programme directors
supervisors
PhD students
ORPHEUS recommends
that this be completed in
collaboration with all
stakeholders
• 40 basic recommendations
• 28 quality development
• 31 annotations
Self-evaluation questionnaire

23. Executive committee
Labelling BoardSub-committees

24. Evaluation Certificate
Evaluation of the completed Self-
evaluation questionnaire by the
ORPHEUS Labelling Board.
www.orpheus-med.org
Written discussion with
ORPHEUS Labelling
Board
Award of an
ORPHEUS Evaluation Certificate.
Xx hoji sp ep dæie jkj enicodiekkm,eooke
Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
Xx hoji sp ep dæie jkj enicodiekkm,eooke
Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
e Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
e Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd

25. • Completed self-evaluation
questionnaire sent to Labelling
Board
Label
www.orpheus-med.org
Xx hoji sp ep dæie jkj enicodiekkm,eooke
Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
Xx hoji sp ep dæie jkj enicodiekkm,eooke
Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
e Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
e Jodmm,oe iihenkdXx hoji sp ep dæie jkj
enicodiekkm,eooke Jodmm,oe iihenkd
head graduate school
head
administration
programme directors
supervisors
PhD students
ORPHEUS
facilitators
• Site visit by two members of the
Labelling Board to meet with
stakeholders.
Award of an ORPHEUS label

26. Institutions with
Evaluation Certificates
Mannheim
Institutions in process
of self-evaluation
Groningen
Manitoba
Vanderbilt
Copenhagen
Belgrade
Bergen
Graz
Iceland
Karolinska
Izmir
Institutions with Labels
Evaluation Certificate and Label

27. Accreditation
• Accreditation is normally an inspection by relevant Ministry to
ensure that regulations are being followed
• Emphasis on numbers of PhD students, numbers of
completions, etc.
Accreditation and labelling
Labelling
• Aim is to encourage self-reflection.
• Label is awarded on the basis of peer review following
discussion with all stakeholders.
• Minimal documentation.
• Process is concerned with the quality of the training being
provided.

28. Using the ORPHEUS label
1. The process will have encouraged self-reflection
2. A mark of quality
3. Recruitment of PhD students
4. A factor when applying for grants
Label
Interested? Write to robert.harris@ki.se or mm@farm.au.dk

29. • Research integrity
ORPHEUS tools for assisting institutions in implementing best practices
for responsible research training
Summary
• Developing and implementing best practices
• Ensuring good careers
• ORPHEUS Best Practices document
• Self-evaluation questionnaire
• ORPHEUS Evaluation Certificate
• ORPHEUS Label
Interested?
Write to
robert.harris@ki.se
or
mm@farm.au.dk
• What is responsible research training?