This slide set highlights most of the content from our recent day-long workshop on Educational Research held at KAHER, Belagavi on 19th April 2024. This gives a comprehensive overview for conducting such workshops as well as insight into educational research from concept, design, conduct to dissemination of findings.

1. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Educational Research
Dr. Animesh Jain
Dr. Rashmi Jain

2. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Ice breaking
&
Introduction
2
Resource Persons
Dr Animesh Jain, Professor of Community Medicine,
Dy Coordinator, Medical Education Unit,
Kasturba Medical College, Mangalore
Dr Rashmi Jain,
Professor of Ophthalmology,
Coordinator, Medical Education Unit,
Yenepoya Medical College, Mangalore

3. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Ice breaking & Introduction
3
• Name
• Designation, Dept & Institution
• Experience with Educ Research
• Expectation from workshop

4. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Agenda
• Ice breaking and Introduction
• Importance of Education Research
• Purpose & Types of Educational Research
• Designing and Conducting Educational Research
• Dissemination of Educational Research
• Open House - Final tips & takeaways
4

5. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Objectives
• Understand the importance of educational research
in medical and health professions education
• Learn key research methodologies and techniques
applicable to educational research
• Explore best practices in conducting educational
research in medical and health professions education
• Apply theoretical knowledge through hands-on activities
• Foster collaboration and networking among
professionals from various healthcare fields
5

6. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Problem Solution
Systematic process
Data collection Data analysis Interpretation of findings
Research
6

7. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Your take
• Power point is the best A-V aid in a lecture
• OSCE is the key to clinical assessment
7

8. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
8

9. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
9

10. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
10

11. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
11

12. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Research in medical education
• A rigorous, systematic investigation of any aspect of
education
• seeks to deepen the knowledge and understanding
of learning, teaching and education
• by studying phenomena, relations and how and why
what works for whom
12

13. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Educational Vs Clinical Research
• Same fundamental principles
• Both deal with basic and applied research
• In both 3 types of research is done – qualitative,
quantitative and mixed
• Only difference is…..
• In educational research, qualitative methods are used
more than quantitative methods
13
Different
Or Same?

14. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Why do research in HPE/med education?
• Evidence-based approach in HPE/ME
• Scientific support for intended curriculum reforms
• Improved HPE/ME benefits patients
• Genuine scholarly interest
• Attract funding for new educational strategies
14

15. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Administrators - how to provide an environment for happy
and productive learning?
Teachers - what kind of materials, strategies & activities,
assessment methods best help students learn?
Students - how to study to learn as much as they can ?
Health Professionals - how to improve practice to provide
best health care ?
Adapted from How to design and evaluate research in education –Fraenkel ,Wallen
Why Educational Research ?
The need to know…
15

16. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
The Challenge
• To place a concrete idea, interest or problem
within a general context of learning, teaching and
education
• Generalisation perspective
• Avoiding mere focus on local, concrete problems
or questions
16

17. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Your view on these topics
• “How satisfied are participants with the content and
format of my course?”
• “What is the learning outcome measured by a skills
test at the end of this class?”
• “How well is this programme implemented in our
institution as measured by the number of teachers
who adhere to the standards?”
17

18. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
The Challenge
• Researchable problems relating to general questions
about learning, teaching and education that are studied in
local contexts
• Generalisability of study results is a prime consideration
• How the study contributes general new knowledge about
learning, teaching and education?
• Practical relevance, and how the new knowledge can
guide educational practice?
• Requires critical appraisal of how the results may have
been affected by the context of the study
18

19. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
19

20. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
The Challenge and advice
• Unattainable goal for researchers to aspire to finding the
one solution or explanation that is uniformly valid in all
medical education settings
• The most researchers can probably aim for is contributing
bits and parts of new knowledge, understanding and
reflection on a variety of phenomena and how and why
things work or do not work, and for whom
• In a nutshell, research in medical education is neither
about solving local problems nor about finding general
solutions (Regehr, 2010)
20

21. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Top Themes in
ME Research
21

22. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Activity – Group work
• Each group has been given a set of 5 published articles
• Please go through the abstracts and identify the key
differences in the purpose and types of research
22

23. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
23

24. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Description
24

25. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Description
25
Indian J Community Med 2022;47:479-82.

26. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Description Studies
• Focus on the first step in the scientific method, namely, observation
✓Describe what was done, or
✓Present a new model
• May or may not contain outcome data
• Usually do not make comparision
26

27. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Justification
27

28. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Justification
28

29. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Justification Studies
• Comparing one educational intervention with another or none.
• Address the question (often implied): Does the new intervention
work?
• Comparison of problem-based learning curriculum with traditional
curriculum
• Does assessment by OSPE work better than traditional examination ?
29

30. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Clarification
30

31. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Clarification
31
Indian J Physiol Pharmacol 2020:64(2):147-54

32. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Clarification Studies
• Clarifies the processes underlying observed effect
• Seek to answer the questions:
• How & why does it works or doesn’t work?
• How can it be made better?
• Hallmark - conceptual framework to be confirmed or refuted by
results of study
• Aimed at deepening understanding
32

33. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Example to clarify the concept of 3 types
Descriptive
How do we improve educational research output?
How to conduct a faculty development workshop on Educational Research?
Justification
Does Educational Research workshop improve output of Educational
Research and publication?
Is workshop better than other methods?
Clarification
How, Why Educational research Workshop works?
33

34. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
What they mean?
• Description and justification studies - focusing on existing
interventions, look to the past
• Clarification studies - illuminate the path to future
developments; useful in larger and different context too
34

35. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Objectives of Educational Research
35
1. Exploration: This is done when you are trying to generate ideas about something.
2. Description: This is done when you want to describe the characteristics of something or some
phenomenon.
3. Explanation: This is done when you want to show how and why a phenomenon operates as it
does. If you are interested in causality, you are usually interested in explanation.
4. Prediction: This is your objective when your primary interest is in making accurate predictions. Note
that the advanced sciences make much more accurate predictions than the newer social and
behavioral sciences.
5. Influence: This objective is a little different. It involves the application of research results to
impact the world. A demonstration program is an example of this.

36. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Activity – Group work
Among the articles given, one each is on qualitative research,
quantitative research and mixed research.
Among the articles provided, specifically look at the following
areas
• What is being studied?
• Method of data collection
• Nature of the data collected
• Method of analysis
• Sampling technique
36

37. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Qualitative Vs Quantitative
Quantitative
• Deductive – Test theory and hypothesis
• Identifies associations/casual
relationship
• Data collected are discrete variables
• Results obtained and conveyed by
statistical analyses
• Probability sampling
Qualitative
• Inductive – theory and hypothesis
generation
• Gives insight into attitudes, concerns,
beliefs, value systems etc
• Data obtained by interviews, focus
group discussions etc.
• Results conveyed in a case-report or
narrative format
• Non – probability sampling
37

38. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Activity
• Think of a broad area or a problem or something
that you would like to research on in the context of
your work
38

39. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
From idea/problem to research question
• Ask yourself what will happen if this research is not done -
does it really matter?
• Who will benefit from it?
39

40. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
40

41. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing
Educational
Research
Studies

42. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
The Educational research process
Observation/Problem
Define research
question
Conduct
literature search
Design study
Obtain IEC
approval
Collect &
analyze data
Disseminate
results
42

43. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
43
Kirkpatrick Framework
Reaction
Learning of skills
and knowledge
Behaviour
change in
Service
Providers
Patient
outcome
improved
Level-1
Level-2 2a – Change in attitude
of subjects
2b – Change in knowledge
and/or skills of subjects
Level-3
Level-4 4a-Change in professional practice
4b- Change in patients’ conditions

44. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
44

45. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Research Question
• Broad to narrow
• Generalizability
• Practicability
• Refine after literature search
• Use of AI ?!!
45
◼ The RQ should be important and significant

46. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Researchable vs. Non researchable questions
How to design and evaluate research in education –Fraenkel ,Wallen
How to design and evaluate research in education –Fraenkel,Wallen
46

47. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Group Work
Formulate a Research Question for
an Educational Research

48. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Literature search
• What is already known
• Knowledge gap
• Helps to focus on aspects that are worth pursuing
48

49. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
49
Study design
Is a qualitative or quantitative approach appropriate?
• Qualitative
• Participants perspectives on a
new T-L method
• Quantitative
• Performance of student after
an intervention
• Mixed
• Comparing PBL with tutorial as a SGT method
Experimental
Translational

50. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Exploratory
Descriptive
Qualitative
Psychometric
50
Experimental
RCT
Quasi
experiment
Observational Translational
Case Control Kn creation
Cohort
Kn
implementation
Efficacy
Associational

51. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Ringsted C, Hodges B, Scherpbier A (2011). “The research compass”: An introduction to
research in medical education: AMEE Guide No.56. Medical Teacher, 33: 695–709

52. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Research Compass
• Conceptual and theoretical framework as the foundation for any research
approach
• Highlights the diverse paths researchers can take in conducting research
in medical education, allowing for flexibility and adaptation based on the
research problem at hand
• Choose the approach that best fits needs and preferences while
ensuring it is appropriate and feasible within the study context
52

53. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Group Work
Select a Study Design for your RQ

54. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Sample Size
• Appropriate – Quantity and Quality
• Quantitative – Depends on expected effect, sensitivity of instrument
and the variance among participants
• Qualitative – Smaller sample size, generally purposive
Statistical representativeness is not the aim
54

55. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Data Collection
• Quantitative – Survey, Observation, Document review
• Qualitative – FGD, IDI, Semi-structured interview, Document/Photo
review
• Questionnaire designing
• Pilot testing
55

56. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Data Analysis
56
QUAL Data analysis
• Identify patterns
• Thematic analysis
• Individual opinions
should also be noted
How to interpret the data?
• How much emphasis to give a topic?
• Account for the different views of the
minority
QUAN Data analysis
• Statistical tests
• Associations
• Correlations

57. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
57

58. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
• Data Presentation
58

59. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
59

60. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
60
BMC Medical Education 2009, 9:63 doi:10.1186/1472-6920-9-63

61. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
61
BMC Medical Education 2009, 9:61
doi:10.1186/1472-6920-9-61

62. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Characteristics of mentoring relationships formed by medical
students and faculty.
Medical Education Online, 17(1)
https://doi.org/10.3402/meo.v17i0.17242
62

63. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
63
https://doi.org/10.3402/meo.v17i0.17242

64. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
64
BMC Medical Education 2009, 9:62 doi:10.1186/1472-6920-9-62

65. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Designing Educational Research Studies
Ethical Issues
• IEC approval – Exemption??!
• Principles of Ethics – Key
• CTRI Registration
• Informed consent
• Confidentiality
• Remember – Learner is a vulnerable participant because there is a
power differential between teacher and trainee
65

66. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Any Questions/
Comments?
66

67. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Check Out !!
67

68. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
It all depends on your point of view!
“How do you want to be known,
as the discoverer of fire or the
first man to pollute the
atmosphere?”
68
© Page Morahan 2007

69. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Evaluating the effectiveness of intervention
• Purposive sampling may give different but valid perspectives
• For instance, if 25 out of 30 people are shown to have benefited from a
course, the most interesting question might be “why didn’t the other five
people benefit?”
• Were they demographically different? Did they have different learning
styles?
• More detailed interviews with those five students may be more informative
about the philosophy and utility of a course than the simple statistics
• Analysing the deviant cases as a project proceeds is important for the
validity of results
69
BMJ 1999;318:1267–9

70. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Use of AI for educational research
• ChatGPT
• ResearchON
• Perplexity.ai
• ResearchRabbit
70

71. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Live Demo of
ResearchON
& ChatGPT

72. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Dissemination of
Educational Research
72

73. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
What is scholarship?
It is a tangible product, such as
a journal article,
a book,
a presentation, or
an endurable educational product,
of new knowledge or its presentation that was peer reviewed or publicly
disseminated
73
Adapted from Diamond 1995
© Georges Bordage
Slide courtesy: PSG FRI, Coimbatore

74. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Criteria for Scholarship – 3Ps
• Requires high level of expertise
• Peer reviewed
• Verified by those outside of the local context
• Public knowledge
• Is documented, archived
• Accessible, retrievable
• Platform that can be built upon
• Can be replicated & elaborated on
• Has impact on discipline or community of people
• Is novel, innovative, creative, confirmatory in new context
74
Adapted from Robert Diamond,
Lee Shulman, & Deb Simpson
Courtesy: PSG FRI, Coimbatore
Slide courtesy: PSG FRI, Coimbatore

75. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Medical Education Conferences
• NCHPE
• SEARAME
• APMEC
• IMEC
• ICME
• AMEE
• Ottawa Conference
…… and many more
75

76. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Journals publishing
Medical education research
Medical
Education
Medical
Education Online
BMC Medical
Education
Medical Teacher
Academic
Medicine
Advances in
Health Sciences
Education
Teaching and
Learning in
Medicine
Education for
Health
South East Asian
Journal of
Medical
Education
Educational
Research
RHiME
NMJI, JPGM,
IJHAS, AMHS
76
Speciality
journals
and more…

77. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Funding
• Most research is underfunded
• Educational research – Minimum cost
• Funds may be obtained from:
• Institution
• Regulatory bodies
• Agencies
• Organisations
77

78. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Exercise
• As a group prepare a brief outline of a research
study that you would do to solve or get answer to
the problems/RQ developed by your group
78

79. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Group Exercise
• Each group has been given specific topics and
assignment. Please work on those and
present/share in plenary
79

80. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Thank you
80
You may reach me via
animesh.jain@manipal.edu and/or 98450 32334
dr-animesh-jain/
Animesh Jain
animeshjain1
Acknowledgement
Dr Sharada Rai
Dr Thomas V Chacko
FAIMERly esp PSG, MAHE
Dr Suneetha Nithyanandam
Dr Sunita Patil
Dr Nilesh Choudhary
UDEHP, KAHER, Belagavi
KLE Homeopathic Medical College & Hospital

81. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
81

82. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
82

83. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
83
J Datta Meghe Inst Med Sci Univ 2023;18:593-7

84. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
84

85. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
85

86. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
86

87. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
87
Indian J Community Med 2022;47:479-82.

88. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
88
Int J Acad Med 2022;8:96-101.

89. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
89

90. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
90

91. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
91

92. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
92

93. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
93

94. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
94
Archives of Medicine and Health Sciences. 2(2):238-242, Jul-Dec 2014.5

95. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
95

96. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
96
Journal of Clinical and Diagnostic Research. 2011 April, Vol-5(2):344-346

97. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
97

98. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
98

99. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
99

100. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
100

101. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
101

102. Educational Research – Dr Animesh Jain & Dr Rashmi Jain
Thank you
animesh.jain@manipal.edu
Acknowledgement
Dr Sharada Rai
Dr Thomas V Chacko
FAIMERly esp PSG, MAHE
Dr Suneetha Nithyanandam
Dr Sunita Patil
Dr Nilesh Choudhary
UDEHP, KAHER, Belagavi
KLE Homeopathic Medical College & Hospital
Resource Persons
Dr Animesh Jain, Professor of Community Medicine,
Dy Coordinator, Medical Education Unit,
Kasturba Medical College, Mangalore
Dr Rashmi Jain,
Professor of Ophthalmology,
Coordinator, Medical Education Unit,
Yenepoya Medical College, Mangalore