This document discusses assessment methods in medical education. It begins by explaining that medical examinations typically involve internal and external examiners. It then discusses different approaches to evaluating theory versus practical exams. The rest of the document focuses on question types for assessments, including essays, modified essay questions (MEQ), short-answer questions (SAQ), and structured assessment methods like objective structured clinical examinations (OSCE) and structured viva-voce exams. It emphasizes the importance of questions being clear, short, precise, and of increasing difficulty. The overall document provides an overview of different assessment strategies and emphasizes standardization and quality assurance in medical education evaluations.

1. ASSESSMENTDr. Hironmoy Roy
MD (Anat), FAIMER Fellow (CMCL 2015), MBA (NIBM, Pune)

2. Why?
Usually in a 100 students MBBS examination there are Two (2)
Internal Examiners & Two (2) External Examiners
Usually all HODs are requested to make the question paper for Prof Exam
and at the end it gets decided by an External person to finalize the paper
In some university, theory paper is evaluated by one set of Examiner and
Practical exam is taken by another set of examiner
In some university, the marks of a theory answer script is noted in a
booklet, instead of in the paper. That paper gets evaluated by a second
examiner and the marks gets made average
Ideally, among four “Groups”, two Groups are checked by Internal
Examiners and two Groups are checked by External Examiners
QA- IQA & EQA

3. Quality Assurance
Quality assurance (QA) is a way of preventing mistakes
and defects in manufactured products and avoiding
problems when delivering solutions or services to
customers
Indian Medical Graduate
Society
in Medical Education
Needs QA in Assessment

5. While to plan an assessment programme
Whom to assess ? MBBS/Par medics/Nursing
What to assess ? Learning Objective, Learning Domain,
Chapters to be covered
Which level of MP? K/KH/SH/D
Which tool is liked
to be used ?
Theory Q/ Long case/ Short case/spot case

7. Planning our theory question
Group A
SEQ =1(2) X 12
Group B
SEQ= 2 (3) X 7
Group C
Short Note
3 (4) x 4=12
Group D
Explain why
4 (4) x 3= 12
50% is the Pass marks
75% is Honors marks

8. LQ (LAQ) = EQ, MEQ
Supply type
Dr. Hironmoy Roy

9. An “Essay Question”
Traditional
Easy to frame
Easy to mark
Fascinated by old-mass
Describe Maslow’s hierarchy of motivation. [20]
Dr. Hironmoy Roy

10. An “essay question”……
• Requires examinees to compose rather than select their
response.
• Elicits student responses that must consist of more than one
sentence.
• Allows different or original responses or pattern of responses.
• Requires subjective judgment by a competent specialist to
judge the accuracy and quality of responses.
John M Stalnaker 1951
Dr. Hironmoy Roy

11. • An effective essay question will align with each of the four
criteria given in Stalnaker’s definition and provide students
with an indication of the types of thinking and content to use
in responding to the essay question.
Explain in what ways the Hierarchy of motivation will
impact upon the output of a person . Provide an example
that illustrates this impact. [10+10]
Dr. Hironmoy Roy

12. Modified Essay Question (MEQ)
• MEQs are a series of short- questions (sequence of questions)
based on a case study and designed to test higher order
thinking.
• Students are usually presented with a scenario, and then
given a series of questions based on it that they answer with a
short text.
• “Essay” is misnomer
Dr. Hironmoy Roy

13. In a MEQ……
• A student shall identify the problem, define it, interpret the
situation by analysing the given data, organise/ paraphrase
the arguments/reflections by applying his/her thinking skills.
• Approaches higher level of cognitive domain
• Have small markings of each part/portion.
• In totally replace an traditional essay Q.
Dr. Hironmoy Roy

14. Give an account of Fallopian Tube. [10]
Traditional Essay Q
Dr. Hironmoy Roy

15. A 25 yrs old lady reports at obstetrics emergency with severe
abdominal pain and bleeding per vagina. On examination the
resident doctor explores that she missed her period of last
one month. USG reveals rupture ectopic pregnancy.
Which organ is affected in ectopic pregnancy? Enlist its parts.
Name the embryological precursor of the organ. Name the
blood vessels supplying this organ. Provide a histological
diagram of the affected organ with clear labeling. [1+ 2+ 1+
2+ 4= 10]
Modified Essay Q (MEQ)
Dr. Hironmoy Roy

16. SQ/ SAQ
Dr. Hironmoy Roy

17. A Short-answer Q (SAQ)
• Questions may require answers such as complete the
sentence, supply the missing word, short descriptive
or qualitative answers, diagrams with explanations
etc
Dr. Hironmoy Roy

18. For Example:-
 One may simply ask the student to write in a missing word or
phrase:
The current Prime Minister of India is _____? (1)
• Or one may ask for brief listing:
List the three types of plastic surgery procedures
(1 mark for each)
• Or for a one sentence answer:
What is the basic principle of Gram’s staining ? (2)
Dr. Hironmoy Roy

19. Items clearly needed to be specified how the question
should be answered.
e.g.
• Student should answer it briefly and concisely using a single
word or short phrase?
• Is bullet point format acceptable, or does it have to be an
essay format?
• Is the question given a specific number of blanks for
students to answer?
Dr. Hironmoy Roy

20. • Example:
Family planning methods most appropriate for adolescents
are:
a._______________,
b. _______________,
c._______________.
• Questions that involve possible multiple responses demands
more from students and addresses broader content.
Dr. Hironmoy Roy

21. Our MEQ= Group A
Our LQ= Group B
Our SAQ= ??

23. Give an account on the Middle ear cavity.
Describe the formation of brachial plexus.
Discuss the modifications of spinal pia mater.
Write briefly on spinal pia mater.
Short note - Fornix

24. Enumerate the muscles of Middle ear cavity & their
nerve supply.
Enlist the modifications of spinal pia mater with
pictorial presentation.
Short note-
Cerebral Fornix- which type of white fibre is it and
why?

25. We MUST AVOID using vague action-
verbs;
Describe
Discuss
Give an account
Write an essay
Write briefly
…….as they are not at all SMART to assess.

26. “Short note” Group need to be revisited.
Example……
ORS- Its composition & Indication of use
[1.5+1.5=3 marks]
ORS [3 marks]

31. Structured Viva-voce Exam (SVVE)
• Sets of equitable question-cards are prepared
• Each having equal numbers of questions
• With equal numbers of parts,
• Arranged successively with increasing difficulty and
equal marks.
All are packed & sealed in envelope.
• Students are to pickup cards as lottery and needs to
reply.

32. Objective Structured Viva Exam (OSVE)
Station – based
Student needs to move from one station to another
In each station one question card is there,
 written with one structured question,
 what he needs to reply on-spot to the station-
attendee/observer;
 who will match the reply with checklist.

33. The questions shall must be-
• Clear
• Short
• Precise
• Unequivocal
• In proper sequence of increasing difficulty

35. Standardize
Monitor
Analyze
Report
Verify
Track
Audit
Train