2. TEXT
â¸At the end of Presentation students will be able to:
â¸De
fi
ne Rating Scale, Checklist, objective structured
clinical/ practical examination.
â¸Enumerate different types of Rating Scale.
â¸Describe the uses of rating scale, checklist, OSCE/
OSPE.
â¸Identify the purpose and characteristics on OSCE/
OSPE .
â¸List down the steps of preparing of OSCE/ OSPE.
ďżź
2
OBJECTIVES
3. TEXT
â¸MEASUREMENT: Assigning numbers or other symbols to characteristics of
objects being measured, according to predetermined rules.
â¸CONCEPT (OR CONSTRUCT): A generalized idea about a class of objects,
attributes, occurrences, or processes.
â¸-Relatively concrete constructs :Age, gender, number of children, education,
income
â¸-Relatively abstract constructs :loyalty, personality, power, satisfaction
â¸SCALING :The generation of a continuum upon which measured objects is
located.
â¸SCALE : A quantifying measure-a combination of items that is progressively
arranged according to value or magnitude. The purpose is to quantitatively
represent an itemâs, people, or event's place in the scaling continuum.
ďżź
3
SOME KEY CONCEPTS
4.
5.
6. TEXT
â¸PRIMARY SCALES OF MEASUREMENT
â¸NOMINAL: A scale in which the numbers or letters assigned to objects serve
as labels for identi
fi
cation or classi
fi
cation.
â¸ORDINAL: A scale that arranges objects or alternatives, according: to their
Magnitude in an ordered relationship.
â¸INTERVAL :A scale in which objects are arranged according to their
magnitudes and distinguishes the ordered arrangement in units of equal
intervals i..e., indicate order and measure order (or distance) in units of equal
intervals .
â¸RATIO :A scale that has absolute rather than relative quantities and an
absolute zero where an given attribute is present. Money and weight are good
examples of attributes and that Possess absolute zeros interval Properties.
ďżź
6
SOME KEY CONCEPTS
8. TEXT
â¸Rating: It is the term used for expressing opinion
or judgement regarding some performance of a
person ,object, mission or character
â¸According to Barr, Rating is a term applied to an
expression of opinion or judgments regarding some
situation, object or character, opinions are usually
expressed on a scale of values.
ďżź
8
DEFINITION
9. TEXT
â¸1.PROCEDURE EVALUATION:
â¸Focus on the same aspect of performance in all peoples.
â¸2. PRODUCT EVALUATION :
â¸when pupil performance result in some type of product,
it is frequently more desirable to judge the product
rather than the performance .
â¸3. EVALUATING PERSONAL SOCIAL DEVELOPMENT:
â¸Rating scale in the school is rating various aspects of
personal and social development.
ďżź
9
USES OF RATING SCALE
10. TEXT
1.Numerical rating scale
2.Graphic rating scale
3.Behaviourally anchored rating scale
4.Cumulative Point Scale
5.Forced Choice Scale
6.Comparative rating scale
7.Paired Comparison Scaling
8.Rank Order Scaling
9.Constant Sum Scaling
ďżź
10
TYPES OF RATING SCALES.
11. TEXT
â¸Divides the evaluation criteria into
fi
xed number of
points .
â¸Assigned a numerical score ranging from 1 to 10 or
even more.
â¸Observer put a tick or circle on the number to
which students possess that attribute.
â¸For example pain assessment numerical scale.
ďżź
11
1. NUMERICAL RATING SCALE
12.
13. TEXT
â¸Performance is printed
horizontally at various
points lowest to highest.
â¸Includes the numerical
points on the scale.
â¸Anchored by two extreme
points presented to
respondents.
ďżź
13
2. GRAPHIC RATING SCALE
14.
15. TEXT
â¸Uses descriptive phrases to identify the points on a
graphic scale.
â¸The description are brief details how peoples behave
at different steps along the scale .
â¸Some scales the centre and end positions are
de
fi
ned or a descriptive phrase is placed beneath
each point.
ďżź
15
3.DESCRIPTIVE RATING SCALE
17. TEXT
â¸BARS , also known as BES (Behavioural expectation
scale ) and BOS (behavioral observation scales).
â¸BARS evaluates behaviour relevant to speci
fi
c demands
of the job and provides example of speci
fi
c job
behaviour.
â¸The evaluator list a number of critical incident for
each performance dimension and rates the extent to
which the behaviour has been observed on a 5 point
scale.
ďżź
17
4. BEHAVIORALLY ANCHORED RATING SCALE
20. TEXT
â¸The cumulative scale or Guttman scale measures to
what degree a person has a positive or negative
attitude to something.
â¸The total score for an individual or object is the sum
or average of the weighed or unweighed points.
â¸âGuess -Who techniqueâ and âCheck list methodâ
belong to this category or rating
ďżź
20
5. CUMULATIVE POINT SCALE
22. TEXT
â¸The rater is given a set of verbal statements
representing different attributes of a trait and then
rater decides which statement or statements are
best suited to the individual being rated.
â¸Two alternative forms of items are commonly used.
â¸one statement of the item is favourable and other
statement is unfavourable.
ďżź
22
6. FORCED CHOICE SCALE:
23.
24. TEXT
â¸Judgement about an attribute of a person
comparing it with that of a similar and other
person.
â¸For example Mr G decision making abilities closely
resemble Mr Shyam and Mr Gopal.
ďżź
24
7. COMPARATIVE RATING SCALE:
26. TEXT
â¸Select one object in the pair according to some
criterion
â¸The data obtained are ordinal in nature.
â¸Arranged or ranked in order of magnitude.
â¸A few items are compared .
â¸If the number of comparisons is too large,
respondents may become fatigued and no longer
carefully discriminate among them.
ďżź
26
8. PAIRED COMPARISON SCALING
28. TEXT
â¸Presented with several objects simultaneously
â¸Order or rank them according to some criterion.
â¸The data obtained are ordinal in nature.
â¸Arranged or ranked in order of magnitude
â¸Measure preferences among brands and brand
attributes.
â¸Rated in a rank order from high to low on the
attitude or opinion in question.
â¸The units of the scale are unequal.
ďżź
28
9. RANK ORDER SCALING
30. TEXT
â¸Respondents are asked to allocate a constant sum
of units among a set of stimulus objects with
respect to some criterion.
⸠Units allocated represent the importance attached
to the objects .
â¸The data obtained are interval in nature.
â¸Allows for
fi
ne discrimination among alternative.
ďżź
30
10.CONSTANT SUM SCALING
32. TEXT
â¸Educationally signi
fi
cant.
â¸Directly observable
â¸Clearly de
fi
ned traits .
â¸Raters should be oriented to a speci
fi
c scale .
â¸Space in the rating scale card for the rater to give
supplementary remarks.
â¸Record judgments indicating the degree of student performance.
â¸More objective, valid and reliable by getting a pooled rating
from more than one observer.
â¸The rater should be unbiased and trained.
â¸Have expert and well informed raters.
ďżź
32
PRINCIPLES IN PREPARING RATING SCALE
33. TEXT
1. Clarity
A short and concise statement in a simple unambiguous language.
2. Relevance
Relevant to the phenomenon.
3. Variety
A variety of different statements must be ensured.
4. Objectivity
Statement formed in the rating must be objective in nature .
5.Uniqueness
The statement must be unique in itself, So that attributes can be
judged appropriately.
ďżź
33
CHARACTERISTICS OF RATING SCALE
34. TEXT
â¸Decide what area you want to measure(grooming, on-task
behaviour).
â¸For each area decide what characteristics you want to
measure( grooming, clean clothes, clean body)
â¸De
fi
ne each range for each characteristics
â¸Decide how many points on the scale
â¸State extremes-very good and very bad
â¸State points between these extremes
â¸Arrange the items to form the scale
â¸Design directions
â¸Pilot test your scale
â¸Make needed revisions, based on pilot studies.
ďżź
34
STEPS IN CONSTRUCTING A RATING SCALE
https://youtu.be/QtyVDLnHypk
35. TEXT
â¸Easy to administer and score the measured attributes.
â¸Wide range of application in nursing research/Nursing
Education
â¸Easier to make and less time consuming
â¸Easily used for a large group
â¸Used for quantitative methods
â¸Evaluating performance skills, product outcome, interest,
attitude and personal characteristics.
â¸Convenient method for recording the observer judgement.
ďżź
35
ADVANTAGES OF RATING SCALE
36.
37. TEXT
â¸Observe and record quantitative and qualitative
judgements about observed performances
â¸Adaptable and
fl
exible.
â¸Ef
fi
cient and economical in the use of time.
â¸Reduce subjectivity and unreliability that are usually
associated with observation method.
â¸Direct observation to speci
fi
c aspects of behaviour
â¸A common frame of reference for comparing all
people on the same set of characteristics
ďżź
37
ADVANTAGES OF RATING SCALE
38. TEXT
â¸Dif
fi
cult to
fi
x up rating about many aspects of an
individual.
â¸Misuse can result in a decrease in objectivity .
â¸Chances of subjective evaluation thus the scale may
become unscienti
fi
c and unreliable.
â¸Lack of uniformity with which the terms are
interpreted by evaluators.
â¸Common sources of errors in rating scales.
ďżź
38
DISADVANTAGES OF RATING SCALE
39. TEXT
1.PERSONAL BIAS
â¸A General tendency to rate all individuals at approximately the same position on
the scale.
â¸Use the high end of the scale only which is probably the most common type of
bias and is referred to and generosity error
â¸severity error in which lower end of the scale is favoured.
â¸The raters who avoids both extremes of the scale and tend to rate every one as
average is central tendency error.
2.THE HALO EFFECT
â¸General impression of a person in
fl
uences the rating of individual characteristics.
â¸Favourable attitude toward the person ,there will be a tendency to give high
ratings on all traits, but if raterâs attitude is unfavourable the ratings will be low
ďżź
39
COMMON ERRORS IN RATING
40. TEXT
3. A LOGICAL ERROR
â¸Two characteristics are rated as more alike then they actually are because
of the raterâs beliefs concerning their relationship.
4. THE CONTRAST ERROR
â¸Tendency of the rater to rate others in the direction opposite from himself
5. THE PROXIMITY ERROR
â¸The way in which the various items have been placed or ordered on the
rating form
6. LESS KNOWLEDGE FOR ADEQUATE OBSERVATION
â¸When he does not know well enough on those traits about which he has
little or no knowledge.
ďżź
40
COMMON ERRORS IN RATING
41. TEXT
FACTORS FOR IMPROVING VALIDITY OF THE RATING SCALE
â¸Encourage raters not to rate those traits or persons for
which or for whom they have insuf
fi
cient or no knowledge.
â¸Average the judgeâs ratings.
â¸Rate on traits or characteristics at a time.
â¸To reduce the halo effect, vary the direction of the scale,
that is , for some ratings, have the
fi
rst position indicate a
desirable trait, the last an undesirable trait, and vice
versa.
42. TEXT
FACTORS FOR IMPROVING VALIDITY OF THE RATING SCALE
â¸Avoid making the extreme , so atypical of behaviour
that few raters will use these points.
â¸Make the meaning of the intermediate levels closer
to the neutral or average rather than the extreme
points.
â¸The rater may be asked to quote an instance in
support of his judgement to avoid careless rating.
45. TEXT
â¸According to British Columbia Institute of Technology:
A checklist is a tool for identifying the presence or
absence of conceptual knowledge, skills, or
behaviours.
â¸A checklist itemises task descriptions in one column
and provides a space beside each item in a second
column to check off the completion of the task.
ďżź
45
DEFINITION OF CHECKLIST
46. TEXT
â¸Relate directly to learning objectives.
â¸Con
fi
ned to performance areas that can be assessed
scienti
fi
cally by examining positive and negative criteria
and when suf
fi
cient opportunity for observation exists.
â¸Ascertaining whether a particular trait or
characteristic is present or absent.
â¸Separate checklist for each candidate individual .
â¸The observer must be trained how to observe? "What
to observe? And how to record the observed behavior.
ďżź
46
SUGGESTIONS TO FOLLOW WHEN USING A CHECK LIST
47. TEXT
â¸Multiple observations provide a more accurate
assessment of performance than a single observation .
⸠Students should be evaluated in the natural setting
or one as closely as possible to the real situation.
â¸A complete check list should be given to each student
for review followed by an individual session with the
student to discuss the strength and weakness of the
performance and formulate a plan to improve the
performance.
ďżź
47
SUGGESTIONS TO FOLLOW WHEN USING A CHECK LIST
48. TEXT
â¸Observe one respondent at one time
â¸Clearly specify the characteristics of behaviour to
be observed .
â¸Use only a carefully prepared checklist to avoid
more Complex trait.
â¸Observer should be trained how to observe what to
observe and how to record the observed behaviour .
â¸Use checklist only when you are interested in
calculating a particular characteristic.
ďżź
48
CHARACTERISTICS OF CHECKLIST
49. TEXT
â¸Express each item in a clear and simple language.
â¸An intensive survey of the Literature is made to
determine the type of checklist to be used in a
particular Research/ Nursing Education
â¸Items in the checklist may be continuous or divided
into groups of related items.
â¸Items are formulated on the basis of judgement of
experts and each item is evaluated in respect of
number of favourable and unfavourable responses.
ďżź
49
POINTS TO KEEP IN MIND WHILE CONSTRUCTING A CHECK LIST
50. TEXT
â¸Avoid negative statements whenever possible .
â¸Ensure that each item has cleared responses yes or
no true or false etc.
â¸Review the items independently.
â¸Checklist must have the quality of completeness and
comprehensiveness.
ďżź
50
POINTS TO KEEP IN MIND WHILE CONSTRUCTING A CHECK LIST
51. TEXT
ďżź
51
STEPS IN DEVELOPING THE CHECKLIST
1. Identify
each of the
speci
fi
c
actions
desired in the
performance
.
2.Add to the
list those actions
that represent
common errors (if
they are useful in
the evaluation ,are
limited in number,
and can be clearly
stated) .
3. Arrange
the desired
action (and likely
errors, if used) in
the approximate
order in which
they are
expected to
occur.
4. Provide a
simple
procedure for
checking each
action as it occurs
(or for numbering
the actions in
sequence, if
appropriate).
52.
53. TEXT
â¸Review the learning outcome and associated criteria for success.
â¸State the level of success required for the checklist to be
considered completed.
â¸All items must be checked.
â¸Decide on the response such as âYesâ or âNoâ, âdoneâ or ânot
doneâ, or simply have a box to be checked once the item has
been completed.
â¸From a procedure, process, or task description list, pick those
items that are required for a good performance or
fi
nal
outcome.
ďżź
53
TECHNIQUE TO DEVELOP A CHECKLIST
54. TEXT
â¸Group similar items or order them keep as short as
possible.
â¸Highlight critical steps, checkpoints, or indicators of
success.
⸠Write clear instructions for the observer.
â¸Review the task descriptions for details and clarity
â¸Format the checklist.
â¸Ask for feedback from other instructors before using
it with the students.
ďżź
54
TECHNIQUE TO DEVELOP A CHECKLIST
55. TEXT
â¸Short and easy to access and record
â¸Evaluating speci
fi
c well-de
fi
ned behaviour and are
commonly used in the clinical simulated laboratory
setting
â¸Used for both process and procedure evaluation
â¸Adaptable to more subject matter areas
â¸Allows inter individual comparisons
â¸A simple method to record observations
ďżź
55
ADVANTAGES OF CHECKLIST
56. TEXT
â¸Adaptable to subject matter areas
â¸Evaluating learning activities
â¸Evaluating procedural work
â¸Allows the observer to contain the direct attention
â¸Objectivity to evaluate characteristics
â¸Evaluating those processes that can be subdivided
into a series of actions
â¸Decreases the chances of error in observation
ďżź
56
ADVANTAGES OF CHECKLIST
57. TEXT
â¸Does not indicate the quality of performances.
â¸Usefulness of checklist is limited to procedures,
activities, functions and speci
fi
c tasks.
â¸Limited component of overall clinical performances
can be evaluated by checklist.
â¸Degree of accuracy of performance cannot be
assessed.
â¸Limited use in qualitative research studies.
ďżź
57
DISADVANTAGES OF CHECK LIST
59. TEXT
â¸According to Harden 1988 , The OSCE is an approach
to assess the clinical competence in which the
components are assessed in a well planned or
structured way with attention being paid to the
objectivity of the examination.
ďżź
59
DEFINITION OF OSCE
60. TEXT
1. OBJECTIVE
â¸Accessed using same station with the same marking
scheme .
â¸Candidates get marks for each step on the mark
scheme that they perform correctly and which
therefore makes the assessment of clinical skills
more objective and rather subjective.
ďżź
60
OSCE IS DESIGNED AS
61. TEXT
OSCE IS DESIGNED AS
2. STRUCTURED
â¸Stations in OSCE have a very speci
fi
c task.
â¸Instructions are carefully written to ensure that the
candidate is given a very speci
fi
c task to complete.
â¸The OSCE is carefully structured to include parts
from all elements of the curriculum as well as wide
range of skills.
62. TEXT
OSCE IS DESIGNED AS
3. CLINICAL EXAMINATION
â¸Design to apply clinical and theoretical knowledge .
â¸Example answering questions from the examiner at
the end of the station.
63. TEXT
â¸Candidate see number of examiners in the course of
examination usually 8 or more.
â¸what is to be assessed at each station is agreed in
advance and marking schedule is produced ,which list,
what is expected of the candidates at each station.
â¸The aim of the examination is to produce a pro
fi
le for
each candidate rather than a single composite mark .
â¸The standard or criteria for pass ,distinction and fail
can be agreed .
ďżź
63
OBJECTIVITY OF THE EXAMINATION
64. TEXT
OBJECTIVITY OF THE EXAMINATION
â¸The Examiners can be trained for the task expected of them and
their performance can be assessed in advance on practice video Tapes.
â¸Examination test a wide range of skills which greatly reduces the
sampling error. This very signi
fi
cantly improves the reliability of the
examination
â¸All students face the same task .
â¸Simulated patients help to ensure that all students are presented with
a similar challenge.
â¸Trained examiners ,scheduling activities, using checklist, following
standardized system, uniformity in evaluations increases the reliability
of the examination
65. TEXT
â¸A series of stations in an examination room is set up to examine
the students.
â¸Students may be asked to carry out a procedure, which may
involve taking history, performing preset clinical tasks and
diagnosing patientâs problems.
â¸When performing the clinical tasks, students may often interact
with âpatientsâ, who may be healthy volunteers or mock patients.
â¸Students also have to answer questions based on their
fi
ndings
and their interpretation.
â¸Students are observed and scored at some stations by examiners
with checklists.
ďżź
65
STRUCTURE OF OBJECTIVE STRUCTURED CLINICAL EXAMINATIONS(OSCE)
66. TEXT
â¸There are two types of stations in this assessment
method:
â¸Practice-based: Students are given a written
instruction and have to carry out a procedure.
â¸Question-based: Students have to answer questions
about their
fi
ndings at the previous station and
interpret these
fi
ndings. The questions may be open-
ended or of multiple-choice type.
ďżź
66
STRUCTURE OF OBJECTIVE STRUCTURED CLINICAL EXAMINATIONS(OSCE)
67. TEXT
â¸Provide feedback of performance
â¸Used in both formative and summative assessment in
health professional education.
â¸Identify objective performance criteria for the skill
being examined.
â¸Structure the performance criteria in a checklist to
facilitate the identi
fi
cation of desired clinical skills.
â¸A requirement for accreditation in many health
professional programs.
ďżź
67
PURPOSE OF OSCE
68. TEXT
â¸Interpersonal and communication skills
â¸History taking skills
⸠Physical examination of speci
fi
c body system
⸠Mental health assessment
⸠Clinical decision-making including the formation of
different diagnosis
ďżź
68
USES OF OSCE
69. TEXT
⸠Clinical problem solving skill
⸠Interpretation of clinical
fi
ndings and investigations
⸠Management of a clinical situation including
treatment and referral
⸠Patient education
⸠Health promotion
⸠Basic and advanced nursing care procedures
ďżź
69
USES OF OSCE
70. TEXT
â¸The OSCE examination consists of about 15-20
stations, each of which requires about 4-5 minutes of
time.
â¸All stations should be capable of being completed at
the same time.
⸠The students rotate through all stations and moves
to the next station at the signal.
ďżź
70
OSCE METHODOLOGY
71. TEXT
â¸Each candidate is examined on a one to one basis
with one or two impartial examiners on each station.
â¸They are marked by the examiner on standardized
mark sheet.
â¸Using stations of 4 minutes each, 15 students can
complete examination within 1 hour.
ďżź
71
OSCE METHODOLOGY
72. TEXT
â¸1. SELECTION OF EXAMINATION COMMITTEE
â¸Determine the content of the examination
development and implementation.
â¸It has the capacity and personal to address
decisions related to reliability and validity.
â¸2.THE EXAMINATION COORDINATOR
â¸Facilitate the smooth working of the committee in
developing, implementing and assessing the
performance of the OSCE.
ďżź
72
HOW TO PREPARE OSCE
73. TEXT
HOW TO PREPARE OSCE
â¸3. LIST OF SKILLS, BEHAVIOUR AND ATTITUDES TO BE ASSESSED
â¸Measure objectively the competencies in speci
fi
c areas of behaviour,
techniques ,attitude and decision-making strategies
â¸4. HOW TO DEVELOP CASE OR SCENARIO
â¸State the skill and domain to be tested
â¸Candidate instructions must be clear and concise.
â¸Scoring checklist should be complete and include the main components
of the skills being assessed.
â¸standardisation of the patients playing the same role.
â¸Instructions for station set up, list of all equipments required for the
station.
74. TEXT
HOW TO PREPARE OSCE
â¸5.THE EXAMINEE
â¸The examinee is the student of a prescribed course.
â¸6.THE EXAMINER
â¸Most patients will require an examiner although some stations do
not.
â¸The examiner at the station where clinical skills (history-taking,
physical examination, interviewing and communication )are assessed
and may be either an Educator or a Expert.
â¸7. THE EXAMINATION SITE
â¸Part of a special teaching facility in some Institutions.
â¸The examination may be conducted in an outpatient facility.
75. TEXT
â¸8. NUMBER OF STATIONS
â¸20 stations each of
fi
ve minutes can be completed in 1 hour 40 minutes.
â¸20 stations each of 10 minutes requires 3 hours 20 minutes to complete.
â¸9. DURATION OF STATION
â¸Time ranging from 4 to 15 minutes
â¸Depends to some extent on the competencies to be assessed in the examination.
â¸10.COUPLET STATION
â¸Use of link stations extend the time available to complete a task
â¸Duration of station has been
fi
xed
â¸Make sure that are expected of the student can be accomplished within the
time
â¸Double stations will required to be duplicated in the examination
ďżź
75
HOW TO PREPARE OSCE
77. TEXT
â¸Decide the types of skills to be examined.
â¸Decide the types of assessment (such as a uniform
checklist).
â¸Consider the number of skill assessment stations needed.
â¸Allocate resources for the examination (such as space for
examination rooms, marking sheets and plastic models) .
ďżź
77
STEPS IN DEVELOPING AN OBJECTIVE STRUCTURED CLINICAL EXAMINATION:
78. TEXT
STEPS IN DEVELOPING AN OBJECTIVE STRUCTURED CLINICAL EXAMINATION:
â¸Prepare the staff resources needed examiners, timekeepers and patient/
volunteers).
⸠Determine/arrange the day/period of exams.
â¸Conduct a review/evaluation of the arrangement of the exam after it is
over
â¸To design concise marking schemes that focus on actions that distinguish
â¸To design concise marking schemes that focus on actions that distinguish
between good and poor performance
â¸To provide marking scheme instructions on what students would do at each
station for the examiner outline exactly the students.
79. TEXT
â¸REGISTRATION
⸠Show your roll number or identity card
â¸General instructions are provided regarding
examination.
â¸Inspect articles and prohibit those which are not
allowed in examination. e.g. use of mobile.
â¸Receive your exam envelop which contains your ID,
stickers, pencil, notebook or clipboard.
ďżź
79
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
80. TEXT
â¸ORIENTATION
â¸Exam format, procedures and policies will be
reviewed
â¸Introduce to your team and team leader.
â¸Instruct about starting station and how to proceed.
â¸Students can ask their queries regarding the exam.
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
81. TEXT
⸠ESCORTING TO EXAM POSITION
â¸After brie
fi
ng students are escorted to stations.
â¸Instructed about time at each station and about
time buzzer.
â¸Students will start exam as soon as long bell or
buzzer announce the start of the exam..
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
82. TEXT
⸠STATION INSTRUCTION TIME:
⸠One or two minutes to read the instruction about
the station, the situation, patient and required
task.
⸠Students read carefully and enter the room at the
next bell .
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
83. TEXT
â¸THE ENCOUNTER:
â¸Start encounter with the standardized patient.
â¸There is a 5-20 minutes encounter.
â¸Perform the required task.
â¸Stop at the next bell.
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
84. TEXT
â¸POST ENCOUNTER PERIOD:
â¸Some OSCE will have no Post encounter period.
â¸Some will have 1-2 min of the encounter period
assigned to an oral question asked by the examiner
inside the examination room.
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
85. TEXT
â¸REPEAT STEP 4 TO 6:
â¸Step 4-6 will be repeated until student have been in
all the stations.
â¸Some OSCE will offer 1 or 2 short rest period.
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
86. TEXT
â¸EXAM ENDED
⸠Exam is over.
â¸Student will be escorted back to dismissal area for
signing out.
â¸Handle back all what he has received on signing in.
â¸Asked to stay for some time for exam security reason.
ďżź
86
STEPS IN TAKING OSCE AS EXAMINATION FOR STUDENTS
90. TEXT
â¸Uniform marking scheme for examiners.
â¸Consistent examination scenarios for students.
â¸Authentic way to assess nursing students, including
pressure from patients.
â¸Generates formative feedback for both the learners
and the teaching program.
â¸Minimizes the effect of cueing.
â¸More students can be examined at any one time.
ďżź
90
ADVANTAGES OF OSCE
91. TEXT
â¸The setting is more controlled (only two variables
exist: the patient and the examiner).
â¸Objective assessment of the student's clinical
competency .
â¸Insights about studentsâ clinical and interactive
competencies.
â¸Physical examination, interpersonal skills , technical
skills, problem solving abilities, decision-making
abilities and Patient treatment skills can be assessed.
ďżź
91
ADVANTAGES OF OSCE
92. TEXT
â¸More valid than the additional approach to clinical
examinations.
â¸Advanced Clinical skills can be assessed.
â¸Reliable
â¸Can be used with a large number of student.
ďżź
92
ADVANTAGES OF OSCE
93. TEXT
â¸Studentâs knowledge and skills are tested in
compartments .
â¸Demanding for both examiners and patients
â¸Pay close attention to students repeating the same
task on a number of occasions .
â¸The time involved is greater than for the traditional
examination.
â¸Uniform dif
fi
culty level is not always possible.
ďżź
93
DISADVANTAGES OF OSCE
94. TEXT
â¸Expensive in terms of manpower, resources and time
(such as number of examiners, patients, and even the
space of examination room)
â¸Discourage students from looking at the patient as a
whole .
â¸Examine a number of different patients in isolation at
each station instead of comprehensively examining a
single patient.
â¸It requires an extensive amount of organizing.
ďżź
94
DISADVANTAGES OF OSCE
95. TEXT
â¸Training the faculty members in using OSCE.
â¸Preparation of the students from the beginning of the host
for this type of examination.
â¸Proper communication with the administrators of the clinical
areas regarding OSCE.
â¸Ensuring the reliability and validity of the evaluation criteria.
â¸Adequate planning and Organisation of the whole exercise.
â¸Feedback stations are included to provide an examiner with
immediate feedback on performance at the previous station.
ďżź
95
STRATEGIES TO OVERCOME
97. TEXT
â¸Objective structured Practical Examination is a new
pattern of Practical Examination in which component
of clinical competence is tested uniformly and
objectively for all students who are taking up a
Practical Examination at a given time and place.
ďżź
97
DEFINITION
98. TEXT
â¸Separate assessment of process and product through
observation of performance and assessment of result.
â¸Adequate sampling of skills and content of test
â¸An analytical approach to the assessment.
â¸Objectivity
â¸Feedback to teacher and student
ďżź
98
FEATURES OF OSPE
99. TEXT
â¸During this exam student pass through a number of
stations.
â¸OSPE exam ideally consists of 15-20 stations for
exam of a particular course.
ďżź
99
METHODOLOGY OF OSPE
100. TEXT
METHODOLOGY OF OSPE
â¸All the station should be completed in the same
period of time.
â¸Students are rotated through all the station and
move to the next station on the ring of the bell.
101. TEXT
METHODOLOGY OF OSPE
â¸At some stations called the procedures station
students are given tasks to perform on subjects.
â¸At other station called âresponse stationâ student
writes answer of objective type question or record
their
fi
ndings of the previous procedure station.
102. TEXT
â¸1.DEMONSTRATE PRACTICAL SKILL
â¸For demonstration of practical skills, monitoring and recording oral
temperature blood pressure converting 39.4 degree Centigrade to
Fahrenheit and testing using for sugar extra can be given
â¸2.MAKE ACCURATE OBSERVATION
â¸Differentiate between the normal and abnormal ECG ,identify the type of
arrhythmias from ECG
â¸3.ANALYSE AND INTERPRET DATA
â¸Haemogram report, liver function report, urine analysis, blood sugar report
and other laboratory reports
ďżź
102
STEPS OF OSPE
103. TEXT
â¸4. IDENTIFY THE PATIENTS PROBLEMS
â¸5. PLAN ALTERNATIVE NURSING INTERVENTIONS
â¸In case of airway obstruction the student is
expected to keep patient in side lying position and do
oropharyngeal suctioning.
ďżź
103
STEPS OF OSPE
105. TEXT
â¸Examiners A,B,C stands in a place from the student to
have a good view of what a candidate is doing in
particular station .
â¸They have a checklist and tick as they observe.
â¸The score of each student separately and con
fi
dentially
written.
⸠The questions for stations 2,4,6 are speci
fi
c, short and
worded unambiguously and printed on a separate
sheet.
â¸The key to the question should be prepared in advance
ďżź
105
PROCEDURE OF CONDUCTING OSPE
106. TEXT
â¸The students are given clear instructions regarding
how they will rotate around the stations and the time
limit in each station.
â¸At the end of the OSPE in the checklist of examiners
A, B, C pertaining to a given candidate and her answer
sheets are put together to give her a
fi
nal score.
â¸In which speci
fi
c procedure the student has made an
error and its subsequent feedback can be given to
rectify her mistake.
ďżź
106
PROCEDURE OF CONDUCTING OSPE
107. TEXT
â¸More reliable and valid than the traditional system
of examination.
â¸All students are subjected to the same standardized
test.
â¸Emphasis is shifted from testing factual knowledge
to testing of skills that to in a short time .
ďżź
107
ADVANTAGES OF OSPE
108. TEXT
ADVANTAGES OF OSPE
â¸Ensure a wide coverage of all practical skill.
â¸Increased faculty student interaction.
â¸A large number of students can be tested within a
relative short time.
109. TEXT
â¸The stimulated situation may not re
fl
ect the real life
Situation.
â¸Cannot be assessed for different skills, such as IPR,
communication skills and dexterity in handling equipments
â¸Empathy towards the patients cannot be evaluated
â¸The skill of the student in providing holistic nursing care
cannot be assessed
ďżź
109
DISADVANTAGES OF OSPE
110. TEXT
â¸Time consuming to construct an OSPE
â¸Cannot be used by a single person, it needs more
resources in terms of manpower, time and money .
â¸Risk of fatigue .
â¸Breaking clinical skills into individual competencies
may be arti
fi
cial.
DISADVANTAGES OF OSPE
111. TEXT
â¸In conventional examination marks awarded is on
candidates global performances not for individual
competencies. The OSCE is a highly reliable and valid
clinical examination that provides unique information
about the performance of residents . OSCE overcome
most of those obstacles . Combining OSCE with long
cases can assess the competency effectively .
ďżź
111
SUMMARY AND CONCLUSION
113. TEXT
â¸Enhancing Objective Structured Clinical Examinations through visualisation
of checklist scores and global rating scale
â¸CONCLUSION
â¸Improving the quality of assessor observational ratings in OSCEs is very
important and this can be achieved through visualisation of checklist scores
and global rating scale. As discussed earlier, multiple facets can engender
assessor errors and biases, e.g., halo effect, severity or kindness error,
central tendency, liking,
fi
rst impression, companionship, and hence make
studentsâ scores less decisive and unreliable. However, caution should be
taken when interpreting the potential effect of error, as a score may also
be a re
fl
ection of true performance, and not be affected by potential
error.
ďżź
113
RESEARCH ARTICLE
114. TEXT
â¸R Sudha, Nursing Education Principles and Concepts, 2nd Edition, page-181-191
â¸Francis M. Quinn, Principles and Practise of Nursing Education
â¸B. Shankaranarayanan B. Sindhu , Jaypee, Learning and Teaching Nursing,
page-199-198
â¸Mogra Allen, Evaluation of Educational Programs in Nursing
â¸J Stanley Ahman, Evaluating Pupil Growth, Edition -2
â¸Jaspreet Kaur Sodhi, Comprehensive Text Book of Nursing Education,
page-219-234
â¸Sanjay Gupta, A Text Book Nursing Education, Kumar Publishing House,
page-219-226
â¸BT Basavanthappa, Nursing Education, Jaypee, Edition-2,
ďżź
114
BIBLIOGRAPHY