4. Benefits of Blueprinting
Produce a strong foundation
Make sure that the bricks, wood and glass are in the
right place
Allows input from stakeholders
Provides detailed guidance for builders
Provides a legally defensible paper trail
1/27/2023 4
6. Assessment blueprinting #2
• Maps out the content and structure of the assessment
• The key to matching assessment to curriculum objectives
• Ensures adequate sampling across subject area and skill
domains
– The scope and relative emphasis of the assessment
– Relative emphasis – depends on the proficiency of
the topic/portion
• Is followed when the assessment is constructed
1/27/2023 6
7. Assessment blueprinting #3
Includes …
– Essential learning objectives
– Alignment to KSA
– Item types
– Weighting or degree of emphasis
– Number of score points
1/27/2023 7
8. Sample format –Exam blueprint
Essential
learning
objective
Knowledge
Skill
Attitude Item
type
%
Emphasis
Number
of items
Clinical
reasoning
skill
Clinical
skill
Obj1
Obj2
Obj3
8
9. Blueprinting – Instructor issues
• Your guideline for valid exams, Checklists and other
measures
• Start with the objectives
• Consider the BEST means of evaluation
• Sampling vs. testing all content
• Weighting the content areas
• Assigning points
1/27/2023 9
10. Blueprinting – Student issues
Sharing with students?
On the p+ side…
Students feel grounded
Organizing framework for study
Can be used for content review
On the negative side…
Can limit areas that the student chooses to study
1/27/2023 10
11. Advantage of Multiple Measures
• Advantages to both student and instructor
• Allows student to demonstrate competency using
her/his best skills
• Allows instructor to assess student along more
than one dimension
• Allows instructor to note inconsistencies in
performance
1/27/2023 11
12. Consider appropriate means of measuring competency
Male Circumcision K S A
Counseling & Group
Education
MCQ Role Play Role Play
MCQ
Preoperative & Post
operative Assessment
MCQ Role Play Role Play
MCQ
Surgical Procedure MCQ Checklist Supportive
Supervision
Record Keeping MCQ Portfolio Supportive
Supervision
12
13. Carefully consider the K, S & A components of the
competency
Male Circumcision K S A Total
Counseling & Group
Education
17%
(5)
50%
(15)
33%
(10) 30
Preoperative & Post
operative
Assessment
50%
(15)
33%
(10)
17%
(5) 30
Surgical Procedure 17%
(5)
66%
(20)
17%
(5)
30
Record Keeping 16%
(2)
60%
(6)
20%
(2)
10
Total 27 51 22 100
1/27/2023 13
14. Consider difficulty of developing MCQ items related to
competency
Male Circumcision K S A
Counseling & Group Education + +++ +++
Preoperative & Post operative
Assessment
+ +++ ++
Surgical Procedure + ++++ ++++
Record Keeping + +++ +++
+ = Least Difficult
++++ = Most Difficult
14
15. Consider the number of MCQ items needed to test
knowledge
Male Circumcision #
Items
Points
Counseling & Group Education
(18.5%)
9 18
Preoperative & Post operative
Assessment (55.5%)
28 56
Surgical Procedure(18.5%) 9 18
Record Keeping (7.4%) 4 8
Total 50 100
15
16. In aligning KSA with the
objectives we need to specify
what to asses in the three
aspects
16