Presented by Connie Remsberg and Danielle Birch Vertical- Pharmacy Faculty at Washington State University have implemented ExamSoft® rubrics within their lab-based courses for activities such as patient counseling, SOAP note writing, and grading of compounding lab products, simulation exercises, and informal patient case presentations. This has helped to increase collaboration by allowing multiple faculty members to take part in the grading process. Presenters will share Washington State University’s experience with rubrics including: Multiple rubrics for one assessment Multiple graders for one assessment Utilizing the detailed grader report Rubrics for essays Rubrics for simulations Rubrics for compounding lab products and recordsPresenters will end with a discussion on the challenges and successes with rubrics followed by a Q & A with participants. At the end of the session, participants will be able to: 1) Develop and use rubrics for essay grading 2) Assign multiple rubrics to one assessment 3) Assign multiple graders to specific students 4) Utilize checklist in rubric format to evaluate skills based activities 5) Identify challenges and benefits of adopting computerized rubric technology to assess skills-based assessments

1. 1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015

2. 2ExamSoft Assessment Conference | #ASSESS2015
Danielle Birch, BA
Connie Remsberg, Pharm. D., Ph.D.
Washington State University College of Pharmacy

3. 3ExamSoft Assessment Conference | #ASSESS2015
Who are We & What do We do?
Washington State University College of Pharmacy
• Danielle Birch: Program Coordinator for Assessment
• Connie Remsberg: Director, Advancement of Teaching and Learning Excellence

4. 4ExamSoft Assessment Conference | #ASSESS2015
Overview
• Rubrics for Knowledge Based Assessments
• Rubrics for Skills Based Assessments
– Patient counseling example
• Interactive rubrics lesson
• Challenges and benefits
• Questions & answer

5. 5ExamSoft Assessment Conference | #ASSESS2015
Let’s hear from you!

6. 6ExamSoft Assessment Conference | #ASSESS2015
Learning Objectives
1. Develop and use rubrics for essay grading
2. Assign multiple rubrics to one assessment
3. Assign multiple graders to specific students
4. Utilize checklist in rubric format to evaluate skills based activities
5. Identify challenges and benefits of adopting computerized rubric
technology to assess skills-based assessments

7. 7ExamSoft Assessment Conference | #ASSESS2015
Competency Based
• Competency based grading system
• Honors- Satisfactory-Fail (H-S-F)
• Block Testing
– 3 attempts allotted to reach competency
• Test
• Retest
• ELE
• Rubric Terminology
• Longitudinal Reports

8. 8ExamSoft Assessment Conference | #ASSESS2015
Appendix D/ Accreditation
• Accreditation Council for Pharmacy Education (ACPE)
• Longitudinal reporting of Appendix D
85.98%
98.83%
58.88%
90.06%
84.96% 88.65%
97.43%
85.90%
85.03%
82.14%
85.51%
91.41%
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
Group Average

9. 9ExamSoft Assessment Conference | #ASSESS2015
Interactive Rubrics Lesson
Take out your laptops!
(if you haven’t already)

10. 10ExamSoft Assessment Conference | #ASSESS2015
Login
• Google: WSU ExamSoft
• Email: eacrubric@gmail.com
• Password: harrypotter

11. 11ExamSoft Assessment Conference | #ASSESS2015
How to Build A Rubric

12. 12ExamSoft Assessment Conference | #ASSESS2015
Knowledge Based
Performance
(essays)
Skills Based
Performance
(compounding,
patient counseling)
Rubrics

13. 13ExamSoft Assessment Conference | #ASSESS2015
Rubrics
for
Knowledge Based Performance

14. 14ExamSoft Assessment Conference | #ASSESS2015
Assign a Rubric (or 2!) to an Essay
• Post the test, then add the rubric!
Learning Objective #1: Develop and use rubrics for essay grading
Learning Objective #2: Assign multiple rubrics to one assessment
Pg. 1, 11

15. 15ExamSoft Assessment Conference | #ASSESS2015
Learning Objective #1: Develop and use rubrics for essay grading

16. 16ExamSoft Assessment Conference | #ASSESS2015
Assigning Multiple Graders
p.4

17. 17ExamSoft Assessment Conference | #ASSESS2015
Assign Multiple Graders
Learning Objective #3: Assign multiple graders to specific students
Pg. 4

18. 18ExamSoft Assessment Conference | #ASSESS2015
Detailed Grader Report
Learning Objective #3: Assign multiple graders to specific students

19. 19ExamSoft Assessment Conference | #ASSESS2015
Rubrics
for
Skills Based Performance

20. 20ExamSoft Assessment Conference | #ASSESS2015
Compounding Lab
• Use of rubrics to assess the following
– Compounding products
– Compounding records
– Professionalism grades

21. 21ExamSoft Assessment Conference | #ASSESS2015
Patient Counseling Assessment
• https://tegr.it/y/1iz1u

22. 22ExamSoft Assessment Conference | #ASSESS2015

23. 23ExamSoft Assessment Conference | #ASSESS2015
Application
• Page 3 of your packet: accessing your assigned rubric
• https://www.youtube.com/watch?v=hVb_dXfK44E
Learning Objective #4:Utilize checklist in rubric format to evaluate skills based activities

24. 24ExamSoft Assessment Conference | #ASSESS2015
Review: Challenges and Benefits
Challenges
• The move from paper-based to computer-based
• Combining multiple rubrics
• Half points
• Releasing results (delay in registering in the portal)
• Cannot preview what the students will see
Benefits
• Faculty Collaboration
• Efficiency
• Much faster
• Tracking outcomes
• Evaluate grader tendencies
• Score quickly and write comments
Learning Objective #5: Identify challenges and benefits of adopting computerized rubric technology
to assess skills-based assessments

25. 25ExamSoft Assessment Conference | #ASSESS2015
Bad Example
• Ron Swanson Turkey Burger
• https://www.youtube.com/watch?v=tq2CwGgz73Q

26. 26ExamSoft Assessment Conference | #ASSESS2015
Q&A
I can’t wait to grade
more efficiently!
I loved switching from
paper to computer based
rubrics!
This is not my
best jump.
I love saving time by
assigning multiple
graders!