SlideShare a Scribd company logo
1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015
2ExamSoft Assessment Conference | #ASSESS2015
Jason Yamaki, Pharm.D., Ph.D.
Assistant Director of Assessment
Assistant Professor – Infectious Disease
Department of Pharmacy Practice
Chapman University, School of Pharmacy
California. USA
Siu Fun Wong, Pharm.D., FASHP, FCSHP
Associate Dean of Assessment and Scholarship
Professor – Oncology
Department of Pharmacy Practice
3ExamSoft Assessment Conference | #ASSESS2015
Objectives
Participants will be able:
1. To develop a personalized exam blueprint (Integrated
vs Traditional)
2. Design an ExamSoft category system to align with the
exam blueprint
3. Create, maintain and optimize the use of the an
ExamSoft examination question bank
4ExamSoft Assessment Conference | #ASSESS2015
Chapman University School of Pharmacy
(CUSP)
– 3-year accelerated program
(T1-T6 didactic with introductory experiential, T7&8 experiential)
– Inaugural class 9/2015
– 60 students
– “Flipped Classroom” andragogy
– Curriculum course mappings include cognitive level
dimensions (1Foundational – 4Mastery)
– Integrated examinations via ExamSoft
Introduction
5ExamSoft Assessment Conference | #ASSESS2015
Integrated Examinations
• Every 3-week summative assessment
• Total of 5 integrated exams during each of the six trimesters
• Integrated examinations cover content materials from all
courses offered in the trimester
• Integrated exam #5 is cumulative
• Prepares students for the Pharmacy Board exams, less stress,
streamlined exam scheduling
• Questions submitted by faculty to ExamSoft
• OAS creates assessments according to Exam Blueprint
6ExamSoft Assessment Conference | #ASSESS2015
Examination Blueprint
• Important for:
– Breadth, depth, and content
– Guidance for composition of questions to match
lesson objectives at the intended cognitive levels
(1F – 4M)
• Challenges and Considerations
– Appropriate allocations of questions for each
course
– Time issue with higher cognitive level questions
– Point distributions
– Allotted length of exams vs examinee fatigue
7ExamSoft Assessment Conference | #ASSESS2015
Exam Blueprint Development
^ Depends on course classification (didactic = 4Qs/CH, skills = 2Qs/CH, hybrid = 3Qs/CH)
*
* 15 weeks
^
8ExamSoft Assessment Conference | #ASSESS2015
T1 anticipated mostly 1F
Foundational – Remembering, Understanding
Intermediate – Applying (examining, connecting)
Advanced – Complex analyzing (comparing, organizing); evaluating
Mastery - Creating
Exam Blueprint Development
9ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Categories
• Seven categories created in Examsoft
• Categories are created to align with
- Curriculum mapping parameters
- Exam Blueprint parameters
• Each assessment question is coded to all 7
categories by faculty
10ExamSoft Assessment Conference | #ASSESS2015
11ExamSoft Assessment Conference | #ASSESS2015
12ExamSoft Assessment Conference | #ASSESS2015
• Tagging/coding = easier assessment of exam
questions’ content and cognitive level distribution
• Guide for assessment/examination development
to comply with Exam Blueprint
ExamSoft Categories
Question Bank Development
14ExamSoft Assessment Conference | #ASSESS2015
Thank You!
Open for further discussion

More Related Content

What's hot

Grading and reporting of results
Grading and reporting of resultsGrading and reporting of results
Grading and reporting of results
International advisers
 
Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...
Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...
Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...MedCouncilCan
 
Effective course evaluation
Effective course evaluationEffective course evaluation
Effective course evaluation
surveyresults
 
Class session 3
Class session 3Class session 3
Class session 3tjcarter
 
Norm or criterion referenced grading
Norm or criterion referenced gradingNorm or criterion referenced grading
Norm or criterion referenced gradingArmilyn Nadora
 
Developing assessment instruments
Developing assessment instrumentsDeveloping assessment instruments
Developing assessment instruments
Raheen26
 
Chap 15
Chap 15Chap 15
Chap 15
Umme Rubab
 
Achievement test powerpoint97 2003
Achievement test powerpoint97 2003Achievement test powerpoint97 2003
Achievement test powerpoint97 2003
SwathiE6
 
Administering & scoring tabe 9 10
Administering & scoring tabe 9 10Administering & scoring tabe 9 10
Administering & scoring tabe 9 10SABES
 
Types of Grading and Reporting System
Types of Grading and Reporting System Types of Grading and Reporting System
Types of Grading and Reporting System
Cyra Mae Soreda
 
Assignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logsAssignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logstwrobleski
 
Professional growth plan
Professional growth planProfessional growth plan
Professional growth planJill Maynard
 
Examining the exam
Examining the examExamining the exam
Examining the exam
DonnaOti
 
Grading and Reporting
Grading and ReportingGrading and Reporting
Grading and Reporting
Mary Jane Hugo
 
Achievement test
Achievement testAchievement test
Achievement test
Sumi Surendran S
 
Comparison of criterion referenced and norm referenced assessment
Comparison of criterion referenced and norm  referenced assessmentComparison of criterion referenced and norm  referenced assessment
Comparison of criterion referenced and norm referenced assessment
Dr. Amjad Ali Arain
 
Dep ed order do-s2016_55
Dep ed order   do-s2016_55Dep ed order   do-s2016_55
Dep ed order do-s2016_55
jhaymz02
 
Formative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without referencesFormative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without references
pbingham1
 

What's hot (20)

Grading and reporting of results
Grading and reporting of resultsGrading and reporting of results
Grading and reporting of results
 
Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...
Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...
Blueprinting and Choosing Appropriate Tools for Assessment of Student Perform...
 
Module 9
Module 9Module 9
Module 9
 
Effective course evaluation
Effective course evaluationEffective course evaluation
Effective course evaluation
 
Class session 3
Class session 3Class session 3
Class session 3
 
Norm or criterion referenced grading
Norm or criterion referenced gradingNorm or criterion referenced grading
Norm or criterion referenced grading
 
Developing assessment instruments
Developing assessment instrumentsDeveloping assessment instruments
Developing assessment instruments
 
Chap 15
Chap 15Chap 15
Chap 15
 
EEX 501 Assessment
EEX 501 AssessmentEEX 501 Assessment
EEX 501 Assessment
 
Achievement test powerpoint97 2003
Achievement test powerpoint97 2003Achievement test powerpoint97 2003
Achievement test powerpoint97 2003
 
Administering & scoring tabe 9 10
Administering & scoring tabe 9 10Administering & scoring tabe 9 10
Administering & scoring tabe 9 10
 
Types of Grading and Reporting System
Types of Grading and Reporting System Types of Grading and Reporting System
Types of Grading and Reporting System
 
Assignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logsAssignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logs
 
Professional growth plan
Professional growth planProfessional growth plan
Professional growth plan
 
Examining the exam
Examining the examExamining the exam
Examining the exam
 
Grading and Reporting
Grading and ReportingGrading and Reporting
Grading and Reporting
 
Achievement test
Achievement testAchievement test
Achievement test
 
Comparison of criterion referenced and norm referenced assessment
Comparison of criterion referenced and norm  referenced assessmentComparison of criterion referenced and norm  referenced assessment
Comparison of criterion referenced and norm referenced assessment
 
Dep ed order do-s2016_55
Dep ed order   do-s2016_55Dep ed order   do-s2016_55
Dep ed order do-s2016_55
 
Formative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without referencesFormative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without references
 

Similar to Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Week Integrated Computerized Examination Question Pool

A Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based TestingA Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based Testing
ExamSoft
 
Implementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical SettingImplementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical Setting
ExamSoft
 
Test Blueprinting and Exam Revision
Test Blueprinting and Exam Revision Test Blueprinting and Exam Revision
Test Blueprinting and Exam Revision
reckenstein
 
Building Testing Committees that have the Authority to Create Effective Change
Building Testing Committees that have the Authority to Create Effective ChangeBuilding Testing Committees that have the Authority to Create Effective Change
Building Testing Committees that have the Authority to Create Effective Change
ExamSoft
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
ASMZahidKausar
 
The Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft RubricsThe Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft Rubrics
ExamSoft
 
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
ACBSP Global Accreditation
 
Instructional design plan
Instructional design planInstructional design plan
Instructional design planpalmerdm
 
Using Nursing Exam Data Effectively in Preparing Nursing Accreditation
Using Nursing Exam Data Effectively in Preparing Nursing AccreditationUsing Nursing Exam Data Effectively in Preparing Nursing Accreditation
Using Nursing Exam Data Effectively in Preparing Nursing Accreditation
ExamSoft
 
ExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for SuccessExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft
 
NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018
CHC Connecticut
 
lesson-5-230418074306-42cb5f85.pptx
lesson-5-230418074306-42cb5f85.pptxlesson-5-230418074306-42cb5f85.pptx
lesson-5-230418074306-42cb5f85.pptx
GalangRoxanne
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
ExamSoft
 
Restructuring a Capstone Course Based on Longitudinal Assessment of Module Exams
Restructuring a Capstone Course Based on Longitudinal Assessment of Module ExamsRestructuring a Capstone Course Based on Longitudinal Assessment of Module Exams
Restructuring a Capstone Course Based on Longitudinal Assessment of Module Exams
ExamSoft
 
Assessing the Impact of Peer Instructor Generated Formative Self-Assessments
Assessing the Impact of Peer Instructor Generated Formative Self-AssessmentsAssessing the Impact of Peer Instructor Generated Formative Self-Assessments
Assessing the Impact of Peer Instructor Generated Formative Self-Assessments
ExamSoft
 
Building Institutional Research Capacity in a K-12 Unified District
Building Institutional Research Capacity in a K-12 Unified DistrictBuilding Institutional Research Capacity in a K-12 Unified District
Building Institutional Research Capacity in a K-12 Unified District
Christopher Kolar
 
Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!
ExamSoft
 
Workshop-Self-Assessment-Process-Oriental-Learning.ppt
Workshop-Self-Assessment-Process-Oriental-Learning.pptWorkshop-Self-Assessment-Process-Oriental-Learning.ppt
Workshop-Self-Assessment-Process-Oriental-Learning.ppt
sadafshahbaz7777
 
The NAF Student Certification Assessment System: Benefits for Students and Te...
The NAF Student Certification Assessment System: Benefits for Students and Te...The NAF Student Certification Assessment System: Benefits for Students and Te...
The NAF Student Certification Assessment System: Benefits for Students and Te...
NAFCareerAcads
 
The NAF Student Certification Assessment System: Benefit for Students and Tea...
The NAF Student Certification Assessment System: Benefit for Students and Tea...The NAF Student Certification Assessment System: Benefit for Students and Tea...
The NAF Student Certification Assessment System: Benefit for Students and Tea...
NAFCareerAcads
 

Similar to Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Week Integrated Computerized Examination Question Pool (20)

A Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based TestingA Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based Testing
 
Implementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical SettingImplementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical Setting
 
Test Blueprinting and Exam Revision
Test Blueprinting and Exam Revision Test Blueprinting and Exam Revision
Test Blueprinting and Exam Revision
 
Building Testing Committees that have the Authority to Create Effective Change
Building Testing Committees that have the Authority to Create Effective ChangeBuilding Testing Committees that have the Authority to Create Effective Change
Building Testing Committees that have the Authority to Create Effective Change
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
 
The Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft RubricsThe Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft Rubrics
 
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
 
Instructional design plan
Instructional design planInstructional design plan
Instructional design plan
 
Using Nursing Exam Data Effectively in Preparing Nursing Accreditation
Using Nursing Exam Data Effectively in Preparing Nursing AccreditationUsing Nursing Exam Data Effectively in Preparing Nursing Accreditation
Using Nursing Exam Data Effectively in Preparing Nursing Accreditation
 
ExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for SuccessExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for Success
 
NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018NCA PGR Session 7 May 02 2018
NCA PGR Session 7 May 02 2018
 
lesson-5-230418074306-42cb5f85.pptx
lesson-5-230418074306-42cb5f85.pptxlesson-5-230418074306-42cb5f85.pptx
lesson-5-230418074306-42cb5f85.pptx
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
 
Restructuring a Capstone Course Based on Longitudinal Assessment of Module Exams
Restructuring a Capstone Course Based on Longitudinal Assessment of Module ExamsRestructuring a Capstone Course Based on Longitudinal Assessment of Module Exams
Restructuring a Capstone Course Based on Longitudinal Assessment of Module Exams
 
Assessing the Impact of Peer Instructor Generated Formative Self-Assessments
Assessing the Impact of Peer Instructor Generated Formative Self-AssessmentsAssessing the Impact of Peer Instructor Generated Formative Self-Assessments
Assessing the Impact of Peer Instructor Generated Formative Self-Assessments
 
Building Institutional Research Capacity in a K-12 Unified District
Building Institutional Research Capacity in a K-12 Unified DistrictBuilding Institutional Research Capacity in a K-12 Unified District
Building Institutional Research Capacity in a K-12 Unified District
 
Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!
 
Workshop-Self-Assessment-Process-Oriental-Learning.ppt
Workshop-Self-Assessment-Process-Oriental-Learning.pptWorkshop-Self-Assessment-Process-Oriental-Learning.ppt
Workshop-Self-Assessment-Process-Oriental-Learning.ppt
 
The NAF Student Certification Assessment System: Benefits for Students and Te...
The NAF Student Certification Assessment System: Benefits for Students and Te...The NAF Student Certification Assessment System: Benefits for Students and Te...
The NAF Student Certification Assessment System: Benefits for Students and Te...
 
The NAF Student Certification Assessment System: Benefit for Students and Tea...
The NAF Student Certification Assessment System: Benefit for Students and Tea...The NAF Student Certification Assessment System: Benefit for Students and Tea...
The NAF Student Certification Assessment System: Benefit for Students and Tea...
 

More from ExamSoft

More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...
ExamSoft
 
Creating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesCreating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item Types
ExamSoft
 
Psychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionPsychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into action
ExamSoft
 
Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...
ExamSoft
 
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
ExamSoft
 
Last Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterLast Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This Semester
ExamSoft
 
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
ExamSoft
 
Check, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabCheck, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation Lab
ExamSoft
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative Assessments
ExamSoft
 
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessUsing ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan Success
ExamSoft
 
Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research
ExamSoft
 
Improve your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsImprove your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing exams
ExamSoft
 
Psychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouPsychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling You
ExamSoft
 
From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...
ExamSoft
 
What's in it for me-- said the student, faculty, and curriculum
 What's in it for me-- said the student, faculty, and curriculum What's in it for me-- said the student, faculty, and curriculum
What's in it for me-- said the student, faculty, and curriculum
ExamSoft
 
"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum
ExamSoft
 
Closing the Loop on Clinical Competency Based Assessments
 Closing the Loop on Clinical Competency Based Assessments Closing the Loop on Clinical Competency Based Assessments
Closing the Loop on Clinical Competency Based Assessments
ExamSoft
 
Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities
ExamSoft
 
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
ExamSoft
 
Stop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsStop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on exams
ExamSoft
 

More from ExamSoft (20)

More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...
 
Creating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesCreating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item Types
 
Psychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionPsychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into action
 
Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...
 
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
 
Last Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterLast Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This Semester
 
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
 
Check, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabCheck, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation Lab
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative Assessments
 
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessUsing ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan Success
 
Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research
 
Improve your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsImprove your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing exams
 
Psychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouPsychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling You
 
From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...
 
What's in it for me-- said the student, faculty, and curriculum
 What's in it for me-- said the student, faculty, and curriculum What's in it for me-- said the student, faculty, and curriculum
What's in it for me-- said the student, faculty, and curriculum
 
"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum
 
Closing the Loop on Clinical Competency Based Assessments
 Closing the Loop on Clinical Competency Based Assessments Closing the Loop on Clinical Competency Based Assessments
Closing the Loop on Clinical Competency Based Assessments
 
Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities
 
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
 
Stop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsStop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on exams
 

Recently uploaded

Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
DhatriParmar
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
heathfieldcps1
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
EduSkills OECD
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Acetabularia Information For Class 9 .docx
Acetabularia Information For Class 9  .docxAcetabularia Information For Class 9  .docx
Acetabularia Information For Class 9 .docx
vaibhavrinwa19
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 

Recently uploaded (20)

Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Acetabularia Information For Class 9 .docx
Acetabularia Information For Class 9  .docxAcetabularia Information For Class 9  .docx
Acetabularia Information For Class 9 .docx
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 

Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Week Integrated Computerized Examination Question Pool

  • 1. 1ExamSoft Assessment Conference | #ASSESS2015 ExamSoft Assessment Conference #ASSESS2015
  • 2. 2ExamSoft Assessment Conference | #ASSESS2015 Jason Yamaki, Pharm.D., Ph.D. Assistant Director of Assessment Assistant Professor – Infectious Disease Department of Pharmacy Practice Chapman University, School of Pharmacy California. USA Siu Fun Wong, Pharm.D., FASHP, FCSHP Associate Dean of Assessment and Scholarship Professor – Oncology Department of Pharmacy Practice
  • 3. 3ExamSoft Assessment Conference | #ASSESS2015 Objectives Participants will be able: 1. To develop a personalized exam blueprint (Integrated vs Traditional) 2. Design an ExamSoft category system to align with the exam blueprint 3. Create, maintain and optimize the use of the an ExamSoft examination question bank
  • 4. 4ExamSoft Assessment Conference | #ASSESS2015 Chapman University School of Pharmacy (CUSP) – 3-year accelerated program (T1-T6 didactic with introductory experiential, T7&8 experiential) – Inaugural class 9/2015 – 60 students – “Flipped Classroom” andragogy – Curriculum course mappings include cognitive level dimensions (1Foundational – 4Mastery) – Integrated examinations via ExamSoft Introduction
  • 5. 5ExamSoft Assessment Conference | #ASSESS2015 Integrated Examinations • Every 3-week summative assessment • Total of 5 integrated exams during each of the six trimesters • Integrated examinations cover content materials from all courses offered in the trimester • Integrated exam #5 is cumulative • Prepares students for the Pharmacy Board exams, less stress, streamlined exam scheduling • Questions submitted by faculty to ExamSoft • OAS creates assessments according to Exam Blueprint
  • 6. 6ExamSoft Assessment Conference | #ASSESS2015 Examination Blueprint • Important for: – Breadth, depth, and content – Guidance for composition of questions to match lesson objectives at the intended cognitive levels (1F – 4M) • Challenges and Considerations – Appropriate allocations of questions for each course – Time issue with higher cognitive level questions – Point distributions – Allotted length of exams vs examinee fatigue
  • 7. 7ExamSoft Assessment Conference | #ASSESS2015 Exam Blueprint Development ^ Depends on course classification (didactic = 4Qs/CH, skills = 2Qs/CH, hybrid = 3Qs/CH) * * 15 weeks ^
  • 8. 8ExamSoft Assessment Conference | #ASSESS2015 T1 anticipated mostly 1F Foundational – Remembering, Understanding Intermediate – Applying (examining, connecting) Advanced – Complex analyzing (comparing, organizing); evaluating Mastery - Creating Exam Blueprint Development
  • 9. 9ExamSoft Assessment Conference | #ASSESS2015 ExamSoft Categories • Seven categories created in Examsoft • Categories are created to align with - Curriculum mapping parameters - Exam Blueprint parameters • Each assessment question is coded to all 7 categories by faculty
  • 12. 12ExamSoft Assessment Conference | #ASSESS2015 • Tagging/coding = easier assessment of exam questions’ content and cognitive level distribution • Guide for assessment/examination development to comply with Exam Blueprint ExamSoft Categories
  • 14. 14ExamSoft Assessment Conference | #ASSESS2015 Thank You! Open for further discussion

Editor's Notes

  1. ADD SCHOOL
  2. 12, 18, 18, 18, 18, 34 2.2, 4.5, 4.5, 4.5, 4.5
  3. Where are the objectives?  exam question review. Need to know SLO and appendix I are covered.