SlideShare a Scribd company logo
1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015
2ExamSoft Assessment Conference | #ASSESS2015
Coming Full Circle: Tips & Tricks
from Test Item Creation to
Assessment Data Retrieval
3ExamSoft Assessment Conference | #ASSESS2015
Introduction
Western University of Health Sciences – Pomona, CA
4ExamSoft Assessment Conference | #ASSESS2015
Learning Objectives
• Discuss methods of engaging faculty members
in appropriately tagging questions to Institutional
Learning Outcomes (ILOs), Program Learning
Outcomes (PLOs), & relevant topics.
• Understand the process in pulling informative
longitudinal data using the tagged categories to
derive meaningful data relevant to student
performance/progress.
• Identify strengths and weaknesses of the
curriculum.
• Identify strengths and weaknesses of student
performance.
5ExamSoft Assessment Conference | #ASSESS2015
6ExamSoft Assessment Conference | #ASSESS2015
Our Previous Process
• Word document/RTF import
• Problems with category tagging
• Technical issues with import
• Ineffective reporting
7ExamSoft Assessment Conference | #ASSESS2015
OUR CURRENT PROCESS
8ExamSoft Assessment Conference | #ASSESS2015
Landmark #1
9ExamSoft Assessment Conference | #ASSESS2015
Test Item Collection
• Question Export using Item Analysis feature
– Point Bi-Serial
– Question ID/Rev
– Upper/Lower
– Disc Index
• Creation of Question Bank
10ExamSoft Assessment Conference | #ASSESS2015
Test Item Collection
• Benefits
– User Friendly
– Quality Assurance
– Collaboration
Platform
– Organize Data
11ExamSoft Assessment Conference | #ASSESS2015
Test Item Collection
• Question Submission Form
– Purpose: To collect questions from multiple
faculty and house in one central location
– Structure:
• Question type
• Instructor
• Question text and indicate correct answer
• Attachment (any file type accepted,
allows for hi-res images)
• Lecture title
• Location of content in lecture
• Randomize answers & group questions
(Optional)
12ExamSoft Assessment Conference | #ASSESS2015
Test Item Collection
• Category Tagging
13ExamSoft Assessment Conference | #ASSESS2015
Test Item Collection
• Form interacts with
Question Bank
• Increases efficiency for
faculty & staff
• Simplified method of
tagging categories that
engages faculty members
• Ease of use promotes
faculty buy-in
• Deadline Calendar
14ExamSoft Assessment Conference | #ASSESS2015
Landmark #2
15ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Creation
• Data from the Question Submission Form is
extracted as an ExamSoft template Excel file
• Staff converts spreadsheet to .txt file for
import into ExamSoft
16ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Creation
• Staff create assessment in ExamSoft portal
• Staff export an exam draft to SharePoint
– Faculty members collaborate on
reviewing/making necessary edits and
corrections prior to final approval
17ExamSoft Assessment Conference | #ASSESS2015
Landmark #3
18ExamSoft Assessment Conference | #ASSESS2015
Generating Reports
• Pull reports & post to SharePoint for review:
– Exam Taker Results
– Item Analysis
– Summary Report
– Category Reports
TIP! Maintain a
location that
houses question
bank, exam
draft, and exam
reports for
faculty to
access.
19ExamSoft Assessment Conference | #ASSESS2015
Generating Reports
• Faculty recommend key changes
– Review item analysis/question metrics
– Improve test items in question bank
• Score reports are released via ExamSoft
• Scores uploaded to
students’ web-based
academic profile.
20ExamSoft Assessment Conference | #ASSESS2015
Landmark #4
21ExamSoft Assessment Conference | #ASSESS2015
Reporting Longitudinal Data
• Mid-Term & End-of-Term
• Pulled from ExamSoft
22ExamSoft Assessment Conference | #ASSESS2015
Reporting Longitudinal
• Uses of Data
(Faculty, Staff, & Administration):
– Academic Dean: University Strategic and
Effectiveness Report
– Course Directors/Managers: Evaluate student
performance in courses
– Curriculum Design Committee: Consider changes to
curriculum
– Advisors: Pinpoint areas of weakness for student
advisees
23ExamSoft Assessment Conference | #ASSESS2015
Conclusion
Benefits
• Streamline
• Efficiency
• Accountability
• Technical
• Reporting
• Organization
Improvements to Workflow
• Staff time
– Previous Process: 4 hours
– Current Process: 30 minutes
• More manageable
Question Bank
• Quicker turnaround time
for assessment creation
24ExamSoft Assessment Conference | #ASSESS2015
Conclusion
• Coming Full Circle
• Updating questions
• Curriculum changes
• Students track
progress from term-
to-term and
compare to class
average. Beneficial
for targeted learning.
• Lessons Learned
• Questions?
25ExamSoft Assessment Conference | #ASSESS2015
Contact Information
Jayzona Alberto, MS
Academic Manager
(1st & 3rd Year Curriculum)
jalberto@westernu.edu
Jorge Godinez, BS
Academic Manager
(2nd & 4th Year Curriculum)
jgodinez@westernu.edu

More Related Content

Viewers also liked

Targeted Grading Rubrics for Self or Peer Assessment
Targeted Grading Rubrics for Self or Peer AssessmentTargeted Grading Rubrics for Self or Peer Assessment
Targeted Grading Rubrics for Self or Peer Assessment
Amy Lenord
 
Media analysis powerpoint notes
Media   analysis powerpoint notesMedia   analysis powerpoint notes
Media analysis powerpoint notes
KellyLightfoot
 
From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...
From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...
From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...
Neil G. McPherson
 
The Value of Peer Grading Using Rubrics
The Value of Peer Grading Using RubricsThe Value of Peer Grading Using Rubrics
The Value of Peer Grading Using Rubrics
ExamSoft
 
1307578932 rubrics workshop
 1307578932 rubrics workshop 1307578932 rubrics workshop
1307578932 rubrics workshop
jessbrecheisen
 
Rubric Development
Rubric DevelopmentRubric Development
Rubric Development
lsucxc
 
8 sound
8   sound8   sound
8 sound
themassmaker
 
21 cld student work rubrics
21 cld student work rubrics21 cld student work rubrics
21 cld student work rubrics
samesu
 
Rubric Development
Rubric DevelopmentRubric Development
Rubric Development
Steven Baule
 
Project proposal rubrics
Project proposal rubricsProject proposal rubrics
Project proposal rubrics
Felix Bunagan
 
Rubrics final 1
Rubrics final 1Rubrics final 1
Rubrics final 1
Miguel Angelo Rosales
 
Providing feedback
Providing feedbackProviding feedback
Providing feedback
Walaa Abdelnaby
 
rubrics
rubricsrubrics
rubrics
Dulce Montes
 
Performance rubric initial task 3rd eso unit 0 for students
Performance rubric initial task 3rd eso unit 0 for studentsPerformance rubric initial task 3rd eso unit 0 for students
Performance rubric initial task 3rd eso unit 0 for students
Profesora de Inglés
 
Using Rubrics for Strategies 4 & 7 johns&bass
Using Rubrics for Strategies 4 & 7 johns&bassUsing Rubrics for Strategies 4 & 7 johns&bass
Using Rubrics for Strategies 4 & 7 johns&bass
Jeremy
 
Week 7 Rubrics And Rating Scales
Week 7 Rubrics And Rating ScalesWeek 7 Rubrics And Rating Scales
Week 7 Rubrics And Rating Scales
IPT652
 
Rubrics for performance assessment
Rubrics for performance assessmentRubrics for performance assessment
Rubrics for performance assessment
Elton John Embodo
 
Checklists rating scales Rubrics for Preschool
Checklists rating scales Rubrics for PreschoolChecklists rating scales Rubrics for Preschool
Checklists rating scales Rubrics for Preschool
Cleo Leuterio
 
RUBRICS - ALL GRADES
RUBRICS - ALL GRADESRUBRICS - ALL GRADES
RUBRICS - ALL GRADES
Neville Cutting
 
Rubric
RubricRubric

Viewers also liked (20)

Targeted Grading Rubrics for Self or Peer Assessment
Targeted Grading Rubrics for Self or Peer AssessmentTargeted Grading Rubrics for Self or Peer Assessment
Targeted Grading Rubrics for Self or Peer Assessment
 
Media analysis powerpoint notes
Media   analysis powerpoint notesMedia   analysis powerpoint notes
Media analysis powerpoint notes
 
From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...
From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...
From Outcomes to Outputs: Shifting the Culture of Assessment in the 21st Cent...
 
The Value of Peer Grading Using Rubrics
The Value of Peer Grading Using RubricsThe Value of Peer Grading Using Rubrics
The Value of Peer Grading Using Rubrics
 
1307578932 rubrics workshop
 1307578932 rubrics workshop 1307578932 rubrics workshop
1307578932 rubrics workshop
 
Rubric Development
Rubric DevelopmentRubric Development
Rubric Development
 
8 sound
8   sound8   sound
8 sound
 
21 cld student work rubrics
21 cld student work rubrics21 cld student work rubrics
21 cld student work rubrics
 
Rubric Development
Rubric DevelopmentRubric Development
Rubric Development
 
Project proposal rubrics
Project proposal rubricsProject proposal rubrics
Project proposal rubrics
 
Rubrics final 1
Rubrics final 1Rubrics final 1
Rubrics final 1
 
Providing feedback
Providing feedbackProviding feedback
Providing feedback
 
rubrics
rubricsrubrics
rubrics
 
Performance rubric initial task 3rd eso unit 0 for students
Performance rubric initial task 3rd eso unit 0 for studentsPerformance rubric initial task 3rd eso unit 0 for students
Performance rubric initial task 3rd eso unit 0 for students
 
Using Rubrics for Strategies 4 & 7 johns&bass
Using Rubrics for Strategies 4 & 7 johns&bassUsing Rubrics for Strategies 4 & 7 johns&bass
Using Rubrics for Strategies 4 & 7 johns&bass
 
Week 7 Rubrics And Rating Scales
Week 7 Rubrics And Rating ScalesWeek 7 Rubrics And Rating Scales
Week 7 Rubrics And Rating Scales
 
Rubrics for performance assessment
Rubrics for performance assessmentRubrics for performance assessment
Rubrics for performance assessment
 
Checklists rating scales Rubrics for Preschool
Checklists rating scales Rubrics for PreschoolChecklists rating scales Rubrics for Preschool
Checklists rating scales Rubrics for Preschool
 
RUBRICS - ALL GRADES
RUBRICS - ALL GRADESRUBRICS - ALL GRADES
RUBRICS - ALL GRADES
 
Rubric
RubricRubric
Rubric
 

Similar to Coming Full Circle: Tips and Tricks for Test Item Creation to Assessment Data Retrieval

Implementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical SettingImplementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical Setting
ExamSoft
 
ExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for SuccessExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft
 
The Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft RubricsThe Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft Rubrics
ExamSoft
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
ExamSoft
 
Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!
ExamSoft
 
Demonstrating a Streamlined and Effective Application Process
Demonstrating a Streamlined and Effective Application ProcessDemonstrating a Streamlined and Effective Application Process
Demonstrating a Streamlined and Effective Application Process
Hobsons
 
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
ACBSP Global Accreditation
 
M0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-FinalM0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-Final
Research in Action, Inc.
 
Developing a system function future state for online management of assessment
Developing a system function future state for online management of assessmentDeveloping a system function future state for online management of assessment
Developing a system function future state for online management of assessment
BlackboardEMEA
 
M0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINALM0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINAL
Research in Action, Inc.
 
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
BlackboardEMEA
 
Generating Stakeholder Buy-In to Establish a Culture of Assessment
Generating Stakeholder Buy-In to Establish a Culture of AssessmentGenerating Stakeholder Buy-In to Establish a Culture of Assessment
Generating Stakeholder Buy-In to Establish a Culture of Assessment
ExamSoft
 
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
ExamSoft
 
EmpXtrack's Performance Management System - Datasheet
EmpXtrack's Performance Management System - DatasheetEmpXtrack's Performance Management System - Datasheet
EmpXtrack's Performance Management System - Datasheet
Aishwarya Vardhan Chaturvedi
 
Susan haldiman resume
Susan haldiman resumeSusan haldiman resume
Susan haldiman resume
Susan Haldimn
 
Wendy cornett resume finance updated feb 2016
Wendy cornett resume finance updated feb 2016Wendy cornett resume finance updated feb 2016
Wendy cornett resume finance updated feb 2016
Wendy Arney-Cornett
 
Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...
Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...
Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...
ExamSoft
 
PMO and project server 2013
PMO and project server 2013PMO and project server 2013
PMO and project server 2013
Ahmad Hammoud,CPM,IBA,MSE,NLP
 
Varsha_CV_V1
Varsha_CV_V1Varsha_CV_V1
Varsha_CV_V1
Varsha Venkatraman
 
Rachana Resume To be sent
Rachana Resume To be sentRachana Resume To be sent
Rachana Resume To be sent
Rachana PMP,SSGB, SSBB,ITIL
 

Similar to Coming Full Circle: Tips and Tricks for Test Item Creation to Assessment Data Retrieval (20)

Implementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical SettingImplementing and Launching Rubrics in a Clinical Setting
Implementing and Launching Rubrics in a Clinical Setting
 
ExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for SuccessExamSoft Implementation at St. George’s University – A Recipe for Success
ExamSoft Implementation at St. George’s University – A Recipe for Success
 
The Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft RubricsThe Value of Peer Grading Using ExamSoft Rubrics
The Value of Peer Grading Using ExamSoft Rubrics
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
 
Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!Practical Innovations with Rubrics: If You Build it, They Will Grade!
Practical Innovations with Rubrics: If You Build it, They Will Grade!
 
Demonstrating a Streamlined and Effective Application Process
Demonstrating a Streamlined and Effective Application ProcessDemonstrating a Streamlined and Effective Application Process
Demonstrating a Streamlined and Effective Application Process
 
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
Standard Four: Assessment Made Incredibly Easy (Not for Dummies)
 
M0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-FinalM0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-Final
 
Developing a system function future state for online management of assessment
Developing a system function future state for online management of assessmentDeveloping a system function future state for online management of assessment
Developing a system function future state for online management of assessment
 
M0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINALM0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINAL
 
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
 
Generating Stakeholder Buy-In to Establish a Culture of Assessment
Generating Stakeholder Buy-In to Establish a Culture of AssessmentGenerating Stakeholder Buy-In to Establish a Culture of Assessment
Generating Stakeholder Buy-In to Establish a Culture of Assessment
 
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
A Guide to Curriculum and Accreditation Mapping Using Examsoft Categories and...
 
EmpXtrack's Performance Management System - Datasheet
EmpXtrack's Performance Management System - DatasheetEmpXtrack's Performance Management System - Datasheet
EmpXtrack's Performance Management System - Datasheet
 
Susan haldiman resume
Susan haldiman resumeSusan haldiman resume
Susan haldiman resume
 
Wendy cornett resume finance updated feb 2016
Wendy cornett resume finance updated feb 2016Wendy cornett resume finance updated feb 2016
Wendy cornett resume finance updated feb 2016
 
Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...
Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...
Using ExamSoft and Examination Blueprints to Guide Development of Every 3-Wee...
 
PMO and project server 2013
PMO and project server 2013PMO and project server 2013
PMO and project server 2013
 
Varsha_CV_V1
Varsha_CV_V1Varsha_CV_V1
Varsha_CV_V1
 
Rachana Resume To be sent
Rachana Resume To be sentRachana Resume To be sent
Rachana Resume To be sent
 

More from ExamSoft

More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...
ExamSoft
 
Creating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesCreating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item Types
ExamSoft
 
Psychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionPsychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into action
ExamSoft
 
Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...
ExamSoft
 
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
ExamSoft
 
Last Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterLast Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This Semester
ExamSoft
 
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
ExamSoft
 
Check, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabCheck, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation Lab
ExamSoft
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative Assessments
ExamSoft
 
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessUsing ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan Success
ExamSoft
 
Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research
ExamSoft
 
Improve your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsImprove your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing exams
ExamSoft
 
Psychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouPsychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling You
ExamSoft
 
From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...
ExamSoft
 
What's in it for me-- said the student, faculty, and curriculum
 What's in it for me-- said the student, faculty, and curriculum What's in it for me-- said the student, faculty, and curriculum
What's in it for me-- said the student, faculty, and curriculum
ExamSoft
 
"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum
ExamSoft
 
Closing the Loop on Clinical Competency Based Assessments
 Closing the Loop on Clinical Competency Based Assessments Closing the Loop on Clinical Competency Based Assessments
Closing the Loop on Clinical Competency Based Assessments
ExamSoft
 
Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities
ExamSoft
 
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
ExamSoft
 
Stop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsStop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on exams
ExamSoft
 

More from ExamSoft (20)

More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...
 
Creating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesCreating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item Types
 
Psychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionPsychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into action
 
Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...
 
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
 
Last Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterLast Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This Semester
 
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
 
Check, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabCheck, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation Lab
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative Assessments
 
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessUsing ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan Success
 
Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research
 
Improve your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsImprove your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing exams
 
Psychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouPsychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling You
 
From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...
 
What's in it for me-- said the student, faculty, and curriculum
 What's in it for me-- said the student, faculty, and curriculum What's in it for me-- said the student, faculty, and curriculum
What's in it for me-- said the student, faculty, and curriculum
 
"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum
 
Closing the Loop on Clinical Competency Based Assessments
 Closing the Loop on Clinical Competency Based Assessments Closing the Loop on Clinical Competency Based Assessments
Closing the Loop on Clinical Competency Based Assessments
 
Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities
 
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
 
Stop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsStop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on exams
 

Recently uploaded

The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
Celine George
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Dr. Vinod Kumar Kanvaria
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
Nguyen Thanh Tu Collection
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
paigestewart1632
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Akanksha trivedi rama nursing college kanpur.
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 
How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience
Wahiba Chair Training & Consulting
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
adhitya5119
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
History of Stoke Newington
 
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Diana Rendina
 
How to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP ModuleHow to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP Module
Celine George
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Excellence Foundation for South Sudan
 
How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17
Celine George
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
Jyoti Chand
 

Recently uploaded (20)

The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 
How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
 
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
 
How to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP ModuleHow to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP Module
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
 
How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
 

Coming Full Circle: Tips and Tricks for Test Item Creation to Assessment Data Retrieval

  • 1. 1ExamSoft Assessment Conference | #ASSESS2015 ExamSoft Assessment Conference #ASSESS2015
  • 2. 2ExamSoft Assessment Conference | #ASSESS2015 Coming Full Circle: Tips & Tricks from Test Item Creation to Assessment Data Retrieval
  • 3. 3ExamSoft Assessment Conference | #ASSESS2015 Introduction Western University of Health Sciences – Pomona, CA
  • 4. 4ExamSoft Assessment Conference | #ASSESS2015 Learning Objectives • Discuss methods of engaging faculty members in appropriately tagging questions to Institutional Learning Outcomes (ILOs), Program Learning Outcomes (PLOs), & relevant topics. • Understand the process in pulling informative longitudinal data using the tagged categories to derive meaningful data relevant to student performance/progress. • Identify strengths and weaknesses of the curriculum. • Identify strengths and weaknesses of student performance.
  • 6. 6ExamSoft Assessment Conference | #ASSESS2015 Our Previous Process • Word document/RTF import • Problems with category tagging • Technical issues with import • Ineffective reporting
  • 7. 7ExamSoft Assessment Conference | #ASSESS2015 OUR CURRENT PROCESS
  • 8. 8ExamSoft Assessment Conference | #ASSESS2015 Landmark #1
  • 9. 9ExamSoft Assessment Conference | #ASSESS2015 Test Item Collection • Question Export using Item Analysis feature – Point Bi-Serial – Question ID/Rev – Upper/Lower – Disc Index • Creation of Question Bank
  • 10. 10ExamSoft Assessment Conference | #ASSESS2015 Test Item Collection • Benefits – User Friendly – Quality Assurance – Collaboration Platform – Organize Data
  • 11. 11ExamSoft Assessment Conference | #ASSESS2015 Test Item Collection • Question Submission Form – Purpose: To collect questions from multiple faculty and house in one central location – Structure: • Question type • Instructor • Question text and indicate correct answer • Attachment (any file type accepted, allows for hi-res images) • Lecture title • Location of content in lecture • Randomize answers & group questions (Optional)
  • 12. 12ExamSoft Assessment Conference | #ASSESS2015 Test Item Collection • Category Tagging
  • 13. 13ExamSoft Assessment Conference | #ASSESS2015 Test Item Collection • Form interacts with Question Bank • Increases efficiency for faculty & staff • Simplified method of tagging categories that engages faculty members • Ease of use promotes faculty buy-in • Deadline Calendar
  • 14. 14ExamSoft Assessment Conference | #ASSESS2015 Landmark #2
  • 15. 15ExamSoft Assessment Conference | #ASSESS2015 ExamSoft Assessment Creation • Data from the Question Submission Form is extracted as an ExamSoft template Excel file • Staff converts spreadsheet to .txt file for import into ExamSoft
  • 16. 16ExamSoft Assessment Conference | #ASSESS2015 ExamSoft Assessment Creation • Staff create assessment in ExamSoft portal • Staff export an exam draft to SharePoint – Faculty members collaborate on reviewing/making necessary edits and corrections prior to final approval
  • 17. 17ExamSoft Assessment Conference | #ASSESS2015 Landmark #3
  • 18. 18ExamSoft Assessment Conference | #ASSESS2015 Generating Reports • Pull reports & post to SharePoint for review: – Exam Taker Results – Item Analysis – Summary Report – Category Reports TIP! Maintain a location that houses question bank, exam draft, and exam reports for faculty to access.
  • 19. 19ExamSoft Assessment Conference | #ASSESS2015 Generating Reports • Faculty recommend key changes – Review item analysis/question metrics – Improve test items in question bank • Score reports are released via ExamSoft • Scores uploaded to students’ web-based academic profile.
  • 20. 20ExamSoft Assessment Conference | #ASSESS2015 Landmark #4
  • 21. 21ExamSoft Assessment Conference | #ASSESS2015 Reporting Longitudinal Data • Mid-Term & End-of-Term • Pulled from ExamSoft
  • 22. 22ExamSoft Assessment Conference | #ASSESS2015 Reporting Longitudinal • Uses of Data (Faculty, Staff, & Administration): – Academic Dean: University Strategic and Effectiveness Report – Course Directors/Managers: Evaluate student performance in courses – Curriculum Design Committee: Consider changes to curriculum – Advisors: Pinpoint areas of weakness for student advisees
  • 23. 23ExamSoft Assessment Conference | #ASSESS2015 Conclusion Benefits • Streamline • Efficiency • Accountability • Technical • Reporting • Organization Improvements to Workflow • Staff time – Previous Process: 4 hours – Current Process: 30 minutes • More manageable Question Bank • Quicker turnaround time for assessment creation
  • 24. 24ExamSoft Assessment Conference | #ASSESS2015 Conclusion • Coming Full Circle • Updating questions • Curriculum changes • Students track progress from term- to-term and compare to class average. Beneficial for targeted learning. • Lessons Learned • Questions?
  • 25. 25ExamSoft Assessment Conference | #ASSESS2015 Contact Information Jayzona Alberto, MS Academic Manager (1st & 3rd Year Curriculum) jalberto@westernu.edu Jorge Godinez, BS Academic Manager (2nd & 4th Year Curriculum) jgodinez@westernu.edu