Presented by Sally-Ann Clement, Teah Cummings, Avril Best, Leisha Griffith-Mark, and Wayne Radix
Vertical- Medical
In an effort to find a user friendly and cost effective solution to administering examinations St. George’s University (SGU) researched several computer based options. After careful consideration, ExamSoft was identified as the best solution for its needs as it allowed for the easy handling of all major aspects of the exam process. The decision to transition was also based on the fact that computer based examinations have become the standard format for administering exams in higher education.
The rollout of the computer based exams at SGU was phased, with an initial pilot in three School of Medicine (SOM) courses. Through our ExamSoft Pilot, the University was able to identify key resources needed as well as resolve major issues in preparation for a university wide rollout of the software. The Course Directors/Pilot Users were not only instrumental in this process but also helped boost the confidence of their peers some of whom had reservations about the transition process. After successful completion of the Pilot, the university felt confident about extending the use of ExamSoft to other schools specifically the School to Veterinary Medicine (SVM) and later the School of Arts and Science (SAS).
Exam Managers found the unique capabilities of the software such as the use of categories, reports and the availability of certain security features for example exam password, snapshot etc. to be very useful. Additionally, the availability of the highlight features as well as the question review pane provides an enhanced exam experience. The development of student policies and guidelines for Exam Managers were beneficial as they provide clear procedures for the use of ExamSoft at SGU.
This proposal will not only focus on both the successes and challenges SGU faced during the implementation of ExamSoft but will also focus on how faculty and students were engaged throughout the process.
At the end of the session, participants will be:
Equipped with guidelines for the successful implementation of ExamSoft at an educational institution.
6. 6ExamSoft Assessment Conference | #ASSESS2015
History and Schools
• School of Medicine (SOM) – 2588 Students
• School of Veterinary Medicine (SVM) – 569
Students
• School of Arts and Sciences – 661 Students
• Graduate Studies – 110 Students
7. 7ExamSoft Assessment Conference | #ASSESS2015
Project Background
Cost Reduction Reduce paper
usage
Move to computer
based exams
8. 8ExamSoft Assessment Conference | #ASSESS2015
Project Background (2)
Security and
integrity of exams
Easy Reporting Use of
Categories
9. 9ExamSoft Assessment Conference | #ASSESS2015
Project Management Approach to the Project
• Project plan and Schedule
• Working groups
• Communication to students
10. 10ExamSoft Assessment Conference | #ASSESS2015
Project Management Approach to the Project
• Policies
• Pilot
• Facility upgrades
• Hiring of more proctoring staff
11. 11ExamSoft Assessment Conference | #ASSESS2015
Project Management Approach to the Project
Executives
Champions
StudentsStaff
Faculty
Key Stakeholders
14. 14ExamSoft Assessment Conference | #ASSESS2015
Is your institution thinking of moving to
online testing?
1. 2. 3.
0% 0%0%
1. Yes
2. No
3. Already there
15. 15ExamSoft Assessment Conference | #ASSESS2015
What is your type of institution?
1. 2. 3.
0% 0%0%
1. Two year college
2. Four year
university
3. Other
16. 16ExamSoft Assessment Conference | #ASSESS2015
What is your largest class size?
1. 2. 3. 4.
0% 0%0%0%
1. < 100
2. 100-300
3. 300-500
4. > 500
17. 17ExamSoft Assessment Conference | #ASSESS2015
Implementation – Phased Approach
1
• Spring/Fall 2012
• Volunteers (SOM)
2
• Spring 2013
• All SOM, SVM Terms 1 & 2
3
• Fall 2013
• All SOM, All SVM, Optional SAS
4
• Spring 2014
• All SOM, All SVM, Select courses within
SAS
0
100
200
300
400
500
600
Avg. Class
Size
SOM
SVM
SAS
18. 18ExamSoft Assessment Conference | #ASSESS2015
Implementation - Training
• Train the trainer program
• Training of pilot users
• Training of other users
– Exam Managers, Students and Proctors
19. 19ExamSoft Assessment Conference | #ASSESS2015
Implementation – Pilot
• Long pilot
– Volunteers
– Non high stakes exams attempted first
– Allowed for necessary modifications before go-
live
– Feedback informed the process
20. 20ExamSoft Assessment Conference | #ASSESS2015
Implementation - Customization
• System Customization
• Identification of unique needs - use of university
credentials for authentication
22. 22ExamSoft Assessment Conference | #ASSESS2015
Challenges (2)
• Misrepresentation of issues
• Late adopters
• Question Bank Conversion
• Timeline for Creation of Training Materials
23. 23ExamSoft Assessment Conference | #ASSESS2015
Benefits for Faculty & Students
• Use of dynamic
images
• More efficient exam
creation process
• Scrambling feature
24. 24ExamSoft Assessment Conference | #ASSESS2015
Benefits for Faculty & Students
• Reporting
– Track students learning and performance
– Inform course redesign based on category
performance
• Immediate results
• Ease of question feedback
25. 25ExamSoft Assessment Conference | #ASSESS2015
Project Successes
• Implementation was completed:
– Under budget
– Within the allotted time period for the project.
26. 26ExamSoft Assessment Conference | #ASSESS2015
Lessons
Learned
Include
Stakeholders
Early
Structured
Project
Management
Use
Champions
Training
Support
Structure
27. 27ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• A Project Management Approach
– Keeping within the timeline
– Keeping within the budget
– Keeping stakeholders focused
– Include persons with alternative views
28. 28ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Training
– Trainers
– Admin
– Exam Managers
– Students
– Proctors
29. 29ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Administration
– Policies for providing access
– Careful scheduling of import processes
– Development of other policies
– Making connections with existing ExamSoft
clients
30. 30ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Exam Managers
– Champions – peer support / championing the
cause
– Phased pilot
– Timely creation of exams
– Use of mock exams
– Feedback from students
31. 31ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Students
– Computer with minimum requirements
– Support
• Academic Orientation
• Online Support/Documentation
• Walk-in Support
– Download exam ahead of scheduled sitting
32. 32ExamSoft Assessment Conference | #ASSESS2015
• ExamSoft Champions
2012- Helping Others
• Three faculty members
awarded for their selfless
contribution – assisting
and encouraging their
peers through the
implementation process
• Awarded an iPad mini
from ExamSoft
Highlight!
33. 33ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Implementation
Discovery Activity
• Discuss additional guidelines which resulted in
successful implementation at your institutions.
• What are some implementation challenges you
anticipate and how would you overcome them?
Report
In 1 minute or less, share the most important
discovery made during the discussion.