Unproctored Testing


Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Unproctored Testing

  1. 1. Unproctored Testing Jasmin Loi, HR Services Manager Erik Collier, Human Resources Analyst
  2. 2. County of Riverside <ul><li>The County of Riverside: </li></ul><ul><li>Beyond Your Expectations </li></ul><ul><li>Over 20,000 employees </li></ul><ul><li>Over 4,000 Hires in 2006 </li></ul><ul><li>Over 2,000 Clerical Positions in 2006 </li></ul><ul><li>We are the largest employer in the area. </li></ul>Since 2001, the County of Riverside’s labor force has increased by more than 19% (California Employment Development Department , 2006) 7,300 square miles 26% population growth since 2000 Population over 2 million
  3. 3. Applicant Testing
  4. 4. <ul><li>The Human Resources Assessment Center provides professional and secure test administration and scoring services to all County departments. </li></ul>Assessment Center <ul><li>Functions of the Assessment Center: </li></ul><ul><ul><li>Administering and scoring exams </li></ul></ul><ul><ul><li>Developing and writing new test </li></ul></ul><ul><ul><li>items </li></ul></ul><ul><ul><li>Conducting statistical analyses </li></ul></ul><ul><ul><li>Manage candidate score </li></ul></ul><ul><ul><li>database </li></ul></ul><ul><ul><li>Consulting with departments </li></ul></ul><ul><ul><li>regarding employment testing issues </li></ul></ul>
  5. 5. <ul><li>User friendly applications </li></ul><ul><li>Technical support available by vendor </li></ul><ul><li>Immediate test results </li></ul><ul><li>Eliminated expense notifying candidates of test results </li></ul><ul><li>Testing on continuous basis ensures on-going pool of qualified candidates </li></ul><ul><li>Different types of score report available based on need, basic scores or in-depth narrative reports </li></ul><ul><li>Ability to view, print, or download a file version of the completed test report </li></ul><ul><li>Ability to take testing to candidates - Y Carts or Unproctored Assessments </li></ul><ul><li>Ability to build custom assessments </li></ul>Web-Based Testing
  6. 6. <ul><li>Department of Social Services (DPSS) Eligibility Technician Trainee (ET) Assessment Battery of six tests was reviewed by HR Analysts </li></ul><ul><li>Employee test scores were correlated with performance evaluation scores of quality and quantity of work </li></ul><ul><li>Only 2 of the tests were correlated with actual performance scores </li></ul><ul><li>Old assessment battery was reduced from a 2.5 hour, six-test battery, to a 45 minute, three-test battery with greater criterion validity </li></ul>Test Validation: Example
  7. 7. Unproctored Internet Testing
  8. 8. <ul><li>Potential Risks </li></ul><ul><li>Cheating </li></ul><ul><li>Tester identity verification </li></ul><ul><li>Test content exposure </li></ul><ul><li>Unstandardized testing environments </li></ul><ul><li>End-user technical issues </li></ul>Unproctored Testing <ul><li>Potential Benefits </li></ul><ul><li>Reach larger and more diverse applicant pool </li></ul><ul><li>Reduced travel cost for candidates </li></ul><ul><li>Reduced staffing cost for Assessment Center </li></ul><ul><li>Reduced recruitment time/cost </li></ul><ul><li>“ Cutting Edge” Image </li></ul>
  9. 9. Mitigating the Risks <ul><li>Computerized Adaptive Testing (CAT) </li></ul><ul><li>Required resume submission </li></ul><ul><li>Use of applicant identifiers </li></ul><ul><li>Traffic and tracking are monitored by internal servers </li></ul><ul><li>Test vendor has built in security measures </li></ul><ul><li>Used as 1 st hurdle only </li></ul><ul><li>All job offers are contingent upon test score verification </li></ul><ul><li>Proctored testing an option </li></ul>Unproctored Testing Solution
  10. 10. <ul><li>Verifying test scores – did the same person that took the unproctored assessment take the proctored one? </li></ul><ul><ul><li>We utilize the Standard Error of Measurement (SEM) for our assessments at a 95% confidence interval. </li></ul></ul><ul><ul><ul><li>SEM = S x √1-r xx </li></ul></ul></ul><ul><ul><ul><li>SEM factors in scale </li></ul></ul></ul><ul><ul><ul><li>reliability estimates with </li></ul></ul></ul><ul><ul><ul><li>sample standard deviation </li></ul></ul></ul>Unproctored Testing Solution
  11. 11. Application and Invitation One-Day Hiring Event Process All candidates Are retained in our database for regular recruitments One-Day Hiring Event
  12. 12. Applicant Submission Message
  13. 13. Applicant Re-Test Rejection Message
  14. 14. Test Event Email Language <ul><li>Dear John Smith, Thank you for your interest and application for employment with the County of Riverside. You have opted to take your pre-employment assessment online. Please read the following instructions carefully and then proceed to your online test session by clicking the link at the bottom. </li></ul><ul><li>INSTRUCTIONS FOR ONLINE ASSESSMENT: BEFORE YOU BEGIN * Make sure you are in a quiet room with no distractions. * Turn off all internet browser and third-party pop-up blockers. Having pop-up blockers enabled will prevent you from testing successfully. To check if pop-up blockers are disabled click here, http://www.rc-hr.com/QuizLink/popupCheck.htm . If you see the pop-up message, you have successfully disabled pop-ups. </li></ul>
  15. 15. <ul><li>ONCE YOU BEGIN * Click yes on all authorization messages. * You may be asked to install active-X controls by a yellow bar appearing at the top of your browser window. Please right-click on this bar and click to install the active-X control. You may install the active-X controls ahead of time by going to < http://support.select2perform.com/105621 > and following the online instructions. * When you begin the assessment session, record your session ID number on the first screen. If you get disconnected from your test session, you may use this session ID number you log back in at < http:// www.brainbench.com > and begin where you left off. AFTER YOU HAVE COMPLETED YOUR ASSESSMENTS * Upon completion, your assessment scores will be forwarded to Human Resources with your resume. * The County utilizes competitive scoring to determine top candidates for selection. If you are amongst the most competitive, you will receive a call from Human Resources. * Your test scores will be valid for six months and your resume will be kept on file for one year. * Once you've tested, you may not retest for this position for six months. </li></ul>
  16. 16. <ul><li>CHEATING POLICY: Cheating is strictly prohibited. You must complete all tests alone and without assistance. You may not use calculators, study aids, additional software, or any other tool to boost performance. You are allowed scratch paper to write notes or make hand calculations for math. During your test session, all keystrokes will be recorded and reviewed with your scores. You may not exit the testing environment during the assessment. All test scores and performance will be subject to verification by re-testing in a proctored environment on an alternate form of the test. Any discovered or suspected cheating will result in immediate disqualification from employment. SYSTEM REQUIREMENTS FOR ONLINE ASSESSMENT: Operating System: Microsoft Windows 98 or above Connection Speed: Dial-up (56.6 kb/s) Internet Browser: Internet Explorer 6.0 and up ONLY, Mozilla Firefox will not work! Hardware: PC speakers or a headset connected to the computer </li></ul>
  17. 17. <ul><li>READY TO BEGIN? If you have read and complied with all instructions, you may click the link below to begin. http://www.rc-hr.com/QuizLink/quizLink.aspx/Smith_19695 ***** If the above link does not work, please cut and paste the following URL into your browsers address field. ***** http://www.rc-hr.com/QuizLink/quizLink.aspx/Smith_19695 Please note: The above link is only accessible for the next 48 hours and can only be used once. Good Luck! </li></ul>
  18. 18. Invited, eager candidates line up
  19. 19. Orientation and department education
  20. 20. Tested and qualified candidates interview
  21. 21. <ul><li>Unproctored Testing </li></ul><ul><li>(for those candidates that pass the unproctored testing) </li></ul><ul><li>One-day Hiring Event </li></ul><ul><ul><li>Experience Verified </li></ul></ul><ul><ul><li>Proctored Exam </li></ul></ul><ul><ul><li>Interview of Top Candidates </li></ul></ul><ul><ul><li>Conditional offers extended </li></ul></ul>Back-end Recruitment Paperwork 0 Days 1 Day 1 Day _______ _______ County Time Expended 2 Days Total! Expedited Selection Model
  22. 22. <ul><li>Assessment Outcomes </li></ul><ul><ul><li>Over 70% more candidates tested each month </li></ul></ul><ul><ul><li>Candidate pool is now refreshed monthly </li></ul></ul><ul><ul><li>More candidates who are currently employed are testing at home (passive job-seekers) </li></ul></ul><ul><ul><li>Candidates have reported reduced </li></ul></ul><ul><ul><li>performance anxiety in unproctored testing </li></ul></ul><ul><li>One-Day Hire Event Outcomes </li></ul><ul><ul><li>25 of the 37 (68%) total vacancies were filled in one day. </li></ul></ul><ul><ul><li>4 of the 10 participating departments filled 100% of their clerical openings. </li></ul></ul><ul><ul><li>Candidates that were offered positions initiated background checks and scheduled their physicals same-day. </li></ul></ul>Measurable Outcomes
  23. 23. Cheating? Or something else…
  24. 24. <ul><li>Unproctored testing can be an effective candidate pipeline and initial hurdle </li></ul><ul><li>Process and test content security is a crucial consideration </li></ul><ul><li>Identity and test score verification must be built into your processes </li></ul><ul><li>Unproctored testing utilized in conjunction with a One-Day Hiring Event can drive results </li></ul><ul><li>Internal and external customers are serviced efficiently and effectively </li></ul>Our Experience
  25. 25. Questions for the Panel? Jasmin Loi Erik Collier 951-955-1627 951-955-8878 [email_address] ecollier@rc-hr.com
  26. 26. THANK YOU!