Caveon Webinar Series: Six Security Challenges to Your High Stakes Test Program Jan 2014
Presented by Dennis Maynes, Chief Scientist Data Forensics and Steve Addicott, Vice President, Caveon Test Security It’s no secret, your items and tests are under attack. The problem is big, and the challenges are…well…challenging. In this informative session, Dennis Maynes and Steve Addicott explore six security challenges initially faced by the IT certification industry, but which now impact all high stakes tests in Certification/Licensure, Higher Ed, K12 Education, and I/O. These challenges include: • Proxy test taking is big business • Braindump usage continues to undermine trustworthy test results • Test theft appears to be unchecked • Technology greatly facilitates collusive test taking • Stakeholder support must be won • Many test administration models present dilemmas While the threats are severe, many test program directors choose to stand up and fight. Maynes and Addicott present both tried and tested as well as new methods to both measure and manage against these threats.
Recommended
Recommended
More Related Content
What's hot
What's hot (16)
Viewers also liked
Viewers also liked (16)
Similar to Caveon Webinar Series: Six Security Challenges to Your High Stakes Test Program Jan 2014
Similar to Caveon Webinar Series: Six Security Challenges to Your High Stakes Test Program Jan 2014 (20)
More from Caveon Test Security
More from Caveon Test Security (18)
Recently uploaded
Recently uploaded (20)
Caveon Webinar Series: Six Security Challenges to Your High Stakes Test Program Jan 2014
- 1. Caveon Webinar Series: Six Security Challenges to Your High Stakes Test Program and How Data Forensics May Help Thwart Them Steve Addicott, Vice President Dennis Maynes, Chief Scientist Caveon Test Security January 22, 2014
- 2. Upcoming Caveon Events Caveon Webinar Series: Next session, February 19 Protecting Your Tests Using U.S. Copyright Law ATP Innovations In Testing Annual Conference • March 2-5 in Scottsdale, AZ • Check out our sessions here: • http://www.caveon.com/atp-2014-innovations-in-testing-caveonsessions/ • Visit us in Booth 33 or make an appointment to talk to us about your specific test security or test development concerns.
- 4. Magnitude of the Problem • • • • • • • •
- 10. Braindump/Theft Usage Case 2012 • • • • • • • • •
- 12. Test Theft • • •
- 13. A Real-Life Example • Medical certification program • Administration to 3,500 candidates on Saturday • Anonymous email on Wednesday – “I thought you should know…” – ENTIRE ITEM BANK ATTACHED!!
- 16. Technology • • •
- 17. Technology
- 18. Technology
- 19. Technology
- 20. Technology
- 21. Technology
- 24. Stakeholder Support Can Be Won
- 26. We Believe • • •
- 27. Test Security is a Process, Not a State Protect Improve Detect Respond
- 28. Protect Against Security Breaches • • • • • • • • • • •
- 31. Data Forensics Detection Statistical Anomalies Testing Irregularities Security Violations Security Breaches Test Fraud
- 32. Type I Versus Type II Errors • • • • • •
- 34. Questions?
- 36. Thank you!
Editor's Notes
- Paper written in 2009…IT challenges lead other types of testing…challenges for the future , if not already feeling them
- Find some other, non-IT-specific proxy solicitations
- Here’s a real world example from a program BEFORE they started using Caveon. An important medical certrification program, with two administrations per year. A few years ago, about 7,500 candidates were getting ready to take the test on Saturday. They had been in school for years, studied for the exam, registered for the exam, made travel arrangements, and everything, nationwide is set to go on Saturday. However, the Wednesday before the test, the test program manager receives and anonymous email, just saying, “I thought you’want to know. Attached to the email? THE ENTIRE ITEM BANK!! I mean…
- WHAT WOULD YOU DO? Really, what…would…you…do? Cancel the exam, right? That’s what this one did…but what a nightmare! No contingency plan. No spare item banks. No Security Incident response plan. No emergency budgets. And, what about the last administrations? Who passed, but didn’t really have the requisite knowledge and skills to practice this branch of medicine?