October 16, 2013

Caveon Webinar Series:

Online proctoring: Transitioning from
Best Practices to Standards

Dr. David Fos...
A Note on Terminology
• Remote proctoring has been around for several
decades. That’s not what we need today.
• We need On...
What’s the Big Deal?
…about security for online tests?
• More and more important tests are being delivered
online.
• Testi...
It’s not just a big deal…
• …Security is the only deal!
– Security is the #1 and only important
issue for administering im...
Before we get carried away…
• Online proctoring does not solve all security
problems.
• Online proctoring needs other secu...
Nine Caveon Standards for Online Proctoring
1.
2.
3.
4.
5.

6.
7.

8.
9.

The online proctor must be able to see the works...
Caveon Standard #1
The online proctor must be able to see the workstation,
head, torso, arms and hands of the examinee.
Caveon Standard #2
The test taker, during the exam, must have no ability to use
the testing computer to access other resou...
Caveon Standard #3
The online proctor must not be able to view test content.

Yes…It’s a Higher Standard!
Caveon Standard #4
The online proctor must have the ability to communicate
with test taker (e.g., email, instant messaging...
Caveon Standard #5
The online proctor must have the ability to control the test
session (e.g., pause, un-pause, suspend, c...
Caveon Standard #6
Examinee must be clearly authenticated as the person who
should be taking the exam at exam launch and d...
Caveon Standard #7
The test session must be video recorded and stored,
particularly the security incidents. Stored records...
Caveon Standard #8
Organizations with online proctoring models must conduct
and publish research on effectiveness.

Yes…It...
Caveon Standard #9
Security provided by online proctoring must be supported
by other security procedures, such as secure i...
Organizations Looking to Create
Standards or Guidelines for Online
Proctoring
• Accrediting Organizations and Testing
Asso...
Consequences of Non-Adherence
to Standards
• There will be security holes that can and
will be exploited
– Rampant cheatin...
When it comes to test security…
• …good security is the only option!
– More threats anticipated and watched
– Professional...
Trends and Possibilities in Online
Proctoring
• Improved tools:
– Better cameras (higher resolution; greater field of
view...
Evaluating the many services is
easy…
• …compare with the Caveon standards
• …ask for the effectiveness research
Concluding Remarks
• Exciting technologies, exciting times
• Traditional proctoring is weak and needs to
be replaced or su...
The Paper…
Online Proctoring Systems Compared
David Foster, Caveon Test Security
Harry Layman, The College Board
March 13,...
HANDBOOK OF TEST SECURITY
•
•
•
•

•

Editors - James Wollack & John Fremer
Published March 2013
Preventing, Detecting, an...
Caveon Online
• Caveon Security Insights Blog
– http://www.caveon.com/blog/

• twitter
– Follow @Caveon

• LinkedIn
– “Cav...
THANK YOU!

Dr. David Foster
CEO, Caveon Test Security
David.foster@caveon.com

- Follow Caveon on twitter @caveon
- Check...
Upcoming SlideShare
Loading in …5
×

Caveon Webinar Series: Online Proctoring Best Practices Oct 2013

1,016 views

Published on

Several months ago, we presented the webinar, The Good and Bad of Online Proctoring, where we discussed which features of online proctoring enhance, and which features hinder, test security. In this session, we review the original content and add even more helpful information about online proctoring.
In this updated session, Dr. David Foster revisits the 7 best practices for online proctoring, discusses consequences of non-adherence to best practices, reviews trends in online proctoring, and discusses how to incorporate best practices to standards in your organization.
• Discuss new applications of online proctoring

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,016
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
33
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Organizations are or soon will be looking for standards for online proctoring.Ironic that there are no standards for traditional proctoring.
  • Caveon Webinar Series: Online Proctoring Best Practices Oct 2013

    1. 1. October 16, 2013 Caveon Webinar Series: Online proctoring: Transitioning from Best Practices to Standards Dr. David Foster CEO, Caveon Test Security
    2. 2. A Note on Terminology • Remote proctoring has been around for several decades. That’s not what we need today. • We need Online Proctoring, proctoring that operates using a continuous online connection.
    3. 3. What’s the Big Deal? …about security for online tests? • More and more important tests are being delivered online. • Testing locations will be increasingly non-traditional. • Important decisions are being made based on the test score. • Convenience and lower cost of online test administration are overwhelmingly attractive. • Lack of infrastructure for computerized testing in schools will move the focus of the educational community to a distributed online testing model with online proctoring. • Online proctored testing is the future.
    4. 4. It’s not just a big deal… • …Security is the only deal! – Security is the #1 and only important issue for administering important online tests. – Don’t create more security risks with poor online proctoring. – Half-way security is worse than no security at all!
    5. 5. Before we get carried away… • Online proctoring does not solve all security problems. • Online proctoring needs other security support. Here are a few examples: – – – – Test taker agreements Data forensics Web patrol Program Security Plans/Handbook
    6. 6. Nine Caveon Standards for Online Proctoring 1. 2. 3. 4. 5. 6. 7. 8. 9. The online proctor must be able to see the workstation, head, torso, arms and hands of the examinee. The test taker, during the exam, must have no ability to use the testing computer to access other resources (e.g., Internet, hard drive) and to use nontest taking functions of the operating system or browser. The online proctor must not be able to view test content. The online proctor must have the ability to communicate with test taker (e.g., email, instant messaging, phone call). The online proctor must have the ability to control the test session (e.g., pause, un-pause, suspend, cancel) Examinee must be clearly authenticated as the person who should be taking the exam. The test session must be video recorded and stored, particularly the security incidents. Stored records need to include any information relevant to the security of the test session (proctor logs, incident time stamps, conversations, etc.). Online proctoring models must conduct and publish research on effectiveness. Security provided by online proctoring must be supported by other security procedures, such as secure item and test design, test taker NDAs, data forensics, periodic audits, web monitoring, and others.
    7. 7. Caveon Standard #1 The online proctor must be able to see the workstation, head, torso, arms and hands of the examinee.
    8. 8. Caveon Standard #2 The test taker, during the exam, must have no ability to use the testing computer to access other resources (e.g., Internet, hard drive) nor to use non-test taking functions of the operating system or browser.
    9. 9. Caveon Standard #3 The online proctor must not be able to view test content. Yes…It’s a Higher Standard!
    10. 10. Caveon Standard #4 The online proctor must have the ability to communicate with test taker (e.g., email, instant messaging, phone call).
    11. 11. Caveon Standard #5 The online proctor must have the ability to control the test session (e.g., pause, un-pause, suspend, cancel).
    12. 12. Caveon Standard #6 Examinee must be clearly authenticated as the person who should be taking the exam at exam launch and during the exam.
    13. 13. Caveon Standard #7 The test session must be video recorded and stored, particularly the security incidents. Stored records need to include any information relevant to the security of the test session (proctor logs, incident time stamps, conversations, etc.).
    14. 14. Caveon Standard #8 Organizations with online proctoring models must conduct and publish research on effectiveness. Yes…It’s a Higher Standard!
    15. 15. Caveon Standard #9 Security provided by online proctoring must be supported by other security procedures, such as secure item and test design, test taker NDAs, data forensics, periodic audits, web monitoring, and others. Online Proctoring Layers of Security Web Monitoring IT Security Data Forensics Security Plan
    16. 16. Organizations Looking to Create Standards or Guidelines for Online Proctoring • Accrediting Organizations and Testing Associations – National Commission for Certifying Agencies (NCCA) – American National Standards Institute (ANSI) – Association of Test Publishers (ATP) – National Council of Measurement in Education (NCME) – International Test Commission (ITC)
    17. 17. Consequences of Non-Adherence to Standards • There will be security holes that can and will be exploited – Rampant cheating – Effective theft of test content • The solution will be worse than traditional proctoring, already a fairly low standard • It will lead to lack of test validity • It will lead to loss of program credibility
    18. 18. When it comes to test security… • …good security is the only option! – More threats anticipated and watched – Professional and unbiased decisions by proctors – Fewer actual incidents – Drastically lowered risk – Strong evidence to support actions
    19. 19. Trends and Possibilities in Online Proctoring • Improved tools: – Better cameras (higher resolution; greater field of view, less expensive) – Automated support – Improved biometric authentication, such as facial and voice recognition, keystroke analytics • More high-quality online proctoring providers • Possible additional uses – Monitor traditional proctors
    20. 20. Evaluating the many services is easy… • …compare with the Caveon standards • …ask for the effectiveness research
    21. 21. Concluding Remarks • Exciting technologies, exciting times • Traditional proctoring is weak and needs to be replaced or supplemented • Replacing it with an online proctoring model that is just as weak is not the solution • Those of you with testing programs have the power to insist on models that follow the standards
    22. 22. The Paper… Online Proctoring Systems Compared David Foster, Caveon Test Security Harry Layman, The College Board March 13, 2013 Online Proctoring Systems Compared paper can be found at http://bit.ly/proctoring
    23. 23. HANDBOOK OF TEST SECURITY • • • • • Editors - James Wollack & John Fremer Published March 2013 Preventing, Detecting, and Investigating Cheating Testing in Many Domains – Certification/Licensure – Clinical – Educational – Industrial/Organizational Don’t forget to order your copy at www.routledge.com – http://bit.ly/HandbookTS (Case Sensitive) – Save 20% - Enter discount code: HYJ82
    24. 24. Caveon Online • Caveon Security Insights Blog – http://www.caveon.com/blog/ • twitter – Follow @Caveon • LinkedIn – “Caveon Test Security” Group • We now post a “Security Tip of the Day” every Tuesday and Thursday and our “Caveon Security Minute” video every Wednesday. • Facebook – “Like” us! – You can also get the tips and videos here. www.caveon.com
    25. 25. THANK YOU! Dr. David Foster CEO, Caveon Test Security David.foster@caveon.com - Follow Caveon on twitter @caveon - Check out our blog…www.caveon.com/blog - LinkedIn Group – “Caveon Test Security”

    ×