Caveon Webinar Series - Five Things You Can Do Now to Protect Your Assessment Programs - January 2018

Five Things You Can Do
Right Now
To Protect Your Assessment
Programs
January 17, 2018

Steve Addicott
Vice President, Caveon
© 2017, Caveon, LLC. All rights reserved. Do not copy or distribute without permission. 2
Today’s Presenter

Webinar Objectives
Participants will review best practices for:
• Analyzing test security threats and risks
• Reviewing local test security policies
• Conducting site monitoring and
• Managing test incidents

Why should we be concerned?
4
Security
* Attributed to Dr. Phil Dickison, National Council of State Boards of Nursing
© 2017, Caveon, LLC. All rights reserved. Do not copy or distribute without permission.

7© 2017, Caveon, LLC. All rights reserved. Do not copy or distribute without permission.
“As a result, schools too often have taken shortcuts to better
numbers. They’ve taught to the test, and in some cases
have engaged in outright cheating.”

Let’s get clear on:
•Vulnerabilities, vs.
•Threats, vs.
•Risks

Threat/Risk Analysis
THEFT THREATS
• Memorizing questions to
be recalled later
• Manipulation of test
administration rules
• Stealing test booklets or
files
• Stealing questions by
recording or photography
• Obtaining content from a
program insider
CHEATING THREATS
• Using pre-knowledge of
content
• Colluding with an expert
during test-taking
• Copying answers from
another test taker
• Using unauthorized test
aids
• Manipulation of test
administration rules

Analyze YOUR Threats and Risks
https://www.caveon.com/risk-assessment/

Five Things You Can Do Now
1. Review policies and procedures.
2. Enhance training.
3. Plan for monitoring.
4. Review your incident response plan.
5. Be ready to investigate.

1. Review policies
and procedures.

What should I review?
•Test Security Plan
•Roles and responsibilities
•Standard forms and agreements
•Test administration procedures
•Physical and information security
•Security Incident Response Plan

2. Enhance training
and materials.

How Can We Enhance Training?
•Emphasize topics based on previous incidents.
•Refresh content or style to renew interest.
•Implement additional training sessions or
attendees.
•Review training
documentation.

3. Plan for
monitoring test
administrations.

Why Monitor?
•Support the validity of assessment results.
•Provide quality assurance for your testing
program.
• Gather information
• Measure compliance
• Identify areas for improvement
•Comply with state and federal requirements.

Tips for Monitoring
•Identify schools for monitoring (announced or
unannounced).
•Look at all parts of the testing day.
•Look at all assessments (ELL, alternate, etc.).
•Focus on process and people.
•Use an objective checklist or form.
•Decide how to use results.

4. Review your
Security Incident
Response Plan
(SIRP).

Managing Incidents
•Collect test irregularity information from various
sources.
‒Proctors, tip lines, educators
‒On-site monitoring
‒Internet monitoring
‒Data forensics or other statistical analyses

SIRP…what is it?
Outlines standard operating procedures for
various test security incidents, including:
‒Roles and responsibilities
‒“Six Honest Serving Men”
‒Escalation process
‒Sanctions and penalties
‒Appeals
‒Communications Plan
‒ Internal & external stakeholders
‒ Media

Evaluating Incidents
One student
More than one student
Entire classroom
More then one classroom
More than one grade level
One grade level
Entire school
More than one school
Entire District
What is the potential
impact to validity?

Test Security Incident Investigations
•Determine whether an
investigation is necessary.
•Define the objectives.
•Plan and carry out investigations
following a standardized process.
•Communicate the results per district
and state policy.

Test Security Incident Investigations
•Follow standardized process in accordance
with SIRP.
•Identify available evidence.
•Gather and preserve evidence.
•Analyze evidence.
•Report findings in
accordance with state and
district policies and
procedures.

Communication
•Communicate results in accordance with state
and district policies.
•Take action if supported by context.
• Revise policies and procedures.
• Re-train staff.
• Take individual action, if appropriate.

Caveon Resources
•Policies and Procedures Review
•On-Site Monitoring & Training
•School District Test Security Incident
Investigation Training and Protocols

THANK YOU!!
Steve Addicott
Steve.Addicott@caveon.com
www.caveon.com

Caveon Webinar Series - Five Things You Can Do Now to Protect Your Assessment Programs - January 2018

Recommended

Recommended

More Related Content

What's hot

What's hot (13)

Similar to Caveon Webinar Series - Five Things You Can Do Now to Protect Your Assessment Programs - January 2018

Similar to Caveon Webinar Series - Five Things You Can Do Now to Protect Your Assessment Programs - January 2018 (20)

More from Caveon Test Security

More from Caveon Test Security (20)

Recently uploaded

Recently uploaded (20)

Caveon Webinar Series - Five Things You Can Do Now to Protect Your Assessment Programs - January 2018

Editor's Notes