2010 msp administration_proctor_training


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

2010 msp administration_proctor_training

  1. 1. Spring 2010 Administration of the Measurements of Student Progress (MSP) Grades 3-8 Proctor Training <ul><li>Assessment & Student Information </li></ul><ul><li>Jack B. Monpas-Huber, Ph.D. </li></ul><ul><li>Director </li></ul><ul><li>Dianne Murray </li></ul><ul><li>Assessment Specialist </li></ul>
  2. 2. Purpose of this Document <ul><li>To train proctors what they need to know to effectively proctor the 2010 Measurements of Student Progress (MSP) </li></ul>
  3. 3. The MSP Assessments Paper/Pencil Grade Level Paper/Pencil Tests Grades 3 and 6 MSP—Reading and Mathematics Grades 4 and 7 MSP—Reading, Writing and Mathematics Grades 5 and 8 MSP—Reading, Mathematics and Science Online Grade Level Online Tests Grades 6, 7 and 8 MSP—Reading and Mathematics
  4. 4. Security of the State Test is Paramount <ul><li>There are three fundamental dimensions to the security of state assessments. </li></ul><ul><li>First, the test booklets and accommodated forms must be maintained in a secure manner and not revealed to students or teachers prior to testing . </li></ul><ul><li>Second, the students must not be given inappropriate assistance during the time they are taking the test (e.g., visual, tactile or audible clues that lead the students to the correct answer, materials on the walls or blackboards that assist students in finding correct answers, or explanations that lead the student to the correct answers). </li></ul><ul><li>Third, the test booklets and accommodated forms have to be maintained in a secure manner before and after administration because items are reused over time . </li></ul><ul><li>Staff are not permitted to read, inspect, discuss or transmit secure test content as in items, passages or performance tasks before, during or after the assessment has been administered. Follow your district/building security plan. </li></ul>
  5. 5. Following proper assessment protocol is a matter of professional conduct in Washington <ul><li>Confidentiality </li></ul><ul><li>Generally Recognized Standards </li></ul><ul><ul><li>Ensure understanding of test protocol </li></ul></ul><ul><ul><li>Confirm the accuracy of student demographics </li></ul></ul><ul><ul><li>Watch for irregularities during testing </li></ul></ul><ul><ul><li>Document any inappropriate behavior during testing </li></ul></ul><ul><ul><li>Follow the Code of Professional Conduct </li></ul></ul><ul><ul><li>Chapter 181-87 WAC </li></ul></ul>Chapter 181-87 WAC
  6. 6. <ul><li>Teachers are expected to provide students with an opportunity to acquire the knowledge and skills that will be assessed, primarily by providing students with a rich instructional program </li></ul><ul><li>Teachers may not, under any circumstances, use secure test materials for instruction of students </li></ul><ul><li>Teachers shall maintain the confidentiality of individual students’ results </li></ul><ul><li>Teachers may help students improve test-taking skills by: </li></ul><ul><ul><li>Teaching students test-taking strategies; </li></ul></ul><ul><ul><li>Providing practice assessments that demonstrate various item formats; and </li></ul></ul><ul><ul><li>Using resource materials provided by your district and the Office of Superintendent of Public Instruction </li></ul></ul>Responsibilities of Teachers
  7. 7. Responsibilities of Proctors and Staff <ul><li>Test proctors are educational practitioners who shall : </li></ul><ul><ul><li>Attend all required training, read all associated training materials, and sign Proctor Training Log </li></ul></ul><ul><ul><li>Administer tests according to assessment manuals and OSPI updates </li></ul></ul><ul><ul><li>Ensure tests are given only to the student identified in the coding </li></ul></ul><ul><ul><li>Maintain confidentiality concerning all test content </li></ul></ul><ul><ul><li>Document and report any testing irregularities immediately </li></ul></ul><ul><ul><li>Sign and submit Test Security Assurance Forms , as required by OSPI </li></ul></ul><ul><li>Examples of Prohibited Activities : </li></ul><ul><ul><li>Reading, revealing or copying test content </li></ul></ul><ul><ul><li>Interpreting or reading test items or passages for students unless otherwise noted in the student’s IEP for this accommodation; and </li></ul></ul><ul><ul><li>Copying or reading student responses </li></ul></ul><ul><ul><li>Causing achievement to be inaccurately measured or reported </li></ul></ul>
  8. 8. Estimated Testing Times
  9. 9. Proctor Checklist - Before Testing
  10. 10. Review sample questions at the beginning of each content area in the DFA manuals Multiple-choice items have either three (Grades 3, 4 and 5) or four (Grades 6, 7 and 8) response options. For these items, students must choose the best answer and completely fill in the circle next to the answer. Any unwanted marks must be erased completely. Each item is worth one point. Short-answer items ask students to supply the answer, which may be in the form of words, phrases, sentences, numbers and/or pictures/diagrams. Each item is worth two points. Completion items ask students to supply the answer, which may be in the form of a word, phrase, short sentence and/or numeric answers on the answer line or in the box provided. Each item is worth one point. Stand-alone items on the Reading assessments are not connected with a passage. Stand-alone items on the Science assessments are not connected with a scenario. Stand-alone items ask students to choose the best answer or write a word or phrase. Each item is worth either one or two points. In Writing, students are asked to write an essay in response to two prompts. Each prompt is worth six points. MSP Item Format
  11. 11. Proctor Checklist - Before Testing
  12. 12. Calculators <ul><ul><li>NO CALCULATORS on Mathematics Grades 3-6 </li></ul></ul><ul><ul><li>Calculators OK on: </li></ul></ul><ul><ul><li>Mathematics (use optional) </li></ul></ul><ul><ul><ul><li>Grades 7 and 8 (MSP) </li></ul></ul></ul><ul><ul><li>Science </li></ul></ul><ul><ul><ul><li>Grades 5 and 8 (MSP) </li></ul></ul></ul><ul><ul><li>Students must be thoroughly familiar with the operation of the calculator they plan to use on the test. All calculators must be approved hand-held devices for mathematical computations. </li></ul></ul>
  13. 13. Providing Testing Materials <ul><ul><li>No. 2 Pencils ONLY </li></ul></ul><ul><ul><li>Pens, highlighters, markers, mechanical pencils, crayons, and pencils of 2.5, 3.0 etc., are NOT permitted; they will not be picked up by the scanners. </li></ul></ul><ul><ul><li>Students may use a No. 2 pencil to underline or circle key words in the assessment directions. </li></ul></ul><ul><li>Scratch Paper </li></ul><ul><li>For the Reading, Mathematics and Science Assessments , additional paper of any kind is not permitted. </li></ul><ul><li>For the Writing Assessment , students must be provided scratch paper for the prewriting and first drafts of each session. It is suggested that you provide at least 3 sheets of yellow lined letter-size (8 ½” x 11”) scratch paper so that it can be easily identified and removed for shredding. </li></ul><ul><li>Word Processors </li></ul><ul><li>Word processors must not be used for any portion of the assessment unless specified in an IEP or Section 504 Plan. Students may not use semantic mapping software. Any student responses generated with word processers must be transcribed verbatim into the student booklet. </li></ul>
  14. 14. Tools and Manipulatives <ul><ul><li>Mathematics (MSP) </li></ul></ul><ul><ul><li>Glossary of non-mathematics terms (Included in material shipment: one glossary for every 6 students preregistered) </li></ul></ul><ul><ul><li>Mathematics Formula Sheet </li></ul></ul><ul><ul><ul><li>(included on the inside front cover of the student test booklet for grades 6–8) </li></ul></ul></ul><ul><ul><li>Acetates—ruler, protractor (not provided in shipment-may be ordered via WAMS) </li></ul></ul><ul><ul><li>Science (MSP) </li></ul></ul><ul><ul><li>Glossary of non-science terms (Included in material shipment: one glossary for every 6 students preregistered) </li></ul></ul><ul><ul><li>Acetates—ruler, protractor (optional during the Science assessment) </li></ul></ul><ul><ul><li>Manipulatives and tools used during the assessment should be those that are familiar to students. </li></ul></ul><ul><ul><li>Mathematics Formula Sheets and Glossaries (individual student and poster versions) are available for download from the Test Administration Web site </li></ul></ul>
  15. 15. Mathematics Formula Sheets <ul><li>Mathematics Formula Sheets are included on the inside front cover of grades 6, 7 and 8 mathematics test booklets </li></ul><ul><li>Can also project these onto screen for all students </li></ul><ul><li>“ Individual Student“ and Classroom Poster” versions are available for download from the OSPI Test Administration Web site. </li></ul><ul><li>Students must be instructed not to use this page as scratch paper. </li></ul><ul><li>All individual student copies provided during the assessment must be collected and accounted for by the proctor then immediately and securely shredded </li></ul>
  16. 16. <ul><li>Goal is to assure every student has the opportunity to participate in the assessment, without providing a special advantage. </li></ul><ul><li>Refer to the Accommodations Guidelines for specific accommodations available to students receiving Special Education Services and English Language Learners </li></ul>Accommodations available to all students
  17. 17. Document Accommodations <ul><li>Mark the accommodations used Box 6 must be completed on the back cover (demographic page) of the test booklet, if applicable. </li></ul><ul><li>Mark the accommodation plan Box 7 must be completed on the back cover (demographic page) of the test booklet, if applicable. </li></ul><ul><li>Important Note: Refer to the Washington State’s Accommodations Guideline for Students with Disabilities </li></ul>When Speech Recognition software or other assistive technology is used, ensure that secure test information has been removed from all storage devices, including computers. New this year
  18. 18. Scribing <ul><li>Scribing should only be used for students who are unable to write their own responses in the test booklet . The need for a scribe must be documented on the students’ IEP or Section 504 Plan . </li></ul><ul><li>Scribing should not be used to compensate for: </li></ul><ul><ul><li>Poor handwriting </li></ul></ul><ul><ul><li>Poor spelling </li></ul></ul><ul><ul><li>Difficulty with writing organization and slow production </li></ul></ul><ul><ul><li>Student’s resistance to performing writing tasks </li></ul></ul><ul><li>Partial Scribing may be used if document in the students’ IEP or 504 Plan </li></ul><ul><li>Transcribing Student Work from a Computer </li></ul><ul><li>Scribing for student with broken arm, hand, etc. </li></ul><ul><ul><li>Individual Testing Irregularity Report must be submitted to OSPI, Assessment Operations Office </li></ul></ul>
  19. 19. Proctor Checklist - Before Testing
  20. 20. Posting Testing Locations <ul><li>Each testing location must be posted with a sign that alerts staff and administration of testing. When placing the sign, care should be taken not to obscure windows. </li></ul><ul><li>This posting assists in preventing interruptions in testing and facilitates the monitoring of testing sites by administration. </li></ul><ul><li>Data Recognition Corporation will provide one sign for every 20 students pre-registered. </li></ul>
  21. 21. Create a Proper Testing Environment <ul><li>An appropriate testing environment: </li></ul><ul><li>Includes a site that meets security and supervision requirements but is familiar and comfortable to students </li></ul><ul><li>Is scheduled so that there are not competing demands on students’ attention before, during or immediately following the assessments </li></ul><ul><li>Includes walls that do not show information that may help students answer items on the assessment. The following are samples of items permitted: </li></ul><ul><ul><ul><li>Alphabet </li></ul></ul></ul><ul><ul><ul><li>Simple number line </li></ul></ul></ul><ul><ul><ul><li>Writing Checklists </li></ul></ul></ul><ul><ul><ul><li>Glossaries for non-mathematics and non-science terms </li></ul></ul></ul><ul><ul><ul><li>Mathematics Formula Sheet </li></ul></ul></ul>
  22. 22. Proctor Checklist - During Testing
  23. 23. Communication Devices and Backpacks <ul><li>Because cell phones, iPods and other communications devices can be used to transmit information, capture images and disrupt testing, they must be turned off and kept out-of-view and out-of-reach during testing sessions </li></ul><ul><li>Use of cell phones during testing will result in an irregularity and possible invalidation </li></ul><ul><li>Backpacks, bags and purses must be kept a distance from the student so that items may not be retrieved without leaving the seat </li></ul>
  24. 24. Handling Perceived Error on a Test <ul><li>Procedure: </li></ul><ul><li>Contact the School and/or District Assessment Coordinator immediately </li></ul><ul><li>Have students complete the section of the assessment. Do not attempt to provide your own remedy. Assure the student that items found to contain errors will not be counted toward their score . </li></ul><ul><li>Security requires that the perceived problem is not copied, shared with colleagues or transmitted via e-mail. </li></ul><ul><li>The District Assessment Coordinator will contact OSPI </li></ul><ul><li>OSPI will provide an equitable remedy, if needed, for all students </li></ul>
  25. 25. <ul><li>Students must: </li></ul><ul><li>Check their own work to assure that it is complete </li></ul><ul><li>Not disrupt others when finished </li></ul><ul><li>Students must erase completely any marks they wish to change on multiple-choice items. </li></ul><ul><li>If incorrect multiple-choice marks are not completely erased, the scanners may be unable to accurately read the response. </li></ul>Important Note: The above samples are captured in the DFA and the students’ reading, mathematics and science test booklets. Incorrect Correct Set standards of quality for student testing work
  26. 26. No Media <ul><li>Media are never allowed in classrooms where there are test booklets or students are taking the test. </li></ul>
  27. 27. Handling Irregularities <ul><li>Examples of irregularities </li></ul><ul><li>Reproduction or review of secure test materials before, during or after the test administration </li></ul><ul><li>Improper test preparation </li></ul><ul><li>Unforeseen interruption in test administration </li></ul><ul><li>Improper test proctoring including: </li></ul><ul><li>Providing non-allowed accommodations </li></ul><ul><li>Permitting breaks during testing outside the parameters listed in the DFA </li></ul><ul><li>Providing student access to tools or materials not allowed for that test </li></ul><ul><li>Coaching, departing from prescribed script in DFA manual or attempting to artificially inflate the test scores of students </li></ul><ul><li>Reviewing student work in the test booklets </li></ul><ul><li>Not providing students the accommodations listed on their IEP, Section 504 Plan or ELL accommodations </li></ul>
  28. 28. Handling Irregularities <ul><li>Proctors should document any testing/security irregularity in administration in: </li></ul><ul><li>“ Notes: Proctor/Coordinator Use” box on student booklet </li></ul><ul><li>Individual Irregularity Report </li></ul><ul><li>Report all irregularities to School MSP Coordinator </li></ul>
  29. 29. Unprofessional Conduct <ul><li>Acts of unprofessional conduct that may result in invalid scores include, but are not limited to: </li></ul><ul><li>Improper test preparation activities </li></ul><ul><li>Improper test administration / proctoring </li></ul><ul><li>Providing access to tools or materials not allowed on that test </li></ul><ul><li>Reproduction / retention of test content </li></ul><ul><li>Student misconduct (cheating) </li></ul>
  30. 30. Student Signature (Required) Notes Box: Use to annotate, scribes, irregular administration, etc. Test Book Security Barcode Printed Here Design of the 2010 Test Booklet Proctors sign student booklet here ATTENTION: Apply barcode label here if document is to be scored
  31. 31. <ul><ul><li>The Reading, Mathematics and Science Assessments are to be given in one session. The Writing Assessments are to be given in two sessions. </li></ul></ul><ul><ul><li>Reading, Mathematics and Science test booklets must be collected after the completion of the testing day and returned to your school assessment coordinator according to your test security plan. </li></ul></ul><ul><ul><li>Writing test booklets must be collected after the completion of session one and stored in a secure, locked, limited access area. Return to your school assessment coordinator at completion of session two according to your test security plan. </li></ul></ul>Distributing and Collecting Booklets
  32. 32. <ul><li>If a test booklet is incomplete, defective or damaged, the proctor should follow the steps below: </li></ul><ul><li>Obtain a new test booklet from your School Assessment Coordinator </li></ul><ul><li>Verify the student’s name and State Student ID (SSID) are bubbled on the back cover (demographic page) of the replacement booklet </li></ul><ul><li>Document the testing irregularity in the “Notes: Proctor/Coordinator Use” box on the front cover of the student booklet </li></ul><ul><li>Tell the student to continue with the replacement copy, beginning after the last question answered in the defective booklet </li></ul><ul><li>Band both the replacement and damaged/incomplete booklets together prior to returning to School Assessment Coordinator. </li></ul>Handling Defective or Damaged Booklets
  33. 33. Proper Monitoring of Student Test-taking <ul><li>Proctors and monitors must observe students to ensure they are engaged with the assessment and working independently. </li></ul><ul><li>Monitor students and watch for the following: </li></ul><ul><li>Be sure students are working on the correct session of the Writing Assessment; </li></ul><ul><li>Be sure students are following the directions given at the beginning of the session (you may reread the directions to the student, if needed); </li></ul><ul><li>Be sure students are using only authorized tools, No. 2 pencils, etc.; </li></ul><ul><li>Watch for use of cell phones or other electronic devices </li></ul><ul><li>You may not : </li></ul><ul><li>Point out to students an incorrectly answered question </li></ul><ul><li>Point out questions that have not been completed, or read and comment on student essays </li></ul><ul><li>Paraphrase questions or read the items to the students </li></ul>
  34. 34. Proctor Checklist - Following Testing