Published on

Tech Assessment

Published in: Business, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Assessment

    1. 1. 8 th Grade Technology Proficiency Project MORRISTOWN CENTRAL SCHOOL DISTRICT Model Schools Site Administrators Meeting St. Lawrence-Lewis BOCES Canton, NY Presented - April 25, 2007 Mike Wills, Principal Bill Van Vleet, Technology Coordinator Loren Nowak, SLL BOCES Model Schools
    2. 3. Project Rationale: <ul><li>Began as part of the technology plan update requirement for future Title IID funding </li></ul><ul><li>Technology Committee formed to address task of updating plan for compliance </li></ul><ul><li>Added components needed: </li></ul><ul><ul><li>Staff Skills Survey (we used Mankato scale tool, Brasher/SC) </li></ul></ul><ul><ul><li>Student 8 th Grade Proficiency </li></ul></ul><ul><ul><li>Title IID Cover Sheet (referencing required parts of Tech Plan) </li></ul></ul>
    3. 5. Morristown Tech Committee: <ul><li>Weekly meetings scheduled: </li></ul><ul><ul><li>About 1 – 1.5 hours each </li></ul></ul><ul><li>Stakeholder representatives: </li></ul><ul><ul><li>Superintendent, HS Principal, Elementary Supervisor, Administrative Intern (teacher), Athletic Director, Guidance Counselor, Technology Coordinator, Model Schools Tech Curriculum Coach, BOCES Computer Technician </li></ul></ul><ul><li>Morristown meeting format used </li></ul>
    4. 7. The Magic Number: <ul><li>Was always a Federal requirement under NCLB </li></ul><ul><li>New NY State reporting requirement that was introduced at BOCES Tech Planning Day </li></ul><ul><li>Will also be required for most future grant initiatives ( eligibility ) </li></ul><ul><li>Percentage of students deemed proficient needed for Fall (October) BEDS forms, aka “The Magic Number” </li></ul>
    5. 9. Getting to the Magic Number: <ul><li>What is proficient? </li></ul><ul><ul><li>Left for local district interpretation… </li></ul></ul><ul><li>How to assess students? </li></ul><ul><ul><li>Left for local district interpretation… </li></ul></ul><ul><ul><li>Homegrown objective test or commercially available? </li></ul></ul><ul><li>What level of accomplishment should students need to attain to be proficient? </li></ul><ul><ul><li>Left for local district interpretation… </li></ul></ul>
    6. 10. 8 th Grade Proficiency Test – <ul><li>Morristown District Interests: </li></ul><ul><ul><li>low to no cost </li></ul></ul><ul><ul><li>easy to administer, and replicable </li></ul></ul><ul><ul><li>provide insight on students’ application of knowledge </li></ul></ul><ul><ul><li>comply with BEDS requirement </li></ul></ul><ul><ul><li>remain eligible for future tech funding </li></ul></ul><ul><li>Three Parts </li></ul><ul><ul><li>One multiple choice, two real-world project based </li></ul></ul><ul><ul><li>Input from Tech Planning Committee </li></ul></ul>
    7. 12. Proficiency Test – Part 1 <ul><li>70 multiple choice questions developed from a bank of questions found online </li></ul><ul><li>Questions reworded for readability </li></ul><ul><li>Poor questions thrown out </li></ul><ul><li>Additional questions were added </li></ul><ul><li>Original assessment correlated to ISTE NETS </li></ul><ul><li>Questions placed in CPS database for ease of assessment </li></ul>
    8. 13. ISTE Assessment Tool <ul><li> (International Society for Technology in Education) </li></ul><ul><ul><li>< Educator Resources… <Assessment… </li></ul></ul><ul><ul><li>< NETS Online Technology Assessment… </li></ul></ul><ul><ul><li>( ) </li></ul></ul><ul><ul><li>ISTE lists a variety of fee-based assessment services </li></ul></ul><ul><ul><li>This one is FREE until June 30, 2007 (NETS scheduled for update) </li></ul></ul><ul><ul><li>VIRTUAL PC environment (window in a window) </li></ul></ul><ul><ul><li>Students perform 12 modules based on real-world tasks </li></ul></ul><ul><ul><li>Results are automatically graded </li></ul></ul><ul><ul><li>Results export to Excel format </li></ul></ul>
    9. 14. Proficiency Test – Part 2 <ul><li>Business Letter— Take assessment </li></ul><ul><li>Assesses NETS•S 1B and 3A </li></ul><ul><li>Application Skill(s) Assessed: </li></ul><ul><li>Word processing: </li></ul><ul><li>Open a document </li></ul><ul><li>Left justify text </li></ul><ul><li>Change line spacing </li></ul><ul><li>Adjust margins </li></ul><ul><li>Select text, cut and paste </li></ul><ul><li>Select text and delete </li></ul><ul><li>Enter text </li></ul><ul><li>Insert a symbol </li></ul><ul><li>Change font style and size </li></ul><ul><li>Apply font effects </li></ul><ul><li>Use spell check </li></ul><ul><li>Save a document with a different name </li></ul><ul><li>E-mail: </li></ul><ul><li>Create an e-mail message </li></ul><ul><li>Enter an e-mail address </li></ul><ul><li>Enter a subject line </li></ul><ul><li>Type a message </li></ul><ul><li>Attach a file to an e-mail </li></ul><ul><li>Send an e-mail </li></ul>
    10. 16. Proficiency Test – Part 3 <ul><li>The Planets— Take assessment </li></ul><ul><li>Assesses NETS•S 1B and 3A </li></ul><ul><li>Application Skill(s) Assessed: </li></ul><ul><li>Word processing: </li></ul><ul><li>Insert a page break. </li></ul><ul><li>Center text horizontally on a page. </li></ul><ul><li>Center text vertically on a page. </li></ul><ul><li>Indent the first line of a paragraph. </li></ul><ul><li>Add and center page numbers on all pages except the title page. </li></ul><ul><li>Use Print Preview. </li></ul><ul><li>Remove blank pages </li></ul><ul><li>Use Page Setup to change margins. </li></ul><ul><li>Convert a table to text. </li></ul><ul><li>Change bold text to plain text. </li></ul><ul><li>Indent a list. </li></ul><ul><li>Change plain text to bold text. </li></ul><ul><li>Use the spelling tool to find spelling errors. </li></ul><ul><li>Use the grammar tool to find grammar errors. </li></ul><ul><li>Explain why you made spelling and grammar changes. </li></ul><ul><li>Select font size, style and color appropriate to a topic. </li></ul><ul><li>Explain why you selected font size, style and color for a topic. </li></ul>
    11. 18. RESULTS – Part 1 68.6 45.7 Student14 68.6 45.7 Student13 65.8 42.9 Student12 64.3 41.4 Student11 62.9 40.0 Student10 62.9 40.0 Student9 62.9 40.0 Student8 62.9 40.0 Student7 58.6 35.7 Student6 55.8 32.9 Student5 55.8 32.9 Student4 54.3 31.4 Student3 45.8 22.9 Student2 44.3 21.4 Student1 22.9 pt curve Grade Name 22.9 pt curve Grade Name         10 # proficient         41.7 % passing 10 students/24 tested           100 100 77.1 Student24     90 90 67.1 Student23     90 90 67.1 Student22     82.9 82.9 60.0 Student21     82.9 82.9 60.0 Student20     78.6 78.6 55.7 Student19     78.6 78.6 55.7 Student18     75.8 75.8 52.9 Student17     75.8 75.8 52.9 Student16     72.9 72.9 50.0 Student15
    12. 19. <ul><li>Newsletter article to inform parents/guardians </li></ul><ul><li>Test questions were printed </li></ul><ul><li>Cover sheet for student name, access codes </li></ul><ul><li>CPS was used in “student managed” mode to allow slower readers more time </li></ul><ul><li>5 students missing from sample (AIS, absent) </li></ul><ul><li>Provided instruction on how to use CPS </li></ul><ul><li>Realistic expectations were explained </li></ul>Part 1 Observations/Notes:
    13. 21. RESULTS – Parts 2 + 3 <ul><li>TBA </li></ul><ul><ul><li>Part 2 was scheduled for Monday, Part 3 was scheduled for yesterday </li></ul></ul><ul><ul><li>Both postponed due to server outage </li></ul></ul><ul><li>Observations/Notes: </li></ul><ul><ul><li>Requires ActiveX plug-in installation, may need admin rights to PC, so plan a test run before assessing students </li></ul></ul><ul><ul><li>Provide a hyperlink for students to quickly “get there” </li></ul></ul><ul><ul><li>9 th grade test subjects used for “beta” testing </li></ul></ul>
    14. 22. What did we learn? <ul><li>Part 1 results: Average Score 46.31 out of 100.00 (46.31%) raw data before curve </li></ul><ul><li>Results as expected, students tested without comprehensive exposure to preparatory curriculum and integrated technology experiences </li></ul><ul><li>Many teachers offering fragmented instruction on specific topics without knowing what others offer; duplication; holes… </li></ul><ul><li>Student knowledge is high in some tech areas, with unexpected holes (question item analysis) </li></ul><ul><li>Current level of student preparation not congruent with District and Technology Mission Statements </li></ul>
    15. 24. What else…& where do we go now? <ul><li>We have good capacity with current staffing level, but it needs coordination (curriculum mapping) </li></ul><ul><li>Capacity to increase student tech knowledge would be improved with additional staffing </li></ul><ul><li>Instruction must begin early to be effective in developing skills prior to 8 th grade </li></ul><ul><li>Increased student technology proficiency not the sole responsibility of instructors of 8 th graders </li></ul><ul><li>There are benefits to each: objective vs. project-based assessment </li></ul><ul><li>To improve, we must develop curriculum and make a coordinated, well-designed, concerted effort to effectively increase student proficiency </li></ul>