Downloaded 15 times
Uploaded byWinona State University
Evaluating 1 to 1 Workshop
The document discusses the evaluation of 1:1 instructional programs presented at the Illinois Computing Educators Conference in February 2016, aiming to equip participants with skills to develop and implement effective evaluation programs. It outlines the importance of program evaluation, key performance indicators, instructional planning, policies, and infrastructure, while emphasizing the need for proper data collection and analysis to measure success. Additionally, it addresses the facets of a 1:1 program, including device selection, professional development, and the impact on student learning.
More Related Content
![Meet the modern learner [infographic]](https://cdn.slidesharecdn.com/ss_thumbnails/themodernlearnerinfographicfinal-v4-120414-141216092530-conversion-gate01-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Evaluating 1 to 1 Workshop
More from Winona State University
Evaluating 1 to 1 Workshop
- 1. EVALUATING 1:1 INSTRUCTIONALPROGRAMS ADMINISTRATIVE ACADEMY #1447 PRESENTED AT ILLINOIS COMPUTING EDUCATORS (ICE) CONFERENCE, FEB. 2016 @JasonSmithCSBO @DrBaule_MCS or @Baule_S
- 2. PRESENTERS PRESENTER @jasonsmithcsbo Director of BusinessServices and Technology, Food Service Director, Treasurer, FOIA Officer, HR, Gender Equity Officer, Safety Officer, Open Meetings Act Officer, Complaint Manager
- 3. PRESENTERS PRESENTER @DrBaule_MCS Steve Baule 765-747-5205 sbaule@muncie.k12.in. us Superintendent Former ITdirector, HS principal, media specialist, teacher
- 5. OUR GOAL TODAY Helpparticipants gain the necessary skills and understanding to properly develop and implement an effective evaluation program for a 1:1 program.
- 6. Education is theonly business still debating the usefulness of technology. Schools remain unchanged for the most part, despite numerous reforms and increased investments in computers and networks. • U.S. Secretary of Education Rod Paige, quoted in National Educational Technology Plan, 2004
- 7. OVERVIEW Introductions WhyProgram Evaluation Facets of a 1:1 Program Determining Key Performance Indicators (KPI) Policy Infrastructure writ large Instructional Planning Selecting the Device(s), BYOD & Equal Access Professional Development Implementation and Revision Wrap Up
- 8. INTRODUCTIONS Please Share Name School/Organization andyour role Current 1:1 Situation Primary reason for attending today Any specific questions you have
- 9.
- 10.
- 11. Program Evaluation Plan: Whyare we doing this? Who needs to be involved? What will IT* look like? How will we measure success?
- 12. WHY PROGRAM EVALUATION? •Demonstrate program effectiveness to administration and Board of Education • Improve the implementation and effectiveness of programs • Better manage limited resources • Document program accomplishments • Justify current program funding or support the need for increased levels of funding • Demonstrate positive and negative effects of program participation • Document program development and activities to help ensure successful replication
- 13. IT Program Evaluation:Following the Correct Steps Determine project goals & objectives to be measured ~ Key Performance Indicators Determine criteria (or norms) to measure success Determine measurement period(s) Determine who will collect the data and how it will be collected Conduct an analysis of the data & present your results
- 14. WHAT TYPE(S) OFPROGRAM EVALUATION SUITS YOUR NEEDS? Type of Evaluation Best Used For Formative Evaluation Pilot programs, feasibility studies, etc. Process Evaluation Implemented as intended? Outcome Evaluation Measures effect on various aspects of the organization Impact Evaluation Does the program reach its desired goal?
- 15. From CDC Typesof Program Evaluation: http://www.cdc.gov/std/Program/pupestd/Types%20of%20Evaluation.pdf
- 16. EVALUATIVE CRITERIA SMARTGoals Key Performance Indicators Educational Success Measures Comparison Cost …. 0 1 2 3 4 5 6 Category 1 Category 2 Category 3 Category 4
- 17.
- 18. Measurement Options What willyou measure? How (What is the measurement tool)? When (Annually, Quarterly, etc.) Success will equal what? Who (Which stakeholders are involved in the goal setting and reporting?)
- 19.
- 20. FACETS OF A1:1 PROGRAM
- 21. Factors for Evaluationfrom Intel 1:1 Computing Implementation Teacher Knowledge and Skills Classroom Practice Student Outcomes Contextual Factors (Background Characteristics) From Intel in partnership with ROCKMAN ET AL, 2007.
- 22. CoSN’s Elements •Devices •Networks •Systems •IT Spending •Support •OnlineLearning From CoSN, KPI, 2014.
- 23. From CoSN, KPI,2014. CoSN’s KPIs
- 24.
- 25. POLICY ASPECTS Thisis one of the Board’s most direct roles in the process Board’s set policy and direction with guidance from the administrative team
- 26. BUILDING POLICY BoardPolicy AUP & Social Media Administrative Procedures Student Handbooks Progressive Discipline Communicating it to Parents Privacy Safety Security
- 27. Web 2.0 Acceptable Use Policy Policy Review & Guidelines First Amendment Considerations Reference: "Policy and Legal Considerations for Social Networking in Schools" By Dr. Steven M. Baule & Julie E. Lewis, ESQ Used with permission. http://bit.ly/one2onepolicy
- 28. TICE Notification once maynot be enough... Use a Captive Portal: Any device that connects to the network is prompted to review and “acknowledge” the AUP each time they connect... How do you deliver it?
- 29. SOCIAL NETWORKING POLICY What is thepurpose? Be responsible for your content Be authentic Address your audience Use good judgment Respect copyright Protect confidential information Bring value to the organization
- 30. POLICIES TO CHECK 7.20, 7.180, 7.190 (cyberbullying, electronic devices,sexting), 7.310 IASB Press Service 5.120; 5.125 6.235 (electronic resources)
- 31. GUIDELINES Do not postfinancial, confidential, sensitive, proprietary, etc… Speak respectfully…about everyone associated with the district Beware of comments about your posts... If there are unfavorable comments, etc: don't remove the post and don't reply as to escalate… Disclaimer…the views of me the employee do not reflect… Stick to the facts…accurate information Do not post obscenities, slurs, etc… i.e. reputation! Do not post about students w/o permission of ________ Is you post adding value to the district's reputation? Don't violate copyright or trademarks Think before you Post...
- 32.
- 33. FIRST AMENDMENT CONSIDERATIONS Avoid Issuesby... Don’t... Do, but disable... Do, but allow, but don’t remove... BTW, OMA...BOE!
- 34.
- 35. Time to Thinkand Plan... Check the Agenda for links to more resources... One2One Program Evaluation Form What does your current policy allow? Revisions? Social Media Acceptable Use Policy
- 36.
- 37. FACETS OF INFRASTRUCTURE ISP Connectivity Firewalls / CIPA Compliance Data Storage: SAN v. Cloud, etc. Wired Network / Electrical Capacity Wireless Network E-mail and Account Management Hardware Base Help Desk Support / Repair Support
- 38.
- 39.
- 40. BUT REMEMBER… JUST BECAUSEYOU ARE PAYING COMCAST FOR 500 MBPS DOESN'T MEAN YOU ARE GETTING 500 MBPS TO THE INTERNET… An Internal Truth Too…
- 41. Topography Internet “Pipe” WAN PRI:VoicePOTS Private “Dark”Fiber Optic Purchased “Leased” Fiber Optic Fiber Optic, Coaxial, T-1 Internet LAN Intranet
- 42. EDGE Filtering Bandwidth Management VPN Gateway A/V &Intrusion Protection NAT DMZ Firewall
- 43. WIFI Access Point Device ControllerLAN /WAN Firewall
- 44. Heat Maps IDF Determine APplacement to maximize coverage... n - up to 600 MB/s b - 11 MB/s g - 54 MB/s WiFi/AP Types 2.4 GHz Band How many connections per AP? Dual Personality AP...
- 45.
- 46.
- 47. HARDWARE BASE Don’t forgetthe need for non- 1:1devices Rotation plan Reduce the number of labs? Loaner equipment Loaner mice, keyboards, headphones?
- 48. HELP DESK ORGANIZATION Help desk process for 1:1 devices Repair staff Updates for devices Summer and breaks Metrics used to determine effectiveness
- 49. DEVICES Probably themost obvious piece of the puzzle Device policies Student handbook considerations Take home v. Stay at school Summer use Insurance and damage issues WARNING: Don’t Start Here
- 50. One sizedoesn’t necessarily fit all... Ratios and Levels Price and Features PARCC Compliance Pilots! iPad/iPod Android Chromebook Laptop Phablet
- 51.
- 52. Apple iPad,iPod, iPhone 9.x is current version
- 53. ANDROID Google Lotsof things Depends... Variants: 4.x, 3.1, 2.3, 2.2 Open Source* Android
- 54. WINDOWS DEVICES MostMainline Option Laptops Tablets
- 55. ONE TO ONE Whatever the gear...it’s about WHEN not IF Phases rather than truckloads Targeting Equal is not always fair...and vice versa Implementation
- 57. BYOD & EQUALACCESS Part of the program or not? The device, the internet; no both! Where is the equality? In the classroom? In the school? At home? Digital Divide Amongst Digital Natives http://www.ted.com/talks/nicholas_negroponte_on_one_laptop_per _child.html
- 58. Time to Thinkand Plan... Check the Agenda for links to more resources... One2One Program Evaluation Form Device(s) What is the right device for US? BYOD?
- 59. INSTRUCTIONAL PROGRAM 1:1Programs have the potential to transform the instructional process. Differentiation, Modifications and Accommodations like no other Potential to implement the ideas of the 1930s Progressives
- 60. Retrieved From: WSJ,Sept 15, 2015 http://www.wsj.com/articles/technology-in- classrooms-doesnt-always-boost-education-results-oecd-says-1442343420
- 61. FACETS OF THEINSTRUCTIONAL PROGRAM Curriculum Instructional Methods Instructional Resources: traditional, electronic, and OER Learning Management System (LMS) Assessment Tools
- 62. Potential Aspects ofInstructional Technology Programming Student Achievement Student Growth Student Engagement Student Behavior Cost Effectiveness Instructure Effectiveness Professional Development Hardware Reliability Time on Task
- 63. PROCESS CHANGE NOTA PROGRAM CHANGE
- 65. What doesthe 21st Century Classroom look like Essential tools: Web Platforms Instructional Media aka Podcasting Google Forms Communication Methods Digital Management Don’t just teach Stuff, teach Skills...
- 66. SHIFTING GEARS... http://www.youtube.com/watch?v=y0cqrhvgBB0&feature=youtube_gdata_player Getting from hereto the Global One Room Schoolhouse http://vimeo.com/49645115
- 67. Knowing Doing Memorize, Just inCase, Remember Apply, Solve, Create
- 68. Single Sourcing CrowdSourcing
- 69. High Stakes Testing HighValue Demonstration
- 70. 21ST CENTURY CLASSROOM Collaboration Critical Thinking Communication Creation Character Cosmopolitanism
- 71. HOW DO YOUMEASURE NEW INSTRUCTIONAL NEEDS Standardized tests Grades AP Scores Attendance …. 0 1 2 3 4 5 6 Category 1 Category 2 Category 3 Category 4 Series 1 Series 2 Series 3
- 72. Test Scores Attendance Rate GraduationRate Discipline Referrals
- 73. OTHER EXAMPLES OFMEASUREMENT CRITERIA Discipline Rates Homework Completion Social Media Followers …..
- 74. “Social Media is thefuture of communication, a countless array of internet based tools and platforms that increase and enhance the sharing of information...”
- 75.
- 76. Merit Badges Portfolios Rubrics Differentiation assessment PARCC MAP SchoolNet
- 77. LEARNING MANAGEMENT SYSTEMS What type of data can you gather from the system? How often do teachers post content? How often are the assessment tools used? …
- 78. PROFESSIONAL DEVELOPMENT Conducta needs assessment annually Evaluate each PD activity Determine multiple ways to train staff Application training, pedagogical methods, new content …
- 79.
- 80.
- 81.
- 82. FIDELITY OF IMPLEMENTATION Do the teachers utilize the devices each day? Do students remember to bring the devices fully charged? Are online resources used appropriately? ….
- 83. FINANCIAL IMPACT OF1:1 PROGRAMING Total Cost of Ownership per Device Reduction in Operating Costs Reduction in Instructional Supply Costs Change in GSA via Attendance ….
- 86. YOUR EVALUATION TEAM Who should be involved in the evaluation process? Internal Evaluators or External Evaluators? Administrators, Staff, Board Members, Students, Parents, Community Members? …
- 87. RESULTS OF ILLINOIS1:1 SURVEY RESULTS
- 88. PROGRAM EVALUATION TEAM NeedsAssessment 7-12 people
- 89.
- 90. APPLICATION & DISSEMINATION Please complete the following Google Doc Due March 21, 2016