Approaches to Evaluating
Supplemental Online
Learning Programs
•
•
•

Robin Winder, Director of Student Learning, Florida ...
Webinar Focus
• Evaluation of Supplemental Online
Programs
– Information can apply to full time programs as
well as blende...
Michigan Virtual School
www.mivhs.org
About Michigan Virtual School
Fast Facts
• Created in 2000 by Public Act 230
• Supplemental Program
• Mainly High School, ...
Program Evaluation
•
•
•
•
•

Accreditation
Perceptual Data
Reporting Results
Internal Monitoring
External Assistance
Accreditation
Perceptual Data

Available from: http://media.mivu.org/institute/pdf/stusurvey.pdf
Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
Internal Monitoring
Internal Monitoring
Internal Monitoring
Internal Monitoring
Figure 8. School Names for Drops (Min. 5 Drops)
Internal Monitoring
Vendor Comparison Report
External Assistance

Available from: http://www.sri.com/sites/default/files/publications/supporting-k-12-students-online-l...
Florida Virtual School
www.flvs.net
Florida Virtual School
Part –time, Full- time, Global School

Talk about milestones! As we completed our 15th year, we
hav...
Fully Accredited
• North Central Association Commission on
Accreditation and School Improvement
• North West Accreditation...
The Florida Virtual School Approach
STUDENT DRIVEN
Depth of Knowledge
The effectiveness of my virtual program is ____
A. Highly Effective
B. Effective
C. Below Target
D. Uns...
Formative Assessment
•
•
•
•
•

Learning Styles
Pre/Post Tests +
Module Exams +
Live Lessons +
Discussion Based Assessment...
Formative Data
Tracking Student Success
• Parents and Students are surveyed at intervals
• Data Reports that reveal studen...
FLVS Quality Assurance
Examples

•
•
•
•
•

Instructional Audits
Fidelity Checks
Concern & Celebration Reports
Principal R...
Summative Assessments
• Segment Exams
• End of Course Assessment
• AP Results
“Inspect what we
Expect”

FLVS Leaders Influence
Student Learning by
Promoting Vision
• Balanced Score Card
Algebra EOC Assessment Compared to
State
Geometry EOC Assessment
Comparison to State 2012-2013
School Year
Biology EOC Assessment Comparison
to State 2012-2013 School Year
2012 AP Results
Reporting
• Annual Reports both externally and
internally
• Board Updates Monthly
• Community Relations Department
FLVS
Comprehensive Organizational Confidence in
STUDENT MASTERY OUTCOMES
because of….

•Adaptive Instruction
•Competency B...
Questions
Contact Information
• Florida Virtual School – www.flvs.net
– Robin Winder, rwinder@flvs.net
– Amy McGrath, amcgrath@flvs....
Upcoming SlideShare
Loading in …5
×

2013 Evaluation of Online Programs

1,454 views

Published on

This leadership webinar focused on current practices for evaluating program effectiveness, the evaluation tools in use and how state online schools analyze multiple sources of data to understand program success. Presenters will lead a discussion of important considerations around the ongoing formative data collected to inform teachers and administrators about what contributes to student success in online courses. The panelists will explore how their programs approach collection of data and what methodology they use to organize and present data for school or district leaders.

Published in: Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,454
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
24
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • ?
  • 2013 Evaluation of Online Programs

    1. 1. Approaches to Evaluating Supplemental Online Learning Programs • • • Robin Winder, Director of Student Learning, Florida Virtual School Amy McGrath, Principal/Lead Instructor, World Languages, Florida Virtual School Joe Freidhoff, Director of Michigan Virtual Learning Research Institute, Michigan Virtual School December 2013
    2. 2. Webinar Focus • Evaluation of Supplemental Online Programs – Information can apply to full time programs as well as blended learning programs – Takes time to learn what to evaluate, how to evaluate and how to report results – Perspectives from two well established programs • Michigan Virtual School: Est. 2000 • Florida Virtual School: Est. 1996
    3. 3. Michigan Virtual School www.mivhs.org
    4. 4. About Michigan Virtual School Fast Facts • Created in 2000 by Public Act 230 • Supplemental Program • Mainly High School, Some Middle School • Over 138,000 enrollments since its inception • Currently offer around 200-250 different online courses
    5. 5. Program Evaluation • • • • • Accreditation Perceptual Data Reporting Results Internal Monitoring External Assistance
    6. 6. Accreditation
    7. 7. Perceptual Data Available from: http://media.mivu.org/institute/pdf/stusurvey.pdf
    8. 8. Reporting Results Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
    9. 9. Reporting Results Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
    10. 10. Reporting Results Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
    11. 11. Reporting Results Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
    12. 12. Reporting Results Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
    13. 13. Reporting Results Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf
    14. 14. Internal Monitoring
    15. 15. Internal Monitoring
    16. 16. Internal Monitoring
    17. 17. Internal Monitoring Figure 8. School Names for Drops (Min. 5 Drops)
    18. 18. Internal Monitoring Vendor Comparison Report
    19. 19. External Assistance Available from: http://www.sri.com/sites/default/files/publications/supporting-k-12-students-online-learning-2.pdf
    20. 20. Florida Virtual School www.flvs.net
    21. 21. Florida Virtual School Part –time, Full- time, Global School Talk about milestones! As we completed our 15th year, we have served 819,488 total students.
    22. 22. Fully Accredited • North Central Association Commission on Accreditation and School Improvement • North West Accreditation Commission • Southern Association of College and Schools Council on Accreditation and School Improvement • NCAA approval of Core Courses
    23. 23. The Florida Virtual School Approach STUDENT DRIVEN
    24. 24. Depth of Knowledge The effectiveness of my virtual program is ____ A. Highly Effective B. Effective C. Below Target D. Unsure
    25. 25. Formative Assessment • • • • • Learning Styles Pre/Post Tests + Module Exams + Live Lessons + Discussion Based Assessment = Competency Based Learning
    26. 26. Formative Data Tracking Student Success • Parents and Students are surveyed at intervals • Data Reports that reveal student engagement • Course Health Reports
    27. 27. FLVS Quality Assurance Examples • • • • • Instructional Audits Fidelity Checks Concern & Celebration Reports Principal Requests Executive Leadership Requests
    28. 28. Summative Assessments • Segment Exams • End of Course Assessment • AP Results
    29. 29. “Inspect what we Expect” FLVS Leaders Influence Student Learning by Promoting Vision • Balanced Score Card
    30. 30. Algebra EOC Assessment Compared to State
    31. 31. Geometry EOC Assessment Comparison to State 2012-2013 School Year
    32. 32. Biology EOC Assessment Comparison to State 2012-2013 School Year
    33. 33. 2012 AP Results
    34. 34. Reporting • Annual Reports both externally and internally • Board Updates Monthly • Community Relations Department
    35. 35. FLVS Comprehensive Organizational Confidence in STUDENT MASTERY OUTCOMES because of…. •Adaptive Instruction •Competency Based Instruction •Reflection on student engagement •Quality Assurance and Accountability
    36. 36. Questions
    37. 37. Contact Information • Florida Virtual School – www.flvs.net – Robin Winder, rwinder@flvs.net – Amy McGrath, amcgrath@flvs.net • Michigan Virtual School - www.mivhs.org/ – Joe Freidhoff, jfreidhoff@mivu.org

    ×