Evaluating Distance Education: Focus on Online Course Evaluation

3,097 views

Published on

Evaluating Distance Education: Focus on Online Course Evaluation

Published in: Education, Economy & Finance
  • Here’s how the university of nebraska got uses online surveys to improve online course offerings. Check it here: http://snurl.com/nebraskasurvey
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Evaluating Distance Education: Focus on Online Course Evaluation

  1. 1. Evaluating Distance Education Focus on Online Course Evaluation Fall 2008
  2. 2. Standards <ul><li>For K12, NACOL ( http://nacol.org/ ) leads the way but SREB was the stepping stone </li></ul><ul><li>For Higher Education, the Quality Matters Rubric with its peer evaluation process is prominent </li></ul>
  3. 3. Quality Matters Rubric <ul><li>“ Quality Matters (QM) is a faculty-centered, peer review process designed to certify the quality of online courses and online components. Sponsored by MarylandOnline, Inc, Quality Matters has generated widespread interest and received national recognition for its peer-based approach to quality assurance and continuous improvement in online education. Originating from a FIPSE grant (2003), Quality Matters is now a self-supporting organization offering institutional subscriptions and a range of fee-based services including Quality Matters-managed course reviews and an array of trainings.” </li></ul><ul><li>http://www.qualitymatters.org/ </li></ul>
  4. 4. QM Rubric Standards <ul><li>Quality Matters created a set of forty specific elements, distributed across eight broad standards, by which to evaluate the design of online and hybrid courses. </li></ul><ul><ul><ul><li>1. Course Overview and Introduction </li></ul></ul></ul><ul><ul><ul><li>2. Learning Objectives </li></ul></ul></ul><ul><ul><ul><li>3. Assessment and Measurement </li></ul></ul></ul><ul><ul><ul><li>4. Resources and Materials </li></ul></ul></ul><ul><ul><ul><li>5. Learner Engagement </li></ul></ul></ul><ul><ul><ul><li>6. Course Technology </li></ul></ul></ul><ul><ul><ul><li>7. Learner Support </li></ul></ul></ul><ul><ul><ul><li>8. Accessibility </li></ul></ul></ul><ul><ul><li>http://www.qualitymatters.org/Rubric.htm </li></ul></ul>
  5. 5. QM Rubric <ul><li>Handouts </li></ul><ul><li>Annotated version </li></ul><ul><ul><li>Supports a thorough understanding of the rubric, cool version at: http://www.cvtc.edu/pages/272.asp </li></ul></ul><ul><li>Snapshot version </li></ul><ul><ul><li>Great checklist, new version, can’t officially use but it’s available for download on the website: </li></ul></ul><ul><ul><li>http://qminstitute.org/home/Public%20Library/About%20QM/RubricStandards2008-2010.pdf </li></ul></ul>
  6. 6. QM Rubric <ul><li>To meet official Quality Matters review expectations a course must: Answer “yes” to all 3-point Essential Standards AND Earn 72 or more points. </li></ul><ul><li>We took a SLOAN-C workshop, reviewed with QM Rubric, didn’t pass. </li></ul>
  7. 7. QM Status <ul><li>Subscription handout </li></ul><ul><li>The current rubric, as well as the Quality Matters name and logo, cannot be used without the explicit written permission of MarylandOnline, Inc. (Courses that were reviewed and that received QM Recognition to date may continue to use the logo they received). </li></ul>
  8. 8. Additional Ways We Evaluate <ul><li>Surveys are administered using WebCT survey tool including end of course surveys as well as various surveys related to effectiveness of program communication methods, effectiveness of program/course orientation activities, etc. (Formative and Summative) </li></ul><ul><li>The instructors engage in debriefing activities after orientations, at the end of semesters, and at the end of program cycles. (Summative) </li></ul><ul><li>The asynchronous discussion forum tool is utilized in WebCT wherein students are provided with the opportunity to provide anonymous feedback throughout the course as well as the opportunity to discuss what they would do to improve activities and instruction. (Formative and Summative) </li></ul><ul><li>The OTLGC instructors utilize the QM rubric as a checklist and to evaluate the CEL courses. (Formative and Summative) </li></ul>
  9. 9. Use of Student Final Product <ul><li>Students engage in a program practicum where each learner creates/has created online materials and uses them to teach each other in small groups. Their materials and teaching are evaluated using the Quality Matters Rubric by their peers and the instructors. Based on the results, we know the next steps for course/program improvement and revision. (Summative) </li></ul>
  10. 10. Dealing with the Tech <ul><li>Know your learners </li></ul><ul><ul><li>We do a tech pre-survey </li></ul></ul><ul><ul><li>Phases of engagement with technology and collaborative activities, 5 Stages Model </li></ul></ul><ul><li>If you are going to teach online, you really should take an online course. </li></ul><ul><li>eLearning Ecosystem Handout </li></ul>
  11. 11. Shall we take a peek? <ul><li>CEL 560: Fostering Online Learning Communities </li></ul><ul><li>CEL 570: Designing Online Learning Environments </li></ul>
  12. 12. Our Fave Books <ul><li>http://astore.amazon.com/otlgc-20 </li></ul>
  13. 13. Slideshare <ul><li>http://www.slideshare.net/desertjul </li></ul>

×