Quality? Who Says?
  WCET Annual Conference
    November 9, 2007
Objectives
   Walk away with multiple views on rubrics for
    assessing quality of online instruction
   Take ideas from three different quality assurance
    methods

   Recognize the impact and value of a quality
    assurance program
Quality Starts…
                        …and doesn’t stop


   Training

   Developing

   Reviewing
Quality (at) Training
                            …get off on the right foot

Training workshop required one year out
   Course examples
       Content design
       Interactivity (communication)
       Assessment

   Multiple online courses
       Principles of Good Practice Self-Study
       Instructional Design Tutorial
Quality Development
                                    …from the first word

Developing in stages
   Checkpoint #1
       Syllabus, sample lesson

   Checkpoint #2
       ½ of the course, Mac
       Content, interaction, assessment

   Copy editing
Quality Reviews
                        …before the course runs

Reviewing from multiple perspectives
   Technical review (external)
       Content
       Communication
       Assessments
       Services
       Links

   Final Check (internal)
Quality Evolves
                               …or becomes extinct

Critical factors
   Faculty buy-in
       Student satisfaction

   Objective
       Pre-tech reviews
       Tech reviews

   Subjective
       Checkpoints
       Rubrics
Quality Needs Feedback
                            …to remain quality

   Course growth
   Help Desk tickets compared with courses
   Student complaints compared with evaluations
Quality Looks Ahead
                                     …or falls behind

Planned changes
   Training
       Best practices
       Advanced workshops

   Development
       Community of Practice
       Template/technique sharing

   Reviewing
       cQual
End
Technical calls &
                    student evaluations
200
14.00%

180                                               Technical issues Courses
12.00%
                                                               1
160                                                 in courses
10.00%
140

120
 8.00%
100
 6.00%
 80

 60
 4.00%
 40
 2.00%
                                                            Student design
 20                                                         complaints2
 0.00%
  0
         SP00 FA00 SP01FA01 SP02 FA02 SP03 FA03 SP04 FA04 SP05 FA05 SP06
      SP00  FA00 SP01    FA01 SP02 FA02 SP03 FA03 SP04 FA04 SP05 FA05 SP06   FA06
                                                                             FA06   SP07
                                                                                    SP07



         1
          Help Desk tickets as a                    2
                                                     Student comments as a
         percent of courses                         percent of evaluations

Quality Components

  • 1.
    Quality? Who Says? WCET Annual Conference November 9, 2007
  • 2.
    Objectives  Walk away with multiple views on rubrics for assessing quality of online instruction  Take ideas from three different quality assurance methods  Recognize the impact and value of a quality assurance program
  • 3.
    Quality Starts… …and doesn’t stop  Training  Developing  Reviewing
  • 4.
    Quality (at) Training …get off on the right foot Training workshop required one year out  Course examples  Content design  Interactivity (communication)  Assessment  Multiple online courses  Principles of Good Practice Self-Study  Instructional Design Tutorial
  • 5.
    Quality Development …from the first word Developing in stages  Checkpoint #1  Syllabus, sample lesson  Checkpoint #2  ½ of the course, Mac  Content, interaction, assessment  Copy editing
  • 6.
    Quality Reviews …before the course runs Reviewing from multiple perspectives  Technical review (external)  Content  Communication  Assessments  Services  Links  Final Check (internal)
  • 7.
    Quality Evolves …or becomes extinct Critical factors  Faculty buy-in  Student satisfaction  Objective  Pre-tech reviews  Tech reviews  Subjective  Checkpoints  Rubrics
  • 8.
    Quality Needs Feedback …to remain quality  Course growth  Help Desk tickets compared with courses  Student complaints compared with evaluations
  • 9.
    Quality Looks Ahead …or falls behind Planned changes  Training  Best practices  Advanced workshops  Development  Community of Practice  Template/technique sharing  Reviewing  cQual
  • 10.
  • 11.
    Technical calls & student evaluations 200 14.00% 180 Technical issues Courses 12.00% 1 160 in courses 10.00% 140 120 8.00% 100 6.00% 80 60 4.00% 40 2.00% Student design 20 complaints2 0.00% 0 SP00 FA00 SP01FA01 SP02 FA02 SP03 FA03 SP04 FA04 SP05 FA05 SP06 SP00 FA00 SP01 FA01 SP02 FA02 SP03 FA03 SP04 FA04 SP05 FA05 SP06 FA06 FA06 SP07 SP07 1 Help Desk tickets as a 2 Student comments as a percent of courses percent of evaluations