ASSURING QUALITY IN LARGE-       SCALE ONLINE COURSE               DEVELOPMENT                Tina Parscal, PhD           ...
Presentation Outline    Institution Overviews    Curriculum & Course Development (Tools & Templates)    Assessment Develop...
Institution Overviews
Ashford University                         Founded in 1918Online Figures                       Curriculum Team   88,000+ ...
University of Rockies           Founded in 1998 – became UOR in 2007Online Figures                      Curriculum Team  ...
Quality is IntentionalCourse DevelopmentAssessment DevelopmentInternal QA ReviewsExternal QA Reviews                  ...
Curriculum & Course DevelopmentGuidance, Templates, Tools, Model
Curriculum Development  Faculty Driven     Centrally    Developed
Curriculum Development                         Outcomes Based                           Curriculum &                      ...
Course Development TrainingGuidance, Templates, and Tools                  Prepping the                     Team
Course DevelopmentMapping and OrganizingGuidance, Templates, and Tools      Learning     Outcome     Alignment            ...
Course Development ToolsDevelopment Template and Blog Guidance
Course Development ToolsWiki Checklist
Course DevelopmentStyle Guide Blog & eCollege TemplateGuidance, Templates, and Tools                                      ...
Assessment Development
Assessment DevelopmentWaypoint Assessment Tool                                       Linking to• Richer feedback to       ...
Assessment DevelopmentGrading Rubric Development Checklist and BlogGuidance, Templates, and Tools                         ...
Assessment DevelopmentWaypoint Electronic Grading RubricGuidance, Templates, and Tools
Assessment ManagementTaskStream Outcomes MappingGuidance, Templates, and Tools
Assessment ManagementTaskStream Assessment Plan
Internal QA Reviews
UoR Internal QA ReviewsContent AreaCoordinator reviews for:   Course Plan   Course Design & Topical   Organizer   Lear...
AU Internal QA Reviews
External QA Reviews
External QA ReviewsQuality Matters
External QA ReviewsUoR Weekly Internal Reports for Stakeholders
External QA ReviewsQuality Matters Blog                          Positive                         Feedback       Communica...
External QA ReviewsOrganizing QM with Access
External QA ReviewsAU Weekly Report Emailed to Stakeholders
Development Models
Ashford University Course Development Model Development Model          Course                                Development  ...
University of the RockiesCourse Development ModelCourse Development Model                                               De...
Faculty Training
Faculty Training      Integrating QM awareness into faculty      and staff responsibilities . . .Faculty QM peer reviewer...
Research & Evaluation
Template SurveyGuidance, Templates, and Tools
The University of Rockies has implemented a coursedevelopment template that supports the Quality Mattersprinciple of align...
Quality Matters GrantAction-Based Research Grant on Teaching and Learning     Research Questions1.   What is the extent to...
Emergent ResearchQuality Matters Trends   QM Standard    Peer Review     Feedback
QuestionsTina.Parscal@Rockies.eduDeborah.Riemer@Ashford.edu
Upcoming SlideShare
Loading in …5
×

2011Assuring Quality in Online Courses

669 views
613 views

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
669
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

2011Assuring Quality in Online Courses

  1. 1. ASSURING QUALITY IN LARGE- SCALE ONLINE COURSE DEVELOPMENT Tina Parscal, PhD Provost tina.parscal@rockies.edu Deborah Riemer VP of Assessment & Academic Quality deborah.riemer@ashford.edu
  2. 2. Presentation Outline Institution Overviews Curriculum & Course Development (Tools & Templates) Assessment Development (Tools & Templates) Internal QA Reviews External QA Reviews Development Models Faculty Training Research and Evaluation
  3. 3. Institution Overviews
  4. 4. Ashford University Founded in 1918Online Figures Curriculum Team  88,000+ students  Faculty (SMEs)  2200+ faculty  4 Executive Deans  VP of Asmt & Quality  606 courses  Assessment Manager  58 programs  Quality Manager  500-750 course sections starts  4 Program Managers per week  5 Instructional Designers  7 Curriculum Coordinators  2 Learning Tech Specialists  2 Doc Quality Coordinators  4 Assessment Analysts
  5. 5. University of Rockies Founded in 1998 – became UOR in 2007Online Figures Curriculum Team  2000+ Students  Director of Curriculum Development  275 Faculty  Director of Academic Quality  214 courses  Assessment Faculty  5 programs  3 Instructional Designers  15 course sections starts per  2 Curriculum Coordinators week  1 Faculty/SME/Course Developer (per course)  1 External QA Assurance (per course)  14 Faculty Curriculum Area Coordinators
  6. 6. Quality is IntentionalCourse DevelopmentAssessment DevelopmentInternal QA ReviewsExternal QA Reviews We weave it into the process . . .Development ModelsFaculty DevelopmentResearch & Evaluation
  7. 7. Curriculum & Course DevelopmentGuidance, Templates, Tools, Model
  8. 8. Curriculum Development Faculty Driven Centrally Developed
  9. 9. Curriculum Development Outcomes Based Curriculum & Course Alignment
  10. 10. Course Development TrainingGuidance, Templates, and Tools Prepping the Team
  11. 11. Course DevelopmentMapping and OrganizingGuidance, Templates, and Tools Learning Outcome Alignment Ensuring Quality Design
  12. 12. Course Development ToolsDevelopment Template and Blog Guidance
  13. 13. Course Development ToolsWiki Checklist
  14. 14. Course DevelopmentStyle Guide Blog & eCollege TemplateGuidance, Templates, and Tools Consistent Presentation Style Guide andDocumented Processes
  15. 15. Assessment Development
  16. 16. Assessment DevelopmentWaypoint Assessment Tool Linking to• Richer feedback to Outcomes • Data will be used to students impacting inform change in achievement and success • Alignment of rubric curriculum and processes• Enhanced experience for criteria to learning resulting in improved faculty and students outcomes and experience for students competencies Measures of Grading Rubric Student Learning
  17. 17. Assessment DevelopmentGrading Rubric Development Checklist and BlogGuidance, Templates, and Tools Grading Rubric Development Guidance
  18. 18. Assessment DevelopmentWaypoint Electronic Grading RubricGuidance, Templates, and Tools
  19. 19. Assessment ManagementTaskStream Outcomes MappingGuidance, Templates, and Tools
  20. 20. Assessment ManagementTaskStream Assessment Plan
  21. 21. Internal QA Reviews
  22. 22. UoR Internal QA ReviewsContent AreaCoordinator reviews for: Course Plan Course Design & Topical Organizer Learning Resources Outcomes Assessment Strategy Discussion Prompts
  23. 23. AU Internal QA Reviews
  24. 24. External QA Reviews
  25. 25. External QA ReviewsQuality Matters
  26. 26. External QA ReviewsUoR Weekly Internal Reports for Stakeholders
  27. 27. External QA ReviewsQuality Matters Blog Positive Feedback Communicating with the Review Team
  28. 28. External QA ReviewsOrganizing QM with Access
  29. 29. External QA ReviewsAU Weekly Report Emailed to Stakeholders
  30. 30. Development Models
  31. 31. Ashford University Course Development Model Development Model Course Development Approval - SMEs Selected Approval – ID Identified Period Dean• Pre-Dev • Pre-Dev • Week 1-4 • Week 5 • Week 6 Final Rubrics Course Built Final Course QA Adjustments Developed in LMS Approval Made• Weeks 7-8 • Weeks 9-10 • Week 11 • Week 12 • Week 13 Course Ready Quality Matters for Production Review
  32. 32. University of the RockiesCourse Development ModelCourse Development Model Development Developers Learning New Course 1st Draft Final Draft (SMEs) Resources Approved Approved by Review by ID Selected Selected ID/CAC• Pre-Dev • Pre-Dev • Week 1-2 • Week 3-4 • Week 3-5 Course Course Quality Final Approved by Loaded into Assurance Adjustments Final Approval CAC LMS Review (QA) Made• Weeks 5-6 • Weeks 6-7 • Week 7 • Week 8 • Week 8-9 Selected for Course Ready for Quality Online Teaching Matters Review
  33. 33. Faculty Training
  34. 34. Faculty Training Integrating QM awareness into faculty and staff responsibilities . . .Faculty QM peer reviewer certified Assessment AnalystsFaculty QM master reviewer certified Instructional DesignersFaculty Trainers Curriculum Coordinators
  35. 35. Research & Evaluation
  36. 36. Template SurveyGuidance, Templates, and Tools
  37. 37. The University of Rockies has implemented a coursedevelopment template that supports the Quality Mattersprinciple of alignment. The template requires coursedevelopers to explicitly state how thediscussions, activities, and written assignments alignwith the weekly and course outcomes. This template isan improved version of the original template whereexplicit alignment was not required. As a qualityassurance reviewer I have noted the positive impact thistemplate has had on course quality and alignment ofessential course elements. As a result the courses willprovide a rich learning experience. - Carole Hruskocy, Ph.D.
  38. 38. Quality Matters GrantAction-Based Research Grant on Teaching and Learning Research Questions1. What is the extent to which QM certification impact student perceptions of a course?2. Which standards have the greatest impact on student perceptions of a course?3. What do instructors perceive as the positive and negative aspects of teaching the same course before and after the QM course review process?
  39. 39. Emergent ResearchQuality Matters Trends QM Standard Peer Review Feedback
  40. 40. QuestionsTina.Parscal@Rockies.eduDeborah.Riemer@Ashford.edu

×