2011Assuring Quality in Online Courses

655 views
607 views

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
655
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

2011Assuring Quality in Online Courses

  1. 1. ASSURING QUALITY IN LARGE- SCALE ONLINE COURSE DEVELOPMENT Tina Parscal, PhD Provost tina.parscal@rockies.edu Deborah Riemer VP of Assessment & Academic Quality deborah.riemer@ashford.edu
  2. 2. Presentation Outline Institution Overviews Curriculum & Course Development (Tools & Templates) Assessment Development (Tools & Templates) Internal QA Reviews External QA Reviews Development Models Faculty Training Research and Evaluation
  3. 3. Institution Overviews
  4. 4. Ashford University Founded in 1918Online Figures Curriculum Team  88,000+ students  Faculty (SMEs)  2200+ faculty  4 Executive Deans  VP of Asmt & Quality  606 courses  Assessment Manager  58 programs  Quality Manager  500-750 course sections starts  4 Program Managers per week  5 Instructional Designers  7 Curriculum Coordinators  2 Learning Tech Specialists  2 Doc Quality Coordinators  4 Assessment Analysts
  5. 5. University of Rockies Founded in 1998 – became UOR in 2007Online Figures Curriculum Team  2000+ Students  Director of Curriculum Development  275 Faculty  Director of Academic Quality  214 courses  Assessment Faculty  5 programs  3 Instructional Designers  15 course sections starts per  2 Curriculum Coordinators week  1 Faculty/SME/Course Developer (per course)  1 External QA Assurance (per course)  14 Faculty Curriculum Area Coordinators
  6. 6. Quality is IntentionalCourse DevelopmentAssessment DevelopmentInternal QA ReviewsExternal QA Reviews We weave it into the process . . .Development ModelsFaculty DevelopmentResearch & Evaluation
  7. 7. Curriculum & Course DevelopmentGuidance, Templates, Tools, Model
  8. 8. Curriculum Development Faculty Driven Centrally Developed
  9. 9. Curriculum Development Outcomes Based Curriculum & Course Alignment
  10. 10. Course Development TrainingGuidance, Templates, and Tools Prepping the Team
  11. 11. Course DevelopmentMapping and OrganizingGuidance, Templates, and Tools Learning Outcome Alignment Ensuring Quality Design
  12. 12. Course Development ToolsDevelopment Template and Blog Guidance
  13. 13. Course Development ToolsWiki Checklist
  14. 14. Course DevelopmentStyle Guide Blog & eCollege TemplateGuidance, Templates, and Tools Consistent Presentation Style Guide andDocumented Processes
  15. 15. Assessment Development
  16. 16. Assessment DevelopmentWaypoint Assessment Tool Linking to• Richer feedback to Outcomes • Data will be used to students impacting inform change in achievement and success • Alignment of rubric curriculum and processes• Enhanced experience for criteria to learning resulting in improved faculty and students outcomes and experience for students competencies Measures of Grading Rubric Student Learning
  17. 17. Assessment DevelopmentGrading Rubric Development Checklist and BlogGuidance, Templates, and Tools Grading Rubric Development Guidance
  18. 18. Assessment DevelopmentWaypoint Electronic Grading RubricGuidance, Templates, and Tools
  19. 19. Assessment ManagementTaskStream Outcomes MappingGuidance, Templates, and Tools
  20. 20. Assessment ManagementTaskStream Assessment Plan
  21. 21. Internal QA Reviews
  22. 22. UoR Internal QA ReviewsContent AreaCoordinator reviews for: Course Plan Course Design & Topical Organizer Learning Resources Outcomes Assessment Strategy Discussion Prompts
  23. 23. AU Internal QA Reviews
  24. 24. External QA Reviews
  25. 25. External QA ReviewsQuality Matters
  26. 26. External QA ReviewsUoR Weekly Internal Reports for Stakeholders
  27. 27. External QA ReviewsQuality Matters Blog Positive Feedback Communicating with the Review Team
  28. 28. External QA ReviewsOrganizing QM with Access
  29. 29. External QA ReviewsAU Weekly Report Emailed to Stakeholders
  30. 30. Development Models
  31. 31. Ashford University Course Development Model Development Model Course Development Approval - SMEs Selected Approval – ID Identified Period Dean• Pre-Dev • Pre-Dev • Week 1-4 • Week 5 • Week 6 Final Rubrics Course Built Final Course QA Adjustments Developed in LMS Approval Made• Weeks 7-8 • Weeks 9-10 • Week 11 • Week 12 • Week 13 Course Ready Quality Matters for Production Review
  32. 32. University of the RockiesCourse Development ModelCourse Development Model Development Developers Learning New Course 1st Draft Final Draft (SMEs) Resources Approved Approved by Review by ID Selected Selected ID/CAC• Pre-Dev • Pre-Dev • Week 1-2 • Week 3-4 • Week 3-5 Course Course Quality Final Approved by Loaded into Assurance Adjustments Final Approval CAC LMS Review (QA) Made• Weeks 5-6 • Weeks 6-7 • Week 7 • Week 8 • Week 8-9 Selected for Course Ready for Quality Online Teaching Matters Review
  33. 33. Faculty Training
  34. 34. Faculty Training Integrating QM awareness into faculty and staff responsibilities . . .Faculty QM peer reviewer certified Assessment AnalystsFaculty QM master reviewer certified Instructional DesignersFaculty Trainers Curriculum Coordinators
  35. 35. Research & Evaluation
  36. 36. Template SurveyGuidance, Templates, and Tools
  37. 37. The University of Rockies has implemented a coursedevelopment template that supports the Quality Mattersprinciple of alignment. The template requires coursedevelopers to explicitly state how thediscussions, activities, and written assignments alignwith the weekly and course outcomes. This template isan improved version of the original template whereexplicit alignment was not required. As a qualityassurance reviewer I have noted the positive impact thistemplate has had on course quality and alignment ofessential course elements. As a result the courses willprovide a rich learning experience. - Carole Hruskocy, Ph.D.
  38. 38. Quality Matters GrantAction-Based Research Grant on Teaching and Learning Research Questions1. What is the extent to which QM certification impact student perceptions of a course?2. Which standards have the greatest impact on student perceptions of a course?3. What do instructors perceive as the positive and negative aspects of teaching the same course before and after the QM course review process?
  39. 39. Emergent ResearchQuality Matters Trends QM Standard Peer Review Feedback
  40. 40. QuestionsTina.Parscal@Rockies.eduDeborah.Riemer@Ashford.edu

×