2011Evaulating Online Course Quality
Upcoming SlideShare
Loading in...5
×
 

2011Evaulating Online Course Quality

on

  • 482 views

 

Statistics

Views

Total Views
482
Views on SlideShare
481
Embed Views
1

Actions

Likes
0
Downloads
19
Comments
0

1 Embed 1

http://hoot.weisuite.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

2011Evaulating Online Course Quality 2011Evaulating Online Course Quality Presentation Transcript

  • Evaluating Online Course Quality for Student Learning and Success WCET 23rd Annual Conference, Denver, Colorado
  • OUTLINE• Who are we?  Our mission and goals • Community of Inquiry Framework and evolution at APUS • Use of data for decision making, continuous improvement, ensuring student  learning and success • Continuously improving the quality of courses and programs through quality  assurance processes • Predictive analytics, semantic analyses, PAR framework• Discussion/comments/questions AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • WHO WE ARE “Educating Those Who Serve” American Public University System has  been dedicated to educating those who  serve since our doors first opened in  1991. The American Public University  System (APUS) is a fully online system,  encompassing both American Military  University and American Public  University. We are regionally accredited  by the Higher Learning Commission (HLC)  of the North Central Association. AMERICAN PUBLIC UNIVERSITY SYSTEM |  EDUCATING THOSE WHO SERVE View slide
  • 2011: Celebrating 20 Years of Service and LeadershipMission:  To provide quality higher education with emphasis on educating the nation’s military and public service communities by offering respected, relevant, accessible and affordable, student‐focused online programs, which prepare them for service and leadership in a diverse, global society. STRATEGY: • Founded as American Military University (AMU) in 1991 by  • Focus on quality and affordability  James P. Etter, a  Marine Corps Officer  • Graduate successful alumni who  • In 2002, AMU expanded into the American Public University  make important contributions to  System (APUS), adding American Public University (APU) society and their professions • Nationally Accredited (DETC) in 1995 • Enhance America’s  competitiveness by meaningfully  • Regionally Accredited (NCA) in 2006  increasing the population with college degrees • Serving over 96,000 students worldwide  • Collaborate with other  universities to create solutions to  U.S. higher education challenges AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE View slide
  • COMMUNITY OF INQUIRY (COI) “It is nothing short of a miracle that modern methods of instruction have not yet entirely  strangled the holy curiosity of inquiry” – Albert EinsteinAn educational community of inquiry is a group of individuals who collaboratively engage in purposeful critical discourse and reflection to construct personal meaning and confirm mutual understanding.The Community of Inquiry theoretical framework represents a process of creating a deep and meaningful (collaborative‐constructivist) learning experience through the development of three interdependent elements ‐social, cognitive and teaching presence. Over 2 million students across the world have used this validated instrument.  AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO 5 SERVE
  • Social presence is “the ability of participants to  identify with the community (e.g., course of study),  communicate purposefully in a trusting environment,  and develop inter‐personal relationships by way of  projecting their individual personalities.” (Garrison,  2009)  Teaching Presence is the design, facilitation, and  direction of cognitive and social processes for the  purpose of realizing personally meaningful and  educationally worthwhile learning outcomes  (Anderson, Rourke, Garrison, & Archer, 2001).  Cognitive Presence is the extent to which learners  are able to construct and confirm meaning through  sustained reflection and discourse (Garrison,  Anderson, & Archer, 2001). Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text‐based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2‐3), 87‐105. AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • • Phil – sample of COI report
  • “Quality begins on the inside . . . and then Data Driven Culture works its way out.” ‐Bob Moawad • Internal and  external  benchmarking • Data tools for  stakeholders ‐ dashboards,  program and  course level fact  books, data  warehouse,  student learning  assessment  reports.   AMERICAN PUBLIC UNIVERSITY SYSTEM |  EDUCATING THOSE WHO SERVE
  • NATIONALLY BENCHMARKED INSTRUMENTSAPUS utilizes a number of nationally benchmarked tests and validated instruments to measure student engagement, student satisfaction, and the achievement of student learning outcomes. National  Community  Survey of  Proficiency  Major Field  of Inquiry  Student  Profile Tests Tests  Survey Engagement AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO 9 SERVE
  • Direct and Indirect Measures of Assessment AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Regular Dissemination of Data to Stakeholders:  Dashboards “Experts often possess more data than judgment.” – Colin Powell AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Regular Dissemination of Data to Stakeholders:  Course and Program Level Fact Books“In the spirit of science, there really is no such thing as a "failed experiment." Any test that yields valid data is a valid test.” ‐ Adam Savage  AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Student Learning Assessment Report: Alignment of  Student Learning Outcomes AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Student Learning Assessment Report: Culminating  Experience AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Student Learning Assessment Report: Key Course  Embedded Assessments AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Student Learning Assessment Report: Assessment  Data AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Student Learning Assessment Report: Checklist AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Student Learning Assessment Report: Changes  Based on Data AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • PROGRAM REVIEW PROCESS“Quality is never an  “One of the great accident; it is always  mistakes is to judge the result of high  policies and intention, sincere  programs by their effort, intelligent  Data  External   intentions rather direction and skillful  Collection Review than their results.” execution; it represents  Milton Friedmanthe wise choice of many”William A. Foster  Follow‐Up Analysis Program  Three Year  Review  Plan Meeting AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Data Aggregation & AnalysisLibrary and  Curriculum  External Learning Resources Assessment Reviewer Feedback• Course books • Student learning  • Expert reviewer report• Electronic resources outcomes • Industry Advisory  • Instructional strategies Council report• Learning strategies • Evaluation procedures  • Academic rigor AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Data Aggregation & AnalysisFaculty Students Learning Outcomes  Assessment• Analysis of faculty • Student demographic • Curricular Mapping credentials and expertise information • Assessment measures  to ensure breadth and • Enrollment History diversity • Fact books • Growth trends • Student learning assessment  reports • reports AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO AMERICAN PUBLIC UNIVERSITY SYSTEM |  EDUCATING THOSE WHO SERVE SERVE
  • Data Aggregation & AnalysisProgram Benchmarking Program Directory  Review and Findings Summary• Program benchmarking • Evaluation of findings • Dean’s observations  with similar programs • Program recommendations • Meeting minutes and institutions • Three year proposed strategic plan AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO AMERICAN PUBLIC UNIVERSITY SYSTEM |  EDUCATING THOSE WHO SERVE SERVE
  • COURSE REVIEW PROCESS “Everything can be improved.” ‐ C. W. Barron “Quality is everyones responsibility.”‐ W. Edwards  Deming• Evolution of program review to course review process• Response to regulation and oversight• Evaluation of courses as a means to support student success, learning, and  engagement• Systematic and comprehensive method to identify the strengths and areas for  enhancement or improvement for each course offered by APUS• Aligned with the Community of Inquiry framework
  • ONLINE CONTACT HOURS CALCULATOR• Contact hours calculator ‐ Each class evaluated to ensure it had 45 contact  hours of learning and an additional 80 – 100 hours of homework associated  with the class for a total of 120+ hours for undergrad classes and 150+ hours  for grad classes.  • Contact hour calculator emerged as a result of evaluation in the School of  Public Safety and Health• The template was adopted and refined for implementation across APUS  schools. The calculator provides a tool for parties to calculate contact hours  while establishing expectations.
  • ONLINE CONTACT HOURS CALCULATOR
  • ONLINE CONTACT HOURS CALCULATOR
  • ONLINE CONTACT HOURS CALCULATOR
  • Predictive Modeling
  • UI / UX
  • Semantic Analysis
  • GAP ANALYSIS
  • GAP ANALYSIS REPORT
  • Feel Free to Contact Us!Dr. Karan Powell, Provost and Executive Vice‐President kpowell@apus.eduDr. Phil Ice, Vice‐President, Research and Development pice@apus.eduDr. Jennifer Stephens Helm, Vice‐President, Institutional  Research and Assessment jhelm@apus.edu AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE