Measuring digital learning in the 21st century

1,013 views

Published on

Presentation on comprehensive assessment of student learning and persistence used at American Public University System

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,013
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Dr. Frank
  • Dr. Frank
  • Dave
  • Dave
  • Dave
  • Measuring digital learning in the 21st century

    1. 1. Engaging Online Faculty and Administrators in the Assessment Process at the American Public University System<br />Measuring Digital Learning in the 21st Century - Data Warehouses, Dialects, and Dashboards<br />
    2. 2. INTRODUCTIONS<br />Dave BecherDirector, Academic Information Analysis<br />Phil Ice, Ph.D.<br />Director, Course Design, Research, and Development<br />Frank McCluskey, Ph.D.Executive Vice President and Provost<br />Jennifer Stephens Helm, Ph.D.Associate Vice-President, Dean of Assessment<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    3. 3. WHO WE ARE<br />“Educating Those Who Serve”<br />American Public University System has been dedicated to educating those who serve since our doors first opened in 1991. The American Public University System (APUS) is a fully online system, encompassing both American Military University and American Public University. We are regionally accredited by the Higher Learning Commission (HLC) of the North Central Association.<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    4. 4. EXCELLENCE IN EDUCATION<br />We face challenges that are well documented in the educational literature. We are an open enrollment college, as well as a fully online institution of higher education. APUS is committed to improving our learning environment. To continue and increase the success of our students we employ a rigorous assessment plan. Excellence in education is fostered through a cycle of data collection, analysis, remediation, and then further data collection to measure the learning again.<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    5. 5. ASSESSMENT AT APUS<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    6. 6. Promote Accountability Among Faculty and Administrators – APUS Program Review Process<br />STRATEGY #1:<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    7. 7. EFFECTIVE DOCUMENTATION<br />Promoting Accountability through the Documentation of Student Learning Outcomes Evidence<br />We begin with the assumption that our faculty are the experts. Our data collection assists them in translating their expertise into student learning. We want to help them free our students from fixed ideas, cloudy thinking and imprecise analysis. We want to liberate the learning already taking place.<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    8. 8. EFFECTIVE DOCUMENTATION<br />Data Collection and Analysis<br />External Reviewer Feedback<br />Library and Learning Resources<br />Curriculum Assessment<br />•Expert reviewer report<br />•Industry Advisory Council report<br />• Course books<br />• Electronic resources<br />• Learning strategies<br />• Student learning outcomes<br />•Instructional strategies<br />•Evaluation procedures <br />•Academic rigor<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    9. 9. EFFECTIVE DOCUMENTATION<br />Data Collection and Analysis<br />Faculty<br />Students<br />Learning Outcomes Assessment<br />• Analysis of faculty credentials and expertise to ensure breadth and diversity<br />•Student demographic information<br />•Enrollment History<br />•Growth trends<br />• Curricular Mapping<br />•Assessment measures <br />•Fact book<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    10. 10. EFFECTIVE DOCUMENTATION<br />Data Collection and Analysis<br />Program Benchmarking<br />Review and Findings<br />Program Directory Summary<br />•Dean’s observations <br />•Meeting minutes<br />• Program benchmarking with similar programs and institutions<br />•Evaluation of findings<br />•Program recommendations<br />•Three year proposed strategic plan<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    11. 11. Inform Internal and ExternalStakeholders on the Achievementof Student Learning Outcomes<br />STRATEGY #2<br />Internal Communications<br />Transparency by Design Initiative<br />APUS Learning Outcomes Assessment Website<br />•Meetings<br />•Faculty, staff, and student newsletters<br />•Faculty and student lounges<br />• One of fourteen charter member institutions<br />•College Choices for Adults website <br />http://www.collegechoicesforadults.org/<br />http://www.apus.edu/community-scholars/learning-outcomes-assessment/index.htm<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    12. 12. STRATEGY #3<br />Establish a Reciprocal Relationship among Stakeholders and the Institution on the Sharing of Data<br />• Regular dissemination of data to stakeholders<br />• Reciprocal relationship between data team, Deans, and Program Directors<br />• Assessment feedback loop<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    13. 13. FACT BOOK DATA COLLECTION TIMELINE<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    14. 14. STUDENT DEMOGRAPHICS<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    15. 15. STUDENT COUNT<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    16. 16. GRADES BY CORE COURSES (IN PROGRAM): %<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    17. 17. STRATEGY #4<br />Incorporate Assessment Data intoDecision Making Processes<br />APUS utilizes a number of nationally benchmarked tests and validated instrumentsto measure learner engagement, learner success, and learning outcomes.<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    18. 18. STRATEGY #4<br />National Survey of Student Engagement - NSSE<br />• Administered at several hundred colleges and <br /> universities in the United States and Canada<br />• Hundreds of thousands of freshman and <br /> seniors surveyed using a validated instrument <br /> recognized in the literature and nationally<br />• Survey uses more than 70 questions <br /> gathering self reported student perceptions<br />APUS is one of few fully online, for-profit institutions of higher education participating.<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    19. 19. STRATEGY #4<br />The Educational Testing Service<br />• APUS uses the Proficiency Profile (formerly the MAPP) to measure skills of college program graduates.<br />• Presumption for open admission and fully online institutions to score below the national average.<br />• 2009 APUS scores rise above the national average with the sole exception of mathematics which is less than 1% below the norm (See Table 1 – 2009 MAPP Test Data).<br />• ETS performs a major field test for seven of our undergraduate majors upon graduation (See Table 2 – 2009 MFT CJ Data).<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    20. 20. COMMUNITY OF INQUIRY<br />APUS participates in the Community ofInquiry (COI) End of Course survey.<br />The COI is a validated instrument based onthe research around Social, Cognitive, andTeaching Presence.<br />More than 500,000 learners have used this instrument and created a strong baseline forfurther research.<br />Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2-3), 87-105<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />
    21. 21. RECAP OF 4 STRATEGIES<br />• Promote Accountability Among Faculty and Administrators<br />• Inform Internal and External Stakeholders on the Achievement of Student Learning Outcomes<br />• Establish a Reciprocal Relationship among Stakeholders and the Institution on the Sharing of Data<br />• Incorporate Assessment Data into Decision Making Processes<br />AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE<br />

    ×