Measuring digital learning in the 21st century
Upcoming SlideShare
Loading in...5
×
 

Measuring digital learning in the 21st century

on

  • 973 views

Presentation on comprehensive assessment of student learning and persistence used at American Public University System

Presentation on comprehensive assessment of student learning and persistence used at American Public University System

Statistics

Views

Total Views
973
Views on SlideShare
972
Embed Views
1

Actions

Likes
0
Downloads
16
Comments
0

1 Embed 1

https://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Dr. Frank
  • Dr. Frank
  • Dave
  • Dave
  • Dave

Measuring digital learning in the 21st century Measuring digital learning in the 21st century Presentation Transcript

  • Engaging Online Faculty and Administrators in the Assessment Process at the American Public University System
    Measuring Digital Learning in the 21st Century - Data Warehouses, Dialects, and Dashboards
  • INTRODUCTIONS
    Dave BecherDirector, Academic Information Analysis
    Phil Ice, Ph.D.
    Director, Course Design, Research, and Development
    Frank McCluskey, Ph.D.Executive Vice President and Provost
    Jennifer Stephens Helm, Ph.D.Associate Vice-President, Dean of Assessment
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • WHO WE ARE
    “Educating Those Who Serve”
    American Public University System has been dedicated to educating those who serve since our doors first opened in 1991. The American Public University System (APUS) is a fully online system, encompassing both American Military University and American Public University. We are regionally accredited by the Higher Learning Commission (HLC) of the North Central Association.
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
    View slide
  • EXCELLENCE IN EDUCATION
    We face challenges that are well documented in the educational literature. We are an open enrollment college, as well as a fully online institution of higher education. APUS is committed to improving our learning environment. To continue and increase the success of our students we employ a rigorous assessment plan. Excellence in education is fostered through a cycle of data collection, analysis, remediation, and then further data collection to measure the learning again.
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
    View slide
  • ASSESSMENT AT APUS
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Promote Accountability Among Faculty and Administrators – APUS Program Review Process
    STRATEGY #1:
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • EFFECTIVE DOCUMENTATION
    Promoting Accountability through the Documentation of Student Learning Outcomes Evidence
    We begin with the assumption that our faculty are the experts. Our data collection assists them in translating their expertise into student learning. We want to help them free our students from fixed ideas, cloudy thinking and imprecise analysis. We want to liberate the learning already taking place.
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • EFFECTIVE DOCUMENTATION
    Data Collection and Analysis
    External Reviewer Feedback
    Library and Learning Resources
    Curriculum Assessment
    •Expert reviewer report
    •Industry Advisory Council report
    • Course books
    • Electronic resources
    • Learning strategies
    • Student learning outcomes
    •Instructional strategies
    •Evaluation procedures
    •Academic rigor
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • EFFECTIVE DOCUMENTATION
    Data Collection and Analysis
    Faculty
    Students
    Learning Outcomes Assessment
    • Analysis of faculty credentials and expertise to ensure breadth and diversity
    •Student demographic information
    •Enrollment History
    •Growth trends
    • Curricular Mapping
    •Assessment measures
    •Fact book
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • EFFECTIVE DOCUMENTATION
    Data Collection and Analysis
    Program Benchmarking
    Review and Findings
    Program Directory Summary
    •Dean’s observations
    •Meeting minutes
    • Program benchmarking with similar programs and institutions
    •Evaluation of findings
    •Program recommendations
    •Three year proposed strategic plan
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • Inform Internal and ExternalStakeholders on the Achievementof Student Learning Outcomes
    STRATEGY #2
    Internal Communications
    Transparency by Design Initiative
    APUS Learning Outcomes Assessment Website
    •Meetings
    •Faculty, staff, and student newsletters
    •Faculty and student lounges
    • One of fourteen charter member institutions
    •College Choices for Adults website
    http://www.collegechoicesforadults.org/
    http://www.apus.edu/community-scholars/learning-outcomes-assessment/index.htm
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • STRATEGY #3
    Establish a Reciprocal Relationship among Stakeholders and the Institution on the Sharing of Data
    • Regular dissemination of data to stakeholders
    • Reciprocal relationship between data team, Deans, and Program Directors
    • Assessment feedback loop
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • FACT BOOK DATA COLLECTION TIMELINE
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • STUDENT DEMOGRAPHICS
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • STUDENT COUNT
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • GRADES BY CORE COURSES (IN PROGRAM): %
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • STRATEGY #4
    Incorporate Assessment Data intoDecision Making Processes
    APUS utilizes a number of nationally benchmarked tests and validated instrumentsto measure learner engagement, learner success, and learning outcomes.
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • STRATEGY #4
    National Survey of Student Engagement - NSSE
    • Administered at several hundred colleges and
    universities in the United States and Canada
    • Hundreds of thousands of freshman and
    seniors surveyed using a validated instrument
    recognized in the literature and nationally
    • Survey uses more than 70 questions
    gathering self reported student perceptions
    APUS is one of few fully online, for-profit institutions of higher education participating.
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • STRATEGY #4
    The Educational Testing Service
    • APUS uses the Proficiency Profile (formerly the MAPP) to measure skills of college program graduates.
    • Presumption for open admission and fully online institutions to score below the national average.
    • 2009 APUS scores rise above the national average with the sole exception of mathematics which is less than 1% below the norm (See Table 1 – 2009 MAPP Test Data).
    • ETS performs a major field test for seven of our undergraduate majors upon graduation (See Table 2 – 2009 MFT CJ Data).
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • COMMUNITY OF INQUIRY
    APUS participates in the Community ofInquiry (COI) End of Course survey.
    The COI is a validated instrument based onthe research around Social, Cognitive, andTeaching Presence.
    More than 500,000 learners have used this instrument and created a strong baseline forfurther research.
    Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2-3), 87-105
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE
  • RECAP OF 4 STRATEGIES
    • Promote Accountability Among Faculty and Administrators
    • Inform Internal and External Stakeholders on the Achievement of Student Learning Outcomes
    • Establish a Reciprocal Relationship among Stakeholders and the Institution on the Sharing of Data
    • Incorporate Assessment Data into Decision Making Processes
    AMERICAN PUBLIC UNIVERSITY SYSTEM | EDUCATING THOSE WHO SERVE