Analytics and Student Success: Research & Benchmarking by Jeffrey Pomerantz & D. Christopher Brooks Thursday, October 27 Session Type: Breakout Session Delivery Format: Interactive Presentation Benchmarking can be used to calibrate institutional priorities, compare outcomes to peers, and measure progress toward institutional self-improvement. In this session we will discuss developing a framework for establishing benchmarks, aspirations for improving, and measuring success. We will look at specific benchmarks relevant to different types of institutions and the maturity of these benchmarks. This session will introduce participants to EDUCAUSE analytics and student success benchmarking tools and resources as well as showcase community members' case studies for benchmarking these topics. Outcomes: Learn about the analytics and student success benchmarking tools and resources available through EDUCAUSE * Discover new methods that will help you adopt sound analytics and student success benchmarking practices on your campus * Expand your knowledge and appreciation for analytics and student success benchmarking use cases and business practices from your peer panelists

1. Analytics and Student Success:
Research & Benchmarking
D. Christopher Brooks
Senior Research Fellow
EDUCAUSE
@dcbphd
Jeffrey Pomerantz
Senior Research Analyst
EDUCAUSE
@jpom

2. ‘A slow sort of country!’
said the Queen. ‘Now,
HERE, you see, it takes
all the running YOU can
do, to keep in the same
place. If you want to get
somewhere else, you
must run at least twice as
fast as that!’
--Lewis Carroll,
Through the Looking-Glass

3. “Would you tell me, please, which way I
ought to go from here?”
“That depends a good deal on where you
want to get to,” said the Cat.
“I don’t much care where—” said Alice.
“Then it doesn’t matter which way you go,”
said the Cat.
“—so long as I get somewhere,” Alice added
as an explanation.
“Oh, you’re sure to do that,” said the Cat, “if
you only walk long enough.”

4. Establishing benchmarks

5. Examples of benchmarks

6. Examples of benchmarks
Arizona State University
• Enhance university
graduation rate to 75-80%
• 2014 enrollment = 83,301
• 75-80% = 62.5 – 66.5 K
students between 2015-18
City University of New York
• 50% of entering students earn
AA within 3 years
• 2012 cohort = 1,562
• 50% = 781 students by 2015

7. Metrics

8. Higher education digital capabilities
Conceptual map

9. Motivations for investing in learning analytics

10. Uses of learning analytics data

11. Maturity Indices measure the capability to deliver IT services
and applications in a given area.
Deployment Indices measure stages of deployment for
specific technologies and services, which are aggregated to
track progress by area.

12. Maturity Indices

13. Student success maturity index: overall

14. Maturity index composite scores by scale

15. Student success maturity index: Process and
policy

16. Student success maturity index: Student
success

17. Detail of maturity index measures

18. Deployment Indices

19. Student success deployment

20. Student success deployment

21. Detail of deployment index measures

22. Benchmarking using Core Data Service

23. EDUCAUSE
SERVICES
Tools for Better Decision Making
Technology Research in the
Academic Community
Track student and faculty technology
needs and experiences
Core Data Service
Compare peer and aspirant data
for IT financials, staffing, and services
Benchmarking Service
Measure technical and cultural capability
for digital initiatives like student success
BENCHMARKING
ENHANCE DECISION MAKING | educause.edu/research
Campus leaders use EDUCAUSE assessment and benchmarking services to plan for and manage IT service
delivery, financials, security and risk, technology-supported learning, and digital initiatives.
Learning Space Rating System
Measure how classroom design supports
and enables active learning
Information Security Program
Assessment Tool
Evaluate the maturity of your
information security program
IT Risk Register
Identify common risks to support your
strategic IT risk-management program
ASSESSMENT

24. The EDUCAUSE Benchmarking Service

25. MI Composite Score

26. MI & DI Overview

27. Maturity Dimension Scores

28. Maturity Item Detail

29. Maturity Item Detail

30. Deployment Item Detail

31. “Would you tell me, please, which way I
ought to go from here?”
“That depends a good deal on where you
want to get to,” said the Cat.
“I don’t much care where—” said Alice.
“Then it doesn’t matter which way you go,”
said the Cat.
“—so long as I get somewhere,” Alice added
as an explanation.
“Oh, you’re sure to do that,” said the Cat, “if
you only walk long enough.”

32. Help Us Improve and Grow
Thank you for participating
in today’s session.
We’re very interested in your feedback. Please take
a minute to fill out the session evaluation found within
the conference mobile app, or the online agenda.

33. Thank you!
Jeffrey Pomerantz
Senior Research Analyst
EDUCAUSE
@jpom
D. Christopher Brooks
Senior Research Fellow
EDUCAUSE
@dcbphd