This document provides an agenda and information from a webinar on best practices for using data-driven eLearning applications. The webinar featured speakers from several colleges discussing their implementation and use of SmarterMeasure's Learning Readiness Indicator. The webinar covered topics such as integrating the indicator into orientation courses, using the data to identify at-risk students, individualizing student support, and conducting research on the tool's impact. Overall, the webinar provided guidance and examples for how institutions can effectively utilize readiness data to improve student outcomes.

1. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 1Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved.
Top 10 Best Practices on
10/10
SmarterMeasure™
Learning Readiness
Indicator
Julie Owen, Chief Sales and Marketing Officer
Tara McLaughlin, National Account Manager
Devan Flowers, Account Manager

2. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 2
AGENDA
» All participants will receive the webinar recorded link and
slidedeck.
» Feedback survey at the close of the webinar – PLEASE let us
know how we did, your feedback helps us improve
» Speakers
– Devan Flowers & Tara McLaughlin – Top 10 Best
Practices
– Carly Brady – Madison College
– Eddie Andreo – Cowley College
– Dr. Jasmeial “Jazz” Jackson – Southern New Hampshire
University
– Crystal Faulkner – Austin Peay State University

3. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 3
TOP 10 THINGS YOU SHOULD KNOW
1. SmarterServices has been serving educational institutions and their students for 15 years!
2. Our team has over 100 years combined experience.
3. Recently we launched our master brand – SmarterServices
4. The Learning Readiness Indicator is the country’s leading non-cognitive assessment
5. We never turn down a big glass of sweet tea…
6. We provide SmarterProctoring which is the only complete proctoring solution on the market in
higher education.
7. OLC Conference in Orlando – Big Splash with a new announcement about SmarterProctoring
8. We serve over 500 clients institutions across the 50 states, Latin America, Canada, and Australia.
9. We have released SmarterAssessments which is a custom assessment platform
10. SmarterMeasure has expanded to a complete suite of readiness assessments
– Learning Readiness Indicator
– Competency Based Education Readiness Indicator
– Teaching with Technology Readiness Indicator

4. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 4
TOP 10 BEST PRACTICES
IMPROVEINVESTIDENTIFY IMPACTINDIVIDUALIZE
INTEGRATEINFORM IMPLEMENT INSTRUCTINVESTIGATE

5. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 5
INFORM CUSTOM
MESSAGE ON
STUDENT
REPORT
ORIENTATION
PPT/VIDEO
ABOUT
ASSESSMENT
INFORMATIONAL
DOCUMENTS
EMAIL
STUDENTS INFO
POLL

6. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 6
INTEGRATE
» http://www.smartermeasure.com/about/integration/
» LMS LTI User’s Guide Blackboard, Canvas, D2L
» FREE LTI keys provided by your Account Manager upon request
» REST API Docs: http://api.smartermeasure.com
» Webhooks: https://smarterservices.atlassian.net/wiki/display/SM
CD/Webhooks
POLL

7. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 7
IMPLEMENT – Complete Client Implementation
Survey
https://www.research.net/r/2017ClientImplementationSurvey
COLLEGE FRESHMEN – 87%
COLLEGE SOPHOMORES – 62%
REQUIRED COMPONENT – 67%
FIRST YEAR EXPERIENCE – 14%
ORIENTATION COURSE – 52%

8. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 8
INVESTIGATE
Follow Up
Assignment
Review
Student Data
Communicate
Review
Resources

9. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 9
Add Custom Message to Student
Report – Call to Action Follow Up
Assignment

10. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 10
Educator Report
Review
Student Data

11. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 11
Customize Resources for Support
Review
Resources

12. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 12
INSTRUCT
Instruct
Discussion
Boards-
Conversation
with
classmates
Completely
Customizable
Have
Conversation
with Students
Recommend
Resources and
check for
usage
Review
Strengths and
Weakness
with Students

13. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 13
Carly Brady
Project Leader of Academic Strategy & Analysis

14. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 14
Madison Area Technical College
»Serve all or parts of 12 counties in Southcentral
Wisconsin
– 5 campuses within Madison
– 4 regional campuses
»Academic Year 2017:
– Served 35,301 students (unduplicated)
– Served 8,719 students in online classes (unduplicated)
»Offer credentials up to the 2-year Associate Degree
»Largest “feeder” school for UW-Madison

15. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 15
Our Goals with Creating the “Orientation
to Online and Accelerated Learning”
» Close the achievement gap between online and face-to-
face classes
– Online students were dropping at a higher rate than students
in face-to-face classes
– Success rates for online students was approximately 10% lower
than face-to-face
»Limit the barriers to accessing and completing the
Orientation
– Madison College subscribes to SmarterMeasure
– Madison College uses Blackboard for their LMS
…..and there’s a building block for SmarterMeasure in Blackboard!

16. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 16
“How” and “When”?
»Prior to registering for
their first online class.
»Prior to be admitted to a
fully online program.
Make the Orientation a Pre-Requisite

17. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 17
Directions for Enrolling in the Orientation:

18. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 18
Orientation to Online and Accelerated Learning

19. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 19
Contents of the Orientation
»Task 1: View a short video to introduce you to the online
course format
»Task 2: Complete a 13 question quiz regarding the video
and information provided on our “Preparing for Flexible
Learning” page
»Task 3: Resources at Madison College for online learners
»Task 4: Complete the SmarterMeasure Assessment
(we chose to only use questions from “Life Factors”, “Personal Attributes” and “Technical Competency”)

20. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 20
After completing the Smarter Measure
Assessment…
»Students can enroll in an online class!
– Immediately after the student completes all three sections of
the assessment, the Gradebook in Blackboard sends the 100%
completion score to PeopleSoft to meet the course pre-
requisite:

21. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 21
Smarter Measure at Madison College
»USAGE:
– Total Assessments since March 1, 2017: 2,712
– Total Assessments since January 1, 2013: 20,765
– Total Assessments since August 2008: 30,633
»RESULTS:
– Students who successfully “pass” all three sections of the
Smarter Measure Assessment in the Orientation are 10% more
likely to succeed in their online course than students who “fail”
a section:

22. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 22
Eddie Andreo
Assoc VP for Distance Learning, Cowley College
eddie.andreo@cowley.edu
linkedin - https://www.linkedin.com/in/eddieandreo/
twitter @EddieAndreo
12 years of Higher Ed. teaching experience
online
9 years in Instructional Design
Certified QM Trainer
Support Faculty and Students in Blackboard
Manage LMS, SIS Integration, Tutor.com,
etc.

23. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 23
About Cowley College
» Located in Arkansas City, Kansas

24. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 24
About Cowley College
» Founded in 1922
» 2 year, public community college
» Accredited by Higher Learning Commission
» 4000 FTE
» 80+ majors
» 23:1 student to faculty ratio
» 50%+ enrollment fully online
» Exponential growth since 2007
– 60 online course to now more than 1000 fully online

25. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 25
Why SmarterMeasure LRI
»We recently hired a Retention Coordinator
»The need to identify at-risk students early
»We had students taking online courses who
did not have the time management and
persistence skills to succeed
– Needed to know how to better support them
»Pulling this data from the LMS/SIS was
difficult and not always accurate

26. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 26
How is SMLRI Used
» Started the project in July
» Integrated into our Bb Online Student
Orientation course
» All students are required to complete the Bb
Online Student Orientation prior to having
access to their courses
» First assessment under 1] Begin and Login
» Approx. 400 assessments in July 2017

27. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 27

28. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 28
SMLRI Data
» Students can review the data immediately
» The Retention Coordinator has access to the data
– Communicates with at-risk students
– Utilizes SM’s coaching prompts
» Some instructors are asking their students to submit
their SM Reports as an assignment
– Faulty now know how to support their students
» EARLY: Analyzing data to determine patterns based
on Life Factors, 1st Gen, etc.

29. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 29
Takeaways/benefits
»SM LRI provides indicators for us to support
students early on
»Provides a tool for the Retention Coordinator to
coach students
»Valuable data to increase retention rates and
make data driven decisions
»SM LRI is a tool to help us support the
conversation with students where online may not
be the best option for their success

30. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 30
Dr. Jasmeial “Jazz” Jackson
Assoc Dean of First Year Experience & Retention Programs, Southern New
Hampshire University
j.jackson5@snhu.edu
LinkedIn: https://www.linkedin.com/in/jasmeialjackson/
Twitter:@drjazzjackson

31. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 31
» Located in Manchester, NH
» College of Online and
Continuing Education
(COCE)
– 75,000 Students
• Associate, Bachelor, and
Masters Programs
31
SmarterMeasure LRI
Southern New
Hampshire
University
University
College (Campus)
College of Online
and Continuing
Education
College for
America
Sandbox
ColLABorative

32. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 32
32
» SmarterMeasure Utilization
SmarterMeasure Usage
• Admission
Orientation
• Educators
First Year
Seminar Course
• Advising
FYS and Beyond

33. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 33
33
» Orientation
SmarterMeasure Implementation

34. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 34
34
» First Year Seminar
SmarterMeasure Implementation

35. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 35
35
» Results
SmarterMeasure Implementation

36. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 36
Crystal Faulkner
Online Support Coordinator
APSU Distance Education
faulknerc@apsu.edu
www.linkedin.com/in/crystalfaulkner360/

37. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 37
Austin Peay State University
»Clarksville, Tennessee
»4-year public institution
»Associate, bachelor, and master level degrees
»10,310 average 5-year head count (2012-2016)
»67.4% retention rate (Fall 2016 to Fall 2017, FTFT)
»39.38% six-year graduation rate (2010 FTFT cohort)
APSU Institutional Research and Effectiveness | www.apsu.edu/ire

38. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 38
Road to SmarterMeasure
» Online higher education
» Assess technology skills
» Assess non-cognitive skills
» Feedback & resources
» Reporting

39. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 39
Pilot Goals
Partnership
FundingCurriculum
Support &
Training

40. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 40
Pilot Data
»19 sections
»13 instructors
»354 students
»183 completed both SmarterMeasure and survey
»51.7% completion rate

41. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 41
Pilot Student Results

42. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 42
Pilot Student Results

43. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 43
Pilot Student Results

44. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 44
Pilot Instructor Survey Results

45. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 45
Full Deployment & Research
»Fall 2017
»106 sections
»83 instructors
»2,047 students
»1,685 started
»1,499 completed
»Effectiveness of curricula
changes
»APSU vs similar institutions
»Students’ confidence in
online readiness
»Students’ intent to enroll in
online courses

46. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 46
IDENTIFY – AT-RISK STUDENTS
• Who is ready and who may need
additional support in non cognitive
attributes and skills sets?
• Measured in SMLRI
• Math Readiness
• Writing Readiness
• Send reports to
advisors/tutors/coaches to
intervene according to low scores

47. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 47
INDIVIDUALIZE – Student Support
Engage Early for
Best Results
Proactively Support
Students
Personalize Support
Based on
STRENGTHS and
WEAKNESSES
Provide Strategies
for Overcoming
Challenges based
on readiness scores
(high/medium/low)

48. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 48

49. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 49
INVEST – Get all stakeholders
involved
Who else can benefit from the
SMLRI student data?
• Faculty
• Advisors
• Admissions
• Institutional Effectiveness

50. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 50
Provide Training
(Facilitated by
SMLRI AM)
Create SMLRI
Admin Logins
Create Dialogue
Using 4 SMLRI
Reports

51. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 51

52. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 52
IMPACT – Conduct Research
Predictive
Correlation
Comparison
Descriptive
Student Service
Types of Data analysis

53. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 53
IMPROVE – Expand your use of the
tool
IMPROVE
Expand usage
to other
populations
Look for trends
in low scoring
areas
Modify
readiness
ranges
Share learning
styles
information w/
Instructional
Design team
Conduct data
analysis &
involve
Institutional
Effectiveness
team

54. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 54
WEBINAR RESOURCES
»CLIENT IMPLEMENTATION SURVEY CLOSING ON 10/16
– https://www.research.net/r/2017ClientImplementationSurvey
»RESEARCH
– http://www.smartermeasure.com/research/
– http://www.smartermeasure.com/research/research-results/
– http://www.smartermeasure.com/research/accreditation/
– http://www.smartermeasure.com/research/case-studies/

55. Data-driven eLearning applications. | © SmarterServices, LLC. All rights reserved. 55
• DON’T FORGET TO COMPLETE THE CLIENT IMPLEMENTATION
SURVEY
• FOLLOW UP SURVEY-EXIT THE WEBINAR
• FOLLOW UP EMAIL WITH RECORDING & SLIDEDECK
THANK YOU!