The Baptist College of Florida implemented a new assessment system using LiveText across all academic programs to improve institutional effectiveness. The implementation involved five layers including gaining buy-in from faculty and students, extensive faculty and student training, and oversight from program coordinators. Key aspects of the system included developing student learning outcomes, curriculum maps, rubrics, and outcome achievement reports. While challenges occurred during rollout, the new system facilitated a culture of continuous improvement through collaborative data analysis and curriculum enhancements aligned with learning outcomes.

1. Designing and
Implementing an
Assessment System
in a Small College
Dr. Susan Wegmann
The Baptist College of Florida
2016 LiveText Assessment
Conference
sjwegmann@baptistcollege.edu Slideshare.net/swegmann

2. Layers of Implementation
Demo and buy-in
Faculty Development
Student Development
Faculty Development
Program Coordinators
Five Layers of
implementation
2

3. After reading our
comparison studies, the
Administration made the
decision to implement
LiveText across all
programs.
Demo and buy-
in
Faculty Development
Student Development
Faculty Development
Program Coordinators
3
Layers of Implementation

4. 1. Needed to move from
administrativeOutcomes and
Goals to Student Learning
Outcomes (SLOs)
2. Identified LiveText Key
Assignments in each program.
3. Created Curriculum Maps for
each program.
4. Identified at least one
assessment measure for each
Program Student Learning
Demo and buy-in
Faculty
Development
Student Development
Faculty Development
Program Coordinators
4
Layers of Implementation

5. All students in Fall 2014 were
required to purchase LiveText,
except graduating seniors.
Website updated to include
training PDFs and videos
Computer Lab hosted LiveText
training sessions.
Demo and buy-in
Faculty Development
Student
development
Faculty Development
Program Coordinators
5
Layers of Implementation

6. Professional Development
Sessions:
1. “Getting off the SLO Boat:
Creating Measurable SLOs”
2. Development of Rubrics to
accompany LiveText Key
Assignments
3. How to assess using LiveText
interface
4. How to instruct students to
use LiveText
Demo and buy-in
Faculty Development
Student Development
Faculty
Development
Program Coordinators
6
Layers of Implementation

7. Outcome Achievement Reports
(OARs)
OARs describe:
a. Program Student Learning Outcomes (SLOs)
b. Student performance on each Program SLO.
c. Alignment to Assessment, matching each SLO with logical
assessment measure(s)
d. Curriculum and Assessment Maps
e. Program Goals for each Assessment task.
f. Operational and Long-Range Strategies for each Program
SLO.
sjwegmann@baptistcollege.edu Slideshare.net/swegmann
7

8. Example of Elementary Education 2014-2015 OAR
8

9. Rubric to assess Program OARs
9

10. Continuous
Improvement activities:
following up with all
faculty to complete
assessments, create
reports from data,
interpret reports,
complete OARs, etc.
Demo and buy-in
Faculty Development
Student Development
Faculty Development
Program
Coordinators 10
Layers of Implementation

11. Revised: 2/19/2016
* If a Program Coordinator has multiple Programs to lead, one of the Program ePortfolios is due by the first Friday in September. The subsequent programs will be due at two
week intervals.
** Quality Assurance Team will assess first submissions of program ePortfolios by Nov. 1. Since Program Coordinators who lead more than one program will submit at two week
Timeline of
Continuous
Improvement
@ BCF
11
sjwegmann@baptistcollege.edu Slideshare.net/swegmann

12. Institutional
Effectiveness
Assessment
LiveText
Curriculum
Maps
Faculty
and
Student
Buy-In
Rubrics
Student
Learning
Outcomes
12
sjwegmann@baptistcollege.edu Slideshare.net/swegmann

13. Assessment Insight System (AIS))
Implemented AIS in January 2016:
1. Created 2014-2015 OARs in AIS for each program.
2. Evaluated 2014-2015 OARs with existing rubric.
3. Trained Program Coordinators, May 2016.
4. Expectations: Program Coordinators and Unit
Leaders (Academic Support and Administrative
Support units) will complete 2015-2016 OARs in
AIS.
5. Quality Assurance Team will evaluate 2015-2016
OARs this November using AIS and rubrics.
15sjwegmann@baptistcollege.edu Slideshare.net/swegmann

14. AIS Administration Dashboard
16

15. AIS System at BCF
• www.livetext.com
17sjwegmann@baptistcollege.edu Slideshare.net/swegmann

16. Lessons Learned - AIS
• The more training the better.
• LiveText support has been incredible.
• Some pages build on previous pages.
• Explicit instructions are critical – Author’s
Manual from LiveText website Plus our own
directions
• The reports in AIS are different than those in
LiveText, but they serve a different purpose.
• Treat some of the processes with humor. . .
18
sjwegmann@baptistcollege.edu Slideshare.net/swegmann

17. OAR Awards given to. . .
• “Don’t sink the ship” award - Dr. Wegmann and Prof. Johnson,
BA Elementary Education, for having 8 SLOs
• “Aren’t we going in circles?” award - Dr. Rathel, Associate of Divinity,
for logging in the most questions
• “Tree, what tree?” award - Dr. Ford, BA Christian Counseling to BA
Psychology, for changing the entire program name and numerous courses
(and getting her Ph.D. along the way!)
• “Let’s row together” award - Drs. Jumper, Buice, and Scott, BA
Ministry, BA Ministry Studies, BA Christian Studies, for Unifying their
Curriculum Maps
• “ Row, row, row your boat” award - Prof. Grier, General Education, for
being Program Coordinator of THREE programs.
• “Swap your oar” award - Dr. Albin and Chantel, BA Business
Leadership, for the most changes in course numbers and Curriculum Maps
• “Don’t need no stinkin’ oar” award - Dr. Richards, BA in History/Social
Studies, for creating an OAR with the least amount of data
• “We’re all in this boat together” award - Dr. Davis and Music Division,
for adding, subtracting, and revising all programs and Curriculum maps in
Division
19

18. Struggles and Roadblocks
• Student buy-in initially - those at first semester of
senior year.
• Faculty buy-in initially – learning the new process
• Standardizing syllabi, Curriculum and Assessment
Maps, and rubrics
• End of year reporting – tight timeline
• Formation of Quality Assurance Review
Committee
• Faculty who share programs using the same
courses
• Double-majors, minors, etc.
sjwegmann@baptistcollege.edu Slideshare.net/swegmann 20

19. Successes
• First time analysis of student learning in
programs among faculty
• Faculty sharing rubrics and ideas about
programs
• Content of coursework being modified to
closely align with Student Learning
Outcomes at program and course levels.
• All faculty attending to the “bigger picture”
• Data-gathering for SACSCOC
documentation
sjwegmann@baptistcollege.edu Slideshare.net/swegmann
21

20. Future
• Honing Curriculum and Assessment Maps
to further strengthen programs.
• Strengthening a culture of Assessment
and Continuous Improvement on our
campus
• Increasing the number of programs that
use ePortfolios for student assessment.
• Training students to create professional
ePortfolios for job applications
• Creating Faculty portfolios
sjwegmann@baptistcollege.edu Slideshare.net/swegmann
22

21. Designing and
Implementing an
Assessment System
in a Small College
Dr. Susan Wegmann
The Baptist College of Florida
2016 LiveText Assessment
Conference
sjwegmann@baptistcollege.edu Slideshare.net/swegmann
www.plickers.com