This document provides definitions and explanations related to reporting outcomes for the Colorado Helps Advanced Manufacturing Program (CHAMP). It defines key terms like "unique participant," "enrolled," and "program completer." It also explains the process for counting CHAMP students and tracking their outcomes. Finally, it discusses the purpose of evaluating and reporting on the program, and some issues that can arise related to tracking employment outcomes and identifying eligible students.

1. CHAMP Reporting Counts
Ian Burke
Colorado Community College System
May 4, 2015

2. CHAMP Counts and Outcomes
through Fall 2014
Outcome Definition AIMS CCD EGTC FRCC LCC MSU PPCC PCC RRCC
Total (expected totals based on
Statement of Work)
1. Total Unique Participants Served - expected
Number of unique students who have enrolled in at least
one (1) CHAMP course (as listed in "Playbook").
202 324 225 305 22 300 111 196 200 1885
Latest count 349 94 pending 95 47 183 307 384 32 1491
2. Total Participants CompletingTACT funded Program of
Study - expected
Number of students who earned a CHAMP credential as
listed in the playbook.
122 163 170 259 24 125 65 106 96 1130
Latest count 5 9 pending pending 0 0 25 12 8 59
3. Total Participants retained in their program or other
TACT program - expected
Number of unique participants who were enrolled in
CHAMP courses in previous terms who are enrolled in
the current term (excluding Summer) who have not yet
earned a degree or certificate
101 97 57 13 6 155 36 196 138 799
Latest count pending 30 pending 11 23 pending 67 71 13 215
4. Total Participants completingcredits - expected
Unique Number of students who have successfully
completed credit hours in CHAMP coursework
202 324 225 36 33 300 111 156 200 1587
Latest count 296 89 pending 0 41 pending 268 353 26 1073
5. Total Participants earning credentials - expected
Number of students enrolling in CHAMP courses who
earned certificates or degrees of any kind
61 176 170 259 24 90 48 106 96 1030
Latest count 88 10 pending 1 4 pending 59 52 8 222
6. Total Participants enrolled in further education -
expected
Number of unique students who completed a CHAMP
certificate AND enrolled in a subsequent semester
7 53 90 22 6 110 21 108 43 460
Latest count pending 7 pending 0 0 pending 9 4 1 21
7. Total Participants Employed after completion - expected
[EXCLUDES INCUMBENT WORKERS] Number of unique
students who completed a CHAMP certificate AND
earned wages in the next quarter
56 194 156 49 20 117 70 44 103 809
Latest count pending pending pending pending pending pending pending pending pending 0
8. Total participants retained in employment - expected
[EXCLUDES INCUMBENT WORKERS] Number of unique
students who completed a CHAMP certificate AND
earned wages for the three consecutive quarters
following the completion of the certificate or degree
45 135 155 35 17 101 61 33 79 661
Latest count pending pending pending pending pending pending pending pending pending 0
9. Total Participants who received a wage increase -
expected
9. Total Participants who received a wage increase
11 204 132 176 7 91 40 27 79 767
Latest count pending pending pending pending pending pending pending pending pending 0

3. “Unique [grant-affected] Participant”
• Any student enrolled in in a CHAMP associated class
that has been impacted by CHAMP dollars since
October 2013.
– Examples include courses (online, hybrid or traditional)
that are directly influenced by CHAMP program dollars.
– This could include a course created with the support of the
CHAMP grant, a course using CHAMP dollars to make
additions or changes to the curriculum, or a course
utilizing equipment purchased with CHAMP dollars.
– A list of CHAMP-affected courses can be found at
https://www.cccs.edu/partnering-for-success/trade-
adjustment-assistance/taa-champ/taa-champ-archive-
documentation/ under the “CHAMP Degrees, Certificates
and Courses” tab.

4. “Enrolled”
• Any student with a registration status that does not
indicate a dropped course.
• Some IR personnel might use the course census date
headcount; the annual CHAMP report includes all
students with non-drop registration status. These
numbers are similar, but not identical, due to
differences in methodology (it is possible to drop a
course after the census date in some cases).

5. “Course Eligibility”
• A course is CHAMP-affected if it has been
redesigned with CHAMP dollars, uses equipment
purchased with CHAMP dollars, or is otherwise
affected by changes occurring due to CHAMP. A
list of affected courses can A list of CHAMP-
affected courses can be found at
https://www.cccs.edu/partnering-for-
success/trade-adjustment-assistance/taa-
champ/taa-champ-archive-documentation/
under the “CHAMP Degrees, Certificates and
Courses” tab.

6. “Program Completer”
• The total number of unique participants who
completed any grant-funded program to date.
• The student must complete all required courses
as prescribed by the program to confer the
degree or certificate. Clarification note: The
student may complete any combination of
traditional and redesigned courses in order to
complete the degree requirement.
• Participants who complete should only be
included once during the period of performance,
even if they complete multiple programs.

7. Process for Counting CHAMP students
• Students taking grant-affected courses (as
defined by the playbook in terms of course ID,
campus location, and term) are identified.
• This population is tracked for course
completion, retention, program completion,
and employment.
• Program completions are only counted once
the degree becomes grant-affected.

8. Purpose of Evaluation
• To describe the way a program works
– Logic models – cause and effect
• To assess the effectiveness of a program
– Comparisons – improvement over time
• To determine the impact of a program
– Return on Investment

9. Purpose of Reporting
• To describe the per-capita impact of funding
– Similar to return on investment, but causal
relationships should not be assumed
– Correlation != Causation

10. Issues related to Reporting
• Tracking employment outcomes
• Identifying TAACCCT-eligible students

11. Issues related to Program Evaluation
• Earning Credits vs. Proving Proficiency
• Showing Cause and Effect
• Identifying what works and what doesn’t
• Are some programs more effective for some
people than others?

12. Creative Commons Attribution
This Workforce Solution presentation created by Ian Burke under the Colorado Helps Advanced
Manufacturing Program , is licensed under a Creative Commons Attribution 4.0 International
License.Permissions beyond the scope of this license may be available
at https://www.cccs.edu/partnering-for-success/trade-adjustment-assistance/taa-champ/.
This workforce solution was funded by a grant awarded by the U.S. Department of Labor’s Employment
and Training Administration. The solution was created by the grantee and does not necessarily reflect
the official position of the U.S. Department of Labor. The Department of Labor makes no guarantees,
warranties, or assurances of any kind, express or implied, with respect to such information, including
any information on linked sites, and including, but not limited to accuracy of the information or its
completeness, timeliness, usefulness, adequacy, continued availability or ownership.