Taking D t t th N t L
T ki Data to the Next Level
                          l

 Developing Data to Assess Student Progression

       Maury Pearl, LACCD Institutional Effectiveness
                   September 23, 2011
High Interest in Student Progression
  High Interest in Student Progression
• Understanding the Complete Picture 
   – Short‐term measures
     Short term measures
   – Longer term perspective
• Research Findings
   –LLow rates of student progression
           t    f t d t           i
   – Achievement  gaps
• Desire for Improvement 
               p
   o   Describe student progression
   o   Identify problems or issue along path
   o   Research possible explanations
       Research possible explanations
   o   Design and implement interventions
   o   Assess and evaluate
Student Progress Research Questions
 Student Progress Research Questions
• What has been the progress of first time
                                  first-time
  program pursuing students (students who
  attempted 12 units or more in the first
  year) who were assessed and placed in
  Basic Skills Math?
• Does progress vary by ethnicity?
Basic Skills Math Improvement Over Three Years*

  Progress of first-time program pursuing students (attempted 12 units or
  more in the first year) who were assessed and placed in Basic Skills Math.
     Fall 05: assessed=9,201, placed in BS=6,549
     Fall 06: assessed=9,482, placed in BS=6,563
     Fall 07: assessed=10 040 placed in BS=6 915
              assessed=10,040,           BS=6,915
  * Over the three cohorts, 70% of those assessed in Math have been placed in the basic skills levels.




100%
                         Of Those Placed in Basic Skills Math

75%       69% 70% 69%


50%                           42% 42% 41%
                                                  33% 35% 36%

25%                                                                   18% 20% 20%
                                                                                           8% 10% 9%

 0%
          Enrolled in  Completed 1st                Passed              Passed          Passed College
        Recommended Course in 1st                 Elementary         Intermediate          Algebra/
         Course in 1st    Year                      Algebra           Algebra or        Transfer Level
            Year                                                       Geometry             Math
                       Fall 05 Cohort             Fall 06 Cohort             Fall 07 Cohort
Progress Of Fall 2007 Cohort Students Placed in Basic
                         Skills Math


  80%

  70%

  60%

  50%

  40%

  30%

  20%

  10%

   0%
           Enrolled in        Completed First       Passed              Passed        Passed College
          Recommended          Course in the      Elementary         Intermediate       Algebra /
          Course in the         First Year         Algebra             Algebra        Transfer Level
            First Year                                                                    Math



                                    Asian         Black        Hispanic         White



                                                                                    Amer I d/
                                                                                    A     Ind/
                                                                                    Other Non-    All
                                Asian         Black       Hispanic      White         White    Students
Enrolled in Recommended
                                   67.6%        62.4%        73.7%        62.3%         57.4%      69.8%
Course in the First Year

Completed First Course in
                                   50.6%
                                   50 6%        26.4%
                                                26 4%        43.5%
                                                             43 5%        44.9%
                                                                          44 9%         40.6%
                                                                                        40 6%      41.6%
                                                                                                   41 6%
the First Year

Passed Elementary Algebra          47.2%        18.5%        36.8%        46.8%         43.9%      36.2%


Passed Intermediate Algebra        30.6%         7.3%        19.7%        26.3%         19.4%      19.5%

Passed College Algebra /
                                   17.7%         3.1%          9.1%       12.0%          8.4%          9.2%
Transfer Level Math

                                            Supplemental Slides                                           1
Student Outcomes Database
    Student Outcomes Database
• Student unit record (SUR)
• Currently based Fall 2007 cohort
• Includes student characteristics (age, gender, 
                                   ( g ,g      ,
  ethnicity, student status) 
• Contains outcomes (units attempted units
  Contains outcomes (units attempted, units 
  completed, attempted BS English, attempted 
  BS Math, …, completed degree or certificate)
  BS Math, , completed degree or certificate)
• Database
Outcomes Database

      Variable Name                          Variable Description
ID                    Student ID
CAMPUS                Campus
SEM                   Term of entry
SEX                   Student gender
AGE                   Student age group (at the time of entry)

                                      1.00      Under 20
                                      2.00      20 - 24
                                      3.00      25 - 34
                                      4.00      35 - 54
                                      5.00      55 and over
                                      9.00      Unknown
ETHNIC                Student ethnicity
                                      1.00
                                       .00      Asian
                                                 s a
                                      2.00      Black
                                      3.00      Hispanic
                                      4.00      White
                                      5.00      Amer Ind/Other Non-White
                                      6.00      Unknown/Decline to State
NEW                   Entering status
                      2.0    1st Time Student
                      2.4    Former Concurrent Student This College
                      2.6    Former Concurrent Student Another
                      College
UNATTMPT              Units attempted in Fall 07
UNCOMPLT              Units completed in Fall 07
POINT1                Student attempted units in Fall 07 (1=yes)
POINT2                Student completed units in Fall 07 (1=yes)
ATT20081              Units attempted in Spring 2008
POINT3                Student attempted units in Spring 08 (1=yes)
ATT20083              Units attempted in Fall 08
POINT4                Student attempted units in Fall 08 (1=yes)
COMPENGL              Student completed any basic skills English/ESL (1=yes)
COMPMATH              Student completed any basic skills math (1=yes)
COMPE101              Student completed English 101 (1=yes)
COMPM125              Student completed Math 125 (1=yes)
COMPBOTH              Student completed English 101 and Math 125 (1=yes)
TOTCOMPL              Total units completed
COMP60UN              Student completed 60 units or more (1=yes)
TRANMATH              Student completed transfer-level math (1=yes)
DEGRCERT              Student completed degree or certificate (1=yes)
                             Supplemental Slides                               2
Research Using Outcomes Database
  Research Using Outcomes Database

Analysis of Academic Pipeline and Exit Points
  • City
       y
  • Mission
Next




Supplemental Slides          3
Tables
Degree‐Seeking Academic Pipeline @ Los Angeles Mission College
      Fall 2007 Cohort – Academic Years of Study: 07‐08, 08‐09, 09‐10, 10‐11

Exhibit 1                                 Taking Placement Test Results
Cohort Fall 2007 = 1278        Level of Readiness               Total             % 
Not taking placement test
Not taking placement test                                           327            26%31 Earned Award
                                                                                   26%31 Earned Award
Take placement test                                                 951            74%

                               College ready (M125 & E101 or 
                               E28)                                   53           5.6%
                                     Need English only (M125)         29           3.0%
                                 Need Math only (E101 or E28)        222          23.3%
                                                   Need both         647          68.0%
                                                                     951         100.0%

Exhibit 2 ‐ Momentum Point 1                      Attempted and Completed units in Fall 2007

Level of Readiness             Original cohort                  Attempted %               Completed          %
College ready (M125 & E101 or 
E28)                                                      53                53 100%                     48          91%
Need english only (M125)                                  29                29 100%                     27          93%
Need math only (E101 and/or 
E28)                                                     222            222 100%                       195          88%
Need both                                                647            647 100%                       474          73%

                                                                                              744
Exhibit 3 ‐ Momentum point 2                     Attempted and Success Developmental Courses
                                                            No. 
                                                            Attempte
Level of Readiness             Original Cohort              d         % Attempted No. Success     % Success
Need English only (M125)
N d E li h l (M125)                                      29        23         79%              19           83%
Need Math only (E101 and/or 
E28)                                                     222      182                 82%              130           71%
Need both                                                647      571                 88%              356           62%
             Dev Math courses                                     478                 74%              265           55%
               Dev ESL courses                                    459                 71%              291           63%
                                                                  776                                  505
Exhibit 4 ‐ Momentum Point 3              Completed both E101 and M125                        Completed 60 units or more
                                                                           % 
                                                                           %
                                                                Completed  Completed 60 Units or 
Level of Readiness             Original cohort                  both       both      more                    %
College ready (M125 & E101 or 
E28)                                                      53                37        70%               26          49%
Need english only (M125)                                  29                14        48%               17          59%
Need math only (E101 and/or 
E28)                                                     222                57        26%               58          26%
Need both
Need both                                                647                77        12%              128          20%

                                                                    185                          229
Exhibit 5 ‐ Momentum point 4                      Earned an Award or Still Enrolled in Fall 2011
                                                            Still     % Still 
Level of Readiness             Original cohort              Enrolled Enrolled         Awards         % Awards
College ready (M125 & E101 or 
E28)                                                      53           12             23%               19          36%
Need english only (M125)
         g      y(     )                                  29            6             21%               10          34%
Need math only (E101 and/or 
E28)                                                     222          42              19%               33          15%
Need both                                                647         130              20%               54           8%
                                                                     190                               116
                                             Supplemental Slides                                                           4
Students Entering and Leaving the Pipeline From Fall 2007 to Spring 2011
                                           Fall 2007 Cohort (FTIC) 
1000


 900

                              207
 800


 700


 600
                                                 239                                                           Unsuccess/Incompleted


 500
           951                                                                                                 Success/Completed
 400
                              744                                 276
                                                                                   320
 300
                                                 505
 200
                                                                                                   113
 100                                                              229              185
                                                                                                  116
   0
       Take placement     Completed any        Successful      Completed 60    Completed E101  Earned awards
        test in Fall 07   units in Fall 07   completed dev.    units or more     and M125
                                                courses
Directions for Outcomes Database
Directions for Outcomes Database
• Online access and analytical tools
  Online access and analytical tools
• Additional data elements
• Other Ideas?

Das presentation 2011

  • 1.
    Taking D tt th N t L T ki Data to the Next Level l Developing Data to Assess Student Progression Maury Pearl, LACCD Institutional Effectiveness September 23, 2011
  • 2.
    High Interest in Student Progression HighInterest in Student Progression • Understanding the Complete Picture  – Short‐term measures Short term measures – Longer term perspective • Research Findings –LLow rates of student progression t f t d t i – Achievement  gaps • Desire for Improvement  p o Describe student progression o Identify problems or issue along path o Research possible explanations Research possible explanations o Design and implement interventions o Assess and evaluate
  • 3.
    Student Progress Research Questions Student ProgressResearch Questions • What has been the progress of first time first-time program pursuing students (students who attempted 12 units or more in the first year) who were assessed and placed in Basic Skills Math? • Does progress vary by ethnicity?
  • 4.
    Basic Skills MathImprovement Over Three Years* Progress of first-time program pursuing students (attempted 12 units or more in the first year) who were assessed and placed in Basic Skills Math. Fall 05: assessed=9,201, placed in BS=6,549 Fall 06: assessed=9,482, placed in BS=6,563 Fall 07: assessed=10 040 placed in BS=6 915 assessed=10,040, BS=6,915 * Over the three cohorts, 70% of those assessed in Math have been placed in the basic skills levels. 100% Of Those Placed in Basic Skills Math 75% 69% 70% 69% 50% 42% 42% 41% 33% 35% 36% 25% 18% 20% 20% 8% 10% 9% 0% Enrolled in Completed 1st Passed Passed Passed College Recommended Course in 1st Elementary Intermediate Algebra/ Course in 1st Year Algebra Algebra or Transfer Level Year Geometry Math Fall 05 Cohort Fall 06 Cohort Fall 07 Cohort
  • 5.
    Progress Of Fall2007 Cohort Students Placed in Basic Skills Math 80% 70% 60% 50% 40% 30% 20% 10% 0% Enrolled in Completed First Passed Passed Passed College Recommended Course in the Elementary Intermediate Algebra / Course in the First Year Algebra Algebra Transfer Level First Year Math Asian Black Hispanic White Amer I d/ A Ind/ Other Non- All Asian Black Hispanic White White Students Enrolled in Recommended 67.6% 62.4% 73.7% 62.3% 57.4% 69.8% Course in the First Year Completed First Course in 50.6% 50 6% 26.4% 26 4% 43.5% 43 5% 44.9% 44 9% 40.6% 40 6% 41.6% 41 6% the First Year Passed Elementary Algebra 47.2% 18.5% 36.8% 46.8% 43.9% 36.2% Passed Intermediate Algebra 30.6% 7.3% 19.7% 26.3% 19.4% 19.5% Passed College Algebra / 17.7% 3.1% 9.1% 12.0% 8.4% 9.2% Transfer Level Math Supplemental Slides 1
  • 6.
    Student Outcomes Database Student Outcomes Database • Student unit record (SUR) • Currently based Fall 2007 cohort • Includes student characteristics (age, gender,  ( g ,g , ethnicity, student status)  • Contains outcomes (units attempted units Contains outcomes (units attempted, units  completed, attempted BS English, attempted  BS Math, …, completed degree or certificate) BS Math, , completed degree or certificate) • Database
  • 7.
    Outcomes Database Variable Name Variable Description ID Student ID CAMPUS Campus SEM Term of entry SEX Student gender AGE Student age group (at the time of entry) 1.00 Under 20 2.00 20 - 24 3.00 25 - 34 4.00 35 - 54 5.00 55 and over 9.00 Unknown ETHNIC Student ethnicity 1.00 .00 Asian s a 2.00 Black 3.00 Hispanic 4.00 White 5.00 Amer Ind/Other Non-White 6.00 Unknown/Decline to State NEW Entering status 2.0 1st Time Student 2.4 Former Concurrent Student This College 2.6 Former Concurrent Student Another College UNATTMPT Units attempted in Fall 07 UNCOMPLT Units completed in Fall 07 POINT1 Student attempted units in Fall 07 (1=yes) POINT2 Student completed units in Fall 07 (1=yes) ATT20081 Units attempted in Spring 2008 POINT3 Student attempted units in Spring 08 (1=yes) ATT20083 Units attempted in Fall 08 POINT4 Student attempted units in Fall 08 (1=yes) COMPENGL Student completed any basic skills English/ESL (1=yes) COMPMATH Student completed any basic skills math (1=yes) COMPE101 Student completed English 101 (1=yes) COMPM125 Student completed Math 125 (1=yes) COMPBOTH Student completed English 101 and Math 125 (1=yes) TOTCOMPL Total units completed COMP60UN Student completed 60 units or more (1=yes) TRANMATH Student completed transfer-level math (1=yes) DEGRCERT Student completed degree or certificate (1=yes) Supplemental Slides 2
  • 8.
    Research Using Outcomes Database ResearchUsing Outcomes Database Analysis of Academic Pipeline and Exit Points • City y • Mission
  • 9.
  • 10.
  • 11.
    Degree‐Seeking Academic Pipeline @ Los Angeles Mission College Fall 2007 Cohort – Academic Years of Study: 07‐08, 08‐09, 09‐10, 10‐11 Exhibit 1 Taking Placement Test Results Cohort Fall 2007 = 1278 Level of Readiness Total %  Not taking placement test Not taking placement test 327 26%31 Earned Award 26%31 Earned Award Take placement test 951 74% College ready (M125 & E101 or  E28) 53 5.6% Need English only (M125) 29 3.0% Need Math only (E101 or E28) 222 23.3% Need both 647 68.0% 951 100.0% Exhibit 2 ‐ Momentum Point 1 Attempted and Completed units in Fall 2007 Level of Readiness Original cohort Attempted % Completed % College ready (M125 & E101 or  E28) 53 53 100% 48 91% Need english only (M125) 29 29 100% 27 93% Need math only (E101 and/or  E28) 222 222 100% 195 88% Need both 647 647 100% 474 73% 744 Exhibit 3 ‐ Momentum point 2 Attempted and Success Developmental Courses No.  Attempte Level of Readiness Original Cohort d % Attempted No. Success % Success Need English only (M125) N d E li h l (M125) 29 23 79% 19 83% Need Math only (E101 and/or  E28) 222 182 82% 130 71% Need both 647 571 88% 356 62% Dev Math courses 478 74% 265 55% Dev ESL courses 459 71% 291 63% 776 505 Exhibit 4 ‐ Momentum Point 3 Completed both E101 and M125 Completed 60 units or more %  % Completed  Completed 60 Units or  Level of Readiness Original cohort both both more % College ready (M125 & E101 or  E28) 53 37 70% 26 49% Need english only (M125) 29 14 48% 17 59% Need math only (E101 and/or  E28) 222 57 26% 58 26% Need both Need both 647 77 12% 128 20% 185 229 Exhibit 5 ‐ Momentum point 4 Earned an Award or Still Enrolled in Fall 2011 Still  % Still  Level of Readiness Original cohort Enrolled Enrolled Awards % Awards College ready (M125 & E101 or  E28) 53 12 23% 19 36% Need english only (M125) g y( ) 29 6 21% 10 34% Need math only (E101 and/or  E28) 222 42 19% 33 15% Need both 647 130 20% 54 8% 190 116 Supplemental Slides 4
  • 12.
    Students Entering and Leaving the Pipeline From Fall 2007 to Spring 2011 Fall 2007 Cohort (FTIC)  1000 900 207 800 700 600 239 Unsuccess/Incompleted 500 951 Success/Completed 400 744 276 320 300 505 200 113 100 229 185 116 0 Take placement  Completed any  Successful  Completed 60  Completed E101  Earned awards test in Fall 07 units in Fall 07 completed dev.  units or more and M125 courses
  • 13.
    Directions for Outcomes Database Directions for OutcomesDatabase • Online access and analytical tools Online access and analytical tools • Additional data elements • Other Ideas?