Developmental Algebra Project<br />Borough Of Manhattan Community College<br />The Effects of Study Skills Trainingand Pee...
2<br />What is        Developmental Algebra?<br />1. First course in Algebra<br />2. Zero credit course<br />3. Placement<...
3<br />Developmental Algebra ProjectGoals and Treatment<br />Main Goals<br />1. Reduce attrition rate<br />2. Improve cour...
4<br />Developmental Algebra ProjectGoals and Treatment<br />Main Goals<br />1. Reduce attrition rate<br />2. Improve cour...
5<br />Developmental Algebra Project Rationale<br />Q. Why teach study skills?<br />A.  Research shows that a large propor...
6<br />Developmental Algebra Project Rationale<br />Q. Why target at-risk students?<br />A. At-risk students have the high...
7<br />Developmental Algebra ProjectImplementation<br />Q. How were at-risk students identified?<br />A. We developed an i...
8<br />Developmental Algebra Project	Implementation<br />Q. What are coaches?<br />A. Coaches are successful math students...
9<br />Developmental Algebra Project	Implementation<br />Coach Responsibilities:<br />Meet with each of their students onc...
10<br />Developmental Algebra Project	Implementation<br />Coaches Submitted Weekly Reports:<br />Reports contain informati...
11<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: T<br />Date: Oct. 12 and Oct 14 2010<br />Time: ...
12<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name:  Mrs. J	<br />Date: November 01, 2010(Monday)<br...
13<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: C<br />Date: November 01, 2010(Monday)<br />Time...
14<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: R<br />Date: Wednesday, Dec 1<br />Time: 12 – 2 ...
15<br />Developmental Algebra Project 	Implementation<br />Q. How were coaches recruited?<br />Directly from pre-calc and ...
16<br />Developmental Algebra Project 	Implementation<br />Q. How were coaches trained?<br />CITI Certification (IRB)<br /...
17<br />Developmental Algebra Project 	Implementation<br />Coach Training Components<br />Study skills training.<br />How ...
18<br />Developmental Algebra Project 	Implementation<br />Q. How were instructors trained?<br />Three hour training sessi...
19<br />Developmental Algebra Project		Experimental Design<br />Five instructors were randomly selected from a list of BMC...
20<br />What was the treatment?1) Study Skills Training<br />Instructors incorporated a series of short lessons developed ...
21<br />What was the treatment?2) Peer Coaching<br />Peer coaches met with each of their students once or twice a week to:...
22<br />Developmental Algebra Project Outcomes: Treatment vs Control<br />
Retention Results<br />23<br />Control Group<br />Treatment Group<br />Statistical Analysis:        RESULTS ARE SIGNIFIGAN...
Aggregated Retention Results<br />24<br />Control Group<br />Treatment Group<br />Statistical Analysis:        RESULTS ARE...
Passing Rate Results<br />25<br />Control Group<br />Treatment Group<br />Statistical Analysis:        RESULTS DO NOT PROV...
Aggregated Passing Rate Results<br />26<br />Control Group<br />Treatment Group<br />Statistical Analysis:        TREATMEN...
The Diagnostic Test we developed works<br />Passing Rates vs. Total Risk Points.<br />Aggregate data:<br />45% of students...
Passing Rates vs. Number of Coaching Sessions Attended<br />Peer-coaching seems to have a positive effect on pass-rates af...
Peer coaching (mentoring) works.<br />Statistical Analysis:  Peer Coaching Increase Pass Rates (p= 0.03356)  (2x2x4 Cochra...
Peer coaching (mentoring) works - cost issues: <br />30/100 = 30%<br />    high-risk students passed without peer coaching...
31<br />Borough of ManhattanCommunity CollegeWhat is next?            CUNY<br />It appears that peer coaching is an effect...
Upcoming SlideShare
Loading in …5
×

The Effects of Study Skills Training and Peer Coaching of At-Risk Students on Retention and Passing Rates in a Remedial Mathematics Course

710 views

Published on

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

The Effects of Study Skills Training and Peer Coaching of At-Risk Students on Retention and Passing Rates in a Remedial Mathematics Course

  1. 1. Developmental Algebra Project<br />Borough Of Manhattan Community College<br />The Effects of Study Skills Trainingand Peer Coaching of At-Risk-Studentson Retention and Passing Rates in a Remedial Mathematics Course<br />Leonid Khazanov Michael George<br />Annette Gourgey Chris McCarthy<br />1<br />
  2. 2. 2<br />What is Developmental Algebra?<br />1. First course in Algebra<br />2. Zero credit course<br />3. Placement<br />4. Student challenges<br /> poor math and study skills<br /> math anxiety<br />lack of motivation<br />
  3. 3. 3<br />Developmental Algebra ProjectGoals and Treatment<br />Main Goals<br />1. Reduce attrition rate<br />2. Improve course pass rate<br />
  4. 4. 4<br />Developmental Algebra ProjectGoals and Treatment<br />Main Goals<br />1. Reduce attrition rate<br />2. Improve course pass rate<br />Treatment<br />Incorporate Study Skills<br />2. Identify at-risk-students and assign them peer coaches<br />
  5. 5. 5<br />Developmental Algebra Project Rationale<br />Q. Why teach study skills?<br />A. Research shows that a large proportion of developmental students have poor study skills and high levels of math anxiety.<br />
  6. 6. 6<br />Developmental Algebra Project Rationale<br />Q. Why target at-risk students?<br />A. At-risk students have the highest failure and drop out rates. Successful treatment of at-risk students could have the greatest impacts on overall pass and retention rates.<br />
  7. 7. 7<br />Developmental Algebra ProjectImplementation<br />Q. How were at-risk students identified?<br />A. We developed an instrument to identify at risk students that had three components: (1) Arithmetic Diagnostic Test, (2) Student Survey, (3) Classroom Observation.<br />
  8. 8. 8<br />Developmental Algebra Project Implementation<br />Q. What are coaches?<br />A. Coaches are successful math students at BMCC who assume the roles of both tutor and mentor.<br />
  9. 9. 9<br />Developmental Algebra Project Implementation<br />Coach Responsibilities:<br />Meet with each of their students once or twice a week to:<br />Discuss progress <br />Review homework<br />Prepare for tests<br />Explain the material from previous classes if necessary<br />Discuss counter productive behaviors such as absences and lateness (and how to avoid them in the future)<br />Help student to improve math study habits and skills <br />
  10. 10. 10<br />Developmental Algebra Project Implementation<br />Coaches Submitted Weekly Reports:<br />Reports contain information about what was accomplished at each meeting.<br />
  11. 11. 11<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: T<br />Date: Oct. 12 and Oct 14 2010<br />Time: 10 am to 11 am<br />Summary of Meeting: In this week we checked the homework problem on the first-degree inequalities, and also on the first-degree equations. He has the first test and he gets 85% so I think this is a good score for the first time. We also review everything from the beginning of the school, because he is going to have test this week.<br />
  12. 12. 12<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: Mrs. J <br />Date: November 01, 2010(Monday)<br />Time: 11 AM- 12 PM<br />Summary of Meeting: Mrs. J was a little down on hope because she didn’t exceed well on her midterm. Her score was a 20%. Throughout the whole time of our meeting I gave her friendly inspirational advice. My advice to her was “Don’t let one test ruin your day and bring you down”. “You still have more chances to achieve in your class and I will work with you every step of the way to prepare you for your final exam”. <br />
  13. 13. 13<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: C<br />Date: November 01, 2010(Monday)<br />Time: 5:30 PM- 6:30 PM<br />Summary of Meeting: C is such a sweet and kind heart woman. She is serious about passing this course. Knowing she is intimated of the numbers I always told her the numbers are more afraid of us than we are to them… [She] did astounding showing her my quick techniques. Furthermore, she always comes prepare with her questions to be answer. I am always able to help her and give her hints on her homework handouts….<br />
  14. 14. 14<br />Developmental Algebra ProjectCoach’s Reports<br />Protégé’s name: R<br />Date: Wednesday, Dec 1<br />Time: 12 – 2 pm<br />Summary of Meeting: R has lot problems with the majority of exercises from the final review sheet. I been telling that he has to practice more and put more time and effort. He needs to memorize all this rules in order to do each problem and pass the final. Also, I let him do each problem twice so he doesn’t forget how to do them.<br />
  15. 15. 15<br />Developmental Algebra Project Implementation<br />Q. How were coaches recruited?<br />Directly from pre-calc and calculus classes (classroom visit).<br />Recommendations of colleagues.<br />Word of mouth. <br />
  16. 16. 16<br />Developmental Algebra Project Implementation<br />Q. How were coaches trained?<br />CITI Certification (IRB)<br />3 hour training session<br />Ongoing training <br />
  17. 17. 17<br />Developmental Algebra Project Implementation<br />Coach Training Components<br />Study skills training.<br />How to tutor.<br />How to mentor.<br />
  18. 18. 18<br />Developmental Algebra Project Implementation<br />Q. How were instructors trained?<br />Three hour training session.<br />Study skills expert.<br />Math Study SkillsBook (Alan Bass)<br />
  19. 19. 19<br />Developmental Algebra Project Experimental Design<br />Five instructors were randomly selected from a list of BMCC math faculty who were scheduled to teach two sections of Elementary Algebra (Mat 051).<br />One of section from each instructor was randomly designated as control and the other treatment.<br />
  20. 20. 20<br />What was the treatment?1) Study Skills Training<br />Instructors incorporated a series of short lessons developed by a study skills expert: effective note taking, managing time, overcoming math anxiety, etc.<br />
  21. 21. 21<br />What was the treatment?2) Peer Coaching<br />Peer coaches met with each of their students once or twice a week to:<br /> Discuss progress <br /> Review homework <br />Prepare for tests <br />Explain the material from previous classes if necessary<br />Discuss counter productive behaviors such as absences and lateness (and how to avoid them in the future)<br />Help student to improve math study habits and skills <br />
  22. 22. 22<br />Developmental Algebra Project Outcomes: Treatment vs Control<br />
  23. 23. Retention Results<br />23<br />Control Group<br />Treatment Group<br />Statistical Analysis: RESULTS ARE SIGNIFIGANT EVIDENCE THAT THE TREATMENT INCREASES RETENTION RATES<br /> p-value = 0.01299 (2x2x5 Exact Test, Combinatorial)<br />
  24. 24. Aggregated Retention Results<br />24<br />Control Group<br />Treatment Group<br />Statistical Analysis: RESULTS ARE SIGNIFIGANT EVIDENCE THAT THE TREATMENT INCREASES RETENTION RATES<br /> p-value = 0.01212 (2-sample test for equality of <br /> proportions with continuity correction, Chi)<br />
  25. 25. Passing Rate Results<br />25<br />Control Group<br />Treatment Group<br />Statistical Analysis: RESULTS DO NOT PROVIDE SIGNIFIGANT EVIDENCE <br /> THAT THE TREATMENT INCREASES PASS RATES<br /> p-value = 0.3013 (2x2x5 Exact Test, Combinatorial)<br />
  26. 26. Aggregated Passing Rate Results<br />26<br />Control Group<br />Treatment Group<br />Statistical Analysis: TREATMENT GROUP HAD A HIGHER PASSING RATE, <br /> BUT THE RESULTS DO NOT PROVIDE SIGNIFIGANT <br /> EVIDENCE THAT THE TREATMENT INCREASES PASS <br /> RATES.<br /> p-value = 0.3160 (2-sample test for equality of <br /> proportions with continuity correction, Chi)<br />
  27. 27. The Diagnostic Test we developed works<br />Passing Rates vs. Total Risk Points.<br />Aggregate data:<br />45% of students diagnosed as low-risk passed the class<br />24% diagnosed as high-risk passed class<br />Statistical Analysis: High Risk Students (4+ total risk points) have a lower passing rate (p=.0021). Method: 2-sample test for equality of proportions with continuity correction <br />27<br />
  28. 28. Passing Rates vs. Number of Coaching Sessions Attended<br />Peer-coaching seems to have a positive effect on pass-rates after a threshold of about 4 sessions.<br />28<br />
  29. 29. Peer coaching (mentoring) works.<br />Statistical Analysis: Peer Coaching Increase Pass Rates (p= 0.03356) (2x2x4 Cochran-Mantel-Haenszel Test for Count Data, Exact Test, Combinatorial)<br />29<br />
  30. 30. Peer coaching (mentoring) works - cost issues: <br />30/100 = 30%<br /> high-risk students passed without peer coaching<br />14/26 = 54% <br /> high-risk students passed with peer coaching<br />Roughly speaking, for every<br /> 5 high-risk students treated <br />we expect to get <br /> 1 extra student pass. <br />If it costs $100 per treatment, that is $500 per additional pass.<br />30<br />
  31. 31. 31<br />Borough of ManhattanCommunity CollegeWhat is next? CUNY<br />It appears that peer coaching is an effective aspect of intervention for at-risk-students. <br />Next step: finding cost effective ways to provide peer coaches to more students. <br />Contact Information: <br />Leonid Khazanov: lkhazanov@bmcc.cuny.edu<br />Michael George: mgeorge@bmcc.cuny.edu<br />Chris McCarthy: cmccarthy@bmcc.cuny.edu<br />

×