ENGAGE Training Level II InterventionistsFall Intervention Workgroup:Joshua Adams, Director of the Learning CenterJulie Kirkland, Assistant Dean of Student Success, CASMelissa McGuire, Director of Orientation & Transition ProgramsMarilyn Wiley, Associate Dean, College of BusinessLaura Cardona, Research Analyst
Session Caveat:• Training today is for Level II interveners for the ENGAGE project.• You will be asked to sign up as Level II Intervener after this training through the coordination of your Associate Dean.• We wanted you to be informed of the expectation and the time commitment before agreeing to be an intervener.
Agenda• Purpose of the Intervention• Administration of ENGAGE• Intervention Plan for Fall 2012• Level II Intervention Plan Please reserve all questions for the end of the training. Thank you.
Purpose of Intervention• Why Intervene? Provide best possible experience to students Provide support based on student’s needs Research supports intervention
Why ENGAGE?• ACT Study in 2004 400 retention studies were reviewed, 109 met criteria 9 broad categories which have been translated to the 10 categories in the ENGAGE• APA Study in 2012 13 years of research reviewing 7,167 articles on retention “A large correlation was observed for performance self-efficacy, which was the strongest correlate (of 50 measures) followed by high school GPA, ACT, and grade goal”• ACT study 2010 Lists “advising interventions with selected student populations” as one of the top five most effective retention practices for four-year public universities• ACT Engage Research Tracked 14,000 at 48 postsecondary institutions Results showed that ENGAGE is a valid predictor of student persistence
UNT’s Retention Model UNT’s retention model was developed to identify first time in college students who are likely to benefit from an early intervention. The model was developed using advanced statistical techniques designed to increase model accuracy and stability. One retention model is conducted per academic department. Different predictors are likely to be significant for each academic department
• The model uses varied data available to the institution before a students’ first day of classes -This data includes psychosocial factors (ENGAGE) -Academic performance: HS percentile and SAT score -Other variables: Pell eligibility, orientation attended, total credits, HS class size -It is possible for students who did not complete ENGAGE to be placed in the intervention group because of varied information entered in to the predictive model -Students who do not complete ENGAGE and those who have an invalid ENGAGE profile (e.g. gave the same answer to all questions) will be automatically placed in the intervention group as these outcomes signal issues with following directions, motivation, and commitment
UNT Results Fall 2011 Intervention ENGAGE results Group Mean GPA Significance Treatment 2.36 P <.0001 Control 1.84 P <.0001 Fall 2011 Intervention ENGAGE results Group Retained Not Retained Treatment 190 (91.79%) 17 (4.11) Control 163 (78.74%) 44 (21.26%)
Administration of ENGAGE• On-Line Communication with Students• Orientation Computer Labs
Intervention PlanLevel 1 – First Flight/Week 1 (August 25 – August 31) – Target: All new freshmen – Interveners: Staff from across campusLevel 2 – Weeks 2 and 3 (September 4 – September 14) – Target: At-risk freshman population (approximately 1,000 students) – Interveners: Faculty and staff from across campusLevel 3 – Weeks 4 and 5 (September 17 – September 28) – Target: At-risk freshman not reached in Level 2 – Interveners: Core group of faculty and staff from level 2 – A more “intense” attempt to contact Ultimate goal for the ENGAGE project is to reach 100% of our at-risk freshmen by the end of week 5.
Level II Intervention Plan• Access reports• Student Communication• Student Appointments• Data Entry
Excel Tracking Sheet• Joshua Adams will send by September 4th• Data entry will be explained later Student EMPLID Phone Email Attempt 1 Date Attempt 1 Type Attempt 2 Date Attempt 2 Type Attempt 3 Date Attempt 3 Type Final Outcome 1234567 Eagle, Scrappy 8 940-xxx-xxxx email@example.com 8/25/2012 Phone 8/27/2012 Email 8/29/2012 Phone Met in person Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome Attempt 1 Attempt 2 Attempt 3 Outcome
Accessing ENGAGE Reports• All reports uploaded to SharePoint site• An email will be sent with the website and log-in information• Search by name or EMPLID• Look for EUID folder• Interveners will only have access to student reports• Some students may not have an ENGAGE report
Student Communication• Three Attempts 1st attempt: Phone or in-person 2nd attempt: Text, e-mail or in-person 3rd attempt: Phone, e-mail or in-person• Scripts provided• Begin attempts as soon as possible• 48 hours between attempts• Attempts need to be completed, data entered and sent to Joshua Adams by September 14th
Preparing for Student Appointments• Trainer Disclaimer• ENGAGE used as a resource ONLY• Interventionist reviews the ENGAGE and crosswalk before appointment• Decide which open-ended question from “Capitalize on Strengths” and “Make Plans for Improvement”Sample Student ReportReview Crosswalk Work in progress. If you have any recommendations on the questions, they can be changed.
Meeting with Student• Open with a strengths question• Segway into an improvement question• Cover appropriate resources• Review SAP with student• Need to schedule a follow-up?Meetings need to completed by September 21st
Data Collection• Utilize drop-down menus to complete file• Result of Contact: • What you discussed • What happened in the meeting • Referral offices• Additional Information: • Any relevant information• Note: Follow-up by another individual will NOT be made based on the Excel file contents• Limit your responses to 50 characters• Email completed Excel file back to Joshua Adams by 5:00 PM on September 14th