PRAB: R Vanderslice 10 24 08


Published on

October 24th Program Review Advisory Board presentation by Ronna Vanderslice, Ed.D.

Published in: Education
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Fall PRAB Meeting Jun 5, 2009
  • PRAB: R Vanderslice 10 24 08

    1. 1. Program Review Advisory Board October 24, 2008 Ronna Vanderslice, Ed.D. Cameron University [email_address]
    2. 2. PRAB <ul><li>Provide consultation </li></ul><ul><li>Conduct reviews for non-NCATE institutions and non-affiliated areas each semester </li></ul><ul><li>Conduct reviews for new programs </li></ul><ul><li>Monitor changes in state and national standards and make recommendations for modifications </li></ul>
    3. 3. PRAB Compensation <ul><li>Annual stipend of up to $800 + travel </li></ul><ul><ul><li>$200 per semester </li></ul></ul><ul><ul><li>$200 for each review session attended </li></ul></ul><ul><li>Additional compensation may be provided for reviews outside the semester review session </li></ul><ul><li>Chair stipend $1500 per semester; vice-chair $1000 per semester </li></ul>
    4. 4. The Program Review Process <ul><li>Submitted to NCATE (via the web) or OCTP(via CD) a year prior to the visit </li></ul><ul><ul><li>Due on September 15 in the fall </li></ul></ul><ul><ul><li>Due on February 1 in the spring </li></ul></ul><ul><li>Reviewers prepare independent reports </li></ul><ul><li>Lead reviewer compiles final report </li></ul><ul><li>BOE access the report for the on-site visit </li></ul>
    5. 5. The Program Review Process for New Programs <ul><li>Submit rationale, governing board approval documentation, and program review to OCTP 6-12 months prior to offering courses </li></ul><ul><li>Review is conducted—recognition decision is determined. Results forwarded to Program Accreditation Committee (PAC) </li></ul><ul><li>If approved by PAC and the full commission, the approval decision becomes effective the next semester, and the State Department of Education is notified of the certification program’s status so that candidate credentials can be appropriately issued </li></ul>
    6. 6. Our State Partnership <ul><li>Our state partnership determines the program review process </li></ul><ul><li>The program review process is a critical part of the partnership agreement </li></ul><ul><li>Our current partnership protocol remains in effect until December 2009 </li></ul>
    7. 7. Program Areas affiliated with NCATE <ul><li>Early childhood education </li></ul><ul><li>Elementary education </li></ul><ul><li>English/language arts education </li></ul><ul><li>Foreign language education </li></ul><ul><li>Mathematics education </li></ul><ul><li>Reading specialists and supervisors </li></ul><ul><li>Physical Education </li></ul><ul><li>School administrators </li></ul><ul><li>School library media specialists </li></ul><ul><li>School psychologists </li></ul><ul><li>Science education </li></ul><ul><li>Social studies education </li></ul><ul><li>Special education </li></ul><ul><li>Teaching English to speakers of other languages </li></ul>Oklahoma needs national reviewers on PRAB in each of these areas!
    8. 8. Non-Affiliated Areas <ul><li>Agriculture education </li></ul><ul><li>Technology education </li></ul><ul><li>Career and technology business </li></ul><ul><li>Marketing education </li></ul><ul><li>Speech/Drama/Debate </li></ul><ul><li>Instrumental/General Music </li></ul><ul><li>Vocal/General Music </li></ul><ul><li>Journalism </li></ul><ul><li>Driver/Safety education </li></ul><ul><li>Art education </li></ul><ul><li>Dance education </li></ul><ul><li>School Psychometry </li></ul><ul><li>School Counseling </li></ul><ul><li>Gifted and Talented </li></ul><ul><li>Family and Consumer Sciences </li></ul>Standards can be located at
    9. 9. Special Situations <ul><li>Programs accredited by another accrediting agency do not submit program reports in those areas </li></ul><ul><li>Dormant Programs </li></ul><ul><li>Small programs </li></ul>
    10. 10. Unit Review vs. Program Review: the Connection <ul><li>Standard 1- Candidate Knowledge, Skills, and Professional Dispositions </li></ul><ul><li>Standard 2- Assessment System and Unit Evaluation </li></ul>
    11. 11. The Process is more Similar than Different <ul><li>6 Required Assessments </li></ul><ul><li>Alignment is critical </li></ul><ul><ul><li>Standards to assignments </li></ul></ul><ul><ul><li>Assignments to Rubrics </li></ul></ul><ul><li>Data summarized </li></ul><ul><li>Use of data for program improvement </li></ul>
    12. 12. How Much Data is Needed? <ul><li>Fall 2008 and Spring 2009 </li></ul><ul><ul><li>2 years </li></ul></ul><ul><li>Fall 2009 and beyond </li></ul><ul><ul><li>3 years </li></ul></ul>
    13. 13. Overview of what to look for in the Program Report <ul><li>Section I—Contextual Information </li></ul><ul><ul><li>Faculty qualifications </li></ul></ul><ul><ul><li>Course of Study </li></ul></ul><ul><ul><li>Relationship of assessments to unit assessment </li></ul></ul><ul><ul><li>Concerns, strengths, or deficiencies should be noted in Section F of the Recognition Report </li></ul></ul>
    14. 14. Overview of what to look for in the Program Report <ul><li>Section II—Assessment Chart </li></ul><ul><li>Section III—Standards Assessment Chart </li></ul><ul><li>Section IV—Evidence for Meeting Standards </li></ul><ul><ul><li>are the assessments appropriate for the cited standards? </li></ul></ul><ul><ul><li>do the candidate data demonstrate that most candidates meet the standard? </li></ul></ul>
    15. 15. Overview of what to look for in the Program Report <ul><li>Section V—Use of assessment results to improve candidate achievement and program performance in content, professional KSD </li></ul><ul><ul><li>Have they summarized the findings from the evidence? </li></ul></ul><ul><ul><li>Have they interpreted the findings? </li></ul></ul><ul><ul><li>Have they made program changes based on the findings? </li></ul></ul>
    16. 16. Assessment 1 <ul><li>State licensure examinations </li></ul><ul><ul><li>there must be an indication of the content of those exams and how well they are aligned with SPA standards </li></ul></ul><ul><ul><li>The most recent year of data must include the mean and range of total scores and sub-scores on the licensure test </li></ul></ul><ul><ul><li>Our alignment matrices are located at </li></ul></ul>
    17. 17. Assessment 2 <ul><li>Content Assessment </li></ul><ul><li>Grades are now acceptable </li></ul><ul><ul><li>Expectations include a chart listing courses and which SPA standards are addressed in the course with either the course title or brief (1-3 sentence) description of the course </li></ul></ul><ul><li>Portfolio Projects, Comprehensive Exams, etc. </li></ul>
    18. 18. Assessment 3 <ul><li>Instructional Plan (Unit Plan) </li></ul>
    19. 19. Assessment 4 <ul><li>Clinical Practice Assessment </li></ul><ul><li>Generic instruments that are not clearly related to the standard are not enough </li></ul><ul><li>Options include using a content addendum, coding the generic instrument to the SPA standards, or design an instrument that includes SPA standards </li></ul>
    20. 20. Assessment 5 <ul><li>Demonstrates candidates’ ability to impact student learning or provide a supportive learning environment for student learning </li></ul><ul><li>Often TWS </li></ul><ul><li>Should address SPA standards </li></ul>
    21. 21. Assessment 6, 7, and 8 <ul><li>Additional assessment that addresses the standards </li></ul><ul><li>Must have at least one (#6) </li></ul><ul><li>Possibilities include case studies, follow-up studies, employer data, etc. </li></ul>
    22. 22. What Does the Reviewer Do? <ul><li>Judge alignment of assessment and candidate data with SPA standards </li></ul><ul><li>Clearly communicate strengths and weaknesses in relation to the standards </li></ul><ul><li>Make as objective an assessment as possible about the degree to which a given program meets the SPA standards, based on candidate performance evidence. </li></ul>
    23. 23. Recognition Decisions <ul><li>Recognized </li></ul><ul><li>Recognized with conditions </li></ul><ul><li>Further Development Required/Recognized with probation (currently called Decision Deferred) </li></ul><ul><li>Not recognized </li></ul>
    24. 24. The Recognition Report <ul><li>Use the Reviewer Worksheet </li></ul><ul><li>Check alignment </li></ul><ul><ul><li>Content </li></ul></ul><ul><ul><li>Range </li></ul></ul><ul><li>Check for challenging assignments </li></ul><ul><li>Check scoring guides– are they aligned to the standards and are performance expectations clear? </li></ul><ul><li>Are the qualifiers used in the scoring guides distinguishable between levels? </li></ul><ul><li>Determine if data indicate candidate mastery </li></ul>
    25. 25. The Recognition Report <ul><li>Ensure introductory information matches their cover sheet </li></ul><ul><li>Below each standard, list the assessments identified to meet that standard and indicate whether they do </li></ul><ul><li>If the standard is not met, include a comment to explain why </li></ul><ul><li>Cite strengths </li></ul><ul><li>Evaluate program evidence in Part C </li></ul><ul><li>Evaluate their use of assessment results </li></ul><ul><li>Add strengths, comments, and concerns </li></ul>
    26. 26. Frequently Asked Questions <ul><li>What if there is not adequate data for each assessment? </li></ul><ul><li>What if the unit doesn’t have an 80% pass rate on the OSAT? </li></ul><ul><li>What if a program offers several different levels of programs in the same discipline (e.g. programs at both the undergrad and grad level)? </li></ul>