New facultyie&evaluationjan2011 1


Published on

Published in: Education, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

New facultyie&evaluationjan2011 1

  1. 1. January 24, 2011 New Faculty Academy: I.E. & Evaluation in the Community College Dr. Bud Joyner President Emeritus Danita McAnally Dean of Assessment and Development
  2. 2. Questions to be Answered <ul><li>How do outcomes, assessments and accreditation relate? </li></ul><ul><li>How does instruction and assessment correlate? </li></ul><ul><li>What role does the strategic plan have? How is strategic planning accomplished? </li></ul><ul><li>Why should this matter to me? </li></ul>
  3. 3. Overview <ul><li>1. Correlating Instruction & Assessments </li></ul><ul><li>2. Institutional Effectiveness (I.E.) </li></ul><ul><li>3. Planning 101 </li></ul><ul><li>4. Assessment 101 </li></ul><ul><li>5. Planning & Assessment at AC </li></ul><ul><li>6. Why Plan and Assess? </li></ul><ul><li>7. Accreditation & Governance </li></ul><ul><li>8. Why should this matter to you? </li></ul>
  4. 4. Correlating Instruction & Assessments <ul><li>Institutional Planning </li></ul><ul><li>+ </li></ul><ul><li>Institutional Assessments = Results </li></ul><ul><li>IMPROVEMENTS </li></ul>
  5. 5. Correlating Instruction & Assessments <ul><li>Instructional Planning </li></ul><ul><li>+ </li></ul><ul><li>Instructional Assessments = Results </li></ul><ul><li>IMPROVEMENTS </li></ul>Institutional Planning
  6. 6. Institutional Effectiveness What is Institutional Effectiveness?
  7. 7. Institutional Effectiveness What are the 3 components in I.E.? <ul><li>Includes: </li></ul><ul><ul><li>Planning </li></ul></ul><ul><ul><li>Assessing (including evaluation) </li></ul></ul><ul><ul><li>Using results to make improvements </li></ul></ul>
  8. 8. Planning 101
  9. 9. Vision and Mission <ul><li>The reasons for existence </li></ul><ul><li>The “ideal” state that can be achieved </li></ul><ul><li>Major goals </li></ul>
  10. 10. SWOT <ul><li>Strengths </li></ul><ul><li>Weaknesses </li></ul><ul><li>Opportunities </li></ul><ul><li>Threats </li></ul>
  11. 11. Environmental Scan (SWOT) <ul><li>External – economic, social, demographic, political, legal, technological, etc. </li></ul><ul><li>Internal – organization, leadership, financial, efficiency, effectiveness, evaluation, etc. </li></ul>
  12. 12. Gap Analysis <ul><li>Evaluate difference between current position and desired future to enable development of specific strategies and resource identification and allocation. </li></ul>
  13. 13. Strategy Development <ul><li>Setting strategic goals, action plans, and time lines </li></ul><ul><li>SMART model – goals are specific, measurable, agreed upon, realistic, and time/cost bound </li></ul><ul><li>Scenario Planning </li></ul>
  14. 14. Evaluation <ul><li>Specific and regular assessments of the process and plan to evaluate strategies, tactics, and action programs </li></ul><ul><ul><li>Are they meeting expectations? </li></ul></ul><ul><ul><li>If not, what changes must be made? </li></ul></ul>
  15. 15. Benefits of Successful Planning <ul><li>Defines mission, vision and goals </li></ul><ul><li>Produces a comprehensive plan that can be communicated to constituents </li></ul><ul><li>Develops a sense of ownership in a plan </li></ul><ul><li>Helps ensure effective, focused use of resources </li></ul>
  16. 16. Benefits of Successful Planning (cont’d) <ul><li>Provides a basis for assessment and change </li></ul><ul><li>Brings together constituents, board and staff </li></ul><ul><li>Gives the organization its best chance to survive and meet its mission </li></ul>
  17. 17. Action Verbs (examples) <ul><li>Acquire Expand </li></ul><ul><li>Assess Improve </li></ul><ul><li>Build Increase </li></ul><ul><li>Conduct Maintain </li></ul><ul><li>Create Provide </li></ul><ul><li>Decrease Recruit (and retain) </li></ul><ul><li>Design Refine </li></ul><ul><li>Develop Renovate </li></ul><ul><li>Eliminate Replace </li></ul><ul><li>Enable Review </li></ul><ul><li>Enhance Revise </li></ul><ul><li>Ensure Train </li></ul><ul><li>Establish Use </li></ul><ul><li>Evaluate (and…) </li></ul>
  18. 18. Effective Planning <ul><li>“ None of us is as smart as all of us”. </li></ul><ul><li>Alan Weber </li></ul><ul><li>“ If you don’t know where you’re going, how will you know when you get there.” Mager, et al </li></ul><ul><li>“ It’s not who you are or where you’ve been, but where you’re going that counts.” Cal Farley </li></ul>
  19. 19. Strategic Plan <ul><li>Foundation planning document – all other planning documents link to it </li></ul><ul><li>Current Strategic Plan - designed to provide direction for through 2010 </li></ul><ul><li>Strategic Plan under development – will provide direction through 2015 </li></ul><ul><li>Annually audit to determine if we are accomplishing the goals within our strategic plan </li></ul>
  20. 20. Strategic Plan through 2010 <ul><li>Available at: </li></ul><ul><li> </li></ul>
  21. 21. Strategic Plan through 2015 UNDER DEVELOPMENT <ul><li>VALUES </li></ul><ul><li>At Amarillo College, we value: </li></ul><ul><li>Student Success </li></ul><ul><li>Quality Education </li></ul><ul><li>Opportunity for All </li></ul><ul><li>Collaboration </li></ul><ul><li>Community Responsiveness </li></ul><ul><li>Responsible Stewardship </li></ul><ul><li>VISION </li></ul><ul><li>At Amarillo College, we aspire for every student to have a success story. </li></ul><ul><li>CORE PURPOSE </li></ul><ul><li>At Amarillo College, we help each student to succeed. </li></ul>
  22. 22. Strategic Plan through 2010 <ul><li>Includes the current mission : </li></ul><ul><li>“ Amarillo College, a public community college, is dedicated to providing educational, cultural and community services and resources to enhance the quality of life for the diverse population in the service area.” </li></ul>
  23. 23. Strategic Plan through 2015 UNDER DEVELOPMENT <ul><li>Proposed mission : </li></ul><ul><li>“ Amarillo College – enriching the lives of our students and our community.” </li></ul><ul><li>Must be vetted with following key ?s: </li></ul><ul><li>Does this mission encompass everything (e.g. all instruction and public service) Amarillo College is doing to serve all of its stakeholders (i.e. students, community, employees, Board of Regents, etc.)? </li></ul><ul><li>Does the new mission reflect the current economic downturn, budget limitations & how AC is adjusting to these new conditions? If not, how will AC accomplish being sustainable under these conditions? </li></ul><ul><li>What effectiveness indicators will be used to regularly and systematically in decision-making and reported publicly to validate that the mission is being accomplished? </li></ul>
  24. 24. Assessment 101
  25. 25. Principles of Assessment <ul><li>Assessment seeks to discover how well </li></ul><ul><li>the institution, </li></ul><ul><li>a program, or </li></ul><ul><li>a course </li></ul><ul><li>is accomplishing its intent. </li></ul><ul><li>(Aggregate – not individual students) </li></ul><ul><li>Evaluation grades students. Some evaluations are measurements within assessments. </li></ul><ul><li>(Individual students) </li></ul><ul><li>Assessment is always anonymous of the students and the faculty. </li></ul><ul><li>Those two are very different. </li></ul><ul><li>See Principles of Assessment at AC (hand-out) </li></ul>
  26. 26. Assessment Where do student learning outcomes fit in I.E.? <ul><li>Institutional level </li></ul><ul><li>Instructional </li></ul><ul><ul><li>Program level </li></ul></ul><ul><ul><li>Course level </li></ul></ul>
  27. 27. Assessment What are student learning outcomes (SLOs)? <ul><li>OUTCOME ASSESSMENTS </li></ul><ul><li>Proof that learning or service resulted in a change of the student’s/client’s: </li></ul><ul><li>√ knowledge √ attitudes </li></ul><ul><li>√ skills √ expertise </li></ul><ul><li>√ behavior </li></ul>
  28. 28. Assessment How do institutional planning & outcome assessments relate? MAPPING <ul><li>Institutional Level: </li></ul><ul><li>Student Services: </li></ul>Strategic Plan Goal – Ensure Student Success Strategy - Improve Transfer Rates Tactic 1 – Upon 30 credit hours, each AA & AS student will develop a transfer plan. Faculty Instructional Advisors
  29. 29. Assessment How do institutional planning & outcome assessments relate? MAPPING <ul><li>Institutional Level: </li></ul><ul><li>General Ed. Competencies: </li></ul>Strategic Plan Goal – Ensure Student Success Strategy - Improve Transfer Rates Tactic – Upon 30 credit hours, each student will demonstrate at least average critical thinking skills. Instructional Courses Instructional Programs
  30. 30. Assessment How do institutional planning & outcome assessments relate? MAPPING <ul><li>Program Level & Course Level: </li></ul><ul><li>Instructional Courses </li></ul><ul><li>Course Outcomes: </li></ul><ul><li>Link to the program outcomes </li></ul><ul><li>Consistent across multiple sections of the course </li></ul><ul><li>Instruction is adjusted to seek improvement when course or program outcomes are not achieved </li></ul><ul><li>Instructional Programs </li></ul><ul><li>Program Outcomes: </li></ul><ul><li>Assessed by the end of the program </li></ul><ul><li>Documentation of % of students accomplishing the outcomes </li></ul><ul><li>A few outcomes – not a large # </li></ul><ul><li>Agreed upon by the dept. faculty & consistent w/THECB </li></ul>
  31. 31. Outcomes Assessments <ul><li>Referred to as student learning outcomes or student service outcomes </li></ul><ul><li>Most often called outcomes (SLOs) </li></ul>
  32. 32. Assessment How does AC check to see if EVERYTHING connects together? <ul><li>Institutional plans and assessments that are: </li></ul><ul><li>Integrated </li></ul><ul><li>Systematic </li></ul><ul><li>On-going </li></ul><ul><li>If all of this is connected, I.E. has occurred. </li></ul>
  33. 33. Strategic Plan & Other Plans 3 Major Assessments <ul><li>Planning & Evaluation Tracking </li></ul><ul><li>Program Review </li></ul>(Annually) (5-7 yrs. cycle) Strategic Plan
  34. 34. Strategic Plan & Other Plans 3 Major Assessments Improvements Outcome Assessments Program Review PET Strategic Plan (including Operational Plans)
  35. 35. Strategic Plan & Other Plans <ul><li>Master Plan </li></ul><ul><li>(Facilities and </li></ul><ul><li>Virtual Learning) </li></ul><ul><li>Developmental Education Plan </li></ul><ul><li> </li></ul><ul><li>Strategic Plan for </li></ul><ul><li>Distance Learning </li></ul><ul><li> </li></ul><ul><li> IT Tactical Plan </li></ul>Strategic Plan
  36. 36. Planning + Assessments (including Evaluations) = <ul><li>Improvements based on recommendations </li></ul><ul><li>( Institutional Effectiveness – I.E.) </li></ul>
  37. 37. PET Forms <ul><li>All departments/offices plan annually </li></ul><ul><li>PET forms are available on the AC website’s Electronic Archive. </li></ul><ul><li>( </li></ul>
  38. 38. Planning & Evaluation Tracking Form Year: 2009-2010 Division of: ______________Person Responsible: _______________ Department of: ___________Person Responsible: ___________ Purpose Statement: ___________________________________________ _____________________________________________________________ Goal Statements Objectives/ Outcomes (including assessment tools & standards) Results Use of Results/ (including improvements & revisions) ANALYSIS: RECOMMENDATIONS:
  39. 39. Program Review Of Each Division/Area <ul><li>All divisions/areas are reviewed </li></ul><ul><li>Divisions are reviewed on a 5-7 year rotation </li></ul><ul><li>Program Reviews are available on the AC website’s Electronic Archive. </li></ul><ul><li>( ) </li></ul>
  40. 40. Why should AC plan? <ul><li>#1. Best way to do business: </li></ul><ul><ul><li>If we don’t plan: </li></ul></ul><ul><ul><li>we won’t know where we are headed or when we arrive and </li></ul></ul><ul><ul><li>our ability to serve our students will be less than if we plan and follow through with assessment. </li></ul></ul><ul><li>#2. Accreditation association and state’s coordinating board require it. </li></ul>
  41. 41. SACSCOC <ul><li>Southern Association of Colleges and Schools – Commission on Colleges ( </li></ul>and Latin America TX LA MS AL TN KY VA NC SC GA FL
  42. 42. THECB <ul><li>Texas Higher Education Coordinating Board (CoBoard) </li></ul><ul><li>( </li></ul>
  43. 43. <ul><li>to make improvements . </li></ul><ul><li>Not Success or Failure – </li></ul><ul><li>Continual Improvement ! </li></ul>The goal of institutional effectiveness is to use evidence resulting from planning and assessments
  44. 44. Institutional Effectiveness <ul><li>Why should all this matter to you? </li></ul><ul><li>YOUR ONE-TWO SENTENCE ANSWERS. </li></ul>
  45. 45. <ul><li>Contact information: </li></ul><ul><li>Dr. Bud Joyner </li></ul><ul><li>[email_address] </li></ul><ul><li>Danita McAnally </li></ul><ul><li>[email_address] </li></ul>Questions?
  46. 46. Dept. of Assessment & Development – Home Page
  47. 47. Copyright 2010