Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Assessment of Student Learning


Published on

  • Be the first to comment

Assessment of Student Learning

  1. 1. Assessment of Student Learning College of Arts and Sciences Progress Report March, 2008 Assessment and Continuous Improvement Office (A+ Office) Dr. Vivian Navas Dr. Eddie Marrero Dr. Mario Núñez
  2. 2. Objectives <ul><li>Describe the Arts and Sciences (A&S) Assessment and Continuous Improvement Office (A+) structure </li></ul><ul><li>Present the model used by A&S to assess student learning </li></ul><ul><li>Discuss assessment achievements in A&S </li></ul><ul><li>Present A&S dissemination strategies </li></ul>
  3. 3. Arts and Sciences Assessment Office (A+) Structure
  4. 4. A+ Office <ul><li>The Office for Assessment and Continuous Improvement (A+ Office) was created in 2004 to coordinate assessment activities in A&S </li></ul><ul><li>Office Staff: </li></ul><ul><ul><li>Director - Dr. Mario Núñez-Molina, Associate Dean of Assessment and Learning Technologies </li></ul></ul><ul><ul><li>Two assessment consultants </li></ul></ul><ul><ul><ul><li>Vivian Navas and Eddie Marrero </li></ul></ul></ul><ul><ul><li>An assessment coordinator for each of the 13 departments </li></ul></ul>
  5. 5. College of A&S department coordinators <ul><li>Biology: Dra. Vivian Navas </li></ul><ul><li>Marine Sciences: Dra. Nilda Aponte </li></ul><ul><li>Social Sciences: Dra. Luisa Guillemard </li></ul><ul><li>Hispanic Studies: Dr.  Víctor Rivera </li></ul><ul><li>Economy: Dr. Eduardo Kicinski </li></ul><ul><li>Physical Education: Dra. Diana Rodríguez </li></ul><ul><li>Nursing: Prof. Elba Vargas </li></ul><ul><li>Physics: Dr. Raúl Portuondo </li></ul><ul><li>Geology: Dr. Fernando Gilbes </li></ul><ul><li>Humanities: Dr. Christopher Powers </li></ul><ul><li>English: Dra. Judith Casey </li></ul><ul><li>Math: Dr. Pedro Vásquez </li></ul><ul><li>Chemistry: Dr. Francis Patrón and Nairmen Mina </li></ul>
  6. 6. Arts and Sciences assessment strategy and methodology <ul><li>Monthly meetings to coordinate activities and follow-up </li></ul><ul><li>Assessment training for coordinators </li></ul><ul><li>Continuous mentoring to department coordinators </li></ul>
  7. 7. Department coordinator tasks <ul><li>Coordinate the development of a departmental student learning assessment plan </li></ul><ul><li>Do one learning assessment cycle (loop) per year </li></ul><ul><li>Present results and actions taken to other faculty, coordinators and university officials </li></ul><ul><li>Submit a report </li></ul>
  8. 8. Participation incentives <ul><li>3 credits release time for department coordinator </li></ul><ul><li>Professional enhancement education credits (CEP Center) for faculty participants </li></ul><ul><li>Seed money to conduct learning assessment research </li></ul><ul><li>Opportunity to publish in Avalúo Plus Journal </li></ul>
  9. 9. Model used by College of A&S to assess student learning
  10. 10. MSCHE recommendation- June, 2005 <ul><li>“ Each program should complete at least one significant assessment project during the next academic year on a topic of importance to that program.”(MSCHE Report, 2005, p.20 ) </li></ul>
  11. 11. Assessment strategy <ul><li>A template with the fundamental elements in an assessment project was designed. </li></ul><ul><li>The template serves as a guide for designing, implementing and reporting the assessment cycle. </li></ul>
  12. 12. Assessment cycle template Assessed criteria What was assessed – skill or content? Justification Why focus on the selected item? Participants Numbers of students and faculty members impacted by the project? Pre intervention What was done to determine the student’s status on the chosen skill or content before the intervention? Intervention What activities were implemented to improve student performance in the chosen skill or content? Post intervention How was the effectiveness of the intervention determined? Results& discussion What results were obtained? Why? Course of Action Results Dissemination What actions were taken based on these results? Where did you present the results?
  13. 13. Emphasis in closing the loop <ul><li>We continuously emphasized that the assessment of student learning should be viewed as a cycle. Assessment is not completed unless actions are taken based on the results, allowing for continuous improvement of student learning. </li></ul>
  14. 15. Assessment achievements in the Departments of the College of Arts & Sciences
  15. 16. Department Learning Assessment Plan Loop 1 Presentation Loop 1 Final report Loop 2 Presentation Loop 2 Final Report Published in A+ Journal 1.Biology X X X X X   2. Marine sciences X X X X X   3. Social Sciences X X X X X X 4. Economy X X X X X X 5. Nursing X X X X X X 6. Physical Education X X X X X   7. Hispanic Studies X X X X X X 8. Physic X X X X X   9. Geology X X X X X X 10. Humanities X X X X X   11. English X X X X X   12. Math X X X X X X 13. Chemistry X X X X X  
  16. 17. Sample Department Learning Assessment Loop I – August 2006 Learning Assessment Loop II – January 2007 Partiipants Assessed Criteria Participants Assessed Criteria   Faculty Students   Faculty Students   Biology 3 429 Learning in the Introductory Biology II course. 4 279 Learning in the Introductory Biology I course. English 6 250 Written Communication skills 2 60 Written Communication skills Hispanic Studies 5 111 Technological skills 2 57 Writing skills Humanities   118 Critical thinking 8 25 Critical thinking Physical Education 1 21 Sports teaching skills 2 10 Sports teaching skills
  17. 18. Achievements <ul><li>Course improvement: </li></ul><ul><ul><ul><li>Misconceptions were identified and clarified (Biol) </li></ul></ul></ul><ul><ul><ul><li>Important concepts and concepts not well learned in previous courses were identified and re-taught (Biol, Econ, Math, Geol, Physics) </li></ul></ul></ul><ul><ul><ul><li>Student awareness on contemporary issues increased (Marine Sciences) </li></ul></ul></ul>
  18. 19. <ul><li>Skills development improvement: </li></ul><ul><ul><ul><li>Student’s methodology for teaching a sport (Phy Ed) </li></ul></ul></ul><ul><ul><ul><li>Faculty use of technology in the classroom (Social sciences) </li></ul></ul></ul><ul><ul><ul><li>Thesis statement writing skills (English) </li></ul></ul></ul><ul><ul><ul><li>Specialized electronic resources (Hispanic Studies) </li></ul></ul></ul><ul><ul><ul><li>Written (Hispanic Studies) and oral communication (Marine sciences) skills </li></ul></ul></ul><ul><ul><ul><li>Critical thinking skills (Humanities) </li></ul></ul></ul><ul><ul><ul><li>Medical report writing skills (Nursing) </li></ul></ul></ul><ul><ul><ul><li>Lab report writing skills (Chem) </li></ul></ul></ul>Achievements
  19. 20. In progress <ul><li>Third assessment loop project implementation </li></ul><ul><ul><li>Presentation (may 08) </li></ul></ul><ul><ul><li>Final report </li></ul></ul><ul><li>Publication </li></ul><ul><li>Department assessment plan revision </li></ul><ul><li>Departmental workshops to increase faculty involvement </li></ul>
  20. 21. Department Loop 3 Assessed Criteria Biology Contemporary scientific issues Social Sciences Technological skills Economy Content Nursing Basic concepts knowledge Humanities Social bookmarking in teaching English Written Communication skills Math Math learning in advance course
  21. 22. Next semester <ul><li>Coordinator will become department assessment facilitator (consultant) </li></ul><ul><ul><li>Faculty will conduct student learning assessment in their particular courses. Coordinator will mentor them. </li></ul></ul><ul><li>Coordinator has been empowered </li></ul><ul><li>Objective: Involve more faculty in assessment </li></ul>
  22. 23. College of Arts and Sciences Dissemination Strategies
  23. 24. Office Weblogs: ( )
  24. 25.
  25. 26. Assessed criteria Assess learning of basic biology concepts and identify misconceptions in General Biology I course Justification <ul><li>Course introduces important concepts necessary for advanced courses. </li></ul><ul><li>Many course topics are comprised within the Department learning outcomes </li></ul>Impacted population <ul><li>Pre test - 279 students, Post test – 174 students, 2 faculty members </li></ul>Pre- <ul><li>Pretest - first day of class. </li></ul>Int <ul><li>Conventional lectures, laboratory exercises, small group diagnostic test discussion </li></ul>Post- <ul><li>Post test near end of the semester. </li></ul>Results and discussion <ul><li>Students improved performance. </li></ul>Course of Action <ul><li>Incoming and persisting misconceptions as well as missed concepts were identified and re-taught. </li></ul><ul><li>Faculty was made aware of the misconceptions </li></ul>Results Dissemination <ul><li>Project was summarized at department meeting </li></ul><ul><li>Project was presented at Arts and Sciences activity </li></ul>
  26. 27. Avalúo Plus: Learning Assessment Journal ( )
  27. 28. Summary
  28. 29. A+ Team
  29. 30. Available Resources <ul><li>PowerPoint presentation </li></ul><ul><li>Avalúo Plus Journal (both editions) </li></ul><ul><li>College of Arts and Science Progress report (submitted on May 2007) </li></ul>
  30. 31. QUESTIONS?