Your SlideShare is downloading. ×
  • Like
Bidle
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply
Published

 

Published in Business , Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
449
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
3
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Cindy

Transcript

  • 1. Student Learning Outcomes Assessment (SLOA) at the Program and Course Levels: Comprehensive Projects That Work Across All Disciplines AFACCT – January 2008 Carroll Community College T. Bidle, C. Dove, M. Jozik, V. Stein, N. Thorpe
  • 2. Challenges to Student Learning Outcomes Assessment
    • Learning Outcomes vs. Content Objectives
    • Program vs. Course level Outcomes
    • Assessment across all sections and instructors
    • In-house vs. benchmarked assessment
    • Data collection, analysis, storage
    • Closing the loop to improve instruction
  • 3. Levels of Student Learning Outcomes & Assessment Program Course Institutional Middle States Commission on Higher Education (2003), Student Learning Assessment: Options and Resources, Philadelphia, PA 19104.
  • 4. Program Level SLOA
    • Definition of an HCC program – “a sequence of study that results in student achievement of specific learning outcomes”
    • Program areas include:
    • - General education
    • - Developmental education
    • - Transfer education
    • - Career education
  • 5. AS in Chemistry Program
    • General Education 32
    • Program Requirements
    • Gen CHM I and II (8)
    • Organic CHM I and II 8
    • Calculus 1 4
    • Principles/ Physics I and II 10
    • Recommended Electives 10
    • Total Credits 64
  • 6. Chemistry Program
    • Does the two year chemistry transfer program prepare students for successful upper division work?
  • 7. How well does the program transfer to upper division institutions? Course Transfer Equivalencies Handout Incomplete / see handout for complete chart PHYS 201 & 201L (4) College Physics I or Gen. Physics I and Lab PHYS 101 (4) 4 General Physics I PHY 205 (4) Intermediate Physics I PHYS 211 (4) Gen. Physics I (non-calculus based) 2 PHY 203 (5) Principles of Physics I MATH 141 (4) Calculus II MAT 208 (4) Calculus II MATH 202 (4) Calculus II MAT 212 (4) Calculus II Add MAT 205 (4) As a recommended elective (Calc II) MATH 140 (4) Calculus I MAT 207 (4) Calculus I MATH 201 (4) Calculus I MAT 211 (4) Calculus I MATH 211 (3) Calculus for Applications or MATH 273 (4) Calculus I MAT 203 (4) Calculus I CHEM 247 (4) Principles of Organic Chemistry II 6 CHEM 316 &316L (4) Organic Chemistry & Lab II 5 CHEM 210 (4) Organic Chemistry II CHM 222 & 226 (4) Mod. Org. Chem II & Lab CHEM 332 (5) 1 Organic Chem. II 1 CHM 204 (4) Organic Chemistry II CHEM 237 (4) Principles of Organic Chemistry I 6 CHEM 315 & 315L (4) Organic Chemistry & Lab I 5 CHEM 209 (4) Organic Chemistry I CHM 221 & 225 (4) Mod. Org. Chem I & Lab CHEM 331 (5) Organic Chem. I 1 CHM 203 (4) Organic Chemistry I CHEM 153 (3) General and Inorganic Chemistry 6 CHEM 209 & 209L (4) General Chemistry & Lab II CHEM 102 (4) General Chemistry II CHM122 & 126 Chemical Dynamics & Lab 3 CHEM 111 (4) Gen. Chem. II CHM 104 (4) General Chemistry II CHEM 143 (5) General and Analytical Chemistry 6 CHEM 207 & 207L (4) General Chemistry & Lab I CHEM 101 (4) General Chemistry I CHM121 & 125 Chemical Bonding & Lab 3 CHEM 110 (4) Gen. Chem. I CHM 103 (4) General Chemistry I UMCP Shepherd Hood Shippensburg Towson HCC
  • 8. What are Program Outcomes?
    • Expectations for students when they leave the classroom and are working in their careers or in subsequent coursework
    • Results of accomplishing course learning outcomes which build on each other
    • Involve the mastery, integration, and application of content and skills of many courses
    • Must be measurable
    • More difficult to assess than giving final exam
    • “ Career” programs may have a certification or licensure exam
  • 9. How are Program Outcomes Assessed?
    • Survey students completing all or most of the course sequence in a program
    • Assess skills at the course level as the program is in progress
    • Maintain portfolios of student work
    • Monitor success and persistence of students in the course sequences within a program
    • Follow-up with transfer institutions that articulate with many program completers
    • Follow-up with employers
    • Benchmark with nationally normed exams
  • 10. Chemistry Program Outcomes
    • Apply quantitative thinking process and reasoning skills in upper division academic work
    • Communicate chemical concepts to varied audiences
    • Use mathematical tools essential to success in upper division chemistry courses
    • 4. Design an appropriate response to a research problem
    • -- appropriate lab equipment
    • -- experimental design (scientific method)
    • Solve problems collaboratively
    • Use software and hardware to analyze experimental data
  • 11. Survey of Chemistry Graduates (chemistry program assessment)
    • Survey instrument developed based on Program Outcomes (handout)
    • Criteria for selection expanded to include all students who completed 200 level program requirements for degree even if they did not graduate
    • 72 surveys were mailed in Fall 2006
    • 14 surveys were returned and completed
  • 12. Chemistry Survey Results (chemistry program assessment)
  • 13. CAAP Scientific Reasoning 2005 Chemistry Students (Benchmarking) n=12 n=24 n=8 n=8
  • 14. Pre-Allied Health “Program”
    • Prerequisites from Math and Science Division
      • Anatomy and Physiology I & II
      • Math 101
      • Biology 099
      • Chemistry 101
  • 15. Pre-Allied Health Program
    • Do pre-allied health prerequisites prepare students for success in allied health career programs?
  • 16. Evaluation of Pre-Allied Health Program
    • Success in BIO 099, A&P I and A&P II FA 2000  SP 2007
  • 17. Evaluation of Pre-Allied Health Program Students Admitted to Allied Health Programs FA 2000  SP 2007
  • 18. Mathematics Courses Completed by A&P Students 2000-2005
    • Evaluation of Pre-Allied Health Program
  • 19. BIO 099 Course Redesign
    • Revised outcomes to include
      • Reading skills
      • Problem solving
      • Math skills
    • Increase credits from 2 to 3 hours
    • Placement exam revised to reflect outcome changes
  • 20. Pre-Allied Health Program Outcomes
    • Successful completion of Anatomy and Physiology I and II
    • Successful admission into Allied Health Program
  • 21. HCC Science Course Projects: Program Course Institutional Middle States Commission on Higher Education (2003), Student Learning Assessment: Options and Resources, Philadelphia, PA 19104.
  • 22. HCC Science Course Projects:
    • General Chemistry I and II
    • Intro. To College Chemistry
    • Biology for Allied Health
    • Anatomy & Physiology I and II
  • 23. The Program:Course Matrix To Integrate Outcomes (handout) 5. Collaboration 6. Use software for data analysis 4. Experimental design 3. Use math tools 2. Communicate concepts 1. Reasoning skills Course #4 Outcomes Course #3 Outcomes Course #2 Outcomes Course #1 Outcomes Program Outcomes
  • 24. Assessment of Skills and Content (chemistry course assessment)
    • Common Rubrics in Related Courses
      • Dimensional analysis problems (handout)
      • Laboratory reports (handout)
      • Chemical Equations (in progress)
    • Common Final Exams
      • Introductory Chemistry, General Chemistry I and II
  • 25. Definitions Students registered at the census date (including those that withdrew after the census date) Active Students = enrollees Students earning A, B, C completers Completer success rate Students earning A, B, C active students Success Rate Completers active students Retention Rate Active students – withdrawals Completers
  • 26. Definitions, cont’d Aggregate data from peer institutions or normed national tests Benchmark Assessment Progression through successive courses in a course sequence Persistence Measurement of student learning of expected learning outcomes Assessment
  • 27. General Chemistry I (CHM 103) Retention and Success (Fa 05  Fa 07) N=40 N=189 N=18
  • 28. American Chemical Society (ACS) Standardized General Chemistry Exams CHM 103 (Gen Chemistry, I) n= 52 n=14 n=5 n=42 n=21 n = 7 n = 53
  • 29. CHM 103 (Gen. Chem. I) Fall 05 – Fall 07 A B C D F
  • 30. N=64 N=26 General Chemistry II (CHM 104) Retention and Success (SP 06  Fa 07)
  • 31. American Chemical Society (ACS) Standardized General Chemistry Exam CHM 104 (Gen Chemistry, II) n=32 n=8 n=18 n =16
  • 32. CHM 104 (Gen. Chem. II) Spring 06 – Fall 07 A B C D F
  • 33. Persistence from General Chemistry I (CHM 103)  II (CHM 104) 66.4% 23.9% 48.9% 21.1% CHM 103 in Spring or Summer CHM 104 completed in Fall CHM 103 in Fall CHM 104 completed the following Spring
  • 34. CHM 101: Introductory College Chemistry
    • Assessment started Fall 2007
    • Rubric for grading dimensional analysis problems
    • Common final exam
  • 35. CHM 101 (Intro. Chem.) Common Final Exam A B C D F
  • 36. Anatomy and Physiology I and II
    • High Enrollment Course
    • Prerequisites
      • Placement Test
      • BIO 099 for those who fail the placement test
      • H.S. Chemistry or Introductory College Chemistry
  • 37. A&P Project Design Overview
    • Based on the HAPS* learning outcomes
    • Develop a common cumulative final exam to assess student learning at the end of A&P I
    • Administer exam to all students completing A&P I and analyze student and section data
    • Administer national HAPS exam to all A&P II completers
    • Use data to modify course and increase student success
    • Generate Database of students’ exam grades, course grades, success in other prerequisite courses
    * Human Anatomy & Physiology Society (HAPS)
  • 38. Using the Student Database
    • Identify gaps in student learning
    • Modify course components
    • Science Learning Center supplements
    • Laboratory activities
    • Examples of using the data
  • 39. HAPS Exam Scores vs. HCC 1 st Semester Exam
  • 40. HAPS 2-Semester Comprehensive Exam Comparison with Other Colleges (benchmarking) *HCC Retention Rate = 71% 54.01 + 12.5* HCC students (n=294) 50.80 + 10.45 2-yr colleges (n=1466) 57.53 + 12.10 4-yr colleges (n= 964) 53.46 + 11.88 Average of 2-yr and 4-yr colleges (n=2430) Average + Standard Deviation Student Groups
  • 41. The Science Team
    • Cindy Dove
    • Veronica Stein
    • Nancy Thorpe
    • Judith Peisen
    • Terri Bidle
    • Robin Thomas
    • Maria Jozik
    • Richard Campbell
    • Bernard Murphy
    • David Karstaedt
    • James Stemmle
    • Elaine Ashby
    Contact information : [email_address] [email_address] 301-790-2800 extension 268