Focus on Learning:
Student Outcomes
Assessment and the
Learning College
American Association for
Higher Education and The
Higher Learning Commission
 Changing Institutional Priorities
 Conference Workshop
 Omaha, Nebraska
 June 2003
Original Presentation by:
 Gail Mee
 Dean of Instruction
 Mesa Community College
 1833 West Southern Avenue
 Mesa, Arizona 85202
 <gailmee@mail.mc.maricopa.edu>
The Assessment Problem
 Assessment goes against the grain of
academic culture.
 Faculty are suspect of the motivations
that underlie assessment.
 The academic community believes
that assessment lacks scientific rigor.
Marchese, 2000
Why Assess Student
Learning?
 To respond to demands for
accountability from external
constituents.
 To provide evidence of institutional
effectiveness.
 To document successes and identify
weaknesses in programs.
 To improve the curriculum, instruction,
and student learning.
Purpose of Assessment
“The overriding purpose of assessment is to
understand how educational programs are
working and to determine whether they are
contributing to student growth and
development. Hence, the ultimate emphasis
of assessment is on programs rather than
on individual students.”
Palomba & Banta, 1999
Assessment Essentials
Assessment and the
Learning College
A new kind of college . . .
“The call has gone out for building a
new kind of college – A Learning
College for the 21st Century that will
focus the full resources of the college
on student learning.”
O’Banion, 1997
An Inventory for Learning –
Centered Colleges
O’Banion (2000) posits 14 benchmark
activities to be used as guidelines for
learning-centered colleges.
Three of these benchmarks relate
directly to assessing student learning.
Learning-Centered Colleges
 Hold Conversations about Learning
 Identify and Agree on Learning
Outcomes
 Assess and Document Learning
Outcomes
O’Banion, Community College Journal,
Aug/Sept 2000
Elements of the learning
college
 Belief in everyone as a learner
 Shared purpose, values, and
leadership
 Respect for individualism and
community
 Communication and connections
 Learning environments
 Evidence of learning
Ten Guiding
Assessment Principles
for the Learning
College
Guiding Principles
1. Assessment is driven by college
values.
 Student learning outcomes are
aligned with college mission, vision,
and values.
 Student learning outcomes that are
valued are assessed.
Guiding Principles
2. The college makes a long-term
commitment.
 The board and administration make
public statements about the
importance of assessment.
 There are published statements about
assessment in key documents.
 The college has committed resources
to assessment.
Guiding Principles
3. The Chief Academic Officer understands
and believes in the value of assessment.
 CAO has responsibility for leadership of
assessment.
 CAO encourages participation and provides
support for faculty involvement and
professional development.
 CAO ensures that results are used
appropriately.
Guiding Principles
4. Faculty lead the program and own the
results.
 Faculty define student learning
outcomes.
 Faculty identify or develop appropriate
tools for assessment.
 Faculty use assessment results to
make programmatic changes and
improve learning.
4. Faculty lead the program and own
the results, cont’d.
 Faculty governing body is an integral
part of the assessment process.
 A majority of faculty are
knowledgeable about assessment
vocabulary and practices.
 Faculty pursue development
opportunities related to assessment.
Guiding Principles
5. Technical expertise and support are
provided.
 Research Office plays a formal
support role, or knowledgeable staff or
faculty play that role.
 Roles of faculty and technical support
staff are clearly defined.
Guiding Principles
6. Learning outcomes are clearly
defined at the program level.
 The difference between “course” and
“program” assessment is clear.
 The college has clearly identified
“programs”.
 Student learning is assessed at the
completion of a program.
Program Level Outcomes
Program level outcomes are not just an
accumulation of course objectives.
Rather, they reflect a synthesis, or a
holistic picture, or what is expected of
students completing a defined
program or course of study.
Defining Student Learning
Outcomes
 Faculty collaborate and determine
specific student outcomes for a given
program of study.
 The outcomes describe what students
will be able to do at the completion of
the program.
MCC Sample Gen Ed
Outcome:
Written Communication
Write a clear, well-organized paper
using documentation when
appropriate.
Guiding Principles
7. Measurement tools align directly with
learning outcomes.
 Outcomes are clearly defined before
measures are developed.
 Selected measures match the defined
outcomes.
Measurement Tools
 Faculty select or develop measures
specifically aligned with well-defined
student learning outcomes.
 The measure may be faculty-
developed or externally-developed
standardized measures.
 Measures should be pilot-tested.
MCC Measurement Tool:
Written Communication
 Students are given a writing prompt for
which they must develop and argue for
their position on the given topic.
Students write a multi-paragraph essay.
 The essays are blind scored by faculty
using a faculty-developed scoring rubric.
Guiding Principles
8. Sound research design and
methodology are used.
There is a systematic plan for gathering,
analyzing, reporting, and disseminating
the results.
a) What is assessed?
b) Who is assessed?
c) How are the assessments administered?
d) Where and when are they administered?
Guiding Principles
9. Results are used by faculty to
improve learning.
 A process is in place for sharing
results with faculty.
 Faculty are making changes to
curriculum and instruction based upon
assessment results.
Guiding Principles
10. Assessment is linked to college
planning.
 Results are used to develop
department plans.
 Results of assessment inform college
planning and budgeting decisions.
Linking Assessment and
Planning
 Using assessment results to improve
student learning is a stated goal in the
College Strategic Plan.
 Faculty and departments develop systems
for reviewing results to improve curriculum,
instruction, and student learning.
 The college-wide planning process provides
a structure to complete the feedback loop.
Sustaining Assessment for
the Long Term
 Create an expectation for assessment
among students.
 Catalog, schedule, student handbook,
student newspaper, web sites
 Disseminate the results of assessment.
 Annual assessment reports, faculty
publications, newsletters, web sites
 Constantly evaluate the outcomes,
measures, procedures, and results.
Sustaining Assessment
Cont’d.
 Link assessment results to planning and
budgeting processes.
 Engage faculty in decision-making
during every stage of the process.
 Allow the program to evolve and mature.
Assessment and the
Learning College
 Student outcomes assessment places
learning at the center of the academic
program and the student experience.
 Assessment is a necessary component
of the learning college
A Continuous Cycle
Focused on Learning

015092579.pdf

  • 1.
    Focus on Learning: StudentOutcomes Assessment and the Learning College
  • 2.
    American Association for HigherEducation and The Higher Learning Commission  Changing Institutional Priorities  Conference Workshop  Omaha, Nebraska  June 2003
  • 3.
    Original Presentation by: Gail Mee  Dean of Instruction  Mesa Community College  1833 West Southern Avenue  Mesa, Arizona 85202  <gailmee@mail.mc.maricopa.edu>
  • 4.
    The Assessment Problem Assessment goes against the grain of academic culture.  Faculty are suspect of the motivations that underlie assessment.  The academic community believes that assessment lacks scientific rigor. Marchese, 2000
  • 5.
    Why Assess Student Learning? To respond to demands for accountability from external constituents.  To provide evidence of institutional effectiveness.  To document successes and identify weaknesses in programs.  To improve the curriculum, instruction, and student learning.
  • 6.
    Purpose of Assessment “Theoverriding purpose of assessment is to understand how educational programs are working and to determine whether they are contributing to student growth and development. Hence, the ultimate emphasis of assessment is on programs rather than on individual students.” Palomba & Banta, 1999 Assessment Essentials
  • 7.
    Assessment and the LearningCollege A new kind of college . . . “The call has gone out for building a new kind of college – A Learning College for the 21st Century that will focus the full resources of the college on student learning.” O’Banion, 1997
  • 8.
    An Inventory forLearning – Centered Colleges O’Banion (2000) posits 14 benchmark activities to be used as guidelines for learning-centered colleges. Three of these benchmarks relate directly to assessing student learning.
  • 9.
    Learning-Centered Colleges  HoldConversations about Learning  Identify and Agree on Learning Outcomes  Assess and Document Learning Outcomes O’Banion, Community College Journal, Aug/Sept 2000
  • 10.
    Elements of thelearning college  Belief in everyone as a learner  Shared purpose, values, and leadership  Respect for individualism and community  Communication and connections  Learning environments  Evidence of learning
  • 11.
  • 12.
    Guiding Principles 1. Assessmentis driven by college values.  Student learning outcomes are aligned with college mission, vision, and values.  Student learning outcomes that are valued are assessed.
  • 13.
    Guiding Principles 2. Thecollege makes a long-term commitment.  The board and administration make public statements about the importance of assessment.  There are published statements about assessment in key documents.  The college has committed resources to assessment.
  • 14.
    Guiding Principles 3. TheChief Academic Officer understands and believes in the value of assessment.  CAO has responsibility for leadership of assessment.  CAO encourages participation and provides support for faculty involvement and professional development.  CAO ensures that results are used appropriately.
  • 15.
    Guiding Principles 4. Facultylead the program and own the results.  Faculty define student learning outcomes.  Faculty identify or develop appropriate tools for assessment.  Faculty use assessment results to make programmatic changes and improve learning.
  • 16.
    4. Faculty leadthe program and own the results, cont’d.  Faculty governing body is an integral part of the assessment process.  A majority of faculty are knowledgeable about assessment vocabulary and practices.  Faculty pursue development opportunities related to assessment.
  • 17.
    Guiding Principles 5. Technicalexpertise and support are provided.  Research Office plays a formal support role, or knowledgeable staff or faculty play that role.  Roles of faculty and technical support staff are clearly defined.
  • 18.
    Guiding Principles 6. Learningoutcomes are clearly defined at the program level.  The difference between “course” and “program” assessment is clear.  The college has clearly identified “programs”.  Student learning is assessed at the completion of a program.
  • 19.
    Program Level Outcomes Programlevel outcomes are not just an accumulation of course objectives. Rather, they reflect a synthesis, or a holistic picture, or what is expected of students completing a defined program or course of study.
  • 20.
    Defining Student Learning Outcomes Faculty collaborate and determine specific student outcomes for a given program of study.  The outcomes describe what students will be able to do at the completion of the program.
  • 21.
    MCC Sample GenEd Outcome: Written Communication Write a clear, well-organized paper using documentation when appropriate.
  • 22.
    Guiding Principles 7. Measurementtools align directly with learning outcomes.  Outcomes are clearly defined before measures are developed.  Selected measures match the defined outcomes.
  • 23.
    Measurement Tools  Facultyselect or develop measures specifically aligned with well-defined student learning outcomes.  The measure may be faculty- developed or externally-developed standardized measures.  Measures should be pilot-tested.
  • 24.
    MCC Measurement Tool: WrittenCommunication  Students are given a writing prompt for which they must develop and argue for their position on the given topic. Students write a multi-paragraph essay.  The essays are blind scored by faculty using a faculty-developed scoring rubric.
  • 25.
    Guiding Principles 8. Soundresearch design and methodology are used. There is a systematic plan for gathering, analyzing, reporting, and disseminating the results. a) What is assessed? b) Who is assessed? c) How are the assessments administered? d) Where and when are they administered?
  • 26.
    Guiding Principles 9. Resultsare used by faculty to improve learning.  A process is in place for sharing results with faculty.  Faculty are making changes to curriculum and instruction based upon assessment results.
  • 27.
    Guiding Principles 10. Assessmentis linked to college planning.  Results are used to develop department plans.  Results of assessment inform college planning and budgeting decisions.
  • 28.
    Linking Assessment and Planning Using assessment results to improve student learning is a stated goal in the College Strategic Plan.  Faculty and departments develop systems for reviewing results to improve curriculum, instruction, and student learning.  The college-wide planning process provides a structure to complete the feedback loop.
  • 29.
    Sustaining Assessment for theLong Term  Create an expectation for assessment among students.  Catalog, schedule, student handbook, student newspaper, web sites  Disseminate the results of assessment.  Annual assessment reports, faculty publications, newsletters, web sites  Constantly evaluate the outcomes, measures, procedures, and results.
  • 30.
    Sustaining Assessment Cont’d.  Linkassessment results to planning and budgeting processes.  Engage faculty in decision-making during every stage of the process.  Allow the program to evolve and mature.
  • 31.
    Assessment and the LearningCollege  Student outcomes assessment places learning at the center of the academic program and the student experience.  Assessment is a necessary component of the learning college
  • 32.