This document discusses assessment at various levels - instructional, program, and institutional. It defines assessment as determining what you want to know and how to measure it, not as evaluation. The document provides examples of formative and summative instructional assessments including classroom assessment techniques. It also discusses tying instruction to learning outcomes and assessing at the program level by examining outcomes. Finally, it discusses institutional level assessment through tools like rubric assessment of undergraduate learning outcomes.
Moving Beyond Student Ratings to Evaluate TeachingVicki L. Wise
Evidence of teaching quality needs to take into account multiple sources, as teaching is multidimensional. Moreover, the likelihood of obtaining reliable and valid data and making appropriate judgments are increased with more evidence.
Evaluating Teaching in Higher EducationEmma Kennedy
This powerpoint is taken from a workshop for university teachers on the basics of evaluation, including its advantages and disadvantages, and how to best use evaluation as a tool for improving the student experience in higher education.
Are They Learning? Building a longitudinal model of information literacy asse...Alan Carbery
This is a paper presented at the LILAC 2016 conference in Dublin, Ireland during March 2016. This paper provides overview of a three-year assessment project in Champlain College Library - to assess the information literacy competency of students.
Assessment of Learning in Universal Design for LearningCAST
April 25-28, 2011: CEC Convention
Presenters: Tracey Hall and Isabel Arathoon, CAST; Amanda Kloo, University of Pittsburgh; Deborah Taub, UNC Greensboro
@kateboshier used this presentation to model to a group of teachers how they could conduct action research in school, as part of www.researchingteachers.wordpress.com
21st century language and literacy assessment_DepEd UrdanetaGemz Baltazar
This is a discussion related to the reading program implemented at DepEd Urdaneta City-- the SCRIBE (Systematic and Comprehensive Reading Interventions in Building Excellence) Reading Program.
This is the peer-reviewed article form of my assessment literacy slide show. This article was recently published in the Spring, 2009 edition of OnCUE, a peer-reviewed journal published in Japan for college and university educators. A Japanese translation of the abstract is provided at the beginning.
Moving Beyond Student Ratings to Evaluate TeachingVicki L. Wise
Evidence of teaching quality needs to take into account multiple sources, as teaching is multidimensional. Moreover, the likelihood of obtaining reliable and valid data and making appropriate judgments are increased with more evidence.
Evaluating Teaching in Higher EducationEmma Kennedy
This powerpoint is taken from a workshop for university teachers on the basics of evaluation, including its advantages and disadvantages, and how to best use evaluation as a tool for improving the student experience in higher education.
Are They Learning? Building a longitudinal model of information literacy asse...Alan Carbery
This is a paper presented at the LILAC 2016 conference in Dublin, Ireland during March 2016. This paper provides overview of a three-year assessment project in Champlain College Library - to assess the information literacy competency of students.
Assessment of Learning in Universal Design for LearningCAST
April 25-28, 2011: CEC Convention
Presenters: Tracey Hall and Isabel Arathoon, CAST; Amanda Kloo, University of Pittsburgh; Deborah Taub, UNC Greensboro
@kateboshier used this presentation to model to a group of teachers how they could conduct action research in school, as part of www.researchingteachers.wordpress.com
21st century language and literacy assessment_DepEd UrdanetaGemz Baltazar
This is a discussion related to the reading program implemented at DepEd Urdaneta City-- the SCRIBE (Systematic and Comprehensive Reading Interventions in Building Excellence) Reading Program.
This is the peer-reviewed article form of my assessment literacy slide show. This article was recently published in the Spring, 2009 edition of OnCUE, a peer-reviewed journal published in Japan for college and university educators. A Japanese translation of the abstract is provided at the beginning.
Writing and Refining Information Literacy Learning OutcomesChris Sweet
One of the cornerstones of effective information literacy assessment is having clearly-defined student learning outcomes. Learning outcomes specify what learners will know or be able to do as a result of a learning activity. Accrediting bodies often look for specific learning outcomes as one component of the review process. Most librarians have received little –or no- training in writing learning outcomes. This workshop will provide an overview of learning outcomes, their role in assessment and how to write them. Participants are encouraged to come with an instruction session or class for which they want to write or refine learning outcomes.
What's a Library to Do? Transforming the One-Shot Library Workshop for the Ne...Jerilyn Veldof
Cornell University Library invited me to do a workshop for them on <a href="http://www.tc.umn.edu/~jveldof/WorkshopDesign/">creating one-shot library workshops</a>. These are the remarks I made in another session for their Library Assembly prior to the workshop.
For the past few years, reading has taken center stage in PD—specifically because this is an area that has been deemed as being one that most of our students struggle with as evidenced by ISAT performance. For the past couple of years, teachers have been exposed to the concept of Reading Across the Curriculum. At first, Haugan received PD from an outside consultant and then last year, most of our PD was delivered on-site by our Master Teachers. This year, we are going full force with Reading Across the Curriculum and marrying it to the Differentiation concept—Haugan personnel will be the driving force behind the initiative; in terms of providing all PD ourselves. So far, we have delivered 4 PowerPoint presentations that have some type of literacy/differentiation element embedded into it: Ex: 1. Formative Assessment; 2. Word Maps to Build Comprehension; 3. Summarizing; and 4. Differentiation.
Formative Assessment ppt: The idea behind this PD session was to expose teachers to techniques that they can implement in any one of the different content-areas that would allow them to frequently monitor students’ understanding. Research has shown that it is through these constant ‘checks for understanding’ that teachers are better able to adjust their instruction to maximize learning. Through formative assessment, teachers are able to cater to students’ individual needs; this is a huge concept behind differentiation.
An overview of the former ACRL Standards and the new draft ACRL Framework for Information Literacy for an audience of digital humanities instructors and librarians
Subtitle: Peer Reference in the Residence Halls
Presenters: Holly Flynn, Ben Oberdick
Presented At: First Year Experience, Cleveland, OH
Date: April 7, 2014
More from Michigan State University Libraries - Information Literacy (9)
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
Read| The latest issue of The Challenger is here! We are thrilled to announce that our school paper has qualified for the NATIONAL SCHOOLS PRESS CONFERENCE (NSPC) 2024. Thank you for your unwavering support and trust. Dive into the stories that made us stand out!
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
Macroeconomics- Movie Location
This will be used as part of your Personal Professional Portfolio once graded.
Objective:
Prepare a presentation or a paper using research, basic comparative analysis, data organization and application of economic information. You will make an informed assessment of an economic climate outside of the United States to accomplish an entertainment industry objective.
Honest Reviews of Tim Han LMA Course Program.pptxtimhan337
Personal development courses are widely available today, with each one promising life-changing outcomes. Tim Han’s Life Mastery Achievers (LMA) Course has drawn a lot of interest. In addition to offering my frank assessment of Success Insider’s LMA Course, this piece examines the course’s effects via a variety of Tim Han LMA course reviews and Success Insider comments.
Embracing GenAI - A Strategic ImperativePeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
2. WHAT IS ASSESSMENT, EXACTLY?
Figuring out what you want to know
Figuring out how you can know it
Collecting data to that end
3. WHAT IS ASSESSMENT NOT?
Vindication: an attempt to prove or justify something
Evaluation: an immediate measure of your worth, value, or
effectiveness
Automatically going to tell you that you suck.
4. WHAT IS DATA?
Pieces of information that are captured or recorded.
Not just numbers. Qualitative data counts too.
You might already have a lot more sources of data than you
realize.
5. TODAY’S AGENDA:
Teaching and Learning Assessment
Program Assessment
Institutional Level Assessment
6. INSTRUCTIONAL ASSESSMENT:
WHAT DO WE WANT TO KNOW?
Is my teaching effective?
Are students learning?
WHAT are students learning?
From another perspective:
Is students’ approach to research changing? How?
Could the way I teach reinforce negative student habits? Could it have a
positive affect on changing those?
Really specific:
Can students articulate the differences between a popular and scholarly
article?
Does taking students on a building tour increase the likelihood of a favorable
attitude toward the library?
7. TWO TYPES OF INSTRUCTIONAL
ASSESSMENT
Formative helps along the way
Asking: what do you still have questions about?
In-class clicker questions
Summative is assessing after the fact; cumulative.
Paper, project, or bibliography
Final exam
8. LEARNING OUTCOMES
Outcomes are specific and measurable
Outcomes are guides for a sessions’s structure, content, and
teaching methods (pedagogy)
Outcomes can be talking points for faculty – especially when
expectations for a session are unrealistic.
9. WHAT’S THE IDEAL?
In an ideal world, what would you like these students to be able to
do?
What steps would they need to take in order to be able to do
those things?
Can you address any of these steps through your instruction?
How many or how few?
How do you know if the students can do them?
(hint: that last part is assessment!)
10. CATS – CLASSROOM ASSESSMENT
TECHNIQUES
One minute free write
“Muddiest Point”
Class discussion
Worksheets
Think-pair-share or group
review
Concept maps
Groups evaluate source and
present to class
Show two sources, use Poll
Everywhere or clickers to
vote on more appropriate
source
Compare Google vs. Google
Scholar search results
Hoax website experience
Create rubric as a class or
group
Google form
11.
12.
13. USING COURSE ASSESSMENTS
Final papers or projects
Feedback from students
Pre and post session quiz or questionnaire
14. REMEMBER:
If you assess the outcome and it’s not met – this is OK
This could mean:
It’s not achievable in the time you are allotted
There are too many other things going on in class which crowd out focusing
on achieving the outcome
It’s not achievable by the current methods being used in class
Or… several other things.
15. INTERACTIVE TIME
Brainstorm and write down some new ways that you could use
CATs in your own class. You can do this on your own or feel free
to talk to those around you.
16. PROGRAM LEVEL ASSESSMENT
What do you want to know regarding the work that you do with
your library unit or campus department?
How is my liaison work going? What effect is it having?
Is my instruction lining up with course, program, or other outcomes? Do these
outcomes even exist?
17. WHERE CAN YOU FIND
OUTCOMES?
Accreditation standards for your discipline
Program outcomes (ex. First Year Writing)
Departmental/Unit mission statements and Gs and Os
MSU Undergraduate Learning Outcomes
20. INSTITUTIONAL LEVEL
ASSESSMENT
What questions exist at the institutional level?
How do the Libraries affect student learning at MSU?
At what point in their education are MSU students learning information literacy
skills?
What value do the Libraries – our services and collections – have for the
University as a whole?
22. Analytical Thinking – The MSU graduates uses ways of knowing from mathematics, natural sciences, social sciences, humanities, and arts to
access information and critically analyzes complex material in order to evaluate evidence, construct reasoned arguments, and communicate
inferences and conclusions.
Emerging Developing Proficient Exemplary
Acquires, analyzes,
and evaluates
information from
multiple sources
Seeks information from basic
types of sources with minimal
regard for relevance or
quality.
Retrieves information from a
limited range of sources and
identifies biases, strengths,
and weaknesses within those
sources.
Designs and implements
effective strategies to find
relevant sources based on
purpose. Critiques biases,
strengths, and weaknesses of
information sources.
Uses analysis to defend
information choices and reach
original conclusions.
Synthesizes and
applies information
within and across
disciplines
Recognizes multiple
perspectives among sources
of information.
Identifies how information can
be conceptualized differently
within various disciplines.
Examines and integrates
relevant information sources
from multiple disciplinary
perspectives.
Creates a defensible,
compelling work using
multiple disciplinary
perspectives.
Identifies and
applies, as
appropriate,
quantitative
methods for
defining and
responding to
problems
Recognizes the need for and
performs basic quantitative
methods.
Identifies a range of
quantitative methods and
employs them to make
judgments.
Selects quantitative methods
for making sound judgments
and drawing plausible
conclusions based on the
situation.
Critiques biases, strengths, and
weaknesses of quantitative
approaches to reflect on
conclusions and propose
responses to a situation.
Identifies the
credibility, use and
misuse of scientific,
humanistic and
artistic methods
Recognizes a range of inquiry
methods and acknowledges
that they can be misused.
Describes the effective use of
methods and identifies their
misuse in a given contexts.
Judges if methods are credible
and ethical in given contexts.
Selects inquiry methods
ethically and with an
understanding of the
consequences of their misuse.
23. TO SUM UP
What do you want to know about your instruction, or other liaison
efforts?
How can you tie your work in to your discipline’s goals or
outcomes?
Are there larger forces at work that can guide what you’re doing?
How can you find out?
24. HELPFUL SOURCES
MSU Undergraduate Learning Outcomes (formerly Liberal Learning Goals)
http://undergrad.msu.edu/learning
Oakleaf, M. (2010). The Value of Academic Libraries: A Comprehensive
Research Review and Report, American Library Association.
http://www.ala.org/acrl/sites/ala.org.acrl/files/content/issues/value/val_report.
pdf
Angelo, T. A., & Cross, K. P. (1993). Classroom assessment techniques: A
handbook for college teachers. San Francisco: Jossey-Bass Publishers.
LB2822.75 .A54 1993 c.2
Editor's Notes
In it’s basest form, It’s gathering and recording information.
Assessment should be objective.
If you’re going to make evaluative decisions, you need to have done an assessment to provide you with data to base them on.
Data need to be interpreted in order to understand what they mean.
Doesn’t always have to highlight effectiveness or ineffectiveness.
Assessment CAN be the first step in determining these things. Data can be used in all sorts of ways, but that doesn’t mean it shouldn’t be collected.
Blissful ignorance is tempting sometimes, but dangerous as it never leads to innovation or improvement!
Do you get the “anecdotal” slam? Write it down as it happens and it’s not anecdotal anymore.
Teaching/learning – for classes and student interaction
Program – can use to look at certain areas such as liaison, reference, etc.
Write things on your worksheet
Ask people what they want to know about their classes.
The hardest part of assessment is figuring out what you really want to know.
These are ALL things that can be assessed. Some are harder than others, but they can be done.
Assessment takes work, so make sure that it’s what you REALLY want to know. If it is, it should be worth assessing.
Formative mostly involves your teaching
Summative involves learning
These are how we determine exactly what it is that we want to measure. It also determines how we teach.
Specific: not “understand the library” or “know about databases.” How will you measure those things?
They help you keep on track, design, focus, and pare out any uneccessary content
Tech – it’s a cool toy, but will it help me meet my learning outcomes?
How might I use it in a way that addresses the outcomes?
You can collect worksheets!
These are mostly formative
Different methods you can use to collect data, depending on what you want to know.
There’s more than just assessment going on here – it’s part of the whole design of class.
If tech can help you assess what you’re after, great – if not, use something else.
GOOGLE FORM in libguide
For more, see:
http://cft.vanderbilt.edu/teaching-guides/assessment/cats/ and book at end.
If you can collaborate with instructors, even better! Seeing student work is extremely helpful and you might even have some suggestions.
Final projects: rubrics, source or citation analysis, bibliography check, reflection
This can work to your advantage. Remember it’s data… not evaluation.
Some accrediation standards include information literacy, specifically.
MSU Mechanical Engineering Program Outcomes – these are required for accreditation
Student learning concept, even gives specific course where it’s addressed. I know Heidi is involved in this course. If you weren’t, and found something like this, you could contact that prof and offer your services.
ACRL Value of Academic Libraries report
Drawbacks of learning outcomes rubrics
-Easily misinterpreted
-No clear vision yet as to how to use for assessment purposes
Drawbacks of standardized testing:
-Not adaptable to locally-generated outcomes
-Not holistic or contextual
-Need campuswide buy-in and staff time
-Expensive
i.e. we’re paying a lot of money to see if students meet an outcome that’s not really ours… or if they do well on a test
Drawbacks of curriculum mapping:
-MSU is far too big for this to happen
-Need buy-in across campus
Cross-disciplinary, intentionally. What does this look like in your discipline? What are you already doing that fits into some of these categories?
Are students learning? If so, what? Is my teaching approach effective? What can I do differently? Are there different ways to approach liaison that could yield more benefits?
Reflective reading?