SlideShare a Scribd company logo
How do YOU Measure
    Student Learning? SAILS,
     ILCC, & RGR at GVSU
                  MLA Annual Conference
Liaison Librarians, GVSU University Libraries
Pete Coco
Emily Frigo
Hazel McClure
Debbie Morrow

               Wednesday, 26 October 2011, 9-10 am
Discussion questions

• What are your institution's curricular goals and objectives?
  How does your library's work dovetail with those goals?

• What skills would you like to see further integrated into the
  curriculum?

• How would you advocate for that integration amongst your
  colleagues?

• What kind of tools could you use in that effort?
SAILS:
Standardized Assessment of
Information Literacy Skills
Debbie Morrow
Liaison Librarian: Engineering, Computing &
Information Systems, Mathematics, Statistics
Why do Librarians Assess?

  1. Direct application of assessment data
     to increase student learning

  2. Respond to calls for accountability

  3. Improve library instruction programs
How do Librarians Assess?
  Options include ...
    surveys
      interviews
         focus groups
            portfolios
              concept maps
                 classroom assessment techniques
                     tests
                        performance assessments
                           rubrics
                             more ...

                                 How to choose??
Choosing an Assessment Approach

"Guiding Questions for Assessing Information Literacy in
Higher Education" (Oakleaf & Kaske, 2009)

Six questions can aid librarians in selecting a best assessment
approach for a given context:

•   Are we ready to conduct an information literacy assessment?
•   Why are we conducting this assessment?
•   What are the stakeholder needs?
•   Will the assessment tell us what we want to know?
•   What are the costs of this assessment?
•   What are the institutional implications of this assessment?
• Developed at Kent State University, beginning in 2002
• Funding from IMLS, Ohio Board of Regents
  Technology Initiative Grant, & ARL partnership
• Based on ACRL's Information Literacy Competency
  Standards for Higher Education (2000)
• Pilot project included 6-7 ARLs, 2002-2005
• Valid and reliable, considered standardized
• Used by at least 96 institutions, AA through Doctoral
• Conducted twice so far at Grand Valley:
   o 2006-07: 304 First-Year, 102 Fourth-Year
   o 2009-10: 204 First-Year, 283 Fourth-Year
Are we ready to conduct an information
                                            literacy assessment?




• Two necessary elements for grounding assessment:
   o Desired learning outcomes are defined
   o Opportunity for implementing improvement exists
• 2005: First GVSU Dean of University Libraries, re-
  conceiving the mission and vision of GVSU's library
  services
• Ready? maybe not, but ...
Why are we conducting this assessment?
                                   and is our purpose formative,
                                                  or summative?


• Institution has adopted assessment and continuous
  improvement as a university-wide expectation
• By 2006-07 the Provost's Office was strongly
  encouraging the Libraries to begin benchmarking with a
  nationally standardized tool such as SAILS
• Libraries' use of SAILS could be formative for the Library
  Faculty in designing an information literacy program for
  the future
What are the stakeholder needs? (and who
                                           are the stakeholders?)

• GVSU stakeholders in regard to IL:
  o Dean of University Libraries
  o Library Faculty
  o GVSU Faculty
  o GVSU General Education Program
  o GVSU students
• Using SAILS we could
  o demonstrate participation in assessment of the unit's
    impact on student learning
  o benchmark our students externally and internally
  o feed into a larger unit conversation about the shape
    and nature of library contributions to student learning in
    a changing future
Will the assessment tell us what we
                                                   want to know?

"What do we want to know?" -- perhaps THE key question that
we didn't ask before we administered SAILS.

What we were able to learn:
• how GVSU students compare in IL skills to college students
  nationwide (baseline, external comparison): as well as, or
  better than, most comparable participating institutions
• if GVSU students improve their IL skills during the course of
  their college education (longitudinal, internal comparison):
  YES, somewhat
• if UL information literacy programs contribute to student
  learning and information literacy: by indirect inference, we
  could be more effective ...
What are the costs of this assessment? --
                                     time, financial, personnel?
                                         initial and continuing?



• participation cost for one year -- $2000
• marketing to participants, including incentives -- $500?
• staff time -- primarily, small committee work to analyze
  and report
• conduct perhaps every 3rd or 4th year
• TOTAL: ~$2000-$3000, pretty modest cost, really
What are the institutional implications of
                                                 this assessment?

What does SAILS really measure?
• What does it tell us? What DIDN'T it tell us?
• Does information gleaned from this assessment help
  inform campus discussions about the impact of the
  University Libraries on student learning at GVSU? or do
  we need to explore other tools and avenues of
  assessment?

Results and reports from the 2006-07 and 2008-09 iterations
of SAILS at Grand Valley:
 • On the 'About' page on the GVSU Libraries web site
   (www.gvsu.edu/library/about-188.htm)
Our conclusions regarding SAILS:
• Doing SAILS isn't enough. More SAILS isn't the right
  answer.
• Administering SAILS has been valuable:
   o GVSU students are competitive with their peers at
     other institutions in IL skills;
   o Conducting SAILS and analyzing the data has been a
     great "conversation starter" among the Library faculty
     about what it is that we really want to measure, and
     how we can attempt to do it.
Information Literacy Core
Competencies (ILCC) document
Emily Frigo
Liaison Librarian: Art & Design, Italian,
Writing 098 & 150 Library Coordinator
Information Literacy Core Competencies (ILCC) document
-Emily Frigo

Intended to be a multifaceted tool inclusive of the library,
General Education program, and broader academic community

Within the library:
   o undergird our Instruction Program
   o define standards we embrace professionally as librarians
   o provide a tool and shared language for outreach


Larger University:
   o information literacy is a component of every general
     education class
   o create a shared understanding of the breadth of skills
     information literacy encompasses
Information Literacy Core Competencies (ILCC) document



Faculty focus groups chosen to get feedback

   o   awareness of information literacy
   o   gauge receptivity to document
   o   whether there was a need for the document
   o   language in document was inclusive of various disciplines
   o   if more supporting practice documents or related tools
       were needed
Information Literacy Core Competencies (ILCC) document



Focus group findings:

   o   many ways to describe information literacy
Definition of Information Literacy
Information Literacy Core Competencies (ILCC) document



More findings:

   o   clarification of language in document
   o   desire for supporting documentation
   o   addition of new objectives
   o   ASSESSMENT

Results:
  o new iteration of the document
         (www.gvsu.edu/library/ilcc)
   o   addition of preamble
   o   creation of supporting documentation
Information Literacy Core Competencies (ILCC) document

  Where are we at now?

  • Changes to General Education Program are coming

  • We are creating an information literacy assessment
    document and updating the ILCC document
    accordingly

  • Growth of our Instruction Program and upcoming new
    library
                              =

  New opportunities and renewed focus on the University
  Libraries!
The Research Guidance Rubric (RGR)

Pete Coco
Liaison Librarian: English,
Environmental Studies, Writing
&
Hazel McClure
Liaison Librarian: Health Administration,
Public & Nonprofit Administration, Social Work
What is the Research Guidance Rubric?
                           [link]*

 • an assessment tool for research assignment prompts

 • a tool for collaboration




“Assigning Inquiry: How Handouts for Research Assignments Guide Today's
College Students,” Alison J. Head and Michael B. Eisenberg, Project Information
Literacy Progress Report, University of Washington's Information School, July 13, 2010


*http://gvsu.edu/library/research-guidance-rubric-for-assignment-design-175.htm
What skills does the RGR integrate into the
curriculum?

• GVSU's Information Literacy Core Competencies
  o Skills Goals are complimented & supported by guided
    research assignments
  o Ex: Skills Goal II: Locating & Gathering Info


• AACU's Information Literacy VALUE Rubrics
How does the RGR integrate these skills into the
curriculum?


• reaching faculty through:
   o campus partners
   o library liaisons
References

Oakleaf, M., & Kaske, N. (2009). Guiding Questions for Assessing
Information Literacy in Higher Education. portal: Libraries and the Academy, 9(2),
273-286.

Tyron, J., Frigo, E., & O'Kelly, M. (2010).        Using Faculty Focus Groups
to Assess Information Literacy Core Competencies at a University Level. Journal
of Information Literacy, 4(2), 62-77.
Discussion & Conclusion

• What are your institution's curricular goals and objectives?
  How does your library's work dovetail with those goals?

• What skills would you like to see further integrated into the
  curriculum?

• How would you advocate for that integration amongst your
  colleagues?

• What kind of tools could you use in that effort?

More Related Content

What's hot

The Digital Magpie: the academic reading patterns of undergraduate students
The Digital Magpie: the academic reading patterns of undergraduate studentsThe Digital Magpie: the academic reading patterns of undergraduate students
The Digital Magpie: the academic reading patterns of undergraduate students
northerncollaboration
 
Developmental Education Best Practices
Developmental Education Best PracticesDevelopmental Education Best Practices
Developmental Education Best Practices
Association of Florida Colleges
 
My high school library vision
My high school library visionMy high school library vision
My high school library visionHMLibrarian
 
Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...
Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...
Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...
Lynn Connaway
 
School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...
School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...
School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...Justine Kay
 
Mapping digital literacy provision
Mapping digital literacy provisionMapping digital literacy provision
Mapping digital literacy provision
northerncollaboration
 
How & Why to Communicate your Library’s Value
How & Why  to Communicate your Library’s Value How & Why  to Communicate your Library’s Value
How & Why to Communicate your Library’s Value
University of Wisconsin - Superior
 
Common Core and Deeper Learning
Common Core and Deeper LearningCommon Core and Deeper Learning
Common Core and Deeper Learning
Karen F
 
Advancing information literacy in higher education: four questions for debate...
Advancing information literacy in higher education: four questions for debate...Advancing information literacy in higher education: four questions for debate...
Advancing information literacy in higher education: four questions for debate...
IL Group (CILIP Information Literacy Group)
 
Christine Irving and John Crawford, The Scottish Information Literacy Project
Christine Irving and John Crawford, The Scottish Information Literacy ProjectChristine Irving and John Crawford, The Scottish Information Literacy Project
Christine Irving and John Crawford, The Scottish Information Literacy ProjectSLA
 
UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG webinar: Digital resources and library services: meeting the challenge o...UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG: connecting the knowledge community
 
Embracing Undergraduate Research; Creating the 'Arsenal'
Embracing Undergraduate Research; Creating the 'Arsenal'Embracing Undergraduate Research; Creating the 'Arsenal'
Embracing Undergraduate Research; Creating the 'Arsenal'
NASIG
 
NASPA Annual Conference: Learning and Adapting Together During the Pandemic
NASPA Annual Conference: Learning and Adapting Together During the PandemicNASPA Annual Conference: Learning and Adapting Together During the Pandemic
NASPA Annual Conference: Learning and Adapting Together During the Pandemic
brightspot
 
Dynamic Leadership and Management of Libraries/Learning Commons
Dynamic Leadership and Management of Libraries/Learning CommonsDynamic Leadership and Management of Libraries/Learning Commons
Dynamic Leadership and Management of Libraries/Learning Commons
Philippine Association of Academic/Research Librarians
 
Wrapping the Gift? The Role of the School Library and Evaluating the School ...
Wrapping the Gift?  The Role of the School Library and Evaluating the School ...Wrapping the Gift?  The Role of the School Library and Evaluating the School ...
Wrapping the Gift? The Role of the School Library and Evaluating the School ...
Johan Koren
 
From institutional Policy to individual practice: Using Learning technologies...
From institutional Policy to individual practice: Using Learning technologies...From institutional Policy to individual practice: Using Learning technologies...
From institutional Policy to individual practice: Using Learning technologies...
Sarra_Saffron_Powell
 
You don't know what you don't know: using reflection to develop metacognitive...
You don't know what you don't know: using reflection to develop metacognitive...You don't know what you don't know: using reflection to develop metacognitive...
You don't know what you don't know: using reflection to develop metacognitive...
IL Group (CILIP Information Literacy Group)
 
Taking The Mystery Out of Community College Finances
Taking The Mystery Out of Community College FinancesTaking The Mystery Out of Community College Finances
Taking The Mystery Out of Community College Finances
Association of Florida Colleges
 
No more graphing calculators!
No more graphing calculators!No more graphing calculators!
No more graphing calculators!
Association of Florida Colleges
 
21st century learning leadership forum 2011 v2
21st century learning leadership forum 2011 v221st century learning leadership forum 2011 v2
21st century learning leadership forum 2011 v2
Ottawa Catholic School Board
 

What's hot (20)

The Digital Magpie: the academic reading patterns of undergraduate students
The Digital Magpie: the academic reading patterns of undergraduate studentsThe Digital Magpie: the academic reading patterns of undergraduate students
The Digital Magpie: the academic reading patterns of undergraduate students
 
Developmental Education Best Practices
Developmental Education Best PracticesDevelopmental Education Best Practices
Developmental Education Best Practices
 
My high school library vision
My high school library visionMy high school library vision
My high school library vision
 
Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...
Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...
Demonstrating the Value of Academic Libraries in Times of Uncertainty: A Rese...
 
School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...
School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...
School Youth Team 1_ RLS Library Strategic Plan School PowerPoint_4..12.16 UP...
 
Mapping digital literacy provision
Mapping digital literacy provisionMapping digital literacy provision
Mapping digital literacy provision
 
How & Why to Communicate your Library’s Value
How & Why  to Communicate your Library’s Value How & Why  to Communicate your Library’s Value
How & Why to Communicate your Library’s Value
 
Common Core and Deeper Learning
Common Core and Deeper LearningCommon Core and Deeper Learning
Common Core and Deeper Learning
 
Advancing information literacy in higher education: four questions for debate...
Advancing information literacy in higher education: four questions for debate...Advancing information literacy in higher education: four questions for debate...
Advancing information literacy in higher education: four questions for debate...
 
Christine Irving and John Crawford, The Scottish Information Literacy Project
Christine Irving and John Crawford, The Scottish Information Literacy ProjectChristine Irving and John Crawford, The Scottish Information Literacy Project
Christine Irving and John Crawford, The Scottish Information Literacy Project
 
UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG webinar: Digital resources and library services: meeting the challenge o...UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG webinar: Digital resources and library services: meeting the challenge o...
 
Embracing Undergraduate Research; Creating the 'Arsenal'
Embracing Undergraduate Research; Creating the 'Arsenal'Embracing Undergraduate Research; Creating the 'Arsenal'
Embracing Undergraduate Research; Creating the 'Arsenal'
 
NASPA Annual Conference: Learning and Adapting Together During the Pandemic
NASPA Annual Conference: Learning and Adapting Together During the PandemicNASPA Annual Conference: Learning and Adapting Together During the Pandemic
NASPA Annual Conference: Learning and Adapting Together During the Pandemic
 
Dynamic Leadership and Management of Libraries/Learning Commons
Dynamic Leadership and Management of Libraries/Learning CommonsDynamic Leadership and Management of Libraries/Learning Commons
Dynamic Leadership and Management of Libraries/Learning Commons
 
Wrapping the Gift? The Role of the School Library and Evaluating the School ...
Wrapping the Gift?  The Role of the School Library and Evaluating the School ...Wrapping the Gift?  The Role of the School Library and Evaluating the School ...
Wrapping the Gift? The Role of the School Library and Evaluating the School ...
 
From institutional Policy to individual practice: Using Learning technologies...
From institutional Policy to individual practice: Using Learning technologies...From institutional Policy to individual practice: Using Learning technologies...
From institutional Policy to individual practice: Using Learning technologies...
 
You don't know what you don't know: using reflection to develop metacognitive...
You don't know what you don't know: using reflection to develop metacognitive...You don't know what you don't know: using reflection to develop metacognitive...
You don't know what you don't know: using reflection to develop metacognitive...
 
Taking The Mystery Out of Community College Finances
Taking The Mystery Out of Community College FinancesTaking The Mystery Out of Community College Finances
Taking The Mystery Out of Community College Finances
 
No more graphing calculators!
No more graphing calculators!No more graphing calculators!
No more graphing calculators!
 
21st century learning leadership forum 2011 v2
21st century learning leadership forum 2011 v221st century learning leadership forum 2011 v2
21st century learning leadership forum 2011 v2
 

Similar to How do you_measure_student_learning_mla_an

Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...
Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...
Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...
credomarketing
 
Library wrap 2007
Library wrap 2007Library wrap 2007
Library wrap 2007Johan Koren
 
Failing forward in research around technology enhanced learning
Failing forward in research around technology enhanced learningFailing forward in research around technology enhanced learning
Failing forward in research around technology enhanced learning
Charles Darwin University
 
A Departmental Information Literacy Strategy and Frameworks for Independent L...
A Departmental Information Literacy Strategy and Frameworks for Independent L...A Departmental Information Literacy Strategy and Frameworks for Independent L...
A Departmental Information Literacy Strategy and Frameworks for Independent L...
Lyn Parker
 
OBTLP WRITING WITH SDG.pptx
OBTLP WRITING WITH SDG.pptxOBTLP WRITING WITH SDG.pptx
OBTLP WRITING WITH SDG.pptx
RenalynGacusan2
 
National Careers Week webinar — Careers and student equity: Key influencers a...
National Careers Week webinar — Careers and student equity: Key influencers a...National Careers Week webinar — Careers and student equity: Key influencers a...
National Careers Week webinar — Careers and student equity: Key influencers a...
Australian Centre for Student Equity and Success
 
Student Ambassadors for Digital Literacy: supporting student transitions
Student Ambassadors for Digital Literacy: supporting student transitionsStudent Ambassadors for Digital Literacy: supporting student transitions
Student Ambassadors for Digital Literacy: supporting student transitions
Jane Secker
 
Ehlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circleEhlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circle
FOTIM
 
Fig Application
Fig ApplicationFig Application
Fig Applicationncook
 
Portugal Ebp
Portugal EbpPortugal Ebp
Portugal Ebp
Maria Jose Vitorino
 
Evaluate: 2007 version
Evaluate: 2007 versionEvaluate: 2007 version
Evaluate: 2007 versionJohan Koren
 
Information Literacy Teaching for New(er) Professionals, 16/4/18 Sheffield
Information Literacy Teaching for New(er) Professionals, 16/4/18 SheffieldInformation Literacy Teaching for New(er) Professionals, 16/4/18 Sheffield
Information Literacy Teaching for New(er) Professionals, 16/4/18 Sheffield
IL Group (CILIP Information Literacy Group)
 
The Campaign for Information Literacy: Politics, Personalities, & Perseverance
The Campaign for Information Literacy: Politics, Personalities, & PerseveranceThe Campaign for Information Literacy: Politics, Personalities, & Perseverance
The Campaign for Information Literacy: Politics, Personalities, & Perseverance
Elisa Acosta
 
Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...
Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...
Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...Keith Lance
 
LEAP States Summit Visuals
LEAP States Summit VisualsLEAP States Summit Visuals
LEAP States Summit Visuals
Robert Kelly
 

Similar to How do you_measure_student_learning_mla_an (20)

Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...
Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...
Using Rubrics in the Implementation of 21st Century Learning Outcomes Across ...
 
Library wrap 2007
Library wrap 2007Library wrap 2007
Library wrap 2007
 
Failing forward in research around technology enhanced learning
Failing forward in research around technology enhanced learningFailing forward in research around technology enhanced learning
Failing forward in research around technology enhanced learning
 
A Departmental Information Literacy Strategy and Frameworks for Independent L...
A Departmental Information Literacy Strategy and Frameworks for Independent L...A Departmental Information Literacy Strategy and Frameworks for Independent L...
A Departmental Information Literacy Strategy and Frameworks for Independent L...
 
OBTLP WRITING WITH SDG.pptx
OBTLP WRITING WITH SDG.pptxOBTLP WRITING WITH SDG.pptx
OBTLP WRITING WITH SDG.pptx
 
National Careers Week webinar — Careers and student equity: Key influencers a...
National Careers Week webinar — Careers and student equity: Key influencers a...National Careers Week webinar — Careers and student equity: Key influencers a...
National Careers Week webinar — Careers and student equity: Key influencers a...
 
Student Ambassadors for Digital Literacy: supporting student transitions
Student Ambassadors for Digital Literacy: supporting student transitionsStudent Ambassadors for Digital Literacy: supporting student transitions
Student Ambassadors for Digital Literacy: supporting student transitions
 
Ehlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circleEhlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circle
 
Fig Application
Fig ApplicationFig Application
Fig Application
 
Portugal Ebp
Portugal EbpPortugal Ebp
Portugal Ebp
 
Trab Todd Ross
Trab Todd RossTrab Todd Ross
Trab Todd Ross
 
Trab Todd Ross
Trab Todd RossTrab Todd Ross
Trab Todd Ross
 
Trab Todd Ross
Trab Todd RossTrab Todd Ross
Trab Todd Ross
 
Trab Todd Ross
Trab Todd RossTrab Todd Ross
Trab Todd Ross
 
Trab Todd Ross
Trab Todd RossTrab Todd Ross
Trab Todd Ross
 
Evaluate: 2007 version
Evaluate: 2007 versionEvaluate: 2007 version
Evaluate: 2007 version
 
Information Literacy Teaching for New(er) Professionals, 16/4/18 Sheffield
Information Literacy Teaching for New(er) Professionals, 16/4/18 SheffieldInformation Literacy Teaching for New(er) Professionals, 16/4/18 Sheffield
Information Literacy Teaching for New(er) Professionals, 16/4/18 Sheffield
 
The Campaign for Information Literacy: Politics, Personalities, & Perseverance
The Campaign for Information Literacy: Politics, Personalities, & PerseveranceThe Campaign for Information Literacy: Politics, Personalities, & Perseverance
The Campaign for Information Literacy: Politics, Personalities, & Perseverance
 
Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...
Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...
Cut to the Chase Research: Why and How to Pursue Evidence-Based Practice for ...
 
LEAP States Summit Visuals
LEAP States Summit VisualsLEAP States Summit Visuals
LEAP States Summit Visuals
 

Recently uploaded

The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
DhatriParmar
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
Nguyen Thanh Tu Collection
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
Anna Sz.
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Po-Chuan Chen
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 

Recently uploaded (20)

The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 

How do you_measure_student_learning_mla_an

  • 1. How do YOU Measure Student Learning? SAILS, ILCC, & RGR at GVSU MLA Annual Conference Liaison Librarians, GVSU University Libraries Pete Coco Emily Frigo Hazel McClure Debbie Morrow Wednesday, 26 October 2011, 9-10 am
  • 2. Discussion questions • What are your institution's curricular goals and objectives? How does your library's work dovetail with those goals? • What skills would you like to see further integrated into the curriculum? • How would you advocate for that integration amongst your colleagues? • What kind of tools could you use in that effort?
  • 3. SAILS: Standardized Assessment of Information Literacy Skills Debbie Morrow Liaison Librarian: Engineering, Computing & Information Systems, Mathematics, Statistics
  • 4. Why do Librarians Assess? 1. Direct application of assessment data to increase student learning 2. Respond to calls for accountability 3. Improve library instruction programs
  • 5. How do Librarians Assess? Options include ... surveys interviews focus groups portfolios concept maps classroom assessment techniques tests performance assessments rubrics more ... How to choose??
  • 6. Choosing an Assessment Approach "Guiding Questions for Assessing Information Literacy in Higher Education" (Oakleaf & Kaske, 2009) Six questions can aid librarians in selecting a best assessment approach for a given context: • Are we ready to conduct an information literacy assessment? • Why are we conducting this assessment? • What are the stakeholder needs? • Will the assessment tell us what we want to know? • What are the costs of this assessment? • What are the institutional implications of this assessment?
  • 7. • Developed at Kent State University, beginning in 2002 • Funding from IMLS, Ohio Board of Regents Technology Initiative Grant, & ARL partnership • Based on ACRL's Information Literacy Competency Standards for Higher Education (2000) • Pilot project included 6-7 ARLs, 2002-2005 • Valid and reliable, considered standardized • Used by at least 96 institutions, AA through Doctoral • Conducted twice so far at Grand Valley: o 2006-07: 304 First-Year, 102 Fourth-Year o 2009-10: 204 First-Year, 283 Fourth-Year
  • 8. Are we ready to conduct an information literacy assessment? • Two necessary elements for grounding assessment: o Desired learning outcomes are defined o Opportunity for implementing improvement exists • 2005: First GVSU Dean of University Libraries, re- conceiving the mission and vision of GVSU's library services • Ready? maybe not, but ...
  • 9. Why are we conducting this assessment? and is our purpose formative, or summative? • Institution has adopted assessment and continuous improvement as a university-wide expectation • By 2006-07 the Provost's Office was strongly encouraging the Libraries to begin benchmarking with a nationally standardized tool such as SAILS • Libraries' use of SAILS could be formative for the Library Faculty in designing an information literacy program for the future
  • 10. What are the stakeholder needs? (and who are the stakeholders?) • GVSU stakeholders in regard to IL: o Dean of University Libraries o Library Faculty o GVSU Faculty o GVSU General Education Program o GVSU students • Using SAILS we could o demonstrate participation in assessment of the unit's impact on student learning o benchmark our students externally and internally o feed into a larger unit conversation about the shape and nature of library contributions to student learning in a changing future
  • 11. Will the assessment tell us what we want to know? "What do we want to know?" -- perhaps THE key question that we didn't ask before we administered SAILS. What we were able to learn: • how GVSU students compare in IL skills to college students nationwide (baseline, external comparison): as well as, or better than, most comparable participating institutions • if GVSU students improve their IL skills during the course of their college education (longitudinal, internal comparison): YES, somewhat • if UL information literacy programs contribute to student learning and information literacy: by indirect inference, we could be more effective ...
  • 12. What are the costs of this assessment? -- time, financial, personnel? initial and continuing? • participation cost for one year -- $2000 • marketing to participants, including incentives -- $500? • staff time -- primarily, small committee work to analyze and report • conduct perhaps every 3rd or 4th year • TOTAL: ~$2000-$3000, pretty modest cost, really
  • 13. What are the institutional implications of this assessment? What does SAILS really measure? • What does it tell us? What DIDN'T it tell us? • Does information gleaned from this assessment help inform campus discussions about the impact of the University Libraries on student learning at GVSU? or do we need to explore other tools and avenues of assessment? Results and reports from the 2006-07 and 2008-09 iterations of SAILS at Grand Valley: • On the 'About' page on the GVSU Libraries web site (www.gvsu.edu/library/about-188.htm)
  • 14. Our conclusions regarding SAILS: • Doing SAILS isn't enough. More SAILS isn't the right answer. • Administering SAILS has been valuable: o GVSU students are competitive with their peers at other institutions in IL skills; o Conducting SAILS and analyzing the data has been a great "conversation starter" among the Library faculty about what it is that we really want to measure, and how we can attempt to do it.
  • 15. Information Literacy Core Competencies (ILCC) document Emily Frigo Liaison Librarian: Art & Design, Italian, Writing 098 & 150 Library Coordinator
  • 16. Information Literacy Core Competencies (ILCC) document -Emily Frigo Intended to be a multifaceted tool inclusive of the library, General Education program, and broader academic community Within the library: o undergird our Instruction Program o define standards we embrace professionally as librarians o provide a tool and shared language for outreach Larger University: o information literacy is a component of every general education class o create a shared understanding of the breadth of skills information literacy encompasses
  • 17.
  • 18. Information Literacy Core Competencies (ILCC) document Faculty focus groups chosen to get feedback o awareness of information literacy o gauge receptivity to document o whether there was a need for the document o language in document was inclusive of various disciplines o if more supporting practice documents or related tools were needed
  • 19. Information Literacy Core Competencies (ILCC) document Focus group findings: o many ways to describe information literacy
  • 21. Information Literacy Core Competencies (ILCC) document More findings: o clarification of language in document o desire for supporting documentation o addition of new objectives o ASSESSMENT Results: o new iteration of the document  (www.gvsu.edu/library/ilcc) o addition of preamble o creation of supporting documentation
  • 22. Information Literacy Core Competencies (ILCC) document Where are we at now? • Changes to General Education Program are coming • We are creating an information literacy assessment document and updating the ILCC document accordingly • Growth of our Instruction Program and upcoming new library = New opportunities and renewed focus on the University Libraries!
  • 23. The Research Guidance Rubric (RGR) Pete Coco Liaison Librarian: English, Environmental Studies, Writing & Hazel McClure Liaison Librarian: Health Administration, Public & Nonprofit Administration, Social Work
  • 24. What is the Research Guidance Rubric? [link]* • an assessment tool for research assignment prompts • a tool for collaboration “Assigning Inquiry: How Handouts for Research Assignments Guide Today's College Students,” Alison J. Head and Michael B. Eisenberg, Project Information Literacy Progress Report, University of Washington's Information School, July 13, 2010 *http://gvsu.edu/library/research-guidance-rubric-for-assignment-design-175.htm
  • 25. What skills does the RGR integrate into the curriculum? • GVSU's Information Literacy Core Competencies o Skills Goals are complimented & supported by guided research assignments o Ex: Skills Goal II: Locating & Gathering Info • AACU's Information Literacy VALUE Rubrics
  • 26. How does the RGR integrate these skills into the curriculum? • reaching faculty through: o campus partners o library liaisons
  • 27. References Oakleaf, M., & Kaske, N. (2009). Guiding Questions for Assessing Information Literacy in Higher Education. portal: Libraries and the Academy, 9(2), 273-286. Tyron, J., Frigo, E., & O'Kelly, M. (2010). Using Faculty Focus Groups to Assess Information Literacy Core Competencies at a University Level. Journal of Information Literacy, 4(2), 62-77.
  • 28. Discussion & Conclusion • What are your institution's curricular goals and objectives? How does your library's work dovetail with those goals? • What skills would you like to see further integrated into the curriculum? • How would you advocate for that integration amongst your colleagues? • What kind of tools could you use in that effort?

Editor's Notes

  1. Emily introduces speakers and format.  Real brief. The Principle:  Information Literacy   [Open: hand out 3x5 cards, ask participants to respond to the question: " .... ?" -- We will offer some of our thoughts and activities related to this question.]       Assessing students: benchmarks         SAILS --debbie     Assessing our work (ILCC): reflection and developing a vocabulary [Emily] Multifaceted tool (internal and external) discuss background/impetus Created a tool- how do we ascertain whether we crafted an inclusive document-> focus groups Scope and purpose of focus groups Brief overview of findings-> revised iteration of ILCC document     Assessing assignments: a tool to guide assignment-building RGR --hazel & pete In conclusion: What could the role of the Libraries become in a wider move to  collaborate with classroom faculty?     Discussion with participants     [Process orientation--?] End- pass out customized survey on future programming/collaboration
  2. The Principle:  Information Literacy   [Open: hand out 3x5 cards, ask participants to respond to the question: " .... ?" -- We will offer some of our thoughts and activities related to this question.]       Assessing students: benchmarks         SAILS --debbie     Assessing our work (ILCC): reflection and developing a vocabulary [Emily] Multifaceted tool (internal and external) discuss background/impetus Created a tool- how do we ascertain whether we crafted an inclusive document-> focus groups Scope and purpose of focus groups Brief overview of findings-> revised iteration of ILCC document     Assessing assignments: a tool to guide assignment-building RGR --hazel & pete In conclusion: What could the role of the Libraries become in a wider move to  collaborate with classroom faculty?     Discussion with participants     [Process orientation--?] End- pass out customized survey on future programming/collaboration
  3. This article and the 6-question framework it presents would have been really useful for us five years ago, when we undertook our first major attempt at broadly assessing and benchmarking student information literacy at Grand Valley. Even after the fact, the framework provides a useful way to look back at that assessment attempt, and add some dimension to what we've learned from it.
  4.   The attempt in question is our two administrations of SAILS, the Standardized Assessment of Information Literacy Skills.   ACRL standard:  delineates 5 IL standards, each with multiple performance indicators and outcomes. SAILS test questions are derived from the outcomes and also from objectives included in a companion ACRL document.    Participating students respond to 40 multiple choice questions presented to them randomly from a question bank of some 150 items; it takes about 45 minutes to work through the test.
  5. Since 2005, 1st Dean of Libraries has been growing and restructuring the Univ. Libraries and its programs -- not able to do much beyond initial benchmarking until structures and people are in place to develop and carry out programs
  6. Some risk of 'survey fatigue' among student participants Limited information to report to colleagues and administrators
  7. [after Debbie is done here, Emily continues with ILCC document]
  8. Saw advantage of using existing university curriculum as means to advocate for IL Ground work needed to be laid internally--> needed more formal framework to begin standardizing library instruction Document- facilitate conversation by focusing conversation on standards we embrace professionally as librarians Standards provide common ground to base discussion of pedagogy and teaching methodologies both within and beyond the library What does this document look like?
  9. Total of 6 skills goals: 1) Construct a question or problem statement 2) locate and gather information 3)Evaluate sources 4)Manage Information and Communicate Knowledge 5)Use information ethically 6)Develop subject knowledge Shows breadth of IL across students academic career from general education- major program- graduate program Uses a scaffolding hierarchy Use little jargon as possible Use langauge inclusive of any academic discipline  Emphasis that IL is a process
  10. Along with my colleagues MO and JT, we applied for internal grant to fund 2 faculty focus groups.  ($1800 Pew Scholar Teacher Grant)
  11. Should come as no surprise that there was no one shared definition of IL
  12. Clarification of language:  RSS--> Current awareness tools *Seminal- foundational *Proto-thesis New objectives: added information overload and another about disciplinary ethical guidelines Changed Skills Goal #6: Develop Subject Knowledge to Communicate Knowledge Supporting documents: use as lens through which their existing curricular materials could be viewed Assessment- concern over number of skills goals and objectives, but agreed document could be used to inform larger university assessment process (further exploration was outside the scope of this project)