Strategies for Holistic Assessment of Student IL Learning

1,076 views

Published on

Breakout presentation given at the 2014 WASC Core Competencies Retreat on Information Literacy and Critical Thinking in Oakland, CA.

Program information: http://www.wascsenior.org/content/retreat-core-competencies-critical-thinking-and-information-literacy

Published in: Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,076
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
22
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Strategies for Holistic Assessment of Student IL Learning

  1. 1. S T R A T E G I E S for holistic assessment of student IL learning
  2. 2. C H A R B O O T H S T R A T E G I E S for holistic assessment of student IL learning T H E C L A R E M O N T C O L L E G E S L I B R A R Y
  3. 3. C H A R B O O T H S A R A L O W E S E A N S T O N E N A T A L I E T A G G E D A N I B R E C H E R S T R A T E G I E S for holistic assessment of student IL learning T H E C L A R E M O N T C O L L E G E S L I B R A R Y
  4. 4. holistic assessment * of student IL learning
  5. 5. holistic assessment * of student IL learning
  6. 6. a u t h e n t i c differentiated holistic assessment * of student IL learning i n t e g r a t e d
  7. 7. holistic assessment * of student IL learning
  8. 8. holistic assessment * of student IL learning
  9. 9. holistic assessment * of stRudUenB t R ILI CleaS rning
  10. 10. holistic assessment * of stRudUenB t R ILI CleaS rning
  11. 11. M A P P I N G holistic assessment * of stRudUenB t R ILI CleaS rning
  12. 12. { M A P P I N G } R U B R I C S I L i n f r a s t r u c t u r e
  13. 13. { } T H E C L A R E M O N T C O L L E G E S I L i n f r a s t r u c t u r e
  14. 14. { } T H E C L A R E M O N T C O L L E G E S
  15. 15. { } T H E L I B R A R Y
  16. 16. { }
  17. 17. { } I L i n f r a s t r u c t u r e ?
  18. 18. { D I S C U S S : does your campus/institution have an infrastructure for I L A S ? S E S S M E N T ? }
  19. 19. { D I S C U S S : does your campus/institution have an infrastructure for I L A S ? S E S S M E N T ? } is it adequate to achieve your STRATEGIC GOALS?
  20. 20. { M A P P I N G } R U B R I C S
  21. 21. { }
  22. 22. { } C O N T E X T U A L / C U L T U R A L I N V E S T I G A T I O N
  23. 23. { C O N C E P T / M I N D M A P P I N G } m i n d o m o . c o m
  24. 24. { C O N C E P T / M I N D M A P P I N G } K N O W L E D G E M A N A G E M E N T
  25. 25. { C O N C E P T / M I N D M A P P I N G } K N O W L E D G E M A N A G E M E N T
  26. 26. { C O N C E P T / M I N D M A P P I N G } K N O W L E D G E M A N A G E M E N T
  27. 27. C U R R I C U L U M V I S U A L I Z A T I O N
  28. 28. C U R R I C U L U M V I S U A L I Z A T I O N c a t a l o g s s c h e d u l e s w e b s i t e s
  29. 29. C U R R I C U L U M V I S U A L I Z A T I O N c a t a l o g s s c h e d u l e s w e b s i t e s
  30. 30. C U R R I C U L U M V I S U A L I Z A T I O N
  31. 31. C A M P U S
  32. 32. P R O G R A M
  33. 33. R E Q U I R E M E N T S
  34. 34. O B J E C T I V E S / O U T C O M E S
  35. 35. A N N O T A T I O N S
  36. 36. S C A L I N G U P : I M L S S P A R K S ! G R A N T
  37. 37. T E M P L A T E S , S U P P O R T , & T R A I N I N G
  38. 38. I D E N T I F Y I N G S C A F F O L D E D I L S E Q U E N C E
  39. 39. A L I G N I N G P A S T P R A C T I C E T O F U T U R E T A R G E T S
  40. 40. A L I G N I N G P A S T P R A C T I C E T O F U T U R E T A R G E T S
  41. 41. D I S C I P L I N A R Y F A C U L T Y I L F O R U M S
  42. 42. I N S I G H T + S T R A T E G Y
  43. 43. I N S I G H T + S T R A T E G Y
  44. 44. { M A P P I N G } R U B R I C S I L i n f r a s t r u c t u r e
  45. 45. { c u s t o m i z e d R O A D M A P S } o f l e a r n e r C O M P E T E N C I E S R U B R I C S
  46. 46. L I B R A R Y I L D E F I N I T I O N
  47. 47. I L P ERFORMANCE P ERCE P T I O N S GAP 100% 80% 60% 40% 20% 0% Faculty Student Faculty Student Faculty Student Faculty Student Faculty Student Faculty Student Write annotated bibliographies Provide proper attribution to source materials in their academic work Use sources to further an argument/ thesis Evaluate sources to determine if they are authoritative Differentiate between types of information sources (e.g., scholarly v. popular literature, fact v. opinion) Effectively use Library databases, catalog(s), and other information resources to find relevant source material Excellent/Very High Above Average/High Average/Moderate Below Average/Low Poor/None
  48. 48. I L P ERFORMANCE P ERCE P T I O N S GAP 100% 80% 60% 40% 20% 0% Faculty Student Faculty Student Faculty Student Faculty Student Faculty Student Faculty Student Write annotated bibliographies Provide proper attribution to source materials in their academic work Use sources to further an argument/ thesis Evaluate sources to determine if they are authoritative Differentiate between types of information sources (e.g., scholarly v. popular literature, fact v. opinion) Effectively use Library databases, catalog(s), and other information resources to find relevant source material Excellent/Very High Above Average/High Average/Moderate Below Average/Low Poor/None * * * * * * * * * * *
  49. 49. C A M P U S - L E V E L I M P L E M E N T A T I O N S C R I P P S PITZER P O M O N A C G U H M C K G I C M C Grassroots/ consensus governance with robust committee structure Pitzer College Consensus-based governance without much committee structure Scripps College Faculty committees with strong departmental autonomy Pomona College Top-down/ federated states governance Claremont Graduate University Faculty-committee-based governance Harvey Mudd College Small/agile/ progressive committee of core faculty Keck Graduate Institute Top-down governance/ assessment driven Claremont McKenna College
  50. 50. Grassroots/ consensus governance with robust committee structure Pitzer College Consensus-based governance without much committee structure Scripps College Faculty-committee-based with strong department decision making Pomona College Top-down/ federated states governance Claremont Graduate University Faculty-committee-based governance Harvey Mudd College Small/agile/ progressive committee of core faculty Keck Graduate Institute Top-down governance/ assessment driven Claremont McKenna College SU 2012: Director of Assessment meets with librarians to discuss IL assessment options SU 2012: Librarians edit Carleton College Rubric to create Rubric v1.1 SU 2012: Librarians score First Year Seminar papers (FYS) using Rubric v1.2 FA 2012: Faculty incorporate Rubric v1.4 into FYS FA 2012: Librarians score capstone papers with Rubric v1.4 SU 2014: Library uses AiA Rubric to evaluate student IL skills FA 2012: Writing 50 (first-year seminar) faculty score papers using Rubric 2012/2013 SU 2014: Library uses 5-part Rubric to evaluate student IL skills Future: Hopeful integration of 2013-14 IL Rubric into capstone evaluation SU 2011: Environmental Analysis (EA) Rubric created based on Drake Univ. Rubric SU 2011: Discussions with faculty improve rubric & EA program FA 2011/FA 2012: EA Rubric used to develop IL instruction for EA senior thesis students SP 2013: Librarians/ faculty use Rubric 2012/2013 to evaluate sample EA theses from three prior years, submits to WASC SU 2013: Library uses AiA Rubric to evaluate student IL skills SU/FA 2012: Rubric v1.4 discussed at all departmental meetings SP 2013: Dean requests Rubric 2012/2013 as foundation for an IL instruction session in methods course / leads to development of IL Labs pilot SP 2013: 5-Part Rubric provides foundation for developing five core learning outcomes for IL Labs pilot Future: Planning for potential integration of Rubric into a Canvas course pilot as a sample evaluation object, and a Thesis/Dissertation evaluation project FA 2012: Librarians and ALO attend WASC Accreditation Retreat on Core Competencies: Critical Thinking and Information Literacy FA 2012: Librarians present Rubric 2012/13 to Assessment Committee FA 2012: Committee interested in training upper class “peers” in using rubric to evaluate clinic work SU 2014: Library uses AiA Rubric to evaluate student IL skills Future: Hopeful integration of 2013-14 IL Rubric into clinic evaluation FA 2012: Librarians and ALO attend WASC Accreditation Retreat on Core Competencies: Critical Thinking and Information Literacy FA 2012: Map and integrate Rubric v1.? into existing rubrics for some programs SP 2013: Begin using updated rubrics as part of an overall program to increase rubric use in more classes Future: IL Rubric data needs to be gathered and assessed. Rubrics are being adopted/developed for the new BioPharmacy program FA 2012: Assessment committee adopts Rubric 2012/2013 FA 2012: Keck Science Dept. adopts Rubric 2012/2013 SP 2013: Library scores senior theses using Rubric 2012/2013 SP 2013: Keck Science Dept. scores senior theses using Rubric 2012/2013 SU 2014: Library uses AiA Rubric to evaluate student IL skills Future: Hopeful integration of 2013-14 IL Rubric into capstone evaluation
  51. 51. { D I S C U S S : how would you characterize y o u r o ? r g a n i z a t i o n a l s t r u c t u r e / c u l t u r e ? } ( h o w ) a r e d e c i s i o n s a b o u t I L a s s e s s m e n t m a d e & i m p l e m e n t e d ?
  52. 52. S P E C I F I C R U B R I C A P P L I C A T I O N S • F i r s t - y e a r s e m i n a r p a p e r e v a l u a t i o n • S e n i o r c a p s t o n e / t h e s i s e v a l u a t i o n • C a m p u s e s a c c r e d i t a t i o n a s s e s s m e n t • A s s e s s m e n t i n A c t i o n ( 2 0 1 3 - 1 4 )
  53. 53. S P E C I F I C R U B R I C A P P L I C A T I O N S • F i r s t - y e a r s e m i n a r p a p e r e v a l u a t i o n • S e n i o r c a p s t o n e / t h e s i s e v a l u a t i o n • C a m p u s e s a c c r e d i t a t i o n a s s e s s m e n t • A s s e s s m e n t i n A c t i o n ( 2 0 1 3 - 1 4 )
  54. 54. 5 C O L L E G E S = 5 F I R S T Y E A R S E M I N A R P R O G R A M S
  55. 55. Research Question “What impact (if any) does librarian intervention in first-year courses have on IL performance in student work?” Methodology • First-Year Student Papers coded by Level of Librarian Collaboration in Course • Rubric Evaluation (http://bit.ly/ccl-ilrubric) of papers • 4 Liberal Arts College First-Year Seminar/ Experience programs > Claremont McKenna College, Pitzer College, Pomona College, Scripps College (coded in results for anonymity) ; Results from fifth college, Harvey Mudd, still being coded • 416 papers; 14 interrater pairs (Jan-May, 2014) Collaboration Levels 1. None = no faculty collaboration with librarian 2. Low = Traditional One-Shot 3. Moderate = multiple sessions, moderate syllabus/assignment collaboration 4. High = multiple sessions, online tutorial & quiz, significant syllabus/ assignment collaboration
  56. 56. report and data - libguides.libraries.claremont.edu/AiA
  57. 57. { f a c u l t y / l i b r a r i a n c o l l a b o r a t i o n M U T U A L U N D E R S T A N D I N G i m m e d i a t e a s s e s s m e n t t o o l } L O N G - T E R M F R A M E W O R K R U B R I C S
  58. 58. m a p p i n g R E S O U R C E S C A L A B I L I T Y T A R G E T E D I N S T R U C T I O N S T U D E N T C O M P E T E N C I E S r u b r i c s
  59. 59. E V A L U A T I O N I L i n f r a s t r u c t u r e
  60. 60. E V A L U A T I O N C O L L A B O R A T I O N I L i n f r a s t r u c t u r e
  61. 61. E V A L U A T I O N C O L L A B O R A T I O N A D V O C A C Y I L i n f r a s t r u c t u r e
  62. 62. R E S O U R C E S ea curriculum map: ea.pomona.edu/ea-5c-program-map/ ccl il program documents: libraries.claremont.edu/informationliteracy/ A i A p r o j e c t a n d d a t a : l i b g u i d e s . l i b r a r i e s . c l a r e m o n t . e d u / A i A Degrees of Impact: Analyzing the Effects of Progressive Librarian Course Co l l a b o r a t i o n s o n S t u d e n t P e r f o r m a n c e . W i t h M . S a r a L o w e , N a t a l i e T a g g e , a n d S e a n M . S t o n e . C o l l e g e & R e s e a r c h L i b r a r i e s . Accept e d : June 26, 2014; Ant i c i pat e d Pub l i c a t i on Dat e : Jul y 1 , 20 1 5 . Slide 41 Adapted from Tagge, Natalie; Booth, Char; Chappell, Alexandra; Lowe, M. Sara; and Stone, Sean M., "Choose Your Own Adventure: Integrating an I n f o r m a t i o n L i t e r a c y R u b r i c i n t o S e v e n ( V e r y ) D i f f e r e n t Col l e g e s " (2013) . L i b r a r y St a f f Pub l i c a t i o n s a n d Re s e a r c h . Pape r 1 7 . h t t p : / / s c h o l a r s h i p . c l a r e m o n t . e d u / l i b r a r y _ s t a f f / 1 7 S l i d e s 4 6 a n d 4 8 a d a p t e d fr o m Lowe , M. S a r a ; Bo o t h , Ch a r ; S t o n e , S e a n M . ; T a g g e , Nat a l i e ; C h a p p e l l , A l e x a n d r a ; a n d B u r r o w , Ga l e , " L i b r a r i a n s M a t t e r ! I m p a c t o n F i r s t - Y e a r I n f o r m a t i o n L i t e r a c y S k i l l s a t 5 Col l e g e s " (20 1 4 ) . L i b r a r y S t a f f Pu b l i c a t i o n s a n d Re s e a r c h . P a p e r 22. h t t p : / / s c h o l a r s h i p . c l a r e m o n t . e d u / l i b r a r y _ s t a f f / 2 2
  63. 63. C H A R B O O T H D I R E C T O R r e s e a r c h , t e a c h i n g & l e a r n i n g S E R V I C E S c l a r e m o n t c o l l e g e s L I B R A R Y c h a r b o o t h @ g m a i l i n f o m a t i o n a l . c o m @ c h a r b o o t h s l i d e s h a r e . n e t / c h a r b o o t h

×