SlideShare a Scribd company logo

Diagnosing students’ information literacy skills: Building on the past

•
•
Yusuke Ishimura
Yusuke Ishimura

Class presentation on information literacy

Education
1 of 75
Diagnosing students’ information literacy skills: Building on the past Ph.D. Candidate Yusuke Ishimura September 17, 2009 1
Please note: All references used in this presentation are listed at the end of the slides (pp. 28-29) Y. Ishimura GLIS 619 September 17, 2009 2
Objectives • Become familiar with existing various information literacy (IL) assessment approaches • Understand types of evidence obtained from different assessment methods • Understand strengths & weaknesses of each assessment approach • Provide links to future assessment 3 Y. Ishimura GLIS 619 September 17, 2009
4 Y. Ishimura GLIS 619 September 17, 2009
Informs student Informs teacher Formative Summative 4 Y. Ishimura GLIS 619 September 17, 2009
Improve Improve performance Informs student Informs teacher instruction Promoting Making Formative student instructional growth decisions Summative Evaluating Evaluating student programs achievement Recognize Modify accomplishment program 4 Y. Ishimura GLIS 619 September 17, 2009
Before Starting . . . Y. Ishimura GLIS 619 September 17, 2009 5
Large Scale Assessment 6 Y. Ishimura GLIS 619 September 17, 2009
Multiple-choice Tests (Overview) • Can compare IL skills across institutions/departments/individuals • Need time & money to develop reliable and valid instruments • Less time for marking • Good for testing students’ knowledge • Cannot assess higher-order skills • Content may be very generic Y. Ishimura GLIS 619 September 17, 2009 7
Multiple-choice Tests (Examples) Y. Ishimura GLIS 619 September 17, 2009 8
Multiple-choice Tests (Examples) • Developed by Kent State University • Used in 75 US + 7 CAN universities (Total: 42,304 students) • Uses ACRL’s IL standards • 40 multiple-choice questions - Needs: 37 items - Access: 73 items - Evaluation: 20 items - Intellectual honesty: 27 items • Multiple-choice format (Web or Paper) • $3 per student Y. Ishimura GLIS 619 September 17, 2009 8
Multiple-choice Tests (Examples) • Developed by Kent State University • Initiated by Prof. Mittermeyer • Used in 75 US + 7 CAN universities • Distributed to 1st year students in QC (Total: 42,304 students) (Total 3,003 students participated) • Uses ACRL’s IL standards • Uses ACRL IL standards • 40 multiple-choice questions • 20 multiple-choice questions - Needs: 37 items - Concept identification - Access: 73 items - Search strategy - Evaluation: 20 items - Document types - Intellectual honesty: 27 items - Search tools - Use of results • Multiple-choice format (Web or Paper) • $3 per student Y. Ishimura GLIS 619 September 17, 2009 8
Multiple-choice Tests (Sample Question-1) In order to become familiar with a subject about which I know very little, first I consult: ⃯ A journal ⃯ An encyclopedia ⃯ A database ⃯ A book ⃯ Other (please,specify): ⃯ Don’t know Y. Ishimura GLIS 619 September 17, 2009 9
Multiple-choice Tests (Sample Question-2) Which of the following search statements best utilizes nesting search operators for a communication research paper on speech anxiety CHECK ONLY ONE ANSWER. ⃯ Speech and talk and (anxiety or fear) ⃯ Speech or talk and (anxiety and fear) ⃯ Speech or talk and (anxiety or fear) ⃯ (Speech or talk) and anxiety or fear ⃯ (Speech or talk) and (anxiety or fear) Y. Ishimura GLIS 619 September 17, 2009 10
SAILS Results - Sample Report Figure 3.3 Chart for Skill Set: Developing a Research Strategy Goldfinch All Institutions Institution Type: Doctorate 1000 604 598 614 608 596 591 1 1 14 7 2 1 580 579 12 12 587 38 0 Engineering & Applied Business Education Science MAJOR Y. Ishimura GLIS 619 September 17, 2009 604 598 614 11 608 596 591 1
Multiple-choice Tests (Sample Findings) Undergraduate students demonstrated IL skills in some degree: • Demonstrated having knowledge of librarians for help • Strong understanding of AND, but not OR operator and nested search • Good at identifying search terms from research questions • Students’ recognition of limitations on search engines • Lack of knowledge in deciphering citations Y. Ishimura GLIS 619 September 17, 2009 12
Online Test (Example) Y. Ishimura GLIS 619 September 17, 2009 13
Online Test (Example) • IL skills + ICT literacy • Uses ACRL IL standards • Scenario-based assessment (No multiple-choice questions) • Web-based • $22-33 per test • Provides aggregated and individual data Y. Ishimura GLIS 619 September 17, 2009 13
Online Test (Example) • IL skills + ICT literacy • Confusing interface • Uses ACRL IL standards • Not related to disciplines • Scenario-based assessment • Too much focus on technology (No multiple-choice questions) content • Web-based • Can be a black box • $22-33 per test • Provides aggregated and individual data Y. Ishimura GLIS 619 September 17, 2009 13
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 14
Y. Ishimura GLIS 619 September 17, 2009 15
E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
Small Scale Assessment Y. Ishimura GLIS 619 September 17, 2009 17
Interviews & Focus Groups (Overview) • Evidence obtained through individual or group interviews • Involving small number of participants • Eliciting subjective experience in depth • Analysis takes time • Based on self-assessment of information literacy skills • Need training and inter-personal skills Y. Ishimura GLIS 619 September 17, 2009 18
Interviews & Focus Groups (Sample Responses) Y. Ishimura GLIS 619 September 17, 2009 19
Interviews & Focus Groups (Sample Responses) “I think Google is much easier to use than Novanet [online catalogue]. If I enter keywords by separating spaces, I can easily research results. On the other hand, I cannot reach the results on Novanet as I expect. So, I have trouble using it.” Y. Ishimura GLIS 619 September 17, 2009 19
Interviews & Focus Groups (Sample Responses) “I think Google is much easier to use than Novanet [online catalogue]. If I enter keywords by separating spaces, I can easily research results. On the other hand, I cannot reach the results on Novanet as I expect. So, I have trouble using it.” “For example, if I am studying the environment, one report discusses the amount of exhaust gas and says that the amount of gas does not affect the earth’s environment. But, if I carefully look at the report, the organisation receives financial support from oil companies. So, I look at the data very carefully. They do not present false information. But, I recognise that those kinds of reports focus on only one thing without considering other aspects of the situation. In terms of data, they only look at one row of data because it looks good even if the data are inferior to others.” Y. Ishimura GLIS 619 September 17, 2009 19
Interviews & Focus Groups (Sample Findings) • Students demonstrated IL skills to some degree: 1. Time pressure is a key factor to select paper topics 2. Google is a popular place for finding information among students 3. Tend to search for information that they want to find 4. Evaluation criteria for information is not sophisticated 5. Recognise importance of legal and ethical issues, but concept is difficult for students to fully understand • Librarians are not a part of students’ research process • Need more outreach to improve students’ IL skills Y. Ishimura GLIS 619 September 17, 2009 20
Portfolios (Overview) • Collecting pre-determined evidence during given time frame (e.g., topic selection, searching, evaluating, and using information) • Often record students’ reflection on the research process • Significant time commitment needed for students, faculty, & librarians • Often used in a credit-based IL courses or as a part of specific classes • Provide continuous feedback during the process • Can assess higher-order skills Y. Ishimura GLIS 619 September 17, 2009 21
Portfolios (Sample Process) Literature Topic reviews! selection! Identifying Search resources! strategies! Executing Databases search! selection! Y. Ishimura GLIS 619 September 17, 2009 22
Portfolios (Sample Process) Literature Topic reviews! selection! Identifying Search resources! strategies! Executing Databases search! selection! Y. Ishimura GLIS 619 September 17, 2009 22
Portfolios (Sample Process) Literature Topic reviews! selection! Identifying Search resources! Feedback strategies! Executing Databases search! selection! Y. Ishimura GLIS 619 September 17, 2009 22
Portfolios (Sample Findings) • Obtain holistic of students’ information literacy skills (e.g., Search strategies, resources used, synthesis of information) • Visible research process and progress (i.e., Students, librarians, and faculty) • Provide more meaningful and substantial feedback to students • Facilitate students’ understanding of research process Y. Ishimura GLIS 619 September 17, 2009 23
Observation & Screen Capture • One of three phases in research • HUGE amount of time for analysis • 86 hours of screen captures of • Provides an insight in information students behaviour seeking behaviour, but not significant findings • Observation of students’ activity during their search • Conversations with students during their search Y. Ishimura GLIS 619 September 17, 2009 24
Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection Classroom criteria! Faculty’s coopera! Setting! Programme -tion! Institution Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Affective Recruit- Domain! ment! Behavioural Cognitive Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
Domain/ Setting Classroom Programmatic Institutional Informal Surveys Classroom assessment Surveys Interviewing Affective techniques Focus groups Focus groups Surveys Portfolios Portfolios Portfolios Informal Performance Behavioral Performance Portfolios Portfolios Portfolios Informal Classroom assessment techniques Knowledge test Knowledge test Cognitive Knowledge test Portfolios Portfolios Concept maps Portfolios Y. Ishimura GLIS 619 September 17, 2009 26
For Your Future Reference Y. Ishimura GLIS 619 September 17, 2009 27
For Your Future Reference • Examine past findings “critically” (Past research will inform your path) Y. Ishimura GLIS 619 September 17, 2009 27
For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) Y. Ishimura GLIS 619 September 17, 2009 27
For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) Y. Ishimura GLIS 619 September 17, 2009 27
For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) • Know the limitations of different assessment approaches (You may have to give up some evidences) Y. Ishimura GLIS 619 September 17, 2009 27
For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) • Know the limitations of different assessment approaches (You may have to give up some evidences) • Use multiple data collection methodologies if applicable (You can triangulate your data) Y. Ishimura GLIS 619 September 17, 2009 27
For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) • Know the limitations of different assessment approaches (You may have to give up some evidences) • Use multiple data collection methodologies if applicable (You can triangulate your data) • Have passion for assessment (You will find cool things for future IL improvement for students) Y. Ishimura GLIS 619 September 17, 2009 27
Notes Slide 3 Donham Jean, Enhancing teaching and learning (New York: Neal-Schuman, 2005), 251 Slide 6 & 7 Tom Adam and Ilo-Katryn Maimets, “Information Literacy Evaluation: Fishing for answers with SAILS,” https:// www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf. Kent State University, Project SAILS (Standardized Assessment of Information Literacy Skills) homepage, https:// www.projectsails.org/index.php?page=home. Diane Mittermeyer and Diane Quirion, “Information Literacy: Study of Incoming First-Year Undergraduates in Quebec,” http:// www.crepuq.qc.ca/documents/bibl/formation/studies_Ang.pdf. Slide 8 Mittermeyer and Quirion, “Information Literacy.” Slide 9 Adam and Maimets, “Information literacy evaluation.” Slide 10 Kent State University, “Results of the Standardized Assessement of Informaiton Lieteracy Skills (SAILS) for Goldfinch University,” http://www.projectsails.org/pubs/SampleReport2007.pdf. Y. Ishimura GLIS 619 September 17, 2009 28
Notes Slide 12 Amit Asaravala, "Testing Your Tech Smarts." Wired News, April 8, 2005, http://www.wired.com/culture/lifestyle/news/ 2005/04/67156 (accessed April 4, 2009). Educational Testing Service, “iSkills,” http://www.ets.org/portal/site/ets/menuitem.1488512ecfd5b8849a77b13bc3921509/? vgnextoid=159f0e3c27a85110VgnVCM10000022f95190RCRD&vgnextchannel=e5b2a79898a85110VgnVCM 10000022f95190RCRD. Irvin R. Katz, “Testing Information Literacy in Digital Environments: ETS’s iSkills Assessment,” http://www.etsliteracy.org/Media/ Tests/ICT_Literacy/ppt/amla_plenary.ppt. Mary M. Somerville, Lynn D. Lampert, Katherine S. Dabbour, Sallie Harlan, and Barbara Schader. "Toward Large Scale Assessment of Information and Communication Technology Literacy: Implementation Considerations for the ETS ICT Literacy Instrument," Reference Services Review 35 (2007): 8-20. Slide 13 & 14 Katz, “Testing Information Literacy.” Slide 15 Educational Testing Service, “Individual Score Report,” http://www.ets.org/Media/Tests/ICT_Literacy/pdf/ iskills_individual_report.pdf. Slide 17 Yusuke Ishimura, Vivian Howard, and Haidar Moukdad. “Information Literacy in Academic Libraries: Assessment of Japanese Students' Needs for Successful Assignment Completion in Two Halifax Universities,” Canadian Journal of Information and Library Science 31 (2008):1-26. Nanchy H. Seamans. "Student Perceptions of Information Literacy: Insights for Librarians." Reference Services Review 30 (2002): 112-23. Y. Ishimura GLIS 619 September 17, 2009 29
Note Slide 18 Ishimura, Howard, and Moukdad, “Information Literacy in Academic Libraries,” 1-26. Slide 19 Ishimura, Howard, and Moukdad, “Information Literacy in Academic Libraries,” 1-26. Seamans, “Students Perceptions,” 112-23. Slide 20, 21, & 22 Jennifer Nutefall. "Paper Trail: One Method of Information Literacy Assessment." Research Strategies 20 (2004): 89-98. Loanne L. Snavely and Carol A. Wright. "Research Portfolio Use in Undergraduate Honors Education: Assessment Tool and Model for Future Work." Journal of Academic Librarianship 29 (2003): 298–303. Valerie Sonley, Denise Turner, Sue Myer, and Yvonne Cotton. "Information Literacy Assessment by Portfolio: A Case Study." Reference Services Review 35 (2007): 41-70. Slide 23 K. Dunn. "Assessing Information Literacy Skills in the California State University: A Progress Report." Journal of Academic Librarianship 28 (2002): 26-35. Slide 24 & 25 Carolyn J. Radcliff, Mary Lee Jensen, Joseph A. Salem Jr., Kenneth J. Burhanna, and Julie A. Gedeon. A Practical Guide to Information Literacy Assessment for Academic Librarians. (Westport, CT: Libraries Unlimited, 2007), 20-22. Y. Ishimura GLIS 619 September 17, 2009 30
Y. Ishimura GLIS 619 September 17, 2009 31
Questions? Y. Ishimura GLIS 619 September 17, 2009 31

Recommended

Information Literacy 101
Information Literacy 101Information Literacy 101
Information Literacy 101Yusuke Ishimura
 
What do you want to see? Assessing students’ skills
What do you want to see? Assessing students’ skillsWhat do you want to see? Assessing students’ skills
What do you want to see? Assessing students’ skillsYusuke Ishimura
 
Comparison of domestic & international students: What does their research pro...
Comparison of domestic & international students: What does their research pro...Comparison of domestic & international students: What does their research pro...
Comparison of domestic & international students: What does their research pro...Yusuke Ishimura
 
#42 green lantern framework
#42 green lantern framework#42 green lantern framework
#42 green lantern frameworkSrilu Balla
 
Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...
Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...
Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...UNDP Policy Centre
 
Lean & Green Project Management - PMI Conference
Lean & Green Project Management - PMI ConferenceLean & Green Project Management - PMI Conference
Lean & Green Project Management - PMI ConferenceNicos Kourounakis
 
How Does LIS Education Support Librarians’ Identity As Teachers?
How Does LIS Education Support Librarians’ Identity As Teachers?How Does LIS Education Support Librarians’ Identity As Teachers?
How Does LIS Education Support Librarians’ Identity As Teachers?Yusuke Ishimura
 
A framework for green: Applying the Environmental Management System cycle in ...
A framework for green: Applying the Environmental Management System cycle in ...A framework for green: Applying the Environmental Management System cycle in ...
A framework for green: Applying the Environmental Management System cycle in ...Yusuke Ishimura
 

Recommended

Information Literacy 101
Information Literacy 101Information Literacy 101
Information Literacy 101Yusuke Ishimura
 
What do you want to see? Assessing students’ skills
What do you want to see? Assessing students’ skillsWhat do you want to see? Assessing students’ skills
What do you want to see? Assessing students’ skillsYusuke Ishimura
 
Comparison of domestic & international students: What does their research pro...
Comparison of domestic & international students: What does their research pro...Comparison of domestic & international students: What does their research pro...
Comparison of domestic & international students: What does their research pro...Yusuke Ishimura
 
#42 green lantern framework
#42 green lantern framework#42 green lantern framework
#42 green lantern frameworkSrilu Balla
 
Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...
Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...
Policy Background Paper: A Viable Framework for a Green Economy in Caribbean ...UNDP Policy Centre
 
Lean & Green Project Management - PMI Conference
Lean & Green Project Management - PMI ConferenceLean & Green Project Management - PMI Conference
Lean & Green Project Management - PMI ConferenceNicos Kourounakis
 
How Does LIS Education Support Librarians’ Identity As Teachers?
How Does LIS Education Support Librarians’ Identity As Teachers?How Does LIS Education Support Librarians’ Identity As Teachers?
How Does LIS Education Support Librarians’ Identity As Teachers?Yusuke Ishimura
 
A framework for green: Applying the Environmental Management System cycle in ...
A framework for green: Applying the Environmental Management System cycle in ...A framework for green: Applying the Environmental Management System cycle in ...
A framework for green: Applying the Environmental Management System cycle in ...Yusuke Ishimura
 
Iiit b newsletter-may-09
Iiit b newsletter-may-09Iiit b newsletter-may-09
Iiit b newsletter-may-09bikram ...
 
Authentic assessment of medicos
Authentic assessment of medicosAuthentic assessment of medicos
Authentic assessment of medicosK Raman Sethuraman
 
Nd stem forum v master slideset final
Nd stem forum v master slideset finalNd stem forum v master slideset final
Nd stem forum v master slideset finalTom Loughran
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)HennaAnsari
 
Performance based Assessment
Performance based AssessmentPerformance based Assessment
Performance based AssessmentMachine shop ni Don Bosco
 
Ar3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportAr3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportShakarah Levy
 
Ar3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportAr3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportShakarah Levy
 
Curriculum transaction
Curriculum transactionCurriculum transaction
Curriculum transactionMichael J Leo
 
Putting Assessment in its Place
Putting Assessment in its PlacePutting Assessment in its Place
Putting Assessment in its PlaceDarcy Gervasio
 
ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)Dr. Mazin Mohamed alkathiri
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxabhijeetpadhi001
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxDr.Ibrahim Hassaan
 

More Related Content

Similar to Diagnosing students’ information literacy skills: Building on the past

Iiit b newsletter-may-09
Iiit b newsletter-may-09Iiit b newsletter-may-09
Iiit b newsletter-may-09bikram ...
 
Authentic assessment of medicos
Authentic assessment of medicosAuthentic assessment of medicos
Authentic assessment of medicosK Raman Sethuraman
 
Nd stem forum v master slideset final
Nd stem forum v master slideset finalNd stem forum v master slideset final
Nd stem forum v master slideset finalTom Loughran
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)HennaAnsari
 
Ar3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportAr3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportShakarah Levy
 
Ar3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportAr3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportShakarah Levy
 
Curriculum transaction
Curriculum transactionCurriculum transaction
Curriculum transactionMichael J Leo
 
Putting Assessment in its Place
Putting Assessment in its PlacePutting Assessment in its Place
Putting Assessment in its PlaceDarcy Gervasio
 

Similar to Diagnosing students’ information literacy skills: Building on the past (9)

Iiit b newsletter-may-09
Iiit b newsletter-may-09Iiit b newsletter-may-09
Iiit b newsletter-may-09
 
Authentic assessment of medicos
Authentic assessment of medicosAuthentic assessment of medicos
Authentic assessment of medicos
 
Nd stem forum v master slideset final
Nd stem forum v master slideset finalNd stem forum v master slideset final
Nd stem forum v master slideset final
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
 
Performance based Assessment
Performance based AssessmentPerformance based Assessment
Performance based Assessment
 
Ar3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportAr3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research Report
 
Ar3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research ReportAr3 X0 Final Research Paper G Compris Usability Research Report
Ar3 X0 Final Research Paper G Compris Usability Research Report
 
Curriculum transaction
Curriculum transactionCurriculum transaction
Curriculum transaction
 
Putting Assessment in its Place
Putting Assessment in its PlacePutting Assessment in its Place
Putting Assessment in its Place
 

Recently uploaded

What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxabhijeetpadhi001
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxDr.Ibrahim Hassaan
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfUjwalaBharambe
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxEyham Joco
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 

Recently uploaded (20)

ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media Component
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptx
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptx
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptx
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 

Diagnosing students’ information literacy skills: Building on the past

  • 1. Diagnosing students’ information literacy skills: Building on the past Ph.D. Candidate Yusuke Ishimura September 17, 2009 1
  • 2. Please note: All references used in this presentation are listed at the end of the slides (pp. 28-29) Y. Ishimura GLIS 619 September 17, 2009 2
  • 3. Objectives • Become familiar with existing various information literacy (IL) assessment approaches • Understand types of evidence obtained from different assessment methods • Understand strengths & weaknesses of each assessment approach • Provide links to future assessment 3 Y. Ishimura GLIS 619 September 17, 2009
  • 4. 4 Y. Ishimura GLIS 619 September 17, 2009
  • 5. Informs student Informs teacher Formative Summative 4 Y. Ishimura GLIS 619 September 17, 2009
  • 6. Improve Improve performance Informs student Informs teacher instruction Promoting Making Formative student instructional growth decisions Summative Evaluating Evaluating student programs achievement Recognize Modify accomplishment program 4 Y. Ishimura GLIS 619 September 17, 2009
  • 7. Before Starting . . . Y. Ishimura GLIS 619 September 17, 2009 5
  • 8. Large Scale Assessment 6 Y. Ishimura GLIS 619 September 17, 2009
  • 9. Multiple-choice Tests (Overview) • Can compare IL skills across institutions/departments/individuals • Need time & money to develop reliable and valid instruments • Less time for marking • Good for testing students’ knowledge • Cannot assess higher-order skills • Content may be very generic Y. Ishimura GLIS 619 September 17, 2009 7
  • 10. Multiple-choice Tests (Examples) Y. Ishimura GLIS 619 September 17, 2009 8
  • 11. Multiple-choice Tests (Examples) • Developed by Kent State University • Used in 75 US + 7 CAN universities (Total: 42,304 students) • Uses ACRL’s IL standards • 40 multiple-choice questions - Needs: 37 items - Access: 73 items - Evaluation: 20 items - Intellectual honesty: 27 items • Multiple-choice format (Web or Paper) • $3 per student Y. Ishimura GLIS 619 September 17, 2009 8
  • 12. Multiple-choice Tests (Examples) • Developed by Kent State University • Initiated by Prof. Mittermeyer • Used in 75 US + 7 CAN universities • Distributed to 1st year students in QC (Total: 42,304 students) (Total 3,003 students participated) • Uses ACRL’s IL standards • Uses ACRL IL standards • 40 multiple-choice questions • 20 multiple-choice questions - Needs: 37 items - Concept identification - Access: 73 items - Search strategy - Evaluation: 20 items - Document types - Intellectual honesty: 27 items - Search tools - Use of results • Multiple-choice format (Web or Paper) • $3 per student Y. Ishimura GLIS 619 September 17, 2009 8
  • 13. Multiple-choice Tests (Sample Question-1) In order to become familiar with a subject about which I know very little, first I consult: ⃯ A journal ⃯ An encyclopedia ⃯ A database ⃯ A book ⃯ Other (please,specify): ⃯ Don’t know Y. Ishimura GLIS 619 September 17, 2009 9
  • 14. Multiple-choice Tests (Sample Question-2) Which of the following search statements best utilizes nesting search operators for a communication research paper on speech anxiety CHECK ONLY ONE ANSWER. ⃯ Speech and talk and (anxiety or fear) ⃯ Speech or talk and (anxiety and fear) ⃯ Speech or talk and (anxiety or fear) ⃯ (Speech or talk) and anxiety or fear ⃯ (Speech or talk) and (anxiety or fear) Y. Ishimura GLIS 619 September 17, 2009 10
  • 15. SAILS Results - Sample Report Figure 3.3 Chart for Skill Set: Developing a Research Strategy Goldfinch All Institutions Institution Type: Doctorate 1000 604 598 614 608 596 591 1 1 14 7 2 1 580 579 12 12 587 38 0 Engineering & Applied Business Education Science MAJOR Y. Ishimura GLIS 619 September 17, 2009 604 598 614 11 608 596 591 1
  • 16. Multiple-choice Tests (Sample Findings) Undergraduate students demonstrated IL skills in some degree: • Demonstrated having knowledge of librarians for help • Strong understanding of AND, but not OR operator and nested search • Good at identifying search terms from research questions • Students’ recognition of limitations on search engines • Lack of knowledge in deciphering citations Y. Ishimura GLIS 619 September 17, 2009 12
  • 17. Online Test (Example) Y. Ishimura GLIS 619 September 17, 2009 13
  • 18. Online Test (Example) • IL skills + ICT literacy • Uses ACRL IL standards • Scenario-based assessment (No multiple-choice questions) • Web-based • $22-33 per test • Provides aggregated and individual data Y. Ishimura GLIS 619 September 17, 2009 13
  • 19. Online Test (Example) • IL skills + ICT literacy • Confusing interface • Uses ACRL IL standards • Not related to disciplines • Scenario-based assessment • Too much focus on technology (No multiple-choice questions) content • Web-based • Can be a black box • $22-33 per test • Provides aggregated and individual data Y. Ishimura GLIS 619 September 17, 2009 13
  • 20. Y. Ishimura GLIS 619 September 17, 2009 14
  • 21. Y. Ishimura GLIS 619 September 17, 2009 14
  • 22. Y. Ishimura GLIS 619 September 17, 2009 14
  • 23. Y. Ishimura GLIS 619 September 17, 2009 14
  • 24. Y. Ishimura GLIS 619 September 17, 2009 14
  • 25. Y. Ishimura GLIS 619 September 17, 2009 14
  • 26. Y. Ishimura GLIS 619 September 17, 2009 14
  • 27. Y. Ishimura GLIS 619 September 17, 2009 14
  • 28. Y. Ishimura GLIS 619 September 17, 2009 14
  • 29. Y. Ishimura GLIS 619 September 17, 2009 15
  • 30. E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
  • 31. E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
  • 32. E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
  • 33. E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
  • 34. E Your Score: 600 Percentile: 75 L Your Score Your Percentile P 700 99th Scores can range from 400 to 700. The midpoint of the scale M (550) represents the average performance of all early 2006 test takers. 75 A E The bracket represents the range of scores you might expect to 600 receive if you take this test again. S L The percentile shows how you did compared with all the people who took the test early in 2006. For example, if you received a score in the 60th percentile, you did better than 60 percent of all P test takers. 400 0 M Performance Feedback The iSkillsTM assessment measures seven different skill areas of information and communication technology literacy. The feedback below describes your performance on the tasks you saw, organized by these skill areas. This feedback is for your information only and is not A predictive of future performance. S 100 — 90 — 83 80 — 80 79 80 74 Percent Correct 70 — 70 62 66 60 — 60 60 61 55 50 — 46 40 — 46 43 40 42 40 39 30 — 30 22 20 — 10 — 0— DEFINE ACCESS EVALUATE MANAGE INTEGRATE CREATE COMMUNICATE iSKILLS Areas Y. Ishimura GLIS 619 September 17, 2009 16
  • 35. Small Scale Assessment Y. Ishimura GLIS 619 September 17, 2009 17
  • 36. Interviews & Focus Groups (Overview) • Evidence obtained through individual or group interviews • Involving small number of participants • Eliciting subjective experience in depth • Analysis takes time • Based on self-assessment of information literacy skills • Need training and inter-personal skills Y. Ishimura GLIS 619 September 17, 2009 18
  • 37. Interviews & Focus Groups (Sample Responses) Y. Ishimura GLIS 619 September 17, 2009 19
  • 38. Interviews & Focus Groups (Sample Responses) “I think Google is much easier to use than Novanet [online catalogue]. If I enter keywords by separating spaces, I can easily research results. On the other hand, I cannot reach the results on Novanet as I expect. So, I have trouble using it.” Y. Ishimura GLIS 619 September 17, 2009 19
  • 39. Interviews & Focus Groups (Sample Responses) “I think Google is much easier to use than Novanet [online catalogue]. If I enter keywords by separating spaces, I can easily research results. On the other hand, I cannot reach the results on Novanet as I expect. So, I have trouble using it.” “For example, if I am studying the environment, one report discusses the amount of exhaust gas and says that the amount of gas does not affect the earth’s environment. But, if I carefully look at the report, the organisation receives financial support from oil companies. So, I look at the data very carefully. They do not present false information. But, I recognise that those kinds of reports focus on only one thing without considering other aspects of the situation. In terms of data, they only look at one row of data because it looks good even if the data are inferior to others.” Y. Ishimura GLIS 619 September 17, 2009 19
  • 40. Interviews & Focus Groups (Sample Findings) • Students demonstrated IL skills to some degree: 1. Time pressure is a key factor to select paper topics 2. Google is a popular place for finding information among students 3. Tend to search for information that they want to find 4. Evaluation criteria for information is not sophisticated 5. Recognise importance of legal and ethical issues, but concept is difficult for students to fully understand • Librarians are not a part of students’ research process • Need more outreach to improve students’ IL skills Y. Ishimura GLIS 619 September 17, 2009 20
  • 41. Portfolios (Overview) • Collecting pre-determined evidence during given time frame (e.g., topic selection, searching, evaluating, and using information) • Often record students’ reflection on the research process • Significant time commitment needed for students, faculty, & librarians • Often used in a credit-based IL courses or as a part of specific classes • Provide continuous feedback during the process • Can assess higher-order skills Y. Ishimura GLIS 619 September 17, 2009 21
  • 42. Portfolios (Sample Process) Literature Topic reviews! selection! Identifying Search resources! strategies! Executing Databases search! selection! Y. Ishimura GLIS 619 September 17, 2009 22
  • 43. Portfolios (Sample Process) Literature Topic reviews! selection! Identifying Search resources! strategies! Executing Databases search! selection! Y. Ishimura GLIS 619 September 17, 2009 22
  • 44. Portfolios (Sample Process) Literature Topic reviews! selection! Identifying Search resources! Feedback strategies! Executing Databases search! selection! Y. Ishimura GLIS 619 September 17, 2009 22
  • 45. Portfolios (Sample Findings) • Obtain holistic of students’ information literacy skills (e.g., Search strategies, resources used, synthesis of information) • Visible research process and progress (i.e., Students, librarians, and faculty) • Provide more meaningful and substantial feedback to students • Facilitate students’ understanding of research process Y. Ishimura GLIS 619 September 17, 2009 23
  • 46. Observation & Screen Capture • One of three phases in research • HUGE amount of time for analysis • 86 hours of screen captures of • Provides an insight in information students behaviour seeking behaviour, but not significant findings • Observation of students’ activity during their search • Conversations with students during their search Y. Ishimura GLIS 619 September 17, 2009 24
  • 47. Y. Ishimura GLIS 619 September 17, 2009 25
  • 48. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 49. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 50. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 51. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 52. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 53. Time! Outside know- Cost! ledge! Selection Classroom criteria! Faculty’s coopera! Setting! Programme -tion! Institution Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 54. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 55. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Affective Recruit- Domain! ment! Behavioural Cognitive Y. Ishimura GLIS 619 September 17, 2009 25
  • 56. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 57. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 58. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 59. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 60. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 61. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 62. Time! Outside know- Cost! ledge! Selection criteria! Faculty’s coopera! Setting! -tion! Recruit- Domain! ment! Y. Ishimura GLIS 619 September 17, 2009 25
  • 63. Domain/ Setting Classroom Programmatic Institutional Informal Surveys Classroom assessment Surveys Interviewing Affective techniques Focus groups Focus groups Surveys Portfolios Portfolios Portfolios Informal Performance Behavioral Performance Portfolios Portfolios Portfolios Informal Classroom assessment techniques Knowledge test Knowledge test Cognitive Knowledge test Portfolios Portfolios Concept maps Portfolios Y. Ishimura GLIS 619 September 17, 2009 26
  • 64. For Your Future Reference Y. Ishimura GLIS 619 September 17, 2009 27
  • 65. For Your Future Reference • Examine past findings “critically” (Past research will inform your path) Y. Ishimura GLIS 619 September 17, 2009 27
  • 66. For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) Y. Ishimura GLIS 619 September 17, 2009 27
  • 67. For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) Y. Ishimura GLIS 619 September 17, 2009 27
  • 68. For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) • Know the limitations of different assessment approaches (You may have to give up some evidences) Y. Ishimura GLIS 619 September 17, 2009 27
  • 69. For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) • Know the limitations of different assessment approaches (You may have to give up some evidences) • Use multiple data collection methodologies if applicable (You can triangulate your data) Y. Ishimura GLIS 619 September 17, 2009 27
  • 70. For Your Future Reference • Examine past findings “critically” (Past research will inform your path) • Decide what you want to assess (You need purposes & goals for assessment) • Remember you cannot assess everything (Think small) • Know the limitations of different assessment approaches (You may have to give up some evidences) • Use multiple data collection methodologies if applicable (You can triangulate your data) • Have passion for assessment (You will find cool things for future IL improvement for students) Y. Ishimura GLIS 619 September 17, 2009 27
  • 71. Notes Slide 3 Donham Jean, Enhancing teaching and learning (New York: Neal-Schuman, 2005), 251 Slide 6 & 7 Tom Adam and Ilo-Katryn Maimets, “Information Literacy Evaluation: Fishing for answers with SAILS,” https:// www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf. Kent State University, Project SAILS (Standardized Assessment of Information Literacy Skills) homepage, https:// www.projectsails.org/index.php?page=home. Diane Mittermeyer and Diane Quirion, “Information Literacy: Study of Incoming First-Year Undergraduates in Quebec,” http:// www.crepuq.qc.ca/documents/bibl/formation/studies_Ang.pdf. Slide 8 Mittermeyer and Quirion, “Information Literacy.” Slide 9 Adam and Maimets, “Information literacy evaluation.” Slide 10 Kent State University, “Results of the Standardized Assessement of Informaiton Lieteracy Skills (SAILS) for Goldfinch University,” http://www.projectsails.org/pubs/SampleReport2007.pdf. Y. Ishimura GLIS 619 September 17, 2009 28
  • 72. Notes Slide 12 Amit Asaravala, "Testing Your Tech Smarts." Wired News, April 8, 2005, http://www.wired.com/culture/lifestyle/news/ 2005/04/67156 (accessed April 4, 2009). Educational Testing Service, “iSkills,” http://www.ets.org/portal/site/ets/menuitem.1488512ecfd5b8849a77b13bc3921509/? vgnextoid=159f0e3c27a85110VgnVCM10000022f95190RCRD&vgnextchannel=e5b2a79898a85110VgnVCM 10000022f95190RCRD. Irvin R. Katz, “Testing Information Literacy in Digital Environments: ETS’s iSkills Assessment,” http://www.etsliteracy.org/Media/ Tests/ICT_Literacy/ppt/amla_plenary.ppt. Mary M. Somerville, Lynn D. Lampert, Katherine S. Dabbour, Sallie Harlan, and Barbara Schader. "Toward Large Scale Assessment of Information and Communication Technology Literacy: Implementation Considerations for the ETS ICT Literacy Instrument," Reference Services Review 35 (2007): 8-20. Slide 13 & 14 Katz, “Testing Information Literacy.” Slide 15 Educational Testing Service, “Individual Score Report,” http://www.ets.org/Media/Tests/ICT_Literacy/pdf/ iskills_individual_report.pdf. Slide 17 Yusuke Ishimura, Vivian Howard, and Haidar Moukdad. “Information Literacy in Academic Libraries: Assessment of Japanese Students' Needs for Successful Assignment Completion in Two Halifax Universities,” Canadian Journal of Information and Library Science 31 (2008):1-26. Nanchy H. Seamans. "Student Perceptions of Information Literacy: Insights for Librarians." Reference Services Review 30 (2002): 112-23. Y. Ishimura GLIS 619 September 17, 2009 29
  • 73. Note Slide 18 Ishimura, Howard, and Moukdad, “Information Literacy in Academic Libraries,” 1-26. Slide 19 Ishimura, Howard, and Moukdad, “Information Literacy in Academic Libraries,” 1-26. Seamans, “Students Perceptions,” 112-23. Slide 20, 21, & 22 Jennifer Nutefall. "Paper Trail: One Method of Information Literacy Assessment." Research Strategies 20 (2004): 89-98. Loanne L. Snavely and Carol A. Wright. "Research Portfolio Use in Undergraduate Honors Education: Assessment Tool and Model for Future Work." Journal of Academic Librarianship 29 (2003): 298–303. Valerie Sonley, Denise Turner, Sue Myer, and Yvonne Cotton. "Information Literacy Assessment by Portfolio: A Case Study." Reference Services Review 35 (2007): 41-70. Slide 23 K. Dunn. "Assessing Information Literacy Skills in the California State University: A Progress Report." Journal of Academic Librarianship 28 (2002): 26-35. Slide 24 & 25 Carolyn J. Radcliff, Mary Lee Jensen, Joseph A. Salem Jr., Kenneth J. Burhanna, and Julie A. Gedeon. A Practical Guide to Information Literacy Assessment for Academic Librarians. (Westport, CT: Libraries Unlimited, 2007), 20-22. Y. Ishimura GLIS 619 September 17, 2009 30
  • 74. Y. Ishimura GLIS 619 September 17, 2009 31
  • 75. Questions? Y. Ishimura GLIS 619 September 17, 2009 31

Editor's Notes

  1. If large scale.
  2. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  3. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  4. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  5. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  6. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  7. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  8. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  9. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  10. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  11. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  12. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  13. UBC, Alberta, Brandon, Manitoba, Western, York, New Brunswick https://www.projectsails.org/files/Presentation.pdf https://www.projectsails.org/pubs/SAILSatWILU_May7_2006.pdf https://www.projectsails.org/files/sample_report_2009.pdf
  14. Here’s results. For example, students majoring business performed lower than other universities. (mean, different from other insitutions) Don’t tell why.
  15. Technical literacy: wordprocessing, emailing, using web IL: Evaluate, organise, presenting, information How students perform Includes 14 short (3-5 minute) tasks and 1 longer (15 minute) task
  16. Technical literacy: wordprocessing, emailing, using web IL: Evaluate, organise, presenting, information How students perform Includes 14 short (3-5 minute) tasks and 1 longer (15 minute) task
  17. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  18. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  19. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  20. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  21. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  22. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  23. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  24. Define: Formulate a research statement to facilitate the search for information Access: Find and retrieve information from a variety of sources Evaluate: Judge the usefulness and sufficiency of information for a specific purpose Manage: Organize information so as to find it later Integrate: Summarize or otherwise synthesize information from a variety of sources Create: Generate or adapt information to meet a need, expressing a main point and supporting information Communicate: Adapt information for a particular audience
  25. Everything is not applicable, but generally speaking... Time committment --> credit-based course
  26. Here’s example. This is a sample process of a credit IL course. Making record: 4.2 (can look back what they did and revise their process & performace)
  27. Here’s example. This is a sample process of a credit IL course. Making record: 4.2 (can look back what they did and revise their process & performace)
  28. Here’s example. This is a sample process of a credit IL course. Making record: 4.2 (can look back what they did and revise their process & performace)
  29. Think aloud can be used as well
  30. Affective: Feeling, perceptions Behavioral: what students can do, have learned Cognitive: What students know
  31. Slide 12: (e.g., Asaravala, 2005; Educational Testing Services [ETS], 2009; Katz, 2007; Somerville, Smith, & Macklin, 2007) Slide 13 & 14: Katz, I. R. (2007).Testing information literacy in digital environments: ETS’s iSkills assessment. Retrieved September 12, 2009, from http://www.ets.org/Media/Tests/ICT_Literacy/ppt/amla_plenary.ppt. (Slide ) Slide 17, 19: (e.g., Ishimura, Howard, Moukdad, 2007; Seamans, 2002) Slide 18: Ishimura, Howard, Moukdad, 2007 Slide 20, 21,22 (e.g., Nutefall, 2004; Snavely & Wright, 2003; Sonley, Turner, Myer, & Cotton, 2007) Slide 23 (e.g., Nutefall, 2004; Snavely & Wright, 2003; Sonley, Turner, Myer, & Cotton, 2007) Slide 24 (e.g., Nutefall, 2004; Snavely & Wright, 2003; Sonley, Turner, Myer, & Cotton, 2007) Slide 25: Radcliff, C. J., Jensen, M. L., Salem Jr., J. A., Burhanna, K. J., & Gedeon, J. A. (2007). A practical guide to information literacy assessment for academic librarians. Westport, CT: Libraries Unlimited. (Page 20)
  32. Slide 17, 19: (e.g., Ishimura, Howard, Moukdad, 2007; Seamans, 2002) Slide 18: Ishimura, Howard, Moukdad, 2007 Slide 20, 21,22 (e.g., Nutefall, 2004; Snavely & Wright, 2003; Sonley, Turner, Myer, & Cotton, 2007) Slide 23 (e.g., Nutefall, 2004; Snavely & Wright, 2003; Sonley, Turner, Myer, & Cotton, 2007) Slide 24 (e.g., Nutefall, 2004; Snavely & Wright, 2003; Sonley, Turner, Myer, & Cotton, 2007) Slide 25: Radcliff, C. J., Jensen, M. L., Salem Jr., J. A., Burhanna, K. J., & Gedeon, J. A. (2007). A practical guide to information literacy assessment for academic librarians. Westport, CT: Libraries Unlimited. (Page 20)