Trails2010 OELMA


Published on

Information literacy assessment introduction. TRAILS - Tool for Real-time Assessment of Information Literacy

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Funding for TRAILS was initially provided through ilile and IMLS. Grade 3 and 12 test development was provided through both a Jennings Foundation Grant and Library Services Technology Act Grant.
  • Outcomes for this session include
  • Partnership for 21 st Century Skills information literacy definition
  • Funded by LSTA and Jennings foundation TRAILS was developed specifically as a tool to be used for assessing information literacy competencies of students, originally at the high school level, and assessments addressing the 6 th grade Ohio Standards were added in January of this year. The tool is based on standards (Ohio first and Informatin Power, now includes AASL Standards for 21 st Century Learning), it’s available on the web at no cost to users, easy and quick to administer and get results, insure privacy of student test-takers b/c we don’t collect any identifying information, results reported by class and by student.
  • Grouped standards into 5 broader categories this was done by asking content experts to sort standards into groups; looked at agreement among experts after objectives were written and items were drafted, categories were reexamined this was an iterative process
  • Before getting to the business of writing items, competencies were prioritized Then objectives were developed to match the competencies Finally, items were drafted and reviewed and rewritten to address each of the objectives After a number of internal reviews and revisions, items are field tested by students in the target population T-9 field testing was done by a small number of LMS in Ohio (this was when we were first starting out and we really had to call in favors to get assistance) We have had people all over the country contact us about being involved in field testing for T-6! (Much has changed since the project began.)
  • The two tests are parallel – pre-post test
  • Those of you who have been using TRAILS know about the various assessments available. We started out with 2 general assessments, which were considerably revised before the 2006 school year. Shorter category assessments were added before 2006-07 school year TRAILS began as a 9 th grade tool, but was expanded in 2008 to address the 6 th grade level. For T-6 we put together 2 general assessments; live in January so we don’t have a lot of information about their use yet
  • This is the homepage for the TRAILS site. Note the address is trails-9 – but we have tests for grades 6 & 9. Coming soon we will have tests for 3, 6, and 9.
  • The registration form collects very little personal information. After registering, you must go to your email account and authenticate from a link sent in your email. If you do not get an authentication email, use the Contact Us form to alert the TRAILS team. They will assist you.
  • This is what the view assessment screen looks like --
  • It is suggested that your review the various tests before creating a session. Also decide if you are going to collect data for one class or for the entire school. If you are collecting the data for the whole school and want to analyze the school, then you will need to generate a large number of students. If you are going to create separate sessions for each class you will need to have a naming configuration to help keep the grades/years/etc. straight. The TRAILS tests are not discarded. This is so that benchmarks can be established.
  • Note that the student codes have several options including copying from a closed session. Many use this feature to do pre and post testing. Assign a student a code – have that student use the same code for both the pre and post test – then it is easy to correlate the test results by student.
  • Before administering the TRAILS assessment, you can review the assessment. After students have completed the assessment and you have closed the session, the students can review the session with you or independently. To review the session with students, have them go to and sign in using their original student codes. Students will see the assessment items in the same order as you see them below. Their original responses will show in their individual views, and the correct responses will show in red. NOTE: The session status must be set to "CLOSED" for this to function for the students.
  • Student codes can be downloaded as a csv file and then manipulated in an Excel spreadsheet.
  • CSV file exports and automatically converts to Excel. You can add student names next to the codes. This allows you to keep track of how each student did on the assessment.
  • This is what the student code sheet looks like. You can write in the student name. Cut the student codes apart. Then each student will have their own unique test. You can post the session url on your website so that students can just click the url to begin their assessment. TRAILS Administration DETAILS Session Name: Sample Session URL: To administer a session to your students, give them the Session URL shown in the upper right-hand corner. Students will enter that URL in their browser to access their TRAILS session. If you have requested individual student codes for your students to track their personal performance, you will need to assign each student one of the unique codes that will appear below. You will need to keep a record of what students were given what codes, as TRAILS does not keep track of this information. When connected to TRAILS, a student will enter his/her individual code. If trouble occurs due to network failure, Internet traffic, or any other problem that might prevent a student from completing the assessment, the session can be restarted using the same process and student code. All of the student's previous responses will be present and the student can resume the assessment from the point he or she last attempted to respond. [TIP for using student codes: Print this page. Write student names on the lines provided, and then photocopy the pages. Keep the original for reference and cut apart the copy to hand out to students].
  • This is a class report.
  • This is a student report – shows individual student scores.
  • When you download the CSV file it will look like this. You can sort the CSV file with the student names – and the CSV file with the data. Then copy the names into the file with the data.
  • Once you have the data in an excel spread sheet you can create graphs to demonstrate how the student are doing as a whole or how one individual student is standing up to the rest of his or her classmates. In this sample the graph is demonstrating the particular class compared to the Ohio 9 th grade benchmarks and the US benchmarks. There are benchmarks for 9 th grade only since to create benchmarks you need data over a lengthy period of time. It is the goal to have benchmarks for each grade in the future. That will be several years from now.
  • This is what students see when they use a student response system.
  • This rubric was created by Trumbull County Career Center. The focus is on evaulation of websites. It was developed after teachers reviewed the results of the TRAILS test which demonstrated that the students were having trouble evaluating information sources.
  • Benchmark data is available for 9 th grade. 6 th grade benchmarks will be posted one we have enough TRAILS 6 users to establish a benchmark for sixth grade.
  • Funding for TRAILS was initially provided through ilile and IMLS. Grade 3 and 12 test development was provided through both a Jennings Foundation Grant and Library Services Technology Act Grant.
  • Trails2010 OELMA

    1. 1. Jennifer Schwelik, MEd, WVIZ/PBS ideastream® TRAILS Project Manager Cool New (Free) Tools to Assess Information Literacy OELMA Conference October, 2010
    2. 2. <ul><li>What is Information Literacy </li></ul><ul><li>What is TRAILS </li></ul><ul><li>Getting Started with TRAILS </li></ul>Providing an Introduction
    3. 3. <ul><li>Access and Evaluate Information </li></ul><ul><li>Access information efficiently (time) and effectively (sources) </li></ul><ul><li>Evaluate information critically and competently </li></ul><ul><li>Partnership for 21 st Century Skills </li></ul>Information Literacy 21 st Century Skill       Information Literacy       Information Literacy
    4. 4. <ul><li>Use information accurately and creatively for the issue or problem at hand </li></ul><ul><ul><li>Manage the flow of information from a wide </li></ul></ul><ul><ul><li>variety of sources </li></ul></ul><ul><ul><li>Apply a fundamental understanding of the </li></ul></ul><ul><ul><li>ethical/legal issues surrounding the access </li></ul></ul><ul><ul><li>and use of information </li></ul></ul><ul><li>Partnership for 21st Century Skills </li></ul>Information Literacy 21st Century Skill
    5. 5. <ul><li>TRAILS is: </li></ul><ul><li>Tool to measure information literacy competencies </li></ul><ul><li>Assessments based on 3 rd , 6 th and 9 th and 12 th grade standards available </li></ul><ul><li>Freely available on the Web </li></ul>What is TRAILS?
    6. 6. <ul><li>Standards categorized into five measurable information literacy categories: </li></ul>Information Literacy Categories <ul><ul><li>Develop topic </li></ul></ul><ul><ul><li>Identify potential sources </li></ul></ul><ul><ul><li>Develop, use, and revise search strategies </li></ul></ul><ul><ul><li>Evaluate sources and information </li></ul></ul><ul><ul><li>Recognize how to use information responsibly, ethically, and legally </li></ul></ul>
    7. 7. <ul><ul><li>Developed by library media specialists </li></ul></ul><ul><ul><li>Field tested in classrooms with students </li></ul></ul><ul><ul><ul><ul><li>Are the items understandable ? </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Are the items measuring what was intended? </li></ul></ul></ul></ul>Test Items
    8. 8. <ul><li>TRAILS-3: </li></ul><ul><li>Two 15-item general assessments covering all five of the information literacy categories. </li></ul><ul><li>One set of 10-item assessments for each of the five categories. </li></ul><ul><li>TRAILS-6: </li></ul><ul><li>Two 20-item general assessments covering all five of the information literacy categories. </li></ul><ul><li>One set of 10-item assessments for each of the five categories. </li></ul>Available Assessments
    9. 9. <ul><li>TRAILS-9: </li></ul><ul><li>Two 25-item general assessments covering all five of the information literacy categories. </li></ul><ul><li>One set of 10-item assessments for each of the five categories. </li></ul><ul><li>TRAILS-12: </li></ul><ul><li>Two 30-item general assessments covering all five of the information literacy categories. </li></ul><ul><li>One set of 10-item assessments for each of the five categories. </li></ul>Available Assessments
    10. 10. <ul><li>Create an Account </li></ul><ul><li>Create a Session </li></ul><ul><li>View Assessment </li></ul><ul><li>Manage a Session </li></ul>Getting Started
    11. 11. Create an Account
    12. 12. Create an Account NOTE: To activate account, you must respond to the confirmation e-mail.
    13. 13. View Assessment <ul><li>Each item includes </li></ul><ul><li>AASL Standard </li></ul><ul><li>OAC Standard </li></ul><ul><li>21 st Cent.Learner Standard </li></ul><ul><li>TRAILS Objective </li></ul>Red text is the correct answer.
    14. 14. Create a Session
    15. 15. Create a Session
    16. 16. Review Session
    17. 17. Manage a Session
    18. 22. CSV File Sample
    19. 24. How TRAILS has been used to integrate information literacy <ul><li>Collaboration with classroom teachers for a specific class </li></ul><ul><li>With a particular grade level </li></ul><ul><li>To target librarian instruction </li></ul><ul><li>To share results with administration </li></ul><ul><li>As part of an overall school improvement plan </li></ul><ul><li>As a professional development opportunity </li></ul><ul><li>For personal development </li></ul><ul><li>With response system as instructional tool </li></ul>
    20. 25. Response System
    21. 26. Response System
    22. 27. Response System Data
    23. 28. How TRAILS has been used to integrate information literacy
    24. 29. Users Report “I am an Illinois high school media specialist and have been using TRAILS with my ninth grade students. Thank you for your work. TRAILS provides an objective evaluation of information skills that would otherwise be difficult to achieve by sole practitioners.” [Illinois] “I have been using a couple of the #2 assessments with Seniors taking a Research Paper class. They have been extremely helpful to reinforce specific information literacy skills for which they have received instruction.” [Minnesota] “We are using Trails 9 to gather baseline assessments .  I'm setting up logins by grade level but we are not tracking each student by name.  Our goal is to find out where our students currently stand with competencies.” [New York]
    25. 30. Bench-mark Data TRIALS9
    26. 31. TRAILS: Tool for Real-Time Assessment of Information Literacy
    27. 32. Presentor Jennifer Schwelik, MEd, WVIZ/PBS ideastream® TRAILS Project Manager [email_address]