Footholds and Foundations Setting Freshmen on the Path to Lifelong Learning Gayla Byerly, Annie Downey, & Frank Gosnell LO...
Basic Background Facts <ul><li>University of North Texas  </li></ul><ul><li>Core curriculum = lists of electives </li></ul...
ACRL Standards <ul><li>Library instruction sessions teach ACRL Information Literacy Competency Standards for Higher Educat...
Success? <ul><li>English Library Instruction Sessions </li></ul><ul><ul><li>Average about 80 sessions per academic year </...
Assessment Options <ul><li>Paper surveys </li></ul><ul><li>Online surveys </li></ul><ul><ul><li>Problem: </li></ul></ul><u...
Software Development <ul><li>General Requirements </li></ul><ul><ul><li>Provide assessment on each student PC </li></ul></...
Software Development <ul><li>Requirement </li></ul><ul><li>Provide assessment on each student PC </li></ul><ul><li>Solutio...
Software Development <ul><li>Requirement </li></ul><ul><li>Collect anonymous, individual results </li></ul><ul><li>Solutio...
Software Development <ul><li>Requirement </li></ul><ul><li>Collect browser activity for each PC only during actual testing...
Software Development <ul><li>Requirement </li></ul><ul><li>Start assessment simultaneously for all students from teacher P...
Assessment Tool <ul><li>Development of Assessment Tool </li></ul><ul><ul><li>Worked with Frank Gosnell to develop software...
Assessment Instrument <ul><li>Step 1 :  </li></ul><ul><li>How likely  </li></ul><ul><li>are you to  </li></ul><ul><li>ask ...
Assessment Instrument <ul><li>Step 2 :  </li></ul><ul><li>From the </li></ul><ul><li>UNT Libraries’ </li></ul><ul><li>home...
Assessment Instrument <ul><li>Step 3 :  </li></ul><ul><li>Perform a  </li></ul><ul><li>subject  </li></ul><ul><li>search f...
Assessment Instrument <ul><li>Step 4 :  </li></ul><ul><li>Perform a  </li></ul><ul><li>search in </li></ul><ul><li>Academi...
Basic Background Facts <ul><li>UNT Library Instruction  </li></ul><ul><ul><li>900 English 1320 students attended a library...
Basic Background Facts <ul><li>UNT Library Instruction Assessment  </li></ul><ul><li>48 English 1320 classes completed the...
Library Anxiety – Pre-test <ul><li>How likely  </li></ul><ul><li>are </li></ul><ul><li>students  </li></ul><ul><li>to ask ...
Library Anxiety – Post-test <ul><li>How likely  </li></ul><ul><li>are </li></ul><ul><li>students  </li></ul><ul><li>to ask...
Library Anxiety – Comparison Positive  Results Up 14.71% Neutral  Results Down 11.68% Negative Results Down 2.2% 2.47% 7.2...
Results – Pre-test <ul><li>What do students know in terms of basic library technology skills when they first start college...
Results – Searching Skills Pre-test Results
Results – Analysis <ul><li>Our thoughts on students’ basic library technology skills on college entry: </li></ul><ul><li>B...
Results – Post-test <ul><li>Do students understand some tools better than others after instruction? </li></ul>
Results – Searching Skills Post-test Results
Results – Analysis <ul><li>Percentage changes between students’ pre-test and post-test results: </li></ul><ul><li>33.2 % i...
Results – Analysis <ul><li>Questions about the comparison of pre-test and post-test results: </li></ul><ul><ul><li>Why is ...
Results – Analysis What we show in class. What we should show.
Results – Post Post-test <ul><li>Are students retaining what we are teaching? </li></ul>
Results – Searching Skills Post Post-test Results
Results – Analysis <ul><li>Ability to find Help page in the post post-test is significantly higher than it was in both the...
Results 47.43% 49.69% 16.49% Academic Search Premier 7.8% 11.13% 1.24% Catalog 73.7% 58.56% 68.04% Help Post Post-test Pos...
Conclusions <ul><li>Catalog is much more difficult for students to use  </li></ul><ul><li>Even though only doing one-shot ...
Finally… <ul><li>Assessment tool is under development to be offered as either freeware or at a cost recovery. </li></ul><u...
Questions? Acknowledgements: We would like to thank the following people for their support in this project: Ellen Truax, B...
Upcoming SlideShare
Loading in...5
×

Footholds and Foundations: Setting Freshmen on the Path to Lifelong Learning

389

Published on

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
389
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Footholds and Foundations: Setting Freshmen on the Path to Lifelong Learning

  1. 1. Footholds and Foundations Setting Freshmen on the Path to Lifelong Learning Gayla Byerly, Annie Downey, & Frank Gosnell LOEX of the West 2006, Hawaii, HI
  2. 2. Basic Background Facts <ul><li>University of North Texas </li></ul><ul><li>Core curriculum = lists of electives </li></ul><ul><ul><li>Required courses include: </li></ul></ul><ul><ul><ul><li>Basic U.S. History </li></ul></ul></ul><ul><ul><ul><li>Political Science </li></ul></ul></ul><ul><ul><ul><li>Freshmen English (1310 & 1320) </li></ul></ul></ul>
  3. 3. ACRL Standards <ul><li>Library instruction sessions teach ACRL Information Literacy Competency Standards for Higher Education within our curriculum </li></ul><ul><ul><ul><li>Research skills </li></ul></ul></ul><ul><ul><ul><li>Catalog searching </li></ul></ul></ul><ul><ul><ul><li>Database searching </li></ul></ul></ul><ul><ul><ul><li>Help from a librarian </li></ul></ul></ul>
  4. 4. Success? <ul><li>English Library Instruction Sessions </li></ul><ul><ul><li>Average about 80 sessions per academic year </li></ul></ul><ul><ul><li>Four years of successful collaboration with the English department </li></ul></ul>
  5. 5. Assessment Options <ul><li>Paper surveys </li></ul><ul><li>Online surveys </li></ul><ul><ul><li>Problem: </li></ul></ul><ul><ul><ul><li>Students report what they think they know </li></ul></ul></ul><ul><li>Goal: empirical evidence of learning </li></ul><ul><ul><li>Solution: </li></ul></ul><ul><ul><ul><li>Create our own performance-based software </li></ul></ul></ul>
  6. 6. Software Development <ul><li>General Requirements </li></ul><ul><ul><li>Provide assessment on each student PC </li></ul></ul><ul><ul><li>Collect anonymous individual results </li></ul></ul><ul><ul><li>Collect browser activity for each PC only during actual testing timeframe </li></ul></ul><ul><ul><li>Start assessment simultaneously for all students from teacher PC </li></ul></ul>
  7. 7. Software Development <ul><li>Requirement </li></ul><ul><li>Provide assessment on each student PC </li></ul><ul><li>Solution </li></ul><ul><li>Use HTML forms that collect info as students interact with the forms while taking the assessment </li></ul><ul><li>Submit assessment forms to a web server that will save the results to files for viewing / analysis </li></ul>
  8. 8. Software Development <ul><li>Requirement </li></ul><ul><li>Collect anonymous, individual results </li></ul><ul><li>Solution </li></ul><ul><li>Use host name of PC as identifier to link together pre-test and post-test results for comparison </li></ul><ul><li>Student names are never obtained </li></ul>
  9. 9. Software Development <ul><li>Requirement </li></ul><ul><li>Collect browser activity for each PC only during actual testing timeframe </li></ul><ul><li>Solution </li></ul><ul><li>Custom program to monitor start / stop times and analyze browser history for both pre-test and post-test individually </li></ul>
  10. 10. Software Development <ul><li>Requirement </li></ul><ul><li>Start assessment simultaneously for all students from teacher PC </li></ul><ul><li>Solution </li></ul><ul><li>All files installed on each PC at every reboot </li></ul><ul><li>NetSupport School – from one PC, you can… </li></ul><ul><ul><li>Reboot all student PCs simultaneously </li></ul></ul><ul><ul><li>Run executables on all student PCs </li></ul></ul><ul><ul><li>Distribute files to one or all PCs, if needed </li></ul></ul><ul><ul><li>Monitor student PC activities </li></ul></ul>
  11. 11. Assessment Tool <ul><li>Development of Assessment Tool </li></ul><ul><ul><li>Worked with Frank Gosnell to develop software </li></ul></ul><ul><ul><li>Identified skills necessary for success at research paper assignment </li></ul></ul><ul><ul><li>Prepared questions that demonstrate skills </li></ul></ul><ul><ul><li>Identified URLs that point to success in demonstrating skills </li></ul></ul>
  12. 12. Assessment Instrument <ul><li>Step 1 : </li></ul><ul><li>How likely </li></ul><ul><li>are you to </li></ul><ul><li>ask a </li></ul><ul><li>librarian </li></ul><ul><li>for help? </li></ul>
  13. 13. Assessment Instrument <ul><li>Step 2 : </li></ul><ul><li>From the </li></ul><ul><li>UNT Libraries’ </li></ul><ul><li>homepage, </li></ul><ul><li>find the </li></ul><ul><li>Webpage </li></ul><ul><li>that has </li></ul><ul><li>help from </li></ul><ul><li>a librarian. </li></ul>
  14. 14. Assessment Instrument <ul><li>Step 3 : </li></ul><ul><li>Perform a </li></ul><ul><li>subject </li></ul><ul><li>search for </li></ul><ul><li>Robert </li></ul><ul><li>Frost in </li></ul><ul><li>the library </li></ul><ul><li>catalog. </li></ul>
  15. 15. Assessment Instrument <ul><li>Step 4 : </li></ul><ul><li>Perform a </li></ul><ul><li>search in </li></ul><ul><li>Academic </li></ul><ul><li>Search </li></ul><ul><li>Premier </li></ul><ul><li>for the </li></ul><ul><li>term </li></ul><ul><li>Robert </li></ul><ul><li>Frost. </li></ul>
  16. 16. Basic Background Facts <ul><li>UNT Library Instruction </li></ul><ul><ul><li>900 English 1320 students attended a library instruction session in Fall 2005 </li></ul></ul><ul><ul><li>1475 English 1320 students attended a library instruction session in Spring 2006 </li></ul></ul><ul><ul><li>Total = 2375 students </li></ul></ul>
  17. 17. Basic Background Facts <ul><li>UNT Library Instruction Assessment </li></ul><ul><li>48 English 1320 classes completed the assessment in Fall 2005 & Spring 2006 </li></ul><ul><ul><li>90 minute class sessions only </li></ul></ul><ul><ul><li>Completely anonymous </li></ul></ul><ul><ul><li>Institutional Review Board approved </li></ul></ul><ul><ul><li>499 useable results </li></ul></ul>
  18. 18. Library Anxiety – Pre-test <ul><li>How likely </li></ul><ul><li>are </li></ul><ul><li>students </li></ul><ul><li>to ask </li></ul><ul><li>for help </li></ul><ul><li>from a </li></ul><ul><li>librarian? </li></ul>Very =40% Somewhat = 30.72% Neutral = 17.11% Not at all = 2.47% No response = 9.69%
  19. 19. Library Anxiety – Post-test <ul><li>How likely </li></ul><ul><li>are </li></ul><ul><li>students </li></ul><ul><li>to ask </li></ul><ul><li>for help </li></ul><ul><li>from a </li></ul><ul><li>librarian? </li></ul>Very = 57.11% Somewhat = 27.8 % Neutral = 7.63% Not at all = .21% No response = 7.22%
  20. 20. Library Anxiety – Comparison Positive Results Up 14.71% Neutral Results Down 11.68% Negative Results Down 2.2% 2.47% 7.22% 9.69% No response 2.2% .21% 2.47% Not at all 9.48% 7.63% 17.11% Neutral 2.4% 27.8% 30.2% Some- what 17.11% 57.11% 40% Very Change Post-test Pre-test
  21. 21. Results – Pre-test <ul><li>What do students know in terms of basic library technology skills when they first start college? </li></ul>
  22. 22. Results – Searching Skills Pre-test Results
  23. 23. Results – Analysis <ul><li>Our thoughts on students’ basic library technology skills on college entry: </li></ul><ul><li>Basic searches essential to information literacy </li></ul><ul><ul><li>Foundational building blocks </li></ul></ul><ul><li>Necessity of evaluation skills </li></ul><ul><ul><li>Using library resources makes evaluation easier </li></ul></ul>
  24. 24. Results – Post-test <ul><li>Do students understand some tools better than others after instruction? </li></ul>
  25. 25. Results – Searching Skills Post-test Results
  26. 26. Results – Analysis <ul><li>Percentage changes between students’ pre-test and post-test results: </li></ul><ul><li>33.2 % increase in ability to search Academic Search Premier. </li></ul><ul><li>9.89% increase in ability to search the catalog. </li></ul><ul><li>9.48% decrease in ability to find help from a librarian. </li></ul>
  27. 27. Results – Analysis <ul><li>Questions about the comparison of pre-test and post-test results: </li></ul><ul><ul><li>Why is there such a difference between the level of students’ ability to search the catalog and Academic Search Premier? </li></ul></ul><ul><ul><li>Why did ability to find the Help page decrease between the pre-test and post-test? </li></ul></ul>
  28. 28. Results – Analysis What we show in class. What we should show.
  29. 29. Results – Post Post-test <ul><li>Are students retaining what we are teaching? </li></ul>
  30. 30. Results – Searching Skills Post Post-test Results
  31. 31. Results – Analysis <ul><li>Ability to find Help page in the post post-test is significantly higher than it was in both the pre and post-tests. </li></ul><ul><li>Only slight decrease in post-test and post post-test catalog and Academic Search Premier </li></ul>
  32. 32. Results 47.43% 49.69% 16.49% Academic Search Premier 7.8% 11.13% 1.24% Catalog 73.7% 58.56% 68.04% Help Post Post-test Post-test Pre-test
  33. 33. Conclusions <ul><li>Catalog is much more difficult for students to use </li></ul><ul><li>Even though only doing one-shot instruction, students are retaining the skills </li></ul><ul><li>Library anxiety decreases after library instruction session </li></ul>
  34. 34. Finally… <ul><li>Assessment tool is under development to be offered as either freeware or at a cost recovery. </li></ul><ul><li>For more information on assessment software: http://www.library.unt.edu/assess </li></ul>
  35. 35. Questions? Acknowledgements: We would like to thank the following people for their support in this project: Ellen Truax, Business Librarian, University of North Texas – for her assistance with statistical analysis. Lilly Ramin, Library Specialist, University of North Texas – for her in-depth literature review and helpful assistance and feedback throughout the project.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×