The document compares two information literacy assessment tools: iSkills and SAILS. iSkills is a proprietary test from ETS that measures critical thinking skills through scenario-based tasks. It is administered online in a proctored environment. SAILS is an open source test from Kent State University that measures competency standards through a multiple choice knowledge test. It is also administered online but does not require proctoring. Both tools measure skills aligned with the ACRL standards but iSkills focuses more on performance of tasks while SAILS focuses on knowledge.

1. Information Literacy Tests Comparison Table
Based on What skills How skills Administration Description, Time Advantages Drawbacks
are measured are requirements and Cost
measured
iSkills ACRL Performance Tests the No preset test Uses scenarios 75 Assesses Expensive.
(ETS) Information Areas: competency administration that require minutes, critical
Literacy Define of individual dates; students to $20 per thinking; Must be
Can be used Competency Access students, complete test (1- taken in a
to measure Standards Evaluate or of a web-based specific tasks, 500) fast results; designated
information for Higher Manage group of assessment rather than $19 per location
Education: Integrate students. anywhere, answering test (501- students (testing
literacy skills
anytime using 1000)
associated Create multiple-choice complete centers) and
institution-owned $18 per
with usage 1.Determine Communicate. (min 50 in questions: 14 specific real proctored
machines or test
info need; both cases) short tasks that world
of student laptops. A (1000+)
2. access info; Assesses all 5 take 4 minutes scenario Measures in
technology small file must be
3. evaluate
(of individual competency installed -ensures each; one long Scores tasks; relation to
&incorporate
students and standards. that students task that takes are ready technology
info;
for IL cannot perform 15 minutes. only
4. use info to within 10
Focuses on the tasks outside of
program accomplish a days.
cognitive the test Technical Downloading
assessment) specific
environment (web
purpose; problem requirements: required
searching, instant
5. use info solving and Windows®
messaging
ethically & critical 2000, NT, XP or Knowledge of
Reliability:
legally. thinking skills higher; Pentium the topics and
NA Proctored
associated III 700 MHz or ability to
manipulate
with using Results: higher; Internet
technology
technology Score reports Explorer 5.5 (or
are needed to
to handle can be retrieved higher) complete
suitable for information. via ETS Program ;1024x768; tasks
students from Workshop, a external mouse;
high school web-based iSkills secure
through administration browser must
college as well portal be installed.
as for working
adults
Website: http://www.ets.org/iskills/about
FAQ: http://www.ets.org/iskills/faq
Case studies: - http://www.ets.org/iskills/case_studies
Pricing and ordering: http://www.ets.org/iskills/pricing_ordering

2. Based on What skills How skills Administration Description, Time and Advantages Drawbacks
are are requirements Cost
measured measured
SAILS ACRL Assesses all 5 Tests the Students are A knowledge 45 min – Less does not
(Kent State Information competency competency directed to the test with individual expensive; provide
University) Literacy standards. of SAILS web site multiple-choice immediate
Competency
individual to take the questions 35 min - takes short results, need
Standards for Measures 8
Can be used students web-based test. (55 questions- group time: will fit to wait until
Higher skill sets:
to gather Education: (no min), Each student individual; in a 50- the end of
baseline or of a may take the 45 questions- $3 per minute class semester.
information Developing a group of test once per group student session
1.Determine
Research
and to track info need; students administration. (up to a cap i.e. Spring
Strategy
the 2. access (min 50, Technical of $2,000 per no testing begins
development info; recom-d SAILS testing requirements: administration designated in January –
3. evaluate Selecting 200)
of occurs during Very minimal. up to 5000 location the results
&incorporate Finding Tools
information two sessions Registration students) needed for are available
info;
literacy per academic and set-up are delivery in June.
4. use info to Searching
skills of accomplish a year: Fall and done through
individual specific Spring the SAILS Web Administering
Using Finding and taking the
students or purpose; site. The only
Tool Features SAILS test
groups of 5. use info Proctored needs are
requires very
students. ethically & Internet
legally Retrieving little technical
access and a
Sources expertise.
Results: Web browser.
and
Responses are SAILS is Pre- and post-
Evaluating
Reliability: Sources
sent to a central compatible testing are
over 0.80 Objectives database where with all available for
for
data are current Web individual
Information Documenting
analyzed and browsers. tests
Literacy Sources
Instruction: reports are
Provides
A Model Understanding
generated and
benchmarking
Statement Economic, made available
suitable for for Academic Legal, and for download in
undergraduate Librarians. Social Issues PDF;
students
Website: https://www.projectsails.org/AboutTest
Sample questions https://www.projectsails.org/SampleQuestions
Sample report (group) https://www.projectsails.org/files/Sample_Report_2009.pdf
Sample report (individual) https://www.projectsails.org/files/SampleIndividualScoresReport.xls

3. Based on What How skills Administration Description, Time and Advantages Drawbacks
skills are are requirements Cost
measured measured
ILT ACRL Standards 1, Tests the Tests are Web- 60 Multiple- Around 75 no Does not
(James Information 2, 3, and 5. competency based, and are choice minutes; designated assess
Madison Literacy It does not of individual delivered via items location Standard 4.
Competency
University) address students JMU servers. (multimedia $5-$10 needed for (use info to
Standards
Standard 4. and assess intensive) depending delivery accomplish
for Higher
Can be used Education: the program A schedule will 5 pilot items on the specific
to help be established amount of purpose).
measure 1.Determine The data to use testing Technical tests
student info need; collected can services over a Requirements: purchased
information 2. access be used to specified time Internet (to be
info; provide confirmed)
literacy period. The Explorer 5.0 or
3. evaluate information
outcomes, client will later
&incorporate about student
to test the learning that determine the Resolution:
info;
competency can inform testing period. 1024 X 768
4. use info
of individual to improvements Windows or
students, accomplish to IL JMU provides UNIX operating
and for IL a specific programs the web address system.
program purpose; for institutions
assessment. 5. use info to access the
ethically & tests on their
legally scheduled
testing date.
Reliability: Proctored
0.88 environment
Results:
JMU provides
institutions with
dataset of
Suitable for scores and
undergraduate scored
and graduate responses.
students
Website: http://www.madisonassessment.com/assessment-testing/information-literacy-test
Test Manual: http://www.madisonassessment.com/uploads/ILT%20Test%20Manual%202010.pdf
Request demo - http://www.madisonassessment.com/view-demo

4. For further review:
Taking Flight—Pilot Testing the Information Literacy Test. Connie Ury, Sarah G. Park, Frank Baudino, and Gary Ur
http://www.ala.org/ala/mgrps/divs/acrl/events/national/baltimore/papers/256.pdf
Information Literacy Assessment: A Review of Objective and Interpretive Methods and Their Uses. Penny Beile, PhD
http://ilassessments.pbworks.com/f/SITE2008+paper+beile.doc
A Review of Digital Literacy Assessment Instruments . Stephen Covello.
http://www.apescience.com/id/fulltext/research-on-digital-literacy-assessment-instruments
Multiple research articles on Information Literacy Assessment tools are available via the database:
Library, Information Science & Technology Abstracts with Full Text