Designing and Implementing Web-based Tools
to Assess Information Competences of Social

Science Students at Spanish Univer...
Aims
• To describe the process
integrated
tool
to
Competences

and aplication of an
assess
Information

• Information Comp...
Context
•

The European Higher Education Area demands an approach of
competency-based learning

•

The acquisition of Info...
Background
• ACRL, CILIP and CAUL Standards
• Own and Preview Experience
 e-COMS (2004- )
 ALFINEEES (2005- )
 IL-HUMAS...
Background
Background
• Web PORTALS focused on learning and assessing in IL

•

That’s means:
–
–
–

•

What we need to assess
To def...
Tools
Integrated Assessment of Students’ Information Competences
to measure:
• Attitudes
• Expectations

Subjective assess...
Assessment Tools

8
Set of Reading Texts

• Experts selected a hundred of texts
• Requirements
• Belonging to an international organization (F...
Set of Reading Texts
• Nine types of texts were validated and analyzed

• Topics:
1.
2.
3.
4.
5.
6.
7.
8.
9.

Food and Agr...
IL-HUMASS Test

• From Total Quality Based approach, we have developed
and validated and integrated in IL-HUMASS Model
(st...
IL-HUMASS Model
Actitudinal Approach in the Educational Triangle

Declarative
Knowledge

Procedural
Knowledge

Motivation
...
IL-HUMASS Test

13
IL-HUMASS Test
Applied in:
Universidad de Granada
Universidad Jaume I
Universidad de Salamanca
Universidad Complutense
Uni...
Knowledge Test
• This test measures the basic knowledge as a whole
• It is focused on the dimension of "know”

• 78 items ...
Knowledge Text
Design

Designing and Implementing Web-based Tools
to Assess Information Competences of Social Science Stud...
Knowledge Text
Design

Designing and Implementing Web-based Tools
to Assess Information Competences of Social Science Stud...
Assessment Matrices

Students were asked about :
•
•
•
•
•
•
•
•

Specialized Terminology
Being familiar with information ...
Assessment Matrices

19
Consistency of the tools
Sample:
• It was piloted with 155 undergraduated Students: UGR, UCM, UMA.
• Statistical results s...
Results: IL-HUMASS Test – Knowledge Test

9
10
Motivation

11

Self-efficacy

Knowledge

12
13
0

2

4

6

8

21
Results Knowledge Test - Assessment Matrices

7.76

9

6.06

7.63

10

3.76

Knowledge
SABER HACER

6.77

11

5.90

0

2

...
Results Knowledge Test - Assessment Matrices

7.99

21

5.41

4.88

24

Knowledge

4.78

SABER HACER
6.61

25

4.13

0

1
...
Global Findings
9

8

7

6

5

Information search
Information evaluation
Information processing

4

Information evaluation...
Conclusions
• Emerging culture on assessment of IL
• Four tools are validated
• EVAL-CI is a project in progress to integr...
Çok teşekkür ederim

26
Upcoming SlideShare
Loading in …5
×

Designing and Implementing Web Based Tools to Asess Information Competences of Social Science Students at Spanish Universities

362 views

Published on

Descripción un conjunto de herramientas web para evaluación las competencias informacionales de los estudiantes universitarios españoles de grados de Ciencias Sociales

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
362
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Designing and Implementing Web Based Tools to Asess Information Competences of Social Science Students at Spanish Universities

  1. 1. Designing and Implementing Web-based Tools to Assess Information Competences of Social Science Students at Spanish Universities María Pinto University of Granada José-Antonio Gómez-Hernández University of Murcia Susana Puertas University of Granada David Guerrero University of Granada Ximo Granell University Jaume I of Castellón Carmen Gómez University of Málaga Rocío Palomares University of Málaga Aurora Cuevas University Complutense (Madrid) 1
  2. 2. Aims • To describe the process integrated tool to Competences and aplication of an assess Information • Information Competences of Social Sciences Students at Spanish Universities 2
  3. 3. Context • The European Higher Education Area demands an approach of competency-based learning • The acquisition of Information Competences at Spanish Universities is a requirement (RD 1387/2007) • Training by competences, including IL, in Higher Education belongs to professors and librarians and there is an emerging culture in assessment • Implantation of University Degrees (2009—) • Joint Strategy CRUE-TIC/REBIUN, 2010… 3
  4. 4. Background • ACRL, CILIP and CAUL Standards • Own and Preview Experience  e-COMS (2004- )  ALFINEEES (2005- )  IL-HUMASS (2007- )  ALFINTRA (2005, 2008)  INFOLITRANS (2009- )  EVALUAREED (2011- ) Focused in learning and assessing in IL 4
  5. 5. Background
  6. 6. Background • Web PORTALS focused on learning and assessing in IL • That’s means: – – – • What we need to assess To define how to assess To specify the level of assessment For that reason, its necessary to assess: – – – Knowledge Attitudes and values Skills
  7. 7. Tools Integrated Assessment of Students’ Information Competences to measure: • Attitudes • Expectations Subjective assessment • Knowledge • Skills Objective assessment By four key tools: • • • • Set of reading texts IL-HUMASS test Knowledge Test Assessment Matrices 7
  8. 8. Assessment Tools 8
  9. 9. Set of Reading Texts • Experts selected a hundred of texts • Requirements • Belonging to an international organization (FAO, UNESCO, EU, ILO) • Written in Spanish and English • Short in length (2500 words or 15 min time-reading) • Be current, interesting and easy undertanding • Be accompanied by an ilustration • Be open access on the Web 9
  10. 10. Set of Reading Texts • Nine types of texts were validated and analyzed • Topics: 1. 2. 3. 4. 5. 6. 7. 8. 9. Food and Agriculture Organization Nutrition and Health Environment Comsumption fo digital news Labour safety Home workers Crisis in education Sexual exploitation Illegal wood 10
  11. 11. IL-HUMASS Test • From Total Quality Based approach, we have developed and validated and integrated in IL-HUMASS Model (stakeholders) Dimensions: Self-assessment IL: based on Students’ perception and efficacy Learning Assessment: Report of learning outcomes and recomendations to improve 11
  12. 12. IL-HUMASS Model Actitudinal Approach in the Educational Triangle Declarative Knowledge Procedural Knowledge Motivation K A S SelfEfficacy Source of Learning 12
  13. 13. IL-HUMASS Test 13
  14. 14. IL-HUMASS Test Applied in: Universidad de Granada Universidad Jaume I Universidad de Salamanca Universidad Complutense Universidad de Málaga Universidad de Murcia St. Patrick's College (Irlanda) Universidad Oporto Universidad Nova de Lisboa, ISPA Universidad de la Habana Universidad Central de las Villas Universidad Brasilia Universidad de Guadalajara Universidad de Antioquia (Colombia) Universidad Rio Cuarto (Argentina) 14
  15. 15. Knowledge Test • This test measures the basic knowledge as a whole • It is focused on the dimension of "know” • 78 items Test • 5 possible answers • Divided into 4 categories (as IL-HUMASS): Search, evaluatition, processing and communication/dissemination 15
  16. 16. Knowledge Text Design Designing and Implementing Web-based Tools to Assess Information Competences of Social Science Students at Spanish Universities 16
  17. 17. Knowledge Text Design Designing and Implementing Web-based Tools to Assess Information Competences of Social Science Students at Spanish Universities 17
  18. 18. Assessment Matrices Students were asked about : • • • • • • • • Specialized Terminology Being familiar with information search strategies Evaluating the quality of information sources Identifying the main idea of the text or what the author tries to say Schematising and extracting information Recognising the structure of a text Citing information sources Designing academic presentations. 18
  19. 19. Assessment Matrices 19
  20. 20. Consistency of the tools Sample: • It was piloted with 155 undergraduated Students: UGR, UCM, UMA. • Statistical results shown a high internal consistency of the tools • Cronbach alfa of the tools has been: 0.871 Set Reading Texts 0.944 IL-HUMASS Test 0.869 Knowledge Test 0.837 Assessment Matrices 20
  21. 21. Results: IL-HUMASS Test – Knowledge Test 9 10 Motivation 11 Self-efficacy Knowledge 12 13 0 2 4 6 8 21
  22. 22. Results Knowledge Test - Assessment Matrices 7.76 9 6.06 7.63 10 3.76 Knowledge SABER HACER 6.77 11 5.90 0 2 4 6 8 22
  23. 23. Results Knowledge Test - Assessment Matrices 7.99 21 5.41 4.88 24 Knowledge 4.78 SABER HACER 6.61 25 4.13 0 1 2 3 4 5 6 7 8 9 23
  24. 24. Global Findings 9 8 7 6 5 Information search Information evaluation Information processing 4 Information evaluation Communication 3 2 1 0 Motivation Self-efficacy Knowledge Know how 24
  25. 25. Conclusions • Emerging culture on assessment of IL • Four tools are validated • EVAL-CI is a project in progress to integrate information literacy instruction and assessment in the curricula • Offers self-diagnostic based on perception and a diagnostic based on evidence (students) • Findings are partial but significative 25
  26. 26. Çok teşekkür ederim 26

×