This document outlines a proposed methodology for implementing an international survey partnership between schools from different countries and educational systems. The methodology involves: 1. Developing a common questionnaire in English to collect both quantitative and qualitative data from students and teachers. 2. Administering the questionnaire through Moodle to standardize data collection across partners. 3. Each partner school would be responsible for collecting and validating their own data for analysis. 4. Data would be aggregated and analyzed collectively to evaluate the effectiveness of ICT tools for independent learning across different educational contexts.

1. How to implement an
International Survey School
parternership (an introduction)
Project Name: ICT as an effective tool for independent learning
Comenius Meeting
Agrupamento de Escolas Cardoso Lopes
November 18, 2008

2. Challenge: How to get data and
communicate outcomes?
From:

 Different Countries
 Different Educational Systems
 Different Languages
 Using scientific and tested methods ?
2
ICT as an effective tool for independent learning - Fernando R. Campos

3. Challenge: How to get data and
communicate outcomes?
Have na Agreement with

 Methodology
 Methods
 Approaches
 Instruments
3
ICT as an effective tool for independent learning - Fernando R. Campos

4. What is basic needs to start
implementing the data acquisition?
Agreement of the specific instruments

 Questionnaire
Agreement in the methodology

 Testing and assesment
4
ICT as an effective tool for independent learning - Fernando R. Campos

5. How to solve the language
diferences?
Using a common language (English).

Building common instruments for data acquisition.

Building a participated responsibility between partners.

Include all partners specifcs contexts in the instruments

5
ICT as an effective tool for independent learning - Fernando R. Campos

6. How to build an instrument when
different Countries and different
Educational Systems are envolved?
Agree a questionnaire between partners

Build questions to include the several

educational systems characteristics .
6
ICT as an effective tool for independent learning - Fernando R. Campos

7. Type of data
Quantitative

 From questionnaire closed questions
Qualitative

 From questionnaire open questions
7
ICT as an effective tool for independent learning - Fernando R. Campos

8. Using ICT (Moodle) solution
Questionnaire. (question example using Likert scale)
(*) - means the question is mandatory for answering.
8
ICT as an effective tool for independent learning - Fernando R. Campos

9. Example of Questionnaire (cont.)
Possibility to save page by page of the

questionnaire.
Finishing the submission by showing the

official project web page.
9
ICT as an effective tool for independent learning - Fernando R. Campos

10. What is the proposal for
implementing data acquisition.
Answering directly in Moodle questionnaire.

Export answers data directly from Moodle to a

data file.
One approved English Questionnaire, for the

teacher and for the student (when applicable).
One entry for each partner: each school

manages its own discipline, translations,
students access.
An excel File with the results from the students

10
ICT as an effective tool for independent learning - Fernando R. Campos

11. Example of Excel File From
Students results (an example)
Time of Day____ Date:_____ School______ Scale Used:_______ Class ID______

11
ICT as an effective tool for independent learning - Fernando R. Campos

12. Partner responsibilities
Each partner is responsible for:

Applying the methods in their schools according
to the proposed .
Data recovery
Data validation
Open question analysis
Moodle discipline management (specific
language).
General platform management by Agrupamento

Cardoso Lopes - Portugal
12
ICT as an effective tool for independent learning - Fernando R. Campos

13. How do I known the responses are
minimum credible?
Check as internal consistency

Using:
 SPLIT-HALF RELIABILITY
(Spearman-Brown)
 Using Cronbach alfa parameter
13
ICT as an effective tool for independent learning - Fernando R. Campos

14. How to calculate internal
consistency?
 Using the acquired data from all the partners
 Byapplying the tests (cronbach and
Spearman-Brown) using a statistical package
(SPSS for example)
14
ICT as an effective tool for independent learning - Fernando R. Campos

15. Quantitative Data - Validity
Concerns

 Objectivity
 Generalizability
 Replicability
 Predictability
 controllability
15
ICT as an effective tool for independent learning - Fernando R. Campos

16. Internal data validation
How do we known that the data received

is valid.
 Check for missing values
 Check for outliers
 Check for cronbach parameter validation by
item.
16
ICT as an effective tool for independent learning - Fernando R. Campos

17. Some recommendations in the
application of the ICT
methodologies.
Don't inform the students that they are in an

assessments situation (Hawthorne effect).
Record the time of the day , week , month

(Stiggins 2001).
Use simple indication during the tests

Don't give too much information.

…

17
ICT as an effective tool for independent learning - Fernando R. Campos

18. Who is responsible for analysis of
open questions data?
Translation to English from the open question is

a work to be done by each partner.
Each partner is responsible for the data analysis

in the mother tongue language, translate to
English and distribute information to others
partners.
18
ICT as an effective tool for independent learning - Fernando R. Campos

19. Analyze data Model – Portuguese
responsibilities, for quantities data.
• Converter to Excel file from Moodle
• Aggregate data from different partners
• Applying statistics according to available data and statistical methods
used in education.
• Distribute aggregated data source to all the partners.
19
ICT as an effective tool for independent learning - Fernando R. Campos

20. Some Ethical questions?
Obtain explicit authorizations : Each

teacher needs to approve their
participation in the project .
 All partners need to Accept responsibility
for maintaining confidentiality.
 How owns the data?
 Shared among the partners.
20
ICT as an effective tool for independent learning - Fernando R. Campos

21. Some Ethical questions? Cont.
Each partner need to agree that data

obtained can be used for the project
divulgation proposes only.
Data cannot be used to other proposes

without partners authorization.
21
ICT as an effective tool for independent learning - Fernando R. Campos

22. Copyright questions?
Which copyright to use?
You are free:
 to Share — to copy, distribute and transmit the work.
 to Remix — to adapt the work
Creative Comms 3.0

22
ICT as an effective tool for independent learning - Fernando R. Campos

23. References
Cohen,L.,Manion,L.,Morrison,K.(2007). Research methods in

EDUCATION. Sixth edition. Routledge.
Fink,A. (1995).How to analyze Survey Data. Sage Publications.

http://moodle.org/, Modules and plugins available at May 15, 2008.

http://creativecommons.org/license/, available at November 14, 2008.

http://www.cardosolopes.net/elearning/course/category.php?id=12,

available at November 14, 2008.
http://www.spss.com/, available at November 14, 2008.SPSS

version 16
23
ICT as an effective tool for independent learning - Fernando R. Campos

24. The End
Thanks for your time
Fernando Rui P. Campos frcamposri@gmail.com
Agrupamento de Escolas Cardoso Lopes (Amadora)
Portugal
http://www.cardosolopes.net/projectos/Comenius/comenius1_uk.htm
24
ICT as an effective tool for independent learning - Fernando R. Campos