This document outlines principles for evaluating computer-assisted language learning (CALL) materials and tasks. It discusses five key principles:
1. CALL evaluation is dependent on specific contexts and situations, rather than providing definitive judgments of effectiveness.
2. CALL should be evaluated through both judgmental analysis of software/tasks and empirical analysis of learner performance.
3. Evaluation criteria should be based on theories and research findings about instructed second language acquisition.
4. Criteria must be applied considering the purpose of the CALL task.
5. Language learning potential should be the central criterion in CALL evaluation.
The document also provides examples of criteria for CALL task quality and questions to guide both judgmental and empirical
Among all the methods and approaches to language teaching there is one that may not have a strong basis on its Theory of Language but an excellent background on its Theory of Learning, the Natural Approach, based on the principles of the Theory of Language Acquisition proposed by Stephen Krashen.
Among all the methods and approaches to language teaching there is one that may not have a strong basis on its Theory of Language but an excellent background on its Theory of Learning, the Natural Approach, based on the principles of the Theory of Language Acquisition proposed by Stephen Krashen.
Introductory lecture on Corpus Linguistics. Contents: Corpus linguistics: past and present, What is a corpus?, Why use computers to study language? Corpus-based vs. Intuition-based approach, Theory vs. Methodology.
This lecture was based on McEnery et al. 2006. Corpus-based Language Studies. An Advanced resource book. Routlege.
Most of what is considered characteristics of literary language nevertheless has its Roots in everyday uses of language and can best be studied with some reference to these uses. Just as there are no firm lines of division between 'poetic' and ' ordinary ' language so it would be artificial to enforce a clear division between the languages of poetry considered as verse literature and that of other literary kind as prose. The creative writer and more particularly the poet enjoy unique freedom.
Among users of the language, without respect to the social or historical contexts to which they belong. This means: among other things. The poet can draw on the language of past Ages, or can borrow features belonging to other non literary use of language.
CLT and ALM are approach which helps to learn the language. Both are inter-connected. CLT can apply anywhere where people can communicate and ALM controls the people with such limitation. For proper pronunciation we need ALM but there is such limitation of vocabulary.
Introductory lecture on Corpus Linguistics. Contents: Corpus linguistics: past and present, What is a corpus?, Why use computers to study language? Corpus-based vs. Intuition-based approach, Theory vs. Methodology.
This lecture was based on McEnery et al. 2006. Corpus-based Language Studies. An Advanced resource book. Routlege.
Most of what is considered characteristics of literary language nevertheless has its Roots in everyday uses of language and can best be studied with some reference to these uses. Just as there are no firm lines of division between 'poetic' and ' ordinary ' language so it would be artificial to enforce a clear division between the languages of poetry considered as verse literature and that of other literary kind as prose. The creative writer and more particularly the poet enjoy unique freedom.
Among users of the language, without respect to the social or historical contexts to which they belong. This means: among other things. The poet can draw on the language of past Ages, or can borrow features belonging to other non literary use of language.
CLT and ALM are approach which helps to learn the language. Both are inter-connected. CLT can apply anywhere where people can communicate and ALM controls the people with such limitation. For proper pronunciation we need ALM but there is such limitation of vocabulary.
Overview of Assessment
It is an integral part of instruction, as it determines whether or not the goals of education are being met.
3 criteria of assessment
Validity
Reliability
Practicality
(Farhady,2012)
Assessment
Assessment information is needed by administrators, teachers, staff developers, students, and parents to assist in determining appropriate program placements and instructional activities as well as in monitoring student progress. (O’Malley,1994)
Assessment Purposes of ELL Students
Screening and identification
Placement
Reclassification or exit
Monitoring Student Progress
Program Evaluation
Accountability
(O’Malley,1994)
A presentation about assessment in Moroccan high school. The standards-based approach to the teaching of English suggested in this Slideshare requires performance-based assessment.
In today's rapidly evolving educational landscape, traditional methods of evaluation often fall short in capturing the multifaceted skills and competencies our students possess. Performance-based assessment offers an alternative approach that goes beyond standardized testing, allowing individuals to showcase their abilities in authentic, real-world contexts. In this presentation, we will explore the concept of performance-based assessment, its characheristics, benifits, and how it can revolutionize the way we measure achievement.
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
Unit 8 - Information and Communication Technology (Paper I).pdfThiyagu K
This slides describes the basic concepts of ICT, basics of Email, Emerging Technology and Digital Initiatives in Education. This presentations aligns with the UGC Paper I syllabus.
This is a presentation by Dada Robert in a Your Skill Boost masterclass organised by the Excellence Foundation for South Sudan (EFSS) on Saturday, the 25th and Sunday, the 26th of May 2024.
He discussed the concept of quality improvement, emphasizing its applicability to various aspects of life, including personal, project, and program improvements. He defined quality as doing the right thing at the right time in the right way to achieve the best possible results and discussed the concept of the "gap" between what we know and what we do, and how this gap represents the areas we need to improve. He explained the scientific approach to quality improvement, which involves systematic performance analysis, testing and learning, and implementing change ideas. He also highlighted the importance of client focus and a team approach to quality improvement.
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxEduSkills OECD
Andreas Schleicher presents at the OECD webinar ‘Digital devices in schools: detrimental distraction or secret to success?’ on 27 May 2024. The presentation was based on findings from PISA 2022 results and the webinar helped launch the PISA in Focus ‘Managing screen time: How to protect and equip students against distraction’ https://www.oecd-ilibrary.org/education/managing-screen-time_7c225af4-en and the OECD Education Policy Perspective ‘Students, digital devices and success’ can be found here - https://oe.cd/il/5yV
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Ethnobotany and Ethnopharmacology:
Ethnobotany in herbal drug evaluation,
Impact of Ethnobotany in traditional medicine,
New development in herbals,
Bio-prospecting tools for drug discovery,
Role of Ethnopharmacology in drug evaluation,
Reverse Pharmacology.
2. PRINCIPLES FOR CALL
EVALUATION2
Three needs must be addressed when
evaluating CALL materials:
Materials include
Courseware – CD ROMs etc
Websites – ESL website
Mobile Apps -
Tasks & – assignments including use of WWW, CMC
Activities – Chat, Blog, Podcast, etc
3. PRINCIPLES FOR CALL
EVALUATION3
Evaluation criteria should incorporate
findings and theory-based speculation about
ideal conditions for SLA
Findings from research on SLA
Theories of SLA
4. PRINCIPLES FOR CALL
EVALUATION
Criteria should be
accompanied by
guidance as to
how they should
be used i.e. a
theory of
evaluation needs
to be articulated
4
5. PRINCIPLES FOR CALL
EVALUATION5
Both criteria and theory need to apply not only
to software, but also to the task that the
teacher plans and that the learner carries out
6. PRINCIPLES FOR CALL
EVALUATION6
According to Chapelle (2001)
5 principles of CALL evaluation criteria
Evaluation of CALL is a situation-specific argument.
CALL should be evaluated through two perspectives: judgmental
analysis of software and planned tasks, and empirical analysis of
learners’ performance.
Criteria for CALL task quality should come from theory and
research on instructed SLA.
Criteria should be applied in view of the purpose of the task.
Language learning potential should be the central criterion (most
critical) in evaluation of CALL.
7. CALL EVALUATION:
PRINCIPLE 17
Evaluation of CALL is a situation-specific argument.
The outcome of task evaluation for any L2 tasks including those for CALL cannot be a
decision about effectiveness.
Instead, an evaluation has to result in an argument indicating in what ways a particular
CALL task is appropriate for particular learners at a given time, the use at a particular
setting
Implication: CALL developers need to be familiar with criteria for evaluation which
should be applied relative to a particular context.
8. CALL EVALUATION:
PRINCIPLE 28
CALL should be evaluated through two perspectives: judgmental
analysis of software and planned tasks, and empirical analysis of
learners’ performance.
Judgmental analyses - examine characteristics of the software and
task in terms of criteria drawn from research on SLA.
Empirical analyses - address the same criteria but through
data gathered to reveal the details of CALL use and learning
outcomes.
Implication: CALL developers need to be familiar with criteria
for evaluation which should be applied relative to a particular
context.
9. LEVELS OF ANALYSIS FOR CALL EVALUATION
9
Level of
Analysis
Object of Evaluation Example Question Method of
Evaluation
1 CALL software
Does the software provide
learners the opportunity for
interactional modifications to
negotiate meaning?
Judgmental
2 Teacher-planned
CALL activities
Does the CALL activity
designed by the teacher
provide learners the
opportunity to modify
interaction for negotiation of
meaning?
Judgmental
3
Learners’
performance
during CALL
activities
Do learners actually interact
and negotiate meaning while
they are working in a chat
room?
Empirical
10. CALL EVALUATION:
PRINCIPLE 310
Criteria for CALL task quality should come from theory and research on instructed SLA.
Language learning potential
Learner fit
Meaning focus
Authenticity
Positive impact
Practicality
Implication: CALL evaluators need to keep up with and make
links to research on instructed SLA.
11. CRITERIA FOR CALL TASK
APPROPRIATENESS
11
Language
Learning Potential
•The extent to which the activity can be considered to be a language learning activity rather than simply an opportunity for language use.
•The degree of opportunity present for beneficial focus on form.
Learner Fit
•The individual differences in linguistic ability level and non-linguistic characteristics.
•The amount of opportunity for engagement with language under appropriate conditions given learner characteristics.
Meaning Focus
•The learner’s primary attention is directed toward the meaning of the language that is required to accomplish the task.
•The extent to which learners’ attention is directed toward the meaning of the language.
Authenticity
•The degree of correspondence between an L2 learning task and tasks that the learner is likely to encounter outside the classroom
•The degree of correspondence between the CALL activity and target language activities of interest to learners out of the classroom.
Positive Impact
•Its effects beyond its language learning potential. E.g. – help build metacognitive strategies, willingness to seek out opportunities to use TL.
•The positive effects of the CALL activity on those who participate in it.
Practicality
•How easy it is for the learners and teachers to implement a CALL task within the particular constraints of a class or language program.
•The adequacy of resources to support the use of the CALL activity.
12. CRITERIA FOR CALL TASK
APPROPRIATENESS
12
Language
Learning
Potential
• They learn e.g. how to use modals
Learner Fit
• Task appropriate at their level, taking into also consideration age, learning style, willingness to communicate
Meaning Focus
• Meaning of language to accomplish a task. e.g. using language to make decision, exchanging information to
accomplish a goal
Authenticity
• What they would actually encounter outside of the classroom, in the real world
Positive Impact
• E.g. Seek opportunities to use what they have learned in class outside.
Practicality
• Easy to implement CALL despite lacking facilities
13. CALL EVALUATION:
PRINCIPLE 413
Criteria should be applied in view of the purpose of the
task.
Implication: CALL tasks should have a clearly
articulated purpose.
14. CALL EVALUATION:
PRINCIPLE 514
Language learning potential should be the central
criterion (most critical) in evaluation of CALL.
Implication: Language learning potential
should be one aspect of the purpose of CALL
tasks.
15. JUDGEMENTAL ANALYSIS OF
CALL APPROPRIATENESS15
Qualities Questions
Language learning
potential
Do task conditions present sufficient opportunity for beneficial focus on form?
Learner fit Is the difficulty level of the targeted linguistics forms appropriate for the learners to
increase their language ability?
Is the task appropriate for learners with the characteristics of the intended learners?
Meaning focus Is learner’s attention directed primarily toward the meaning of the language?
Authenticity Is there a strong correspondence between the CALL task & second language tasks of
interest to learners outside the classroom?
Will learners be able to see the connection between the CALL task and tasks outside the
classroom?
Impact Will learners learn more about the target language and about strategies for language
learning through the use of the tasks.
Will instructors observe sound second language pedagogical practices by using the task?
Will both learners and teachers have a positive learning experience with technology
through the use of the task?
Practicality Are hardware, software, and personnel resources sufficient to allow the CALL task to
succeed?
16. Empirical Analysis of CALL
Appropriateness16
Qualities Questions
Language learning
potential
What evidence suggests that the learner has acquired the target forms that
were the focused on during the CALL tasks/
What evidence indicates that learners focused on form during the CALL task?
Learner fit What evidence suggests that the targeted linguistic forms are at an
appropriate level of difficulty for the learners?
What evidence suggests that the task is appropriate to learners’ individual
characteristics (age, learning styles, computer experience)
Meaning focus What evidence suggests that the learner’s construction of linguistic meaning
aids language learning?
What evidence indicates that the learners use the language during the task
for constructing and interpreting meaning?
Authenticity What evidence suggests that learners’ performance in the CALL tasks
corresponds to what one would expect to see outside the CALL tasks?
What evidence suggests that the learners see the connection between CALL
task and tasks outside the classroom?
Impact What evidence suggests that the learners learn more about the target
language and about strategies for language learning through the use of the
tasks?
Practicality What evidence suggests that hardware, software and personnel resources
prove to be sufficient to allow the CALL task to succeed?