The document discusses evaluation in language curriculum design. It explains that evaluation aims to determine if a course is successful and where improvements are needed. Evaluation looks at all aspects of curriculum design, including results, planning, teaching quality, learner satisfaction, and cost-effectiveness. Gathering information involves interviews, surveys, and observations. It is important to gain support from those involved and determine who the evaluation is for and what information they need. Formative evaluation can help improve courses by involving teachers and designers and providing ongoing feedback. The results of evaluation are used to strengthen course design and implementation.
Alternative Assessments
Brown and Hudson ( 1988) noted that to speak of alternatives assessment is counterproductive because the term implies some thing new and different that may be exempt from the requirements of responsible test construction.
Assessment procedures that are not like traditional tests with respect to format, performance or implementation
Traditional vs Alternative
What should alternative assessments do?
Ask Ss to perform, create, produce or do something
Tap higher level thinking skills
Use tasks that are meaningful
Invoke real world applications
People, not machines, do the scoring
Require new instructional and assessment roles for teachers
The alternatives in assessment must be:
Open ended in their time orientation and format
Contextualized to a curriculum
Referenced to the criteria ( objectives) of that curriculum and
Likely to build intrinsic motivation.
Tets types
Language Aptitude Test
Proficiency Tests
Placement Tests
Diagnostic Tests
Achievement Tests
Language Aptitude Test
Is designed to measure capacity or general ability to learn a foreign language and ultimate success in that undertaking. Language aptitude tests are ostensibly designed to apply to the classroom learning of any language. Two standardized aptitude tests have been used in the USA: the Modern Language Aptitude Test (MLAT) (Carroll and Sapon, 1958) and the Pimsleur Language Aptitude Battery (PLAB) (Pimsleur, 1966). Both are English language tests and require students to perform a number of Language-related tasks.
Alternative Assessments
Brown and Hudson ( 1988) noted that to speak of alternatives assessment is counterproductive because the term implies some thing new and different that may be exempt from the requirements of responsible test construction.
Assessment procedures that are not like traditional tests with respect to format, performance or implementation
Traditional vs Alternative
What should alternative assessments do?
Ask Ss to perform, create, produce or do something
Tap higher level thinking skills
Use tasks that are meaningful
Invoke real world applications
People, not machines, do the scoring
Require new instructional and assessment roles for teachers
The alternatives in assessment must be:
Open ended in their time orientation and format
Contextualized to a curriculum
Referenced to the criteria ( objectives) of that curriculum and
Likely to build intrinsic motivation.
Tets types
Language Aptitude Test
Proficiency Tests
Placement Tests
Diagnostic Tests
Achievement Tests
Language Aptitude Test
Is designed to measure capacity or general ability to learn a foreign language and ultimate success in that undertaking. Language aptitude tests are ostensibly designed to apply to the classroom learning of any language. Two standardized aptitude tests have been used in the USA: the Modern Language Aptitude Test (MLAT) (Carroll and Sapon, 1958) and the Pimsleur Language Aptitude Battery (PLAB) (Pimsleur, 1966). Both are English language tests and require students to perform a number of Language-related tasks.
Language Assessment - Beyond Test-Alternatives Assessment by EFL LearnersEFL Learning
The concept of assemble additional measures of students—portfolios, journals, observations, self-assessments, peer-assessments, and the like—in an effort to triangulate data about students.
Types of tests: proficiency, achievement, diagnostic, placement
Types of testing: direct vs indirect tests, discrete point vs integrative tests, criterion-referenced vs norm-referenced tests, objective vs subjective tests
Language Assessment - Beyond Test-Alternatives Assessment by EFL LearnersEFL Learning
The concept of assemble additional measures of students—portfolios, journals, observations, self-assessments, peer-assessments, and the like—in an effort to triangulate data about students.
Types of tests: proficiency, achievement, diagnostic, placement
Types of testing: direct vs indirect tests, discrete point vs integrative tests, criterion-referenced vs norm-referenced tests, objective vs subjective tests
This power point is about the didactic assessment. It is all about the didactic assessment definitions, related concepts, types, and didactic assessment tools.
It refers to the collection of information on which judgment might be made about the worth and the effectiveness of a particular programme. It includes making those judgments so that decision might be made about the future of programme, whether to retain the programme as it stand, modify it or throw it out altogether.
Types of Evaluation prior to Instructional Actitspetacular
Evaluations prior to instructional act are pre-assessment, formative, and summative test. These three types of evaluation are done to determine the needs and strengths o the students
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
Embracing GenAI - A Strategic ImperativePeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
The Roman Empire A Historical Colossus.pdfkaushalkr1407
The Roman Empire, a vast and enduring power, stands as one of history's most remarkable civilizations, leaving an indelible imprint on the world. It emerged from the Roman Republic, transitioning into an imperial powerhouse under the leadership of Augustus Caesar in 27 BCE. This transformation marked the beginning of an era defined by unprecedented territorial expansion, architectural marvels, and profound cultural influence.
The empire's roots lie in the city of Rome, founded, according to legend, by Romulus in 753 BCE. Over centuries, Rome evolved from a small settlement to a formidable republic, characterized by a complex political system with elected officials and checks on power. However, internal strife, class conflicts, and military ambitions paved the way for the end of the Republic. Julius Caesar’s dictatorship and subsequent assassination in 44 BCE created a power vacuum, leading to a civil war. Octavian, later Augustus, emerged victorious, heralding the Roman Empire’s birth.
Under Augustus, the empire experienced the Pax Romana, a 200-year period of relative peace and stability. Augustus reformed the military, established efficient administrative systems, and initiated grand construction projects. The empire's borders expanded, encompassing territories from Britain to Egypt and from Spain to the Euphrates. Roman legions, renowned for their discipline and engineering prowess, secured and maintained these vast territories, building roads, fortifications, and cities that facilitated control and integration.
The Roman Empire’s society was hierarchical, with a rigid class system. At the top were the patricians, wealthy elites who held significant political power. Below them were the plebeians, free citizens with limited political influence, and the vast numbers of slaves who formed the backbone of the economy. The family unit was central, governed by the paterfamilias, the male head who held absolute authority.
Culturally, the Romans were eclectic, absorbing and adapting elements from the civilizations they encountered, particularly the Greeks. Roman art, literature, and philosophy reflected this synthesis, creating a rich cultural tapestry. Latin, the Roman language, became the lingua franca of the Western world, influencing numerous modern languages.
Roman architecture and engineering achievements were monumental. They perfected the arch, vault, and dome, constructing enduring structures like the Colosseum, Pantheon, and aqueducts. These engineering marvels not only showcased Roman ingenuity but also served practical purposes, from public entertainment to water supply.
Model Attribute Check Company Auto PropertyCeline George
In Odoo, the multi-company feature allows you to manage multiple companies within a single Odoo database instance. Each company can have its own configurations while still sharing common resources such as products, customers, and suppliers.
Biological screening of herbal drugs: Introduction and Need for
Phyto-Pharmacological Screening, New Strategies for evaluating
Natural Products, In vitro evaluation techniques for Antioxidants, Antimicrobial and Anticancer drugs. In vivo evaluation techniques
for Anti-inflammatory, Antiulcer, Anticancer, Wound healing, Antidiabetic, Hepatoprotective, Cardio protective, Diuretics and
Antifertility, Toxicity studies as per OECD guidelines
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
2. THE AIM ??
The aim of the evaluation in the curriculum
design process is to decide if the course is
successful and where it needs to be improved.
3. What is an Evaluation?
evaluation looks at all aspects of curriculum design to
see if the course is the best possible .
Evaluation requires looking both at the results of the course,
and the planning and running of the course .
4. evaluation answer questions like the
following:
• Is the teaching of the course is high standard?
• Is the course preparing the learners properly for their use of
English at the end of the course (e.g. to pass the TOEFL test, to study
in an English-medium university, to work as a tour guide)?
• Are the learners satisfied with the course?
• Is the course cost effective?
5. Steps in an Evaluation 9
1 Find who the evaluation is for and what kind of
information they need.
2 Find what the results of the evaluation will be used for –
to improve the course, to decide whether to keep or get
rid of the course.
3 Decide if the evaluation is necessary or if the needed
information is already available.
4 Find how much time and money are available to do the
evaluation.
6. 5 Decide what kinds of information will be
gathered.
• Amount of learning
• Quality of learning
• Quality of teaching
• Quality of curriculum design
• Quality of course administration
• Quality of support services – library, language lab, etc.
• Teacher satisfaction
• Learner satisfaction
• Sponsor satisfaction
• Later success of graduates of the course
• Financial profitability of the course.
7. 6 Try to gain the support of the people involved in the evaluation.
7 Decide how to gather the information and who will be involved in
the gathering of information.
8 Decide how to present the findings.
9 Decide if a follow-up evaluation is planned to check the
implementation *application * of the findings.
8. Purpose and Audience of the Evaluation
Kiely and Rea-Dickens (2006: 225–271) make a useful
three-way scope distinction:
(1) teacher-led evaluations,
(2) management-led evaluations.
(3) large-scale evaluations
9. A course evaluation can be an expensive and time-
consuming procedure. Like if a university wants to
evaluate a course : outside evaluators/fees/hotels/
tickets .
Because of this investment of time and money, it is
important that an evaluation is well focused and well
motivated.
10. The first critical step is to find out who the evaluation is for
and what kind of information they value. This step is very
important because :
Firstly, it helps determine the degree of confidentiality of the
evaluation.
Secondly, it helps determine what kind of information should be
gathered and what kind of information should not be gathered.
Thirdly, knowing who the evaluation is for is useful in determining
whether the data to be gathered will be provided willingly or
reluctantly.
11. In this stage , the evaluator should be able to tell
the person commissioning the evaluation:
(a) whether the evaluation is worth doing
(b) whether the evaluation is possible
(c) how long it might take
(d) how much it might cost
(e) whether the evaluator is willing to do it
(f) what kind of evidence the evaluation will gather.
If all the people are in agreement, then the evaluation can
continue.
13. NOTE
In evaluation a teacher’s quality cannot be reliably or
validly assessed from watching one or two lessons. The
lessons may be especially well prepared for the
evaluation, or the teacher could be nervous and having
a bad day.
15. THREE FACTORS OF EVALUATION
Cognitive factors
Involve learning and teaching and the
gaining of knowledge,
Typical questions would be:
Affective factors
involve feelings of satisfaction and
attitudes
Typical questions would be:
Resource factors
involve costs, profit, learning
resources such as books, classrooms,
visual aids, tape recorders,computers
Typical questions would be:
“How much has been taught ?” “Are the learners pleased with the
course?”
“Is the library adequate for the needs
of the learners?”,,
“How much has been learned?”, “Do the staff work well together?”, “Are the classrooms large enough?”
, “Has the course improved learners’ “Do the teachers feel the course is
effective?”
“Does the course make a financial
profit?”
16. Gaining Support for the Evaluation
A course evaluation looks for strengths and weaknesses,
but it is naturally the weaknesses that cause concern.
Because :
They will criticize your weaknesses
These are the points that you need to improve
17. THE QUESTION IS
HOW CAN YOU GAIN SUPPORT FOR THE EVALUATION ?
How can you get honest data and information ?
How can you proceed the evaluation effectively ?
18. it is necessary for those involved in the evaluation, particularly those
who are sources of information, to feel that the evaluation is
worthwhile and not personally threatening to their “face”
and their job security. This will require meeting with those involved
and involving them in the planning and carrying out of the
evaluation.
So Gaining the agreement and cooperation of the staff
a prerequisite (condition ) to doing the evaluation.
19. The assumptions behind an evaluation
usually are that(before ):
(1) this course is worth improving,
(2) the people running and teaching the course are
capable of improving it,
(3) the people involved in the course have the freedom
and flexibility to make changes to the course,
(4) the improvements will make it a better course for all
concerned.
21. Interviews ?
• the interviewer has a procedure
and a set of questions to follow
and generally keeps to these
structured
• No prepared questions
unstructured
22. The table shows what information you want to get and the tools for that
23. Self-report scales
??????????????????????????????
A self-report scale is a type of survey or questionnaire
( it could be for mostly learners and teachers of the course )
self-report is any method which involves asking the participants
about their feelings, attitudes, beliefs and so on.
24. Self-report scales are very efficient when
1
• (1) You survey a large number of people,
2
• (2) there is a large number of pieces of information
to gather,
3
• (3) there are very clear focuses for the evaluation
4
• 4) there is a need to summarize the data to get a general picture,
and compare it with previous evaluations or other courses.
25. There are several dangers of self-report
scales:
1. They tend to result in average results , This is usually avoided by also
showing how many people responded with 5 (excellent), how many responded
with 4 (very good) and so on.
2.Self-report scales involve pre-determined questions and types of answers.
3. Self-report scales are often used for student evaluation of teaching and
giving them short period of time to answer . This can be partly avoided by
giving them time and encouraging learners to reflect on the whole course and
by allowing them to discuss in pairs or small groups before responding
individually.
26.
27. Observation and checklists
a course can be evaluated to some degree through
observation and analysis. These include analyzing the
course book, observing learning in lessons, observing
teaching, and observing the performance of learners after
the course.
The Observation has two types structured
unstructured
28. the observer or
analyzer has a
checklist of
features to look for
and evaluate.
the structured
observation with a
checklist makes sure
that everything that
was thought to be
important to look at is
looked at.
structured
the observer or
analyzer tries to see
what is there without
too many
preconceptions.
The unstructured
observation may pick
up features that may
not have been
included in any
checklist.
unstructured
29. A practical checklist should not be too long,
easy to use, and easy to interpret its results.
should
not be
too long,
easy to
use
easy to
interpret
its results
31. The disadvantages of
checklists
(1) they may “blind” the
observer from seeing other
important features that are
not on the list,
(2) they tend to become out
of date as theory changes
(consider the course book
evaluation form designed by
Tucker (1968)), and
(3) many checklists are based
on the assumption that
summing the parts is equal to
the whole.
The advantages of checklists
(1) they ensure that there is
a systematic coverage of
what is important,
(2) they allow comparison
between different courses,
lessons, teachers etc., and
(3) they can act as a basis
for the improvement of a
course through formative
evaluation.
32. Formative Evaluation as a Part of a Course
An important question in an evaluation is : who will be
involved in the evaluation ?
The involvement of curriculum designers and teachers in
an evaluation can be an important part of professional
development.
The evaluation is a part and it doesn’t end but it
continuous .
33. The formative evaluation can be planned as a part
of curriculum design in the following ways:
1 Parts of the curriculum design can be negotiated between the
teacher and the learners This may include negotiation of
classroom activities, some of the goals of the course, and some
assessment procedures. This negotiation is a kind of evaluation
with immediate effects on the course.
2 The course can include periodic and systematic observation
of classes by teacher peers.
3 The staff hold regular meetings to discuss the progress of the
course.
34. 4 Teachers are required to periodically fill self-evaluation
forms that they discuss with a colleague.
5 Learners periodically fill course evaluation forms.
6 Some class time is set aside for learner discussion of the
course and
providing feedback for teachers.
7 Occasionally an outside evaluator is invited to evaluate
aspects of the course.
35. The Results of an Evaluation
When an evaluation has been done, the results need to be presented. This
presentation involves ethical issues, particularly those of confidentiality (privacy
)and consideration for the feelings of others.
Because The results of an evaluation may also be threatening to the individuals
concerned, especially if weaknesses are revealed.
The results of evaluations of teaching are usually only available to the teacher
concerned and perhaps to the head of the department. They are not seen by
colleagues.
# In the comparison of the evaluation there are two ways
norm-referenced and criterion-referenced?
36. In such evaluations particular comments by students may be reported, but the
names of the students who made these comments are not reported.
Most evaluations involve a written report, or in some cases two written
reports
A report of an evaluation needs to indicate the quality of the course and it must be
made clear what the standard for the measure of quality is.
The written report will usually be accompanied by an oral report. This oral report
has two purposes,
(1) to make sure the written report is clearly understood, and
(2) (2) to say things that could not be put tactfully in writing.
37. Is the report the end of the evaluation ?
The report needs to be considered and then
acted on. The evaluation procedure may involve some
later follow-up to monitor the effects and implementation
* application* of the evaluation for the planning of future
courses.
38. Summary of the chapter
1 Discover the purpose and type of the evaluation.
2 Assess the time and money needed.
3 Decide what kinds of information to gather.
4 Gain the support of the people involved.
5 Gather the information.
6 Present the findings.
7 Apply what has been learned from the evaluation.
8 Do a follow-up evaluation.