SlideShare a Scribd company logo
1 of 21
Assessment “Assessment is the measure of student learning...the process of obtaining information about how much the student knows...[and] using that information to form judgements which in turn are to be used in decision making”  (Reece & Walker 2007 p35) Assessment “is an integral component of the teaching and learning system [it] may be used explicitly to guide students in their study. But also, student perceptions of what is rewarded and what is ignored...will have a substantial impact on their learning behaviour” (Wakeford 1999 p58)
Summative Assessment “Summative assessment is used to indicate the extent of a learner's success in meeting the assessment criteria used to gauge the intended learning outcomes of a module or programme.”  (UK QAA 2006) “Any assessment activity which results in a mark or grade which is subsequently used as a judgement on student performance. Ultimately judgements using summative assessment marks will be used to determine the classification of award at the end of a course or programme.”   (Irons 2008 p7)
Purpose “Assessment is fundamentally about helping students to learn and teachers to learn about how best to teach them.”   (Ramsden 2003 p177) “What is assessed? The simple answer to this question should be learning – of the student, the teacher and the institution.” (Merricks 2002 p167) Why assess? To classify students – are they worthy of the award? To diagnose students – do they need help? To encourage and support learning - individually and generally. (Ellis 2001 p38)
Purpose Students expect it and are motivated by it!  To diagnose learning To certificate learning To provide feedback To help remedy mistakes To help with option choice and selection To help diagnose faults To provide performance indicators for students and enable final award grading To ensure the learning outcomes for different awards and programmes are met To provide performance indicator for staff To provide performance indicator for course and institution We have always done it  (Merricks 2002)
Impacts “Assessment activities shape students idea of curriculum – what do I need to learn?”  (Ramsden 2003) “Assessment is an integral component of the teaching and learning system...explicitly to guide students in their study...student perceptions of what is rewarded and what is ignored...will have a substantial impact on their learning behaviour” (Wakeford 1999)
Impacts Curriculum and teaching Teaching to test (at expense of curriculum content; distorted teaching techniques; time consuming – does not directly improve learning; encourages didactic transmission style. Effects on motivation On lower / higher achieving students; anxiety; does motivate some students; promotes extrinsic, no intrinsic motivation;
How its used “Assessment often seen as an addition to teaching rather than an integral part of it. Questions such as ‘how do I write a multiple choice item? Become more important than ‘what effect does multiple choice questioning have on the learning outcomes of my students?’” “Assessment is something that follows learning , so there is no need to consider its function as a means of helping students to learn through diagnosing their errors and misconceptions and reinforcing their correct understanding” (Ramsden 2003).
How it should be used “The teacher with a developed understanding of assessment will strive to connect his or her goals for learning firmly with the assessment strategies he or she uses...This teacher will also be thinking carefully about the related need to assess students values and commitments to the subject area. These...are too rarely addressed.” (Ramsden 2003) “What the forms [of assessment] have in common is that they should be designed as a coherent part of the curriculum. They should each be designed to test specific learning outcomes, and all learning outcomes of the course...should be assessed” (Merricks 2002) “Just as we should inform our choice of teaching methods by the nature of the subject matter we are teaching, so in our choice of assessment methods we should consider our goals for student learning. It is particularly important to match the whole experience of assessment with what the programme is trying to achieve and the culture it is trying to create. This will require innovation and a wider variety of modes than we currently employ.” (Light & Cox 2001)
“To be effective, assessment will need to reflect programme content and be valid, reliable and fair.”  (Wakeford1999)
Valid...or appropriate Face validity – appropriateness of the content of a test for the audience and level used. Construct validity – nature of broader constructs tested e.g. Recall of knowledge, demonstration of teamwork skills i.e. Are you testing what has been taught.  Impact validity – what impact the assessment has on the behaviour of learners, is it shaped to what is being assessed.  (Wakeford1999)
Reliable...or accurate & consistent “To what extent would the same results have been achieved with a similar, parallel form of the same test?” (Wakeford1999) e.g.’s of unreliability: Inadequate test length Inconsistency of individual examiners Inconsistency across examiners Inadequacy of test for subject
Fair Fairness – to all individuals and groups of individuals (possible differences based on gender, learning needs etc.)  Wakeford 1999) Assessments needs to be accurate...it is pointless and unfair to students otherwise.  Consider the use of multiple assessment methods to counter possible bias associated with individual methods.
Good practice QAA reviews 1998-2000 asked: How effective are the assessment design and practice in terms of: ,[object Object]
Promoting learning (including the quality of feedback to students);
Measuring attainment of the intended learning outcomes;
Appropriateness to the student profile, level and mode of study;
Consistency and rigour of marking
Evidence of internal moderation and scrutiny by external examiners?
They have since been expanded upon and detailed within ‘code of practice for the assurance of academic quality and standards in higher education’ section 6 – assessment of students (2006),[object Object]
Practical Projects (Annabelle)
Clickers? (Eyad)

More Related Content

What's hot

Teacher's competences
Teacher's competencesTeacher's competences
Teacher's competences
gueste538c3
 

What's hot (20)

Objective Types of test...
Objective Types of test...Objective Types of test...
Objective Types of test...
 
Teacher's competences
Teacher's competencesTeacher's competences
Teacher's competences
 
Learner profile
Learner profileLearner profile
Learner profile
 
Subjective test
Subjective testSubjective test
Subjective test
 
School Based Assessment (SBA)
School Based Assessment (SBA)School Based Assessment (SBA)
School Based Assessment (SBA)
 
Formative & summative evaluation
Formative & summative evaluationFormative & summative evaluation
Formative & summative evaluation
 
The Role of Politics in Curriculum Decision Making
The Role of Politics in Curriculum Decision MakingThe Role of Politics in Curriculum Decision Making
The Role of Politics in Curriculum Decision Making
 
Curriculum Development - models
Curriculum Development - modelsCurriculum Development - models
Curriculum Development - models
 
Assessment Approaches: Quantitative and Qualitative Assessment
Assessment Approaches: Quantitative and Qualitative AssessmentAssessment Approaches: Quantitative and Qualitative Assessment
Assessment Approaches: Quantitative and Qualitative Assessment
 
Selection and organization of learning experience
Selection and organization of learning experienceSelection and organization of learning experience
Selection and organization of learning experience
 
Nature of curriculum need and importance of curriculum development
Nature of curriculum need and importance of curriculum developmentNature of curriculum need and importance of curriculum development
Nature of curriculum need and importance of curriculum development
 
NON-SCIENTIFIC MODELS OF CURRICULUM DEVELOPMENT
NON-SCIENTIFIC MODELS OF CURRICULUM DEVELOPMENT NON-SCIENTIFIC MODELS OF CURRICULUM DEVELOPMENT
NON-SCIENTIFIC MODELS OF CURRICULUM DEVELOPMENT
 
Topic (1)
Topic (1)Topic (1)
Topic (1)
 
Total quality management in teacher education
Total quality management in teacher educationTotal quality management in teacher education
Total quality management in teacher education
 
Ppt.oral questioning & peer appraisal
Ppt.oral questioning & peer appraisalPpt.oral questioning & peer appraisal
Ppt.oral questioning & peer appraisal
 
Characteristics of a Good Curriculum
Characteristics of a Good Curriculum Characteristics of a Good Curriculum
Characteristics of a Good Curriculum
 
Role of motivation
Role of motivationRole of motivation
Role of motivation
 
PHILOSOPHICAL FOUNDATIONS OF CURRICULUM
PHILOSOPHICAL FOUNDATIONS OF CURRICULUMPHILOSOPHICAL FOUNDATIONS OF CURRICULUM
PHILOSOPHICAL FOUNDATIONS OF CURRICULUM
 
LESSON PLAN
LESSON PLAN LESSON PLAN
LESSON PLAN
 
Research in education
Research in educationResearch in education
Research in education
 

Similar to Assessment - Process

Assessment: Grading & Student Evaluation
Assessment: Grading & Student EvaluationAssessment: Grading & Student Evaluation
Assessment: Grading & Student Evaluation
Eddy White, Ph.D.
 
Assessment - Product
Assessment - ProductAssessment - Product
Assessment - Product
stomaskovic
 
competencyFormulate, express, and support individual perspective.docx
competencyFormulate, express, and support individual perspective.docxcompetencyFormulate, express, and support individual perspective.docx
competencyFormulate, express, and support individual perspective.docx
ardhowp
 
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
Language Acquisition Resource Center
 
Evaluacón ILE Introduction to the Course
Evaluacón ILE Introduction to the CourseEvaluacón ILE Introduction to the Course
Evaluacón ILE Introduction to the Course
songoten77
 

Similar to Assessment - Process (20)

Postdoc Teaching Day workshop on assessment design Oct 2018
Postdoc Teaching Day workshop on assessment design Oct 2018Postdoc Teaching Day workshop on assessment design Oct 2018
Postdoc Teaching Day workshop on assessment design Oct 2018
 
Assessment: Grading & Student Evaluation
Assessment: Grading & Student EvaluationAssessment: Grading & Student Evaluation
Assessment: Grading & Student Evaluation
 
Assessment
AssessmentAssessment
Assessment
 
Assessment - Product
Assessment - ProductAssessment - Product
Assessment - Product
 
Assessment (1)
Assessment (1)Assessment (1)
Assessment (1)
 
Pollyana Magne "Inclusive Assessment"
Pollyana Magne "Inclusive Assessment"Pollyana Magne "Inclusive Assessment"
Pollyana Magne "Inclusive Assessment"
 
Ash edu 645 week 6 final paper curriculum based summative assessment design (...
Ash edu 645 week 6 final paper curriculum based summative assessment design (...Ash edu 645 week 6 final paper curriculum based summative assessment design (...
Ash edu 645 week 6 final paper curriculum based summative assessment design (...
 
Ash edu 645 week 6 final paper curriculum based summative assessment design (...
Ash edu 645 week 6 final paper curriculum based summative assessment design (...Ash edu 645 week 6 final paper curriculum based summative assessment design (...
Ash edu 645 week 6 final paper curriculum based summative assessment design (...
 
Assessment
AssessmentAssessment
Assessment
 
15366790.pdf
15366790.pdf15366790.pdf
15366790.pdf
 
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
 
Assessment
AssessmentAssessment
Assessment
 
Assessment for learning chapter 1 - copy-converted
Assessment for learning chapter 1  - copy-convertedAssessment for learning chapter 1  - copy-converted
Assessment for learning chapter 1 - copy-converted
 
competencyFormulate, express, and support individual perspective.docx
competencyFormulate, express, and support individual perspective.docxcompetencyFormulate, express, and support individual perspective.docx
competencyFormulate, express, and support individual perspective.docx
 
Summative Evaluation
Summative EvaluationSummative Evaluation
Summative Evaluation
 
ProfEd7reportf.pptx
ProfEd7reportf.pptxProfEd7reportf.pptx
ProfEd7reportf.pptx
 
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
 
Feedback on summative assessment group pres
Feedback on summative assessment group presFeedback on summative assessment group pres
Feedback on summative assessment group pres
 
Evaluacón ILE Introduction to the Course
Evaluacón ILE Introduction to the CourseEvaluacón ILE Introduction to the Course
Evaluacón ILE Introduction to the Course
 
Assessment for learning by Dr. Goggi gupta
Assessment for learning by Dr. Goggi guptaAssessment for learning by Dr. Goggi gupta
Assessment for learning by Dr. Goggi gupta
 

Recently uploaded

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 

Recently uploaded (20)

Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 

Assessment - Process

  • 1. Assessment “Assessment is the measure of student learning...the process of obtaining information about how much the student knows...[and] using that information to form judgements which in turn are to be used in decision making” (Reece & Walker 2007 p35) Assessment “is an integral component of the teaching and learning system [it] may be used explicitly to guide students in their study. But also, student perceptions of what is rewarded and what is ignored...will have a substantial impact on their learning behaviour” (Wakeford 1999 p58)
  • 2. Summative Assessment “Summative assessment is used to indicate the extent of a learner's success in meeting the assessment criteria used to gauge the intended learning outcomes of a module or programme.” (UK QAA 2006) “Any assessment activity which results in a mark or grade which is subsequently used as a judgement on student performance. Ultimately judgements using summative assessment marks will be used to determine the classification of award at the end of a course or programme.” (Irons 2008 p7)
  • 3. Purpose “Assessment is fundamentally about helping students to learn and teachers to learn about how best to teach them.” (Ramsden 2003 p177) “What is assessed? The simple answer to this question should be learning – of the student, the teacher and the institution.” (Merricks 2002 p167) Why assess? To classify students – are they worthy of the award? To diagnose students – do they need help? To encourage and support learning - individually and generally. (Ellis 2001 p38)
  • 4. Purpose Students expect it and are motivated by it! To diagnose learning To certificate learning To provide feedback To help remedy mistakes To help with option choice and selection To help diagnose faults To provide performance indicators for students and enable final award grading To ensure the learning outcomes for different awards and programmes are met To provide performance indicator for staff To provide performance indicator for course and institution We have always done it (Merricks 2002)
  • 5. Impacts “Assessment activities shape students idea of curriculum – what do I need to learn?” (Ramsden 2003) “Assessment is an integral component of the teaching and learning system...explicitly to guide students in their study...student perceptions of what is rewarded and what is ignored...will have a substantial impact on their learning behaviour” (Wakeford 1999)
  • 6. Impacts Curriculum and teaching Teaching to test (at expense of curriculum content; distorted teaching techniques; time consuming – does not directly improve learning; encourages didactic transmission style. Effects on motivation On lower / higher achieving students; anxiety; does motivate some students; promotes extrinsic, no intrinsic motivation;
  • 7. How its used “Assessment often seen as an addition to teaching rather than an integral part of it. Questions such as ‘how do I write a multiple choice item? Become more important than ‘what effect does multiple choice questioning have on the learning outcomes of my students?’” “Assessment is something that follows learning , so there is no need to consider its function as a means of helping students to learn through diagnosing their errors and misconceptions and reinforcing their correct understanding” (Ramsden 2003).
  • 8. How it should be used “The teacher with a developed understanding of assessment will strive to connect his or her goals for learning firmly with the assessment strategies he or she uses...This teacher will also be thinking carefully about the related need to assess students values and commitments to the subject area. These...are too rarely addressed.” (Ramsden 2003) “What the forms [of assessment] have in common is that they should be designed as a coherent part of the curriculum. They should each be designed to test specific learning outcomes, and all learning outcomes of the course...should be assessed” (Merricks 2002) “Just as we should inform our choice of teaching methods by the nature of the subject matter we are teaching, so in our choice of assessment methods we should consider our goals for student learning. It is particularly important to match the whole experience of assessment with what the programme is trying to achieve and the culture it is trying to create. This will require innovation and a wider variety of modes than we currently employ.” (Light & Cox 2001)
  • 9. “To be effective, assessment will need to reflect programme content and be valid, reliable and fair.” (Wakeford1999)
  • 10. Valid...or appropriate Face validity – appropriateness of the content of a test for the audience and level used. Construct validity – nature of broader constructs tested e.g. Recall of knowledge, demonstration of teamwork skills i.e. Are you testing what has been taught. Impact validity – what impact the assessment has on the behaviour of learners, is it shaped to what is being assessed. (Wakeford1999)
  • 11. Reliable...or accurate & consistent “To what extent would the same results have been achieved with a similar, parallel form of the same test?” (Wakeford1999) e.g.’s of unreliability: Inadequate test length Inconsistency of individual examiners Inconsistency across examiners Inadequacy of test for subject
  • 12. Fair Fairness – to all individuals and groups of individuals (possible differences based on gender, learning needs etc.) Wakeford 1999) Assessments needs to be accurate...it is pointless and unfair to students otherwise. Consider the use of multiple assessment methods to counter possible bias associated with individual methods.
  • 13.
  • 14. Promoting learning (including the quality of feedback to students);
  • 15. Measuring attainment of the intended learning outcomes;
  • 16. Appropriateness to the student profile, level and mode of study;
  • 18. Evidence of internal moderation and scrutiny by external examiners?
  • 19.
  • 24. Making summative assessment effective Certain principles can inform the effective use of summative assessment of coursework.  These principles are seen as ways of encouraging skills and attitudes for lifelong learning. “Intrinsic” interest in tasks can be encouraged Pupil awareness of learning goals rather than test performance goals can be developed A wide range of types of understanding can be included in summative assessment Some formative assessment evidence may be included in summative reports Peer- and self-assessment could be included in summative records Tests don’t need to be formal written assessments The comparison of individual pupils on the basis of scores can be avoided Summative tests can be placed before the end of a teaching block so that there is some opportunity for follow-up based on the results, and even reassessment
  • 25. Making summative assessment effective Summative judgements can be made on the basis of a variety of tests (varied both in form and content) Pupils could carry forward lessons from assessments even into the next school session (eg in the form of a copy of their school report) Feedback can be given to pupils in terms of the learning goals rather than just a test mark Tests might be devised to assess separate elements of the course separately In practising for summative assessment, pupils can make up and answer their own questions.  (Research has shown this to be an effective strategy) Tests can be timed according to pupil readiness rather than leaving them to the end of the block of work Summative assessment can be presented to pupils realistically, as being limited Tests can provide evidence for evaluating courses and teaching approaches Whole-school discussion of such assessment principles can be helpful
  • 26. Conclusion “...the more you can bring teaching, learning, and assessment together; the more successful you and your students will become in knowing how and to what extent meaningful progress is being made (Ellis 2001 p38).”