SlideShare a Scribd company logo
1 of 32
DEFINITION OF LEARNING JOURNAL

   Learning journal is “writing that is done progressively
    and regularly by students during a course, as a
    record of their learning” (Crème, 2005)

   Learning journal is a kind of self narrated
    development (Crème, 2005)

   Progressive learning journal is different from
    „reflective writing‟ where students relate theory to
    examples of their practice (Stierer, 2000) as in
    „reflection-in-action‟. However,
DEFINITION OF LEARNING JOURNAL

 Learning journals (more personal) = “You
  + course materials” (Crème & Lea, 2003)
 It tells a story of writer‟s engagement with
  course material & processes

   Learning journals always contain some
    element of writer self reflection as an aim
    (Qualley 1997, cited in Crème 2005)
Assessment & reflection
CRÈME STATES 2 DIFFERING OPINIONS ON
ASSESSING LEARNING JOURNALS –

   Recognize and value different ways of constructing
    and writing knowledge

 Assessment may undermine the very qualities that
  we value in a journal
[Students draw reflexively on their learning journal in
order to develop further their writing and learning]

Crème suggests a compromise that we use a range
of formative kinds of assessment for the journals
and then assess summatively a new final product.
Assessment & Reflection

KEMBER ET AL (2008)
FISHER (2003)
SCOPE

   Summary of Kember et al (2008) paper
     Comments

   Summary of Fisher (2003) paper
     Comments
KEMBER EL AL (2008)
 Context – Professional Degrees


                                  Promote
  Course Aim                           Critical Reflection
                                  Reflective
                                  PracticesReflection



                                              Understanding



                    Assessment        Habitual Action / Non reflection
DEFINITION OF REFLECTION (P1-2)

 Observed by Atkins and Murphy (1993), and by Sparkes-Langers et al (1990)
                            and among others




             “Formal Definition are not easy
                        to find”
DEFINITION OF REFLECTION (P1-2)
                                           King and
                                           Kitchene
                                               r
                                            (1994)
                                          Jarvis
                                    (1987, 1992, 1995)
  Dewey
  (1933)   Mezirow (1981, 1991, 1992)




1930s         Schon (1983, 1987)                         Kember et al.   Now
                                                         (2001, 2008)
                      Boud and
                    collaborators
                    (1985, 1991)
SYNTHESIZED DEFINITION (P2)

 Ill-define problem
 Through stimuli
     Triggered   by unusual case
     Arranged

   Revisit experience
     Re-examination   & evaluation belief and
      knowledge
   Looking back (ROA)
SYNTHESIZED DEFINITION (P2)

 Reflect while doing (RIA)
 Few levels for reflection
     Highest   level => new belief structure
   New perspective formed
     Takes   time (initial observation to conclusion)
DERIVING PROTOCOL (P3-4)

   Examine suitable scheme
               Proposer                        Evaluation

       Sparks-Langer et al. (1990)   Equated more to the linguistic
                                        structure of discourse
             Powell (1989)           No details of coding procedure
                                      and its reliability or validity.
          Hahnemann (1986)           Focus if answers to questions
                                     were correct, not evidence of
                                               reflection.

           Wong et al. (1995)        2-stage process makes scheme
                                            harder to employ

          Kember et al. (1999)         7 categories were too fine-
                                                grained.
DERIVING PROTOCOL (P3-4)

   Proposed 4 Categories
    protocol
                  Critical Reflection             Based on
                                                   Kember et al.
                      Reflection                   (2000)
                                                   questionnaire
                    Understanding


            Habitual Action / Non reflection
                                                  Empirical
                                                   evidence viable
                                                   scheme to
                                                   access
DESCRIPTION OF 4 CATEGORIES (P4-6)

   Habitual action / non-reflection
     Do without thinking (procedures)
     E.g. Professional practice
        Expertdoing routine task
        Novice strictly following steps

     E.g.   Education
        Answer  without trying to understand concept behind
        Completing essay by piecing information without trying
         to understand it, or forming a view.
DESCRIPTION OF 4 CATEGORIES (P4-6)

   Understanding
     Tryto reach an understanding of a concept.
     Concepts are understood as theory
       No personal meaning making
       Retention period may be limited.

     Writing   rely on textbook or the lecture notes
DESCRIPTION OF 4 CATEGORIES (P4-6)

   Reflection
     Concepts  are infused with personal experiences
      and knowledge.
     Theory applied to practical applications.

     Personal insights beyond theory provided by
      book.
DESCRIPTION OF 4 CATEGORIES (P4-6)

   Critical Reflection
     Change    of perspective
        Manyactions are governed by beliefs and values, to
        undergone change in perspective requires people to
        recognize and change these presumptions.
     Seldom    occur
        Especially   topic is the main activities
VALIDITY AND RELIABILITY

   Validity
     categories    is derived from extensive body of
      literature.
   Reliability
    4 independent assessor using it.
     Results of assessment shows good agreement
      among them.
USING PROTOCOL

 Assess whole paper
 Find highest level of reflection
USES OF PROTOCOL

 Journal
 Essays

 Online discussion

 Evaluation & research purposes (measure
  reflection as outcome)
COMMENTS
   Kember et al. (2008) attempt to show that their
    proposal is valid in view of the numerous
    references quote.
     However, there are biasness displayed with the
      usage of references
     References quote seems to be in the same
      community
     May make the validity of his proposal looks as “not
      so valid”.
   Kember‟s perspective is skew toward Reflection
    on Action (ROA).
COMMENTS
   Cross examining Kember et al. (2008) paper with Tan
    (2008) paper, seems to show that
       Authors‟ perspective of reflection is towards the notion of
        performative reflection (emphasis on certainty in process and
        outcome of reflection).
       The protocol proposed, we think it is used as complement to
        reflective activities.

   Under the critical reflection category, one of descriptor
    “Critical reflection is unlikely to occur frequently”. It is
    used to assess the level of reflection.
       It does not seems to be “correct”. As I would question, what
        does “unlikely to occur frequently” have to do with the level of
        reflection?
FISHER (2003)
   Context:
       Tertiary Education
          Social Science and Humanities (Economics)
          Emancipatory Educative Practices (liberal)
          Action research study into emancipator teaching of
           economics to social welfare & social science students
               Interest to define critical reflection.
 Offer suggestion on criteria for Critical
  Reflection (CR)
 Mentioned on the diverse views on the definition
  of reflection
DERIVING CRITICAL REFLECTION CRITERIA
   Approaches
     Review literature of CR in adult learning.
     Note gaps relation to definition and process.
     Examine multiple perspectives of CR to gain better
      understanding of CR concept.
         Examining   assumptions and beliefs
         Ideology critique.
         Mezirow‟s perspective transformation
         Brookfield‟s contextual awareness & imaginative
          speculation
         Barnett‟s Critical Being (Knowledge, Self and Action =>
          Critical Thinking, Critical Self Reflection, Critical Action)
         Brockbank and McGill‟s reflective dialogue
DERIVING CRITICAL REFLECTION CRITERIA

   Fisher “insights” on important indicators of
    capacity for CR from literature review
     Articulate contextual awareness of own position
      through identify impact own influences and
      background
     Identify own value, belief and assumptions

     Consider alternative views

     Identify own view‟s biasness that may privilege
      certain viewpoints.
     Able envision alternatives / possibilities
DERIVING CRITICAL REFLECTION CRITERIA

   Apply insight towards Research
     Conduct    research based on derived “insights” on
      BSc Social Science at Southern Cross University
     Set 2 assignments that requires students to do
      critical reflections.
     Students are briefed on what constitute towards
      critical reflections prior to their assignment.
     Post-course analysis of the students‟ reflection
      aid Fisher to derive the Cr criteria.
Assessment & reflection
FISHER’S CONCLUSION

   Teachers need to give clear guidance on
    requirements of CR
     Provide feedback on how to improve reflective
      capacities
   Argue against being labeled for taking
    “reductionist approach”
     IfCR is essential to fostering transformative
      learning, transparent criteria may prove
      important
COMMENTS
   For criteria derived based on the CR from the
    students, there might be possibilities that
    students are still not clear about requirements of
    CR even after explanation, thus skewing the
    results, that in turn affect the post-course
    analysis.

   The criteria derived seem to have some overlap.
    For example, would biases and missing
    perspective be similar where students identify
    missing perspective, can also infer identification
    of biases also?
COMMENTS
    We think that the process of bringing students through
    the “mechanics” of reflection (e.g. requirements of
    CR, etc) upfront prior to the assignment would provide a
    better scaffold for student to conduct their reflection.

   We agree with the author that to improve the students
    capacities for CR, transparency of the requirements of
    CR, and feedback on how to improved reflective
    capacities are important.
       While is it reductionist in nature, but it does address the
        “component” part of what constitute to reflective capacities.
       However, with that said, the criteria proposed needs to be
        clearly articulated to the teachers assessing, and students
        using the assessment.
COMMENTS

   Similar to Kember, Fisher‟s perspective is
    nearer to the notion of Reflection on Action.

   Fisher‟s criteria may be infused into the 4th
    Category of Kember‟s protocol to more
    robust.
QUESTION

   What is (are) your opinion (s) on the
    usefulness of the protocol or criteria provided
    in your assessment of the reflection?
     Restrictive?

     Helpfulin guiding thoughts?
     Can be improved? Which part?

More Related Content

Similar to Assessment & reflection

Qualitative research method
Qualitative research methodQualitative research method
Qualitative research methodmetalkid132
 
UiU research seminar 3 sep 2012
UiU research seminar 3 sep 2012UiU research seminar 3 sep 2012
UiU research seminar 3 sep 2012Ahmad Faisal
 
Critical Reflection And The Reflective Practitioner
Critical Reflection And The Reflective PractitionerCritical Reflection And The Reflective Practitioner
Critical Reflection And The Reflective PractitionerYan Karaliotas
 
Collaborative Task - Gibbs Model of Reflection
Collaborative Task - Gibbs Model of ReflectionCollaborative Task - Gibbs Model of Reflection
Collaborative Task - Gibbs Model of ReflectionNovie Isaac
 
English 2 8-12
English 2 8-12English 2 8-12
English 2 8-12DRossNCSU
 
Action research final copy
Action research   final copyAction research   final copy
Action research final copyTrudy Keil
 
Higher order thinking skills
Higher order thinking skillsHigher order thinking skills
Higher order thinking skillsJRNRV Udaipur
 
Qualitative research introduction for newly researcher
Qualitative research introduction for  newly researcherQualitative research introduction for  newly researcher
Qualitative research introduction for newly researcherlarrydepina2
 
Resource Parts I, II and III of the Wren (1995) text, SAS Central.docx
Resource Parts I, II and III of the Wren (1995) text, SAS Central.docxResource Parts I, II and III of the Wren (1995) text, SAS Central.docx
Resource Parts I, II and III of the Wren (1995) text, SAS Central.docxcarlstromcurtis
 
Literature review
Literature reviewLiterature review
Literature reviewtungnth
 
Slides reflective practice2020
Slides reflective practice2020Slides reflective practice2020
Slides reflective practice2020hullpgce
 

Similar to Assessment & reflection (20)

Qualitative research method
Qualitative research methodQualitative research method
Qualitative research method
 
UiU research seminar 3 sep 2012
UiU research seminar 3 sep 2012UiU research seminar 3 sep 2012
UiU research seminar 3 sep 2012
 
Critical Reflection And The Reflective Practitioner
Critical Reflection And The Reflective PractitionerCritical Reflection And The Reflective Practitioner
Critical Reflection And The Reflective Practitioner
 
Critical writing + first part of session
Critical writing + first part of sessionCritical writing + first part of session
Critical writing + first part of session
 
2010 01 psyf 588 master syllabus
2010 01 psyf 588 master syllabus2010 01 psyf 588 master syllabus
2010 01 psyf 588 master syllabus
 
Collaborative Task - Gibbs Model of Reflection
Collaborative Task - Gibbs Model of ReflectionCollaborative Task - Gibbs Model of Reflection
Collaborative Task - Gibbs Model of Reflection
 
Action Research Seminar
Action Research SeminarAction Research Seminar
Action Research Seminar
 
English 2 8-12
English 2 8-12English 2 8-12
English 2 8-12
 
Online assingment
Online assingmentOnline assingment
Online assingment
 
Online assingment
Online assingmentOnline assingment
Online assingment
 
Online assignment
Online assignmentOnline assignment
Online assignment
 
Action research final copy
Action research   final copyAction research   final copy
Action research final copy
 
Higher order thinking skills
Higher order thinking skillsHigher order thinking skills
Higher order thinking skills
 
2010 10-06+eb lv01
2010 10-06+eb lv012010 10-06+eb lv01
2010 10-06+eb lv01
 
Reflective practice
Reflective practiceReflective practice
Reflective practice
 
Qualitative research introduction for newly researcher
Qualitative research introduction for  newly researcherQualitative research introduction for  newly researcher
Qualitative research introduction for newly researcher
 
Resource Parts I, II and III of the Wren (1995) text, SAS Central.docx
Resource Parts I, II and III of the Wren (1995) text, SAS Central.docxResource Parts I, II and III of the Wren (1995) text, SAS Central.docx
Resource Parts I, II and III of the Wren (1995) text, SAS Central.docx
 
Literature review
Literature reviewLiterature review
Literature review
 
Slides reflective practice2020
Slides reflective practice2020Slides reflective practice2020
Slides reflective practice2020
 
Reasoning Skills
Reasoning SkillsReasoning Skills
Reasoning Skills
 

Recently uploaded

Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphNetziValdelomar1
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...raviapr7
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptxraviapr7
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxEduSkills OECD
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxMYDA ANGELICA SUAN
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxDr. Santhosh Kumar. N
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational PhilosophyShuvankar Madhu
 
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxAUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxiammrhaywood
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxraviapr7
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...Nguyen Thanh Tu Collection
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17Celine George
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
How to Solve Singleton Error in the Odoo 17
How to Solve Singleton Error in the  Odoo 17How to Solve Singleton Error in the  Odoo 17
How to Solve Singleton Error in the Odoo 17Celine George
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17Celine George
 

Recently uploaded (20)

Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a Paragraph
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptx
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptx
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational Philosophy
 
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxAUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptx
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
How to Solve Singleton Error in the Odoo 17
How to Solve Singleton Error in the  Odoo 17How to Solve Singleton Error in the  Odoo 17
How to Solve Singleton Error in the Odoo 17
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17
 

Assessment & reflection

  • 1. DEFINITION OF LEARNING JOURNAL  Learning journal is “writing that is done progressively and regularly by students during a course, as a record of their learning” (Crème, 2005)  Learning journal is a kind of self narrated development (Crème, 2005)  Progressive learning journal is different from „reflective writing‟ where students relate theory to examples of their practice (Stierer, 2000) as in „reflection-in-action‟. However,
  • 2. DEFINITION OF LEARNING JOURNAL  Learning journals (more personal) = “You + course materials” (Crème & Lea, 2003)  It tells a story of writer‟s engagement with course material & processes  Learning journals always contain some element of writer self reflection as an aim (Qualley 1997, cited in Crème 2005)
  • 4. CRÈME STATES 2 DIFFERING OPINIONS ON ASSESSING LEARNING JOURNALS –  Recognize and value different ways of constructing and writing knowledge  Assessment may undermine the very qualities that we value in a journal [Students draw reflexively on their learning journal in order to develop further their writing and learning] Crème suggests a compromise that we use a range of formative kinds of assessment for the journals and then assess summatively a new final product.
  • 5. Assessment & Reflection KEMBER ET AL (2008) FISHER (2003)
  • 6. SCOPE  Summary of Kember et al (2008) paper  Comments  Summary of Fisher (2003) paper  Comments
  • 7. KEMBER EL AL (2008) Context – Professional Degrees Promote Course Aim Critical Reflection Reflective PracticesReflection Understanding Assessment Habitual Action / Non reflection
  • 8. DEFINITION OF REFLECTION (P1-2) Observed by Atkins and Murphy (1993), and by Sparkes-Langers et al (1990) and among others “Formal Definition are not easy to find”
  • 9. DEFINITION OF REFLECTION (P1-2) King and Kitchene r (1994) Jarvis (1987, 1992, 1995) Dewey (1933) Mezirow (1981, 1991, 1992) 1930s Schon (1983, 1987) Kember et al. Now (2001, 2008) Boud and collaborators (1985, 1991)
  • 10. SYNTHESIZED DEFINITION (P2)  Ill-define problem  Through stimuli  Triggered by unusual case  Arranged  Revisit experience  Re-examination & evaluation belief and knowledge  Looking back (ROA)
  • 11. SYNTHESIZED DEFINITION (P2)  Reflect while doing (RIA)  Few levels for reflection  Highest level => new belief structure  New perspective formed  Takes time (initial observation to conclusion)
  • 12. DERIVING PROTOCOL (P3-4)  Examine suitable scheme Proposer Evaluation Sparks-Langer et al. (1990) Equated more to the linguistic structure of discourse Powell (1989) No details of coding procedure and its reliability or validity. Hahnemann (1986) Focus if answers to questions were correct, not evidence of reflection. Wong et al. (1995) 2-stage process makes scheme harder to employ Kember et al. (1999) 7 categories were too fine- grained.
  • 13. DERIVING PROTOCOL (P3-4)  Proposed 4 Categories protocol Critical Reflection  Based on Kember et al. Reflection (2000) questionnaire Understanding Habitual Action / Non reflection  Empirical evidence viable scheme to access
  • 14. DESCRIPTION OF 4 CATEGORIES (P4-6)  Habitual action / non-reflection  Do without thinking (procedures)  E.g. Professional practice  Expertdoing routine task  Novice strictly following steps  E.g. Education  Answer without trying to understand concept behind  Completing essay by piecing information without trying to understand it, or forming a view.
  • 15. DESCRIPTION OF 4 CATEGORIES (P4-6)  Understanding  Tryto reach an understanding of a concept.  Concepts are understood as theory  No personal meaning making  Retention period may be limited.  Writing rely on textbook or the lecture notes
  • 16. DESCRIPTION OF 4 CATEGORIES (P4-6)  Reflection  Concepts are infused with personal experiences and knowledge.  Theory applied to practical applications.  Personal insights beyond theory provided by book.
  • 17. DESCRIPTION OF 4 CATEGORIES (P4-6)  Critical Reflection  Change of perspective  Manyactions are governed by beliefs and values, to undergone change in perspective requires people to recognize and change these presumptions.  Seldom occur  Especially topic is the main activities
  • 18. VALIDITY AND RELIABILITY  Validity  categories is derived from extensive body of literature.  Reliability 4 independent assessor using it.  Results of assessment shows good agreement among them.
  • 19. USING PROTOCOL  Assess whole paper  Find highest level of reflection
  • 20. USES OF PROTOCOL  Journal  Essays  Online discussion  Evaluation & research purposes (measure reflection as outcome)
  • 21. COMMENTS  Kember et al. (2008) attempt to show that their proposal is valid in view of the numerous references quote.  However, there are biasness displayed with the usage of references  References quote seems to be in the same community  May make the validity of his proposal looks as “not so valid”.  Kember‟s perspective is skew toward Reflection on Action (ROA).
  • 22. COMMENTS  Cross examining Kember et al. (2008) paper with Tan (2008) paper, seems to show that  Authors‟ perspective of reflection is towards the notion of performative reflection (emphasis on certainty in process and outcome of reflection).  The protocol proposed, we think it is used as complement to reflective activities.  Under the critical reflection category, one of descriptor “Critical reflection is unlikely to occur frequently”. It is used to assess the level of reflection.  It does not seems to be “correct”. As I would question, what does “unlikely to occur frequently” have to do with the level of reflection?
  • 23. FISHER (2003)  Context:  Tertiary Education  Social Science and Humanities (Economics)  Emancipatory Educative Practices (liberal)  Action research study into emancipator teaching of economics to social welfare & social science students  Interest to define critical reflection.  Offer suggestion on criteria for Critical Reflection (CR)  Mentioned on the diverse views on the definition of reflection
  • 24. DERIVING CRITICAL REFLECTION CRITERIA  Approaches  Review literature of CR in adult learning.  Note gaps relation to definition and process.  Examine multiple perspectives of CR to gain better understanding of CR concept.  Examining assumptions and beliefs  Ideology critique.  Mezirow‟s perspective transformation  Brookfield‟s contextual awareness & imaginative speculation  Barnett‟s Critical Being (Knowledge, Self and Action => Critical Thinking, Critical Self Reflection, Critical Action)  Brockbank and McGill‟s reflective dialogue
  • 25. DERIVING CRITICAL REFLECTION CRITERIA  Fisher “insights” on important indicators of capacity for CR from literature review  Articulate contextual awareness of own position through identify impact own influences and background  Identify own value, belief and assumptions  Consider alternative views  Identify own view‟s biasness that may privilege certain viewpoints.  Able envision alternatives / possibilities
  • 26. DERIVING CRITICAL REFLECTION CRITERIA  Apply insight towards Research  Conduct research based on derived “insights” on BSc Social Science at Southern Cross University  Set 2 assignments that requires students to do critical reflections.  Students are briefed on what constitute towards critical reflections prior to their assignment.  Post-course analysis of the students‟ reflection aid Fisher to derive the Cr criteria.
  • 28. FISHER’S CONCLUSION  Teachers need to give clear guidance on requirements of CR  Provide feedback on how to improve reflective capacities  Argue against being labeled for taking “reductionist approach”  IfCR is essential to fostering transformative learning, transparent criteria may prove important
  • 29. COMMENTS  For criteria derived based on the CR from the students, there might be possibilities that students are still not clear about requirements of CR even after explanation, thus skewing the results, that in turn affect the post-course analysis.  The criteria derived seem to have some overlap. For example, would biases and missing perspective be similar where students identify missing perspective, can also infer identification of biases also?
  • 30. COMMENTS  We think that the process of bringing students through the “mechanics” of reflection (e.g. requirements of CR, etc) upfront prior to the assignment would provide a better scaffold for student to conduct their reflection.  We agree with the author that to improve the students capacities for CR, transparency of the requirements of CR, and feedback on how to improved reflective capacities are important.  While is it reductionist in nature, but it does address the “component” part of what constitute to reflective capacities.  However, with that said, the criteria proposed needs to be clearly articulated to the teachers assessing, and students using the assessment.
  • 31. COMMENTS  Similar to Kember, Fisher‟s perspective is nearer to the notion of Reflection on Action.  Fisher‟s criteria may be infused into the 4th Category of Kember‟s protocol to more robust.
  • 32. QUESTION  What is (are) your opinion (s) on the usefulness of the protocol or criteria provided in your assessment of the reflection?  Restrictive?  Helpfulin guiding thoughts?  Can be improved? Which part?