SlideShare a Scribd company logo
1 of 128
REAL Electronic Portfolios
      Reflection,
      Engagement, and
      Assessment for
      Learning
Balancing
“Portfolio as Test”
        with
“Portfolio as Story”
     Dr. Helen Barrett
Legacy from the Portfolio
           Literature
 Much to learn from the literature on
  paper-based portfolios
 As adult learners, we have much to
  learn from how children approach
  portfolios

“Everything I know about portfolios was
  confirmed working with a kindergartener”
The Power of
      Portfolios
   what children can teach us
   about learning and assessment

Author: Elizabeth Hebert
Publisher: Jossey-Bass
Picture courtesy of Amazon.com
The Power of Portfolios

Author:
  Dr.
  Elizabeth
  Hebert,
  Principal
Crow Island
  School,
  Winnetka,
  Illinois
Picture taken by
   Helen Barrett at
   AERA, Seattle,
   April, 2001
From the Preface (1)
      Hebert, Elizabeth (2001) The Power of Portfolios. Jossey-Bass, p.ix


     “Portfolios have been with us for a very long
time. Those of us who grew up in the 1950s or
earlier recognize portfolios as reincarnations of the
large memory boxes or drawers where our
parents collected starred spelling tests, lacy
valentines, science fair posters, early attempts at
poetry, and (of course) the obligatory set of plaster
hands. Each item was selected by our parents
because it represented our acquisition of a new
skill or our feelings of accomplishment. Perhaps
an entry was accompanied by a special notation of
praise from a teacher or maybe it was placed in
the box just because we did it.”
From the Preface (2)
    Hebert, Elizabeth (2001) The Power of Portfolios. Jossey-Bass, p.ix


    “We formed part of our identity from the
contents of these memory boxes. We
recognized each piece and its association with
a particular time or experience. We shared
these collections with grandparents to reinforce
feelings of pride and we reexamined them on
rainy days when friends were unavailable for
play. Reflecting on the collection allowed us
to attribute importance to these artifacts, and by
extension to ourselves, as they gave witness to
the story of our early school experiences.”
From the Preface (3)
    Hebert, Elizabeth (2001) The Power of Portfolios. Jossey-Bass, p.ix-x


    “Our parents couldn’t possibly envision
that these memory boxes would be the
inspiration for an innovative way of thinking
about children’s learning. These collections,
lovingly stored away on our behalf, are the
genuine exemplar for documenting
children’s learning over time. But now these
memory boxes have a different meaning.
It’s not purely private or personal, although
the personal is what gives power to what
they can mean.”
Let’s get personal…
  Think for a minute about:
Something about your COLLECTIONS:
  Suggested topics:
 If you are a parent, what you saved for

  your children
 What your parents saved for you

 What you collect…

 Why you collect…
Some issues to consider
     What do your collections say about what
      you value?
     Is there a difference between what you
      purposefully save and what you can’t
      throw away?
     How can we use our personal collections
      experiences to help learners as they
      develop their portfolios?

The power of portfolios [to support deep learning] is personal.
What is a Portfolio in
          Education?

A portfolio is a purposeful collection
of student work that exhibits the
student's efforts, progress and
achievements in one or more areas
[over time].
(Northwest Evaluation Association, 1990)
What is a Portfolio in Education?
               (2)
    The collection must include:
     student participation in
      selecting contents
     the criteria for selection

     the criteria for judging merit

     evidence of student self-
      reflection
     (Northwest Evaluation Association, 1990)
NLII e-Portfolio Definition
    a collection of authentic and diverse evidence,
   drawn from a larger archive representing what a
    person or organization has learned over time
   on which the person or organization has reflected,
    and
   designed for presentation to one or more
    audiences for a particular rhetorical purpose.
“The Blind Men and the Elephant”
        Thanks to Alan Levine
“The Blind Men and the
           Elephant”
 Eskimos  having 49 different
  words for “snow”
 Those who don’t live in that

  environment tend to see it all as
  the same cold white stuff
 Same goes with “portfolio”
Metaphors!
 Mirror, Map, Sonnet
 C.V. or Multimedia Resume

 Test

 Story


   Electronic Portfolio Organization
    (http://electronicportfolios.org/metaphors.html)
Purpose & Goals for the portfolio
     (Determine Content)

    Multiple   purposes:
     Learning/Process

     Assessment

     Marketing/Showcase
Think about the differences
          between:
 Learning  Portfolio and
  Portfolio Learning
 Assessment Portfolio and

  Portfolio Assessment
 Portfolio
         = Concept, Product,
 and Process
Learning Portfolios

    “know thyself” = a lifetime of investigation

   self-knowledge as outcome of learning
                      Reflection
                                   The Learning Portfolio
                                     (Zubizaretta, 2004,
                      Learning                     p.20)
                      Portfolio

      Documentation                 Collaboration
Learning Portfolios
   Support reflection which is central to learning

Reflections
     The     Heart and Soul of the Portfolio
   An electronic portfolio without reflection is just a
       Digital scrapbook
       Fancy electronic resume
       Multimedia Presentation
       Personal web site
Showcase Portfolios

 Marketing

 Employment

 Tell your story
 A primary motivator for many

  portfolio developers
Assessment Portfolios

A  major movement in Teacher
  Education in U.S.
 A major new commercial
  market
 A primary motivator for
  organizations More later!
                More later!
A few thoughts about
Assessment -- What Type?
Assessment       OF
 Learning? or
Assessment FOR
 Learning?
Assessment for Learning
  at www.qca.org.uk ages3-14
Principles of
    Assessment FOR Learning
   Definition:
    Assessment for Learning is the
    process of seeking and interpreting
    evidence for use by learners and
    their teachers to decide where the
    learners are in their learning, where
    they need to go and how best to get
    there.
Overlap of Assessment
        Types*


Assessment        Assessment
    OF               FOR
 Learning          Learning



             *Alberta Assessment Consortium
Portfolios used for
         Assessment OF Learning
   Purpose of portfolio prescribed by institution
   Artifacts mandated by institution to determine outcomes of
    instruction
   Portfolio usually developed at the end of a class, term or
    program - time limited
   Portfolio and/or artifacts usually "scored" based on a rubric and
    quantitative data is collected for external audiences
   Portfolio is usually structured around a set of outcomes, goals
    or standards
   Sometimes used to make high stakes decisions
   Summative - what has been learned to date? (Past to present)
   Requires Extrinsic motivation
   Audience: external - little choice
Portfolios that support
      Assessment FOR Learning
   Purpose of portfolio agreed upon with learner
   Artifacts selected by learner to tell the story of their learning
   Portfolio maintained on an ongoing basis throughout the
    class, term or program - time flexible
   Portfolio and artifacts reviewed with learner and used to
    provide feedback to improve learning
   Portfolio organization is determined by learner or negotiated
    with mentor/advisor/teacher
   Rarely used for high stakes decisions
   Formative - what are the learning needs in the future?
    (Present to future)
   Fosters Intrinsic motivation - engages the learner
   Audience: learner, family, friends - learner can choose
A Resource on
K-12 Portfolios
   By Evangeline Harris
    Stefanakis

   Published by
    Heinemann

   Includes a CD-ROM
    with examples of
    student portfolios
Assessment for Learning
                   Continuum - Enhanced
Stefanakis,
 Evangeline
 (2002) Multiple
 Intelligences
 and Portfolios.      Le a rning                                          A cco unta bility
 Portsmouth:
 Heinemann, p.

                               Reflection *
 136




                    Se lf Asse ssme nt                                  Sta nda rdize d Te sts

                       Informa l Fe e dba ck                Pe rforma nce Ba se d
                                         Rubrics
                                               Portfolios


                                           Observation *
Which approach should you take?

      Are you looking for an
     electronic portfolio…
   
     Or an assessment
     management system?
    What’s   the difference?
       Along a Continuum
Electronic Portfolio or
         Assessment Management System?
Electronic Portfolio                       Assessment Management System
Multiple purposes: Learning,               Single purpose: Formative and
Assessment, Employment                     Summative Assessment
Data structure varies with tools used to   Data structure most often uses a
create the portfolio; common data          relational database to record, report data
formats (converted to HTML, PDF)
Primary type of data: qualitative          Primary type of data: qualitative and
                                           quantitative
Data storage in multiple options:          Data storage primarily on LAN or on
CD-ROM, videotape, DVD, WWW                secure WWW server
server, LAN

Visual design and hyperlinks often         Visual design and hyperlinks most often
under control of portfolio developer       controlled by database structure
Learner choice of artifacts                Institutional choice of artifacts
Learner-Centered                           Institution-Centered
Electronic Portfolio or Assessment
      Management System?
What is your portfolio?

A  standardized checklist of
  skills? (Positivist)
or
 A reflective story of deep

  learning? (Constructivist)
Tension between two
             approaches
“ The two paradigms produce portfolio activities that
  are entirely different.”
“The positivist approach puts a premium on the
  selection of items that reflect outside standards
  and interests.”
“The constructivist approach puts a premium on the
  selection of items that reflect learning from the
  student’s perspective.”
                                 F. Leon Paulson & Pearl Paulson (1994)
                “Assessing Portfolios Using the Constructivist Paradigm”
                            in Fogarty, R. (ed.) (1996) Student Portfolios.
                              Palatine: IRI Skylight Training & Publishing
How can we address both
           types of portfolios?
Use three different systems that are
  digitally linked:
  I.     A digital archive of a learner’s work
  II.    An institution-centered database to
         collect faculty-generated assessment
         data based on tasks and rubrics
  III.   A student-centered electronic
         portfolio
Q ui kTi e™ and a
                                                           c m
                                              TI FFe( U
                                                 ar neededpr essed) t decom pr e.
                                                       ncom t o see hi pi t ur essor
                                                                       s c




                 Handout

   Image showing the conceptual
    relationships of assessment systems and
    electronic portfolios: balancing
    accountability with learning.
Begin Here




 Learning Experiences
embedded in curriculum
I
       I.
Digital Archive
  of Learner
   Artifacts
(Working Portfolio)
Interactive Process
  Evidence =
   +Artifacts
  +Reflection
  +Validation
Interactive Process

Performance                  Reflection
  Tasks &                   on Learning
                              (self-selected
Rubrics for                 artifacts for self-
 evaluation   Evidence =       evaluation)
               +Artifacts
              +Reflection
Assessor      +Validation         Learner
Q ui kTi e™ and a
                                                           c m
                                              TI FFe( U
                                                 ar neededpr essed) t decom pr e.
                                                       ncom t o see hi pi t ur essor
                                                                       s c




                 Handout

   Image showing the conceptual
    relationships of assessment systems and
    electronic portfolios: balancing
    accountability with learning.
Positivist
    Paradigm
   (Evaluation and
  Making Inferences)



Portfolio as Test
Assessor
EVALUATES
  required
  artifacts
Performance tasks and Rubrics
           for evaluation


Performance
  Tasks &
Rubrics for
 evaluation
Data collected for
  certification/
   licensure
 (high stakes)
     and for
  accreditation
II Assessment Management
          II.
System(institution-centered data
      management system)
      Assessment
      Management
        System
    (institution-centered
     data management
           system)
Resulting in…
Institution-centered
aggregated data
leading to
certification/licensure
and accreditation
Focus on
Limited-Term
 Evaluation
External Locus of
        Control
 Includes  prescribed
  artifacts and rubrics
 Requires database to
  manage information
 Focuses on faculty's
  formative and summative
  evaluations
Q ui kTi e™ and a
                                                           c m
                                              TI FFe( U
                                                 ar neededpr essed) t decom pr e.
                                                       ncom t o see hi pi t ur essor
                                                                       s c




                 Handout

   Image showing the conceptual
    relationships of assessment systems and
    electronic portfolios: balancing
    accountability with learning.
I.
Digital Archive ofPortfolio)
  I. Digital
             Archive
   Artifacts (Working
                      Learning


  of Learner
    Artifacts
 (Working Portfolio)
Constructivist
    Paradigm
  (Making Meaning and
 Assessment as Learning)



Portfolio as Story
Learner
 COLLECTS
artifacts from
   learning
 experiences
Reflection on Learning (self-selected artifacts for self-evaluation)




       Reflection
      on Learning
        (self-selected
      artifacts for self-
         evaluation)
Learner SELECTS
    artifacts and
reflections to meet
  self-determined
     purpose(s)
III.
   Electronic
 III. Electronic Portfolio(s)
(presentation portfolios for
 Portfolio(s)
      multiple purposes)

(presentation portfolios
 for multiple purposes)
Resulting in…
Student-centered
documentation of
deep learning,
for developing self-concept and
presentation to multiple
audiences (peers, employers, etc.)
Focus on
  Lifelong
Self-Directed
  Learning
Internal Locus of
        Control
 Includes  choice of artifacts
 Results in personalized

  e-portfolio
 Focuses on learner's

  celebration of uniqueness
Both approaches result in a:


           Balanced
        Balanced Assessment
          Assessment
          System
            System
Theory
A tale of two paper portfolios

                  High school
 High School      freshman in NY
 graduates in
 Washington        (Jim Mahoney, Power
                   and Portfolios
 state (and        published by
 Utah, too!)       Heinemann)
What’s the difference between
     those two stories?
 What  are the variables that
 produce these extremes in
 attitudes toward ownership
 of portfolios?
Activity Theory
Implications for human-computer
           interaction
 “Tools”-->
Cautions about Portfolio Use
                             (Lucas, 1992)

1.   The weakening of effect
     through careless imitation
2.   The failure of research to
     validate the pedagogy
3.   The co-option by large-scale
     external testing programs
     (Lucas, Catharine. 1992. Introduction: Writing Portfolios - Changes and
     Challenges. Portfolios in the Writing Classroom: An Introduction, ed.
     Kathleen Blake Yancey. Urbana, Illinois: NCTE: 1-11)
Lee Shulman’s 5 dangers
          of portfolios
                           1. "lamination"
                           2. "heavy lifting"
                           3. "trivialization"
                           4. "perversion"
Shulman, Lee (1998)

                           5. "misrepresentation"
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 dangers
          of portfolios
            1. "lamination"
             - a portfolio
             becomes a mere
             exhibition, a self-
             advertisement, to
Shulman, Lee (1998)
"Teacher Portfolios: A


             show off
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 dangers
          of portfolios
         2. "heavy lifting" - a
          portfolio done well
          is hard work. Is it
          worth the extra
          effort?
Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 dangers
          of portfolios
            3. "trivialization" -
             documenting
             stuff that isn't
             worth reflecting
Shulman, Lee (1998)



             upon
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 dangers
          of portfolios
          4. "perversion" - when used
           as a form of high stakes
           assessment “why will
           portfolios be more
           resistant to perversion
           than all other forms of
Shulman, Lee (1998)


           assessment have been?”
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 dangers
          of portfolios
              “…And if one of the requirements … is
                 that you develop a sufficiently
                 objective scoring system [for
                 portfolios] so you can fairly compare
                 people with one another, will your
                 scoring system end up objectifying
                 what's in the portfolio to the point
                 where the portfolio will be nothing but
                 a very, very cumbersome multiple
Shulman, Lee (1998)
"Teacher Portfolios: A
                 choice test?" (p. 35)
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 dangers
          of portfolios
                5. "misrepresentation"
                 - does "best work"
                 misrepresent
                 "typical work" -- not
                 a true picture of
Shulman, Lee (1998)
"Teacher Portfolios: A


                 competency
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Lee Shulman’s 5 benefits of portfolios
   1.            document longer episodes of teaching and
                 learning
       2. encourage the reconnection between process
                 and product.
                  - very best teaching portfolios contain
                 excerpts of student portfolios & highlight the
                 results of teaching that lead to student
                 learning.
       3.         institutionalize norms of collaboration,
                 reflection, and discussion
Shulman, Lee (1998)portable residency... introduces structure to
       4. a
"Teacher Portfolios:
A Theoretical the field experience
Activity" in N. Lyons
       5. (most important) shifts the agency from an
(ed.) With Portfolio
in Hand. (pp. 23-37)

College Press. observer back to the teacher interns...
New York: Teachers
Joanne Carney’s Dilemmas of
    Electronic Portfolios
1.   Multiple Purpose Dilemma
2.   Personal Revelation Dilemma
3.   Cognitive Overload Dilemma
4.   Self-Expression Dilemma
5.   Dead-End Dilemma
6.   Data-Aggregation Dilemma
Carney, Joanne (in development) “Campfires Around Which We Tell Our Stories:
    Confronting the Dilemmas of Teacher Portfolios and New Technologies”
Constructed Meaning


     "The portfolio is a
laboratory where students
construct meaning from their
accumulated experience."
(Paulson & Paulson, 1991, p.5)
Portfolio tells a Story
         "A portfolio tells a story.
It is the story of knowing. Knowing
about things... Knowing oneself...
Knowing an audience... Portfolios
are students' own stories of what
they know, why they believe they
know it, and why others should be of
the same opinion.”
(Paulson & Paulson, 1991, p.2)
Portfolios tell a Story

“A portfolio is opinion
backed by fact...
Students prove what
they know with samples
of their work.”
(Paulson & Paulson, 1991, p.2)
Linking Two Dynamic
Processes to Promote
   Deep Learning


Portfolio Development
        Process
 Digital Storytelling
ePortfolio as Storytelling

Image showing the relationships of the
  concepts of ePortfolios as a story of
  learning and the concepts of Digital
  storytelling as reflective portfolios
Portfolio Development Process


   Image showing the five processes of portfolio
     development: selection, collection,
     reflection, direction, and celebration.
Portfolio Processes
Traditional + Technology
 Collecting  Archiving

 Selecting    Linking/Thinking

 Reflecting  Storytelling

 Directing    Collaborating

 Celebrating  Publishing
Reflective Questions that tie the Past to the Future
Some concerns…
 Assessment     for Learning

 Portfolios   for Learning

 What   about Motivation?
Components of Portfolio
    Development
 Content
 Purpose
 Process
Components of Portfolio
     Development
Content:
evidence=
artifacts + reflections
+ validation
Components of Portfolio
       Development
Purpose:
the reason for developing the
portfolio – includes audience
  Learning& professional
   development - Process
  Assessment (of and for learning)

  Showcase
   (Employment/Marketing)
Components of Portfolio
       Development
Process:
 tools used
 sequence of activities
 rules
 evaluation criteria (rubrics)
  collaboration/conversation
Developmental Levels of
   Portfolio Implementation
 Extrinsic      Motivation
 –institutional directed content, purpose &
 process – external locus of control
 Mixed     Motivation
 –learner ownership over one or two of the
 components
 Intrinsic     Motivation
 —learner ownership of content, purpose
 and process
Learner Ownership and Control of
       Electronic Portfolio Development
                                                         D
                         Intrinsic                       E
                                                         G
 Motivation
  Motivation                             Process         R
Chart showing the growth of extrinsic                   E
                                                         E
 motivation to intrinsic motivation when                 O
 learner takes more control of learning
 Extrinsic
                    Purpose      Purpose
                                                         F

 process, purpose and contents.                          C
                                                         H
       Contents         Contents        Contents         O
                                                         I
                                                         C
ORGANIZATION CONTROL                 LEARNE CONT
                                           R    ROL      E

      Learner Control vs. Organizational Control
                    Assumption:
Greater Learner Control leads to more Intrinsic Motivation
Linked to…
          Digital Tools to
           Support Reflection:
              Online
               Portfolios
              Blogs & Wikis
              Digital
               Storytelling
              Games
“Blog” #1 word of the year*
 Merriam-Webster Inc announced its
  top 10 "words of the year" list, with the
  immensely popular "blog" taking the
  number one place.
 Compiles list each year by taking the

  most researched words on its various
  Web sites
            * Internet Scout Report, December 3, 2004
Portfolios provide
         Encouragement for
             Reflection
1.   …provides both the discipline and the freedom
     of structure, allowing one to see one's own
     work. (Sonnet)
2.   …provides the opportunity to assess one's own
     strengths and weaknesses through examination
     of a collection of samples, as well as to get
     feedback on one's performance from others.
     (Mirror)
3.   …the process of self assessment leads one to
     setting goals for future development and
     professional growth. (Map)
                                    (Mary Diez, 1994)
Helping Students to Reflect
 Provide models and examples
 Begin with forms or prompts

 Move to journals/blogs

 Be careful that reflection in

  portfolios doesn’t become an
  exercise in filling in the blanks on a
  web-based form.
1. Select
                       What evidence is required?
                       Do you want or need to
                                                                     North
                                                                    Carolina
                        include any additional
                        artifacts or evidence?
                       What standards are you

                                                                   Reflection
                        addressing?


    5. Transform                                     2. Describe
            Image showing the Who?
                               cycle
Utilize the information and data
Apply to teaching practice   What?
                                                                     Cycle
              of self-assessment:
Develop new goals and
 strategies based on the data
                              When?
                              Where?
              The reflective                                         Self-
              practitioner..                                         Assessment:
         4. Appraise                                                 The
  Interpret events                             3. Analyze
  Determine impact                          Why?                   Reflective
  Determine effectiveness                   How?                   Practitioner
  Determine the relationship to
   goals, values, philosophy                                         North Carolina Public Sc
                                                                     (http://www.ncpublics
                                                                     chools.org/pbl/pblrefle
                                                                     ct.htm)
How might an e-portfolio support
development of personal knowledge?

                      knowledge for
                       acting/doing
                    performance
       Image showing the relationships of knowledge for
       acting/doing, knowledge of self derived from doing,
       and knowledge for planning actions and imagination.
                         context
       Fr0m Norman Jackson, Higher Education Academy,
  forethought
       UK.
                                           self-reflection
knowledge for                          knowledge of self
planning actions                       derived from doing
and imagination
                          Norman Jackson
                   Higher Education Academy, U.K.
How might an e-portfolio support
 reflection and development of
         metacognition?

             reflection in action
                  performance
       Image showing the relationships of knowledge for
    acting/doing, knowledge of self derived from doing, and
                     context
    knowledge for planning actions and imagination. Fr0m
forethought
      Norman Jackson, Higher Education Academy, UK.
                                       self-reflection
 reflection                                reflection
 for action                                on action
                      Norman Jackson
               Higher Education Academy, U.K.
Digital Storytelling Process

 Learners      create a 2-4 minute
                   digital video clip
 First person narrative
 Told in their own voice

 Illustrated by (mostly) still images

 Music track to add emotional tone
Center for Digital Storytelling

   Image showing the elements of digital
    storytelling; point of view, dramatic
    question, emotional content, your voice,
    sound track, economy, pacing




               http://www.storycenter.org
Why include Digital
Storytelling in ePortfolios?

 Learner Motivation
     and Affect
 Brain Research on
Emotion in Learning
Resource on Biology of
             Learning
          Enriching the
           Practice of
           Teaching by
           Exploring the
           Biology of Learning
          James E. Zull

          Stylus Publishing Co.
The Learning Cycle
David Kolb from Dewey, Piaget, Lewin
   Deep Learning (learning for real
    comprehension) comes from a sequence of
      Experience

      Reflection

      Abstraction

      Active testing

   Zull: the learning cycle arises
    naturally from the structure
    of the brain (p.19)
The Learning Cycle
David Kolb from Dewey, Piaget, Lewin, adapted by Zull


    Image of the learning cycles of active testing,
      concrete experience, reflective observation, and
      abstract hypotheses.
Experiential Learning Model
    Lewin/Kolb with adaptations by Moon and Zull
                                                    (Kolb, 1984, p.21)
Outsideshowing the outside and inside
  Image
                 Concrete
                 experience
    components ofHave an experience in Kolb,
                          the model as
    1084, page 21.
      Testing implications
      of concepts in new                       Observations and
      situations                               reflections
                                           Reflect on the experience
Try out what you
have learned
                        Formation of abstract
                        concepts and
                        generalizations                  Inside
                   Learn from the experience
Reflection and Emotion
                     James Zull
   Even if we experience something that has
    happened to us before, it is hard to make
    meaning of it unless it engages our emotions.
    (p.166)
   Reflection is a search for connections. (p. 167)
   Sleep researchers postulate that dreams help
    us make connections…We discover what is
    important to us, because we dream about what
    matters most. (p.168)
   For comprehension we need time. (p.168)
Reflection and Emotion
                    James Zull
   “Even if we were able to decrease our
    emphasis on speed and information and
    increase the possibilities for reflection, we still
    would have to give our students the kind of
    experience that would produce dreams--
    experiences that engage their emotions.”
    (p.168)
   “…our experiences must matter in our lives if
    we are to learn from them.” (p.168)
   “…it suggests how seriously we have to
    take emotion if we want to foster deep
    learning.” (p. 169)
My own story
 “One good example is worth 1000
  theories”
 The issue of time and learning -
  reaching another transition and
  decision point in a long career,
  reflecting on the milestones in
  my life
 Play "choices"
Storytelling
as a Theory of Learning
              Two educators from
               New Zealand -
               staff developer and
               health educator
              Relates storytelling to
               literature on learning
               and reflection
              Provides stages of
               storytelling related to
               reflection
Maxine Alterio, Helen Barrett, Janice McDrury
 December 9, 2004 - Dunedin, New Zealand
Links between Learning and
                Storytelling
            Map of Learning                                     Learning through
             (Moon, 1999)                                         Storytelling
                                                            (McDrury & Alterio, 2003)
    Noticing                       finding              Story

    Making sense            Story telling

    Making meaning          Story expanding

    Working with meaning    Story processing

    Transformative learning Story reconstructing


McDrury, J., Alterio, M. (2003) Learning through Storytelling in Higher Education. London: Kogan-Page, p.47
Storytelling = Narrative Inquiry
             Mattingly in Schön (1991)

   Aristotle: narrative – natural framework for
    representing world of action
   Everyday sense-making role of storytelling
   Stories reveal the way ideas look in action
   Narrative provides explanation
   Motivation for telling stories: to wrest
    meaning from experiences
Storytelling as Reflection (Schön,
              1988)


  “…for storytelling is the
mode of description best
suited to transformation in
new situations of action.”
Storytelling as Reflection
          (Schön, 1988)

       “Stories are products of
reflection, but we do not
usually hold onto them long
enough to make them objects
of reflection in their own right.”
Storytelling as Reflection
          (Schön, 1988)

       “When we get into the habit
of recording our stories, we can
look at them again, attending to
the meanings we build into them
and attending, as well, to our
strategies of narrative
description.”
Constructivist Approach to Project-
     Based "Assessment-as-Learning"

   Chart showing the components of the approach: learner ownership
    and engagement, emotional connection, extended future time
    perspective, deep learning tool, and learner’s authentic voice.
Learner Ownership and
Engagement with Portfolio

 The tools should allow the
 learner to feel in control of
 the process, including the
 "look and feel" of the
 portfolio.
Deep Learning
 involves reflection,
 is developmental,

 is integrative,

 is self-directive, and

 is lifelong

                 Cambridge (2004)
Voice = Authenticity
 multimedia expands the "voice" in an
  electronic portfolio
  (both literally and rhetorically)
 personality of the author is evident

 gives the reflections a uniqueness

 gives the feeling that the writer is

  talking directly to the reader/viewer
Digital Paper or Digital
         Story?
  Digital paper = text and images only
  Digital story = tell your story in your
               own voice.
     Multimedia = audio and video
Graduate Student Examples

 …or  you are a graduate student
  reflecting on what is drawing
  you into teaching
 Play "coming full circle”

 Play “a journey to the missing”
What’s Your Story?

  Richness not possible in print
Audiences worldwide but most likely
       small and intimate.
Digital Story as
    Legacy
 Not just for professional
      development
 Or skills-based portfolios
Digital Storytelling Becomes a
       Lifelong, Life Wide Skill
   Digital Family Stories
    -from birth to end-of-life
   Digital Family Stories
    -help people reflect on
    life transitions
   Digital Family Stories
    -preserve multimedia
    memories as a legacy
    for future generations
Recommendations!

Unsolicited e-mail messages
From a Teacher Educator in Ohio
   This past quarter, I worked with my graduate students (all inservice
    teachers) on telling their "digital stories" of why they have stayed in
    teaching for so many years/or why they went into teaching, their
    thoughts on the future of education and their philosophy of
    teaching… Some of the stories were so passionate, I cried as I
    graded them. [In fact my whole hallway cried and laughed as we
    watched them.] Digital storytelling is a very powerful medium for
    expressing the art and passion of inservice teachers about their
    own teaching. It was one of the most fantastic experiences for my
    own "learning about my students" that I have had in recent years!
    We used Moviemaker and VideoStudio 8, one free and the other
    $69. since we are doing all of this in an online environment and the
    teachers have to purchase their own software for the courses, the
    teachers loved it -- and keep sending me ideas now of how they
    are going to use it in their own classrooms. Enjoy the digital
    storytelling -- it is well worth the time!
From a Teacher Educator in Florida
      Each of my students this semester
       produced two digital stories, one
       focusing on their philosophy of
       teaching, and the other dealing with
       their field experience, We used
       PhotoStory 3 because it was a free
       Microsoft Download. I was most
       impressed with their efforts and they
       have told me it was a most meaningful
       activity.
Presentation online and
      stories are on my CD
   Go to http://electronicportfolios.org
    and click On-Line Publications
    “Electronic Portfolios as Digital Stories of
    Deep Learning”
   Go to http://electronicportfolios.org
    and click Recent Conference
    Presentations
   My CD has examples of digital stories as
    well as hands-on activities to learn the
    process on Mac and Windows XP
Dr. Helen Barrett
   Co-Director ISTE’s Community &
    Assessment in PT3 Catalyst Grant
 Research Director,
  The REFLECT Initiative
 hbarrett@mac.com
   Website of Electronic Portfolio:
    http://electronicportfolios.org/

More Related Content

Similar to Portfolios

Similar to Portfolios (20)

Mt sanantonio
Mt sanantonioMt sanantonio
Mt sanantonio
 
Mercy2 dec2010
Mercy2 dec2010Mercy2 dec2010
Mercy2 dec2010
 
Castilleja school june 2010
Castilleja school june 2010Castilleja school june 2010
Castilleja school june 2010
 
ASB Web2workshop
ASB Web2workshopASB Web2workshop
ASB Web2workshop
 
Hostos Apr11
Hostos Apr11Hostos Apr11
Hostos Apr11
 
Epic2014 balancing
Epic2014 balancingEpic2014 balancing
Epic2014 balancing
 
Google Apps FETC2012
Google Apps FETC2012Google Apps FETC2012
Google Apps FETC2012
 
Google apps2013workshop
Google apps2013workshopGoogle apps2013workshop
Google apps2013workshop
 
Epic2014 balancing
Epic2014 balancingEpic2014 balancing
Epic2014 balancing
 
Barcelona june 2010
Barcelona june 2010Barcelona june 2010
Barcelona june 2010
 
Calgary1Students
Calgary1StudentsCalgary1Students
Calgary1Students
 
ND District 7 Sept 2010
ND District 7 Sept 2010ND District 7 Sept 2010
ND District 7 Sept 2010
 
Google appsiste2012workshop
Google appsiste2012workshopGoogle appsiste2012workshop
Google appsiste2012workshop
 
2018 Ireland keynote
2018 Ireland keynote 2018 Ireland keynote
2018 Ireland keynote
 
Idaho Balancing2011
Idaho Balancing2011Idaho Balancing2011
Idaho Balancing2011
 
Spain Nov09
Spain Nov09Spain Nov09
Spain Nov09
 
Portfolio Life --at Mercy College
Portfolio Life --at Mercy CollegePortfolio Life --at Mercy College
Portfolio Life --at Mercy College
 
Wake Forest0410
Wake Forest0410Wake Forest0410
Wake Forest0410
 
Sotf interactive e portfolios
Sotf interactive e portfoliosSotf interactive e portfolios
Sotf interactive e portfolios
 
Richland2 2011
Richland2 2011Richland2 2011
Richland2 2011
 

Recently uploaded

ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxDr.Ibrahim Hassaan
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
ROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint PresentationROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint PresentationAadityaSharma884161
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfUjwalaBharambe
 
AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.arsicmarija21
 
Quarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up FridayQuarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up FridayMakMakNepo
 
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance  and worth of ideas part 2.pptxJudging the Relevance  and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptxSherlyMaeNeri
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 

Recently uploaded (20)

ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptx
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
ROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint PresentationROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint Presentation
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
 
AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.
 
Quarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up FridayQuarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up Friday
 
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance  and worth of ideas part 2.pptxJudging the Relevance  and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptx
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 

Portfolios

  • 1. REAL Electronic Portfolios Reflection, Engagement, and Assessment for Learning
  • 2. Balancing “Portfolio as Test” with “Portfolio as Story” Dr. Helen Barrett
  • 3. Legacy from the Portfolio Literature  Much to learn from the literature on paper-based portfolios  As adult learners, we have much to learn from how children approach portfolios “Everything I know about portfolios was confirmed working with a kindergartener”
  • 4. The Power of Portfolios what children can teach us about learning and assessment Author: Elizabeth Hebert Publisher: Jossey-Bass Picture courtesy of Amazon.com
  • 5. The Power of Portfolios Author: Dr. Elizabeth Hebert, Principal Crow Island School, Winnetka, Illinois Picture taken by Helen Barrett at AERA, Seattle, April, 2001
  • 6. From the Preface (1) Hebert, Elizabeth (2001) The Power of Portfolios. Jossey-Bass, p.ix “Portfolios have been with us for a very long time. Those of us who grew up in the 1950s or earlier recognize portfolios as reincarnations of the large memory boxes or drawers where our parents collected starred spelling tests, lacy valentines, science fair posters, early attempts at poetry, and (of course) the obligatory set of plaster hands. Each item was selected by our parents because it represented our acquisition of a new skill or our feelings of accomplishment. Perhaps an entry was accompanied by a special notation of praise from a teacher or maybe it was placed in the box just because we did it.”
  • 7. From the Preface (2) Hebert, Elizabeth (2001) The Power of Portfolios. Jossey-Bass, p.ix “We formed part of our identity from the contents of these memory boxes. We recognized each piece and its association with a particular time or experience. We shared these collections with grandparents to reinforce feelings of pride and we reexamined them on rainy days when friends were unavailable for play. Reflecting on the collection allowed us to attribute importance to these artifacts, and by extension to ourselves, as they gave witness to the story of our early school experiences.”
  • 8. From the Preface (3) Hebert, Elizabeth (2001) The Power of Portfolios. Jossey-Bass, p.ix-x “Our parents couldn’t possibly envision that these memory boxes would be the inspiration for an innovative way of thinking about children’s learning. These collections, lovingly stored away on our behalf, are the genuine exemplar for documenting children’s learning over time. But now these memory boxes have a different meaning. It’s not purely private or personal, although the personal is what gives power to what they can mean.”
  • 9. Let’s get personal… Think for a minute about: Something about your COLLECTIONS: Suggested topics:  If you are a parent, what you saved for your children  What your parents saved for you  What you collect…  Why you collect…
  • 10. Some issues to consider  What do your collections say about what you value?  Is there a difference between what you purposefully save and what you can’t throw away?  How can we use our personal collections experiences to help learners as they develop their portfolios? The power of portfolios [to support deep learning] is personal.
  • 11. What is a Portfolio in Education? A portfolio is a purposeful collection of student work that exhibits the student's efforts, progress and achievements in one or more areas [over time]. (Northwest Evaluation Association, 1990)
  • 12. What is a Portfolio in Education? (2) The collection must include:  student participation in selecting contents  the criteria for selection  the criteria for judging merit  evidence of student self- reflection (Northwest Evaluation Association, 1990)
  • 13. NLII e-Portfolio Definition  a collection of authentic and diverse evidence,  drawn from a larger archive representing what a person or organization has learned over time  on which the person or organization has reflected, and  designed for presentation to one or more audiences for a particular rhetorical purpose.
  • 14. “The Blind Men and the Elephant” Thanks to Alan Levine
  • 15. “The Blind Men and the Elephant”  Eskimos having 49 different words for “snow”  Those who don’t live in that environment tend to see it all as the same cold white stuff  Same goes with “portfolio”
  • 16. Metaphors!  Mirror, Map, Sonnet  C.V. or Multimedia Resume  Test  Story  Electronic Portfolio Organization (http://electronicportfolios.org/metaphors.html)
  • 17. Purpose & Goals for the portfolio (Determine Content)  Multiple purposes: Learning/Process Assessment Marketing/Showcase
  • 18. Think about the differences between:  Learning Portfolio and Portfolio Learning  Assessment Portfolio and Portfolio Assessment  Portfolio = Concept, Product, and Process
  • 19. Learning Portfolios  “know thyself” = a lifetime of investigation  self-knowledge as outcome of learning Reflection The Learning Portfolio (Zubizaretta, 2004, Learning p.20) Portfolio Documentation Collaboration
  • 20. Learning Portfolios  Support reflection which is central to learning Reflections  The Heart and Soul of the Portfolio  An electronic portfolio without reflection is just a  Digital scrapbook  Fancy electronic resume  Multimedia Presentation  Personal web site
  • 21. Showcase Portfolios  Marketing  Employment  Tell your story  A primary motivator for many portfolio developers
  • 22. Assessment Portfolios A major movement in Teacher Education in U.S.  A major new commercial market  A primary motivator for organizations More later! More later!
  • 23. A few thoughts about Assessment -- What Type? Assessment OF Learning? or Assessment FOR Learning?
  • 24. Assessment for Learning at www.qca.org.uk ages3-14
  • 25. Principles of Assessment FOR Learning  Definition: Assessment for Learning is the process of seeking and interpreting evidence for use by learners and their teachers to decide where the learners are in their learning, where they need to go and how best to get there.
  • 26. Overlap of Assessment Types* Assessment Assessment OF FOR Learning Learning *Alberta Assessment Consortium
  • 27. Portfolios used for Assessment OF Learning  Purpose of portfolio prescribed by institution  Artifacts mandated by institution to determine outcomes of instruction  Portfolio usually developed at the end of a class, term or program - time limited  Portfolio and/or artifacts usually "scored" based on a rubric and quantitative data is collected for external audiences  Portfolio is usually structured around a set of outcomes, goals or standards  Sometimes used to make high stakes decisions  Summative - what has been learned to date? (Past to present)  Requires Extrinsic motivation  Audience: external - little choice
  • 28. Portfolios that support Assessment FOR Learning  Purpose of portfolio agreed upon with learner  Artifacts selected by learner to tell the story of their learning  Portfolio maintained on an ongoing basis throughout the class, term or program - time flexible  Portfolio and artifacts reviewed with learner and used to provide feedback to improve learning  Portfolio organization is determined by learner or negotiated with mentor/advisor/teacher  Rarely used for high stakes decisions  Formative - what are the learning needs in the future? (Present to future)  Fosters Intrinsic motivation - engages the learner  Audience: learner, family, friends - learner can choose
  • 29. A Resource on K-12 Portfolios  By Evangeline Harris Stefanakis  Published by Heinemann  Includes a CD-ROM with examples of student portfolios
  • 30. Assessment for Learning Continuum - Enhanced Stefanakis, Evangeline (2002) Multiple Intelligences and Portfolios. Le a rning A cco unta bility Portsmouth: Heinemann, p. Reflection * 136 Se lf Asse ssme nt Sta nda rdize d Te sts Informa l Fe e dba ck Pe rforma nce Ba se d Rubrics Portfolios Observation *
  • 31. Which approach should you take?  Are you looking for an electronic portfolio…  Or an assessment management system?  What’s the difference? Along a Continuum
  • 32. Electronic Portfolio or Assessment Management System? Electronic Portfolio Assessment Management System Multiple purposes: Learning, Single purpose: Formative and Assessment, Employment Summative Assessment Data structure varies with tools used to Data structure most often uses a create the portfolio; common data relational database to record, report data formats (converted to HTML, PDF) Primary type of data: qualitative Primary type of data: qualitative and quantitative Data storage in multiple options: Data storage primarily on LAN or on CD-ROM, videotape, DVD, WWW secure WWW server server, LAN Visual design and hyperlinks often Visual design and hyperlinks most often under control of portfolio developer controlled by database structure Learner choice of artifacts Institutional choice of artifacts Learner-Centered Institution-Centered
  • 33. Electronic Portfolio or Assessment Management System?
  • 34. What is your portfolio? A standardized checklist of skills? (Positivist) or  A reflective story of deep learning? (Constructivist)
  • 35. Tension between two approaches “ The two paradigms produce portfolio activities that are entirely different.” “The positivist approach puts a premium on the selection of items that reflect outside standards and interests.” “The constructivist approach puts a premium on the selection of items that reflect learning from the student’s perspective.” F. Leon Paulson & Pearl Paulson (1994) “Assessing Portfolios Using the Constructivist Paradigm” in Fogarty, R. (ed.) (1996) Student Portfolios. Palatine: IRI Skylight Training & Publishing
  • 36. How can we address both types of portfolios? Use three different systems that are digitally linked: I. A digital archive of a learner’s work II. An institution-centered database to collect faculty-generated assessment data based on tasks and rubrics III. A student-centered electronic portfolio
  • 37. Q ui kTi e™ and a c m TI FFe( U ar neededpr essed) t decom pr e. ncom t o see hi pi t ur essor s c Handout  Image showing the conceptual relationships of assessment systems and electronic portfolios: balancing accountability with learning.
  • 38. Begin Here Learning Experiences embedded in curriculum
  • 39. I I. Digital Archive of Learner Artifacts (Working Portfolio)
  • 40. Interactive Process Evidence = +Artifacts +Reflection +Validation
  • 41. Interactive Process Performance Reflection Tasks & on Learning (self-selected Rubrics for artifacts for self- evaluation Evidence = evaluation) +Artifacts +Reflection Assessor +Validation Learner
  • 42. Q ui kTi e™ and a c m TI FFe( U ar neededpr essed) t decom pr e. ncom t o see hi pi t ur essor s c Handout  Image showing the conceptual relationships of assessment systems and electronic portfolios: balancing accountability with learning.
  • 43. Positivist Paradigm (Evaluation and Making Inferences) Portfolio as Test
  • 45. Performance tasks and Rubrics for evaluation Performance Tasks & Rubrics for evaluation
  • 46. Data collected for certification/ licensure (high stakes) and for accreditation
  • 47. II Assessment Management II. System(institution-centered data management system) Assessment Management System (institution-centered data management system)
  • 48. Resulting in… Institution-centered aggregated data leading to certification/licensure and accreditation
  • 50. External Locus of Control  Includes prescribed artifacts and rubrics  Requires database to manage information  Focuses on faculty's formative and summative evaluations
  • 51. Q ui kTi e™ and a c m TI FFe( U ar neededpr essed) t decom pr e. ncom t o see hi pi t ur essor s c Handout  Image showing the conceptual relationships of assessment systems and electronic portfolios: balancing accountability with learning.
  • 52. I. Digital Archive ofPortfolio) I. Digital Archive Artifacts (Working Learning of Learner Artifacts (Working Portfolio)
  • 53. Constructivist Paradigm (Making Meaning and Assessment as Learning) Portfolio as Story
  • 54. Learner COLLECTS artifacts from learning experiences
  • 55. Reflection on Learning (self-selected artifacts for self-evaluation) Reflection on Learning (self-selected artifacts for self- evaluation)
  • 56. Learner SELECTS artifacts and reflections to meet self-determined purpose(s)
  • 57. III. Electronic III. Electronic Portfolio(s) (presentation portfolios for Portfolio(s) multiple purposes) (presentation portfolios for multiple purposes)
  • 58. Resulting in… Student-centered documentation of deep learning, for developing self-concept and presentation to multiple audiences (peers, employers, etc.)
  • 59. Focus on Lifelong Self-Directed Learning
  • 60. Internal Locus of Control  Includes choice of artifacts  Results in personalized e-portfolio  Focuses on learner's celebration of uniqueness
  • 61. Both approaches result in a: Balanced Balanced Assessment Assessment System System
  • 63. A tale of two paper portfolios  High school  High School freshman in NY graduates in Washington (Jim Mahoney, Power and Portfolios state (and published by Utah, too!) Heinemann)
  • 64. What’s the difference between those two stories?  What are the variables that produce these extremes in attitudes toward ownership of portfolios?
  • 65. Activity Theory Implications for human-computer interaction “Tools”-->
  • 66. Cautions about Portfolio Use (Lucas, 1992) 1. The weakening of effect through careless imitation 2. The failure of research to validate the pedagogy 3. The co-option by large-scale external testing programs (Lucas, Catharine. 1992. Introduction: Writing Portfolios - Changes and Challenges. Portfolios in the Writing Classroom: An Introduction, ed. Kathleen Blake Yancey. Urbana, Illinois: NCTE: 1-11)
  • 67. Lee Shulman’s 5 dangers of portfolios 1. "lamination" 2. "heavy lifting" 3. "trivialization" 4. "perversion" Shulman, Lee (1998) 5. "misrepresentation" "Teacher Portfolios: A Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 68. Lee Shulman’s 5 dangers of portfolios 1. "lamination" - a portfolio becomes a mere exhibition, a self- advertisement, to Shulman, Lee (1998) "Teacher Portfolios: A show off Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 69. Lee Shulman’s 5 dangers of portfolios 2. "heavy lifting" - a portfolio done well is hard work. Is it worth the extra effort? Shulman, Lee (1998) "Teacher Portfolios: A Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 70. Lee Shulman’s 5 dangers of portfolios 3. "trivialization" - documenting stuff that isn't worth reflecting Shulman, Lee (1998) upon "Teacher Portfolios: A Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 71. Lee Shulman’s 5 dangers of portfolios 4. "perversion" - when used as a form of high stakes assessment “why will portfolios be more resistant to perversion than all other forms of Shulman, Lee (1998) assessment have been?” "Teacher Portfolios: A Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 72. Lee Shulman’s 5 dangers of portfolios “…And if one of the requirements … is that you develop a sufficiently objective scoring system [for portfolios] so you can fairly compare people with one another, will your scoring system end up objectifying what's in the portfolio to the point where the portfolio will be nothing but a very, very cumbersome multiple Shulman, Lee (1998) "Teacher Portfolios: A choice test?" (p. 35) Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 73. Lee Shulman’s 5 dangers of portfolios 5. "misrepresentation" - does "best work" misrepresent "typical work" -- not a true picture of Shulman, Lee (1998) "Teacher Portfolios: A competency Theoretical Activity" in N. Lyons (ed.) With Portfolio in Hand. (pp. 23-37) New York: Teachers College Press.
  • 74. Lee Shulman’s 5 benefits of portfolios 1. document longer episodes of teaching and learning 2. encourage the reconnection between process and product. - very best teaching portfolios contain excerpts of student portfolios & highlight the results of teaching that lead to student learning. 3. institutionalize norms of collaboration, reflection, and discussion Shulman, Lee (1998)portable residency... introduces structure to 4. a "Teacher Portfolios: A Theoretical the field experience Activity" in N. Lyons 5. (most important) shifts the agency from an (ed.) With Portfolio in Hand. (pp. 23-37) College Press. observer back to the teacher interns... New York: Teachers
  • 75. Joanne Carney’s Dilemmas of Electronic Portfolios 1. Multiple Purpose Dilemma 2. Personal Revelation Dilemma 3. Cognitive Overload Dilemma 4. Self-Expression Dilemma 5. Dead-End Dilemma 6. Data-Aggregation Dilemma Carney, Joanne (in development) “Campfires Around Which We Tell Our Stories: Confronting the Dilemmas of Teacher Portfolios and New Technologies”
  • 76. Constructed Meaning "The portfolio is a laboratory where students construct meaning from their accumulated experience." (Paulson & Paulson, 1991, p.5)
  • 77. Portfolio tells a Story "A portfolio tells a story. It is the story of knowing. Knowing about things... Knowing oneself... Knowing an audience... Portfolios are students' own stories of what they know, why they believe they know it, and why others should be of the same opinion.” (Paulson & Paulson, 1991, p.2)
  • 78. Portfolios tell a Story “A portfolio is opinion backed by fact... Students prove what they know with samples of their work.” (Paulson & Paulson, 1991, p.2)
  • 79. Linking Two Dynamic Processes to Promote Deep Learning Portfolio Development Process Digital Storytelling
  • 80. ePortfolio as Storytelling Image showing the relationships of the concepts of ePortfolios as a story of learning and the concepts of Digital storytelling as reflective portfolios
  • 81. Portfolio Development Process Image showing the five processes of portfolio development: selection, collection, reflection, direction, and celebration.
  • 82. Portfolio Processes Traditional + Technology  Collecting  Archiving  Selecting  Linking/Thinking  Reflecting  Storytelling  Directing  Collaborating  Celebrating  Publishing
  • 83. Reflective Questions that tie the Past to the Future
  • 84. Some concerns…  Assessment for Learning  Portfolios for Learning  What about Motivation?
  • 85. Components of Portfolio Development Content Purpose Process
  • 86. Components of Portfolio Development Content: evidence= artifacts + reflections + validation
  • 87. Components of Portfolio Development Purpose: the reason for developing the portfolio – includes audience  Learning& professional development - Process  Assessment (of and for learning)  Showcase (Employment/Marketing)
  • 88. Components of Portfolio Development Process: tools used sequence of activities rules evaluation criteria (rubrics)  collaboration/conversation
  • 89. Developmental Levels of Portfolio Implementation  Extrinsic Motivation –institutional directed content, purpose & process – external locus of control  Mixed Motivation –learner ownership over one or two of the components  Intrinsic Motivation —learner ownership of content, purpose and process
  • 90. Learner Ownership and Control of Electronic Portfolio Development D Intrinsic E G Motivation Motivation Process R Chart showing the growth of extrinsic E E motivation to intrinsic motivation when O learner takes more control of learning Extrinsic Purpose Purpose F process, purpose and contents. C H Contents Contents Contents O I C ORGANIZATION CONTROL LEARNE CONT R ROL E Learner Control vs. Organizational Control Assumption: Greater Learner Control leads to more Intrinsic Motivation
  • 91. Linked to…  Digital Tools to Support Reflection:  Online Portfolios  Blogs & Wikis  Digital Storytelling  Games
  • 92. “Blog” #1 word of the year*  Merriam-Webster Inc announced its top 10 "words of the year" list, with the immensely popular "blog" taking the number one place.  Compiles list each year by taking the most researched words on its various Web sites * Internet Scout Report, December 3, 2004
  • 93. Portfolios provide Encouragement for Reflection 1. …provides both the discipline and the freedom of structure, allowing one to see one's own work. (Sonnet) 2. …provides the opportunity to assess one's own strengths and weaknesses through examination of a collection of samples, as well as to get feedback on one's performance from others. (Mirror) 3. …the process of self assessment leads one to setting goals for future development and professional growth. (Map) (Mary Diez, 1994)
  • 94. Helping Students to Reflect  Provide models and examples  Begin with forms or prompts  Move to journals/blogs  Be careful that reflection in portfolios doesn’t become an exercise in filling in the blanks on a web-based form.
  • 95. 1. Select What evidence is required? Do you want or need to North Carolina include any additional artifacts or evidence? What standards are you Reflection addressing? 5. Transform 2. Describe Image showing the Who? cycle Utilize the information and data Apply to teaching practice What? Cycle of self-assessment: Develop new goals and strategies based on the data When? Where? The reflective Self- practitioner.. Assessment: 4. Appraise The Interpret events 3. Analyze Determine impact Why? Reflective Determine effectiveness How? Practitioner Determine the relationship to goals, values, philosophy North Carolina Public Sc (http://www.ncpublics chools.org/pbl/pblrefle ct.htm)
  • 96. How might an e-portfolio support development of personal knowledge? knowledge for acting/doing  performance Image showing the relationships of knowledge for acting/doing, knowledge of self derived from doing, and knowledge for planning actions and imagination. context Fr0m Norman Jackson, Higher Education Academy, forethought UK. self-reflection knowledge for knowledge of self planning actions derived from doing and imagination Norman Jackson Higher Education Academy, U.K.
  • 97. How might an e-portfolio support reflection and development of metacognition? reflection in action performance Image showing the relationships of knowledge for acting/doing, knowledge of self derived from doing, and context knowledge for planning actions and imagination. Fr0m forethought Norman Jackson, Higher Education Academy, UK. self-reflection reflection reflection for action on action Norman Jackson Higher Education Academy, U.K.
  • 98. Digital Storytelling Process  Learners create a 2-4 minute digital video clip  First person narrative  Told in their own voice  Illustrated by (mostly) still images  Music track to add emotional tone
  • 99. Center for Digital Storytelling  Image showing the elements of digital storytelling; point of view, dramatic question, emotional content, your voice, sound track, economy, pacing http://www.storycenter.org
  • 100. Why include Digital Storytelling in ePortfolios? Learner Motivation and Affect Brain Research on Emotion in Learning
  • 101. Resource on Biology of Learning  Enriching the Practice of Teaching by Exploring the Biology of Learning  James E. Zull  Stylus Publishing Co.
  • 102. The Learning Cycle David Kolb from Dewey, Piaget, Lewin  Deep Learning (learning for real comprehension) comes from a sequence of  Experience  Reflection  Abstraction  Active testing  Zull: the learning cycle arises naturally from the structure of the brain (p.19)
  • 103. The Learning Cycle David Kolb from Dewey, Piaget, Lewin, adapted by Zull Image of the learning cycles of active testing, concrete experience, reflective observation, and abstract hypotheses.
  • 104. Experiential Learning Model Lewin/Kolb with adaptations by Moon and Zull (Kolb, 1984, p.21) Outsideshowing the outside and inside  Image Concrete experience components ofHave an experience in Kolb, the model as 1084, page 21. Testing implications of concepts in new Observations and situations reflections Reflect on the experience Try out what you have learned Formation of abstract concepts and generalizations Inside Learn from the experience
  • 105. Reflection and Emotion James Zull  Even if we experience something that has happened to us before, it is hard to make meaning of it unless it engages our emotions. (p.166)  Reflection is a search for connections. (p. 167)  Sleep researchers postulate that dreams help us make connections…We discover what is important to us, because we dream about what matters most. (p.168)  For comprehension we need time. (p.168)
  • 106. Reflection and Emotion James Zull  “Even if we were able to decrease our emphasis on speed and information and increase the possibilities for reflection, we still would have to give our students the kind of experience that would produce dreams-- experiences that engage their emotions.” (p.168)  “…our experiences must matter in our lives if we are to learn from them.” (p.168)  “…it suggests how seriously we have to take emotion if we want to foster deep learning.” (p. 169)
  • 107. My own story  “One good example is worth 1000 theories”  The issue of time and learning - reaching another transition and decision point in a long career, reflecting on the milestones in my life  Play "choices"
  • 108. Storytelling as a Theory of Learning  Two educators from New Zealand - staff developer and health educator  Relates storytelling to literature on learning and reflection  Provides stages of storytelling related to reflection
  • 109. Maxine Alterio, Helen Barrett, Janice McDrury December 9, 2004 - Dunedin, New Zealand
  • 110. Links between Learning and Storytelling Map of Learning Learning through (Moon, 1999) Storytelling (McDrury & Alterio, 2003) Noticing finding Story Making sense Story telling Making meaning Story expanding Working with meaning Story processing Transformative learning Story reconstructing McDrury, J., Alterio, M. (2003) Learning through Storytelling in Higher Education. London: Kogan-Page, p.47
  • 111. Storytelling = Narrative Inquiry Mattingly in Schön (1991)  Aristotle: narrative – natural framework for representing world of action  Everyday sense-making role of storytelling  Stories reveal the way ideas look in action  Narrative provides explanation  Motivation for telling stories: to wrest meaning from experiences
  • 112. Storytelling as Reflection (Schön, 1988) “…for storytelling is the mode of description best suited to transformation in new situations of action.”
  • 113. Storytelling as Reflection (Schön, 1988) “Stories are products of reflection, but we do not usually hold onto them long enough to make them objects of reflection in their own right.”
  • 114. Storytelling as Reflection (Schön, 1988) “When we get into the habit of recording our stories, we can look at them again, attending to the meanings we build into them and attending, as well, to our strategies of narrative description.”
  • 115. Constructivist Approach to Project- Based "Assessment-as-Learning"  Chart showing the components of the approach: learner ownership and engagement, emotional connection, extended future time perspective, deep learning tool, and learner’s authentic voice.
  • 116. Learner Ownership and Engagement with Portfolio  The tools should allow the learner to feel in control of the process, including the "look and feel" of the portfolio.
  • 117. Deep Learning  involves reflection,  is developmental,  is integrative,  is self-directive, and  is lifelong Cambridge (2004)
  • 118. Voice = Authenticity  multimedia expands the "voice" in an electronic portfolio (both literally and rhetorically)  personality of the author is evident  gives the reflections a uniqueness  gives the feeling that the writer is talking directly to the reader/viewer
  • 119. Digital Paper or Digital Story? Digital paper = text and images only Digital story = tell your story in your own voice. Multimedia = audio and video
  • 120. Graduate Student Examples  …or you are a graduate student reflecting on what is drawing you into teaching  Play "coming full circle”  Play “a journey to the missing”
  • 121. What’s Your Story? Richness not possible in print Audiences worldwide but most likely small and intimate.
  • 122. Digital Story as Legacy Not just for professional development Or skills-based portfolios
  • 123. Digital Storytelling Becomes a Lifelong, Life Wide Skill  Digital Family Stories -from birth to end-of-life  Digital Family Stories -help people reflect on life transitions  Digital Family Stories -preserve multimedia memories as a legacy for future generations
  • 125. From a Teacher Educator in Ohio  This past quarter, I worked with my graduate students (all inservice teachers) on telling their "digital stories" of why they have stayed in teaching for so many years/or why they went into teaching, their thoughts on the future of education and their philosophy of teaching… Some of the stories were so passionate, I cried as I graded them. [In fact my whole hallway cried and laughed as we watched them.] Digital storytelling is a very powerful medium for expressing the art and passion of inservice teachers about their own teaching. It was one of the most fantastic experiences for my own "learning about my students" that I have had in recent years! We used Moviemaker and VideoStudio 8, one free and the other $69. since we are doing all of this in an online environment and the teachers have to purchase their own software for the courses, the teachers loved it -- and keep sending me ideas now of how they are going to use it in their own classrooms. Enjoy the digital storytelling -- it is well worth the time!
  • 126. From a Teacher Educator in Florida  Each of my students this semester produced two digital stories, one focusing on their philosophy of teaching, and the other dealing with their field experience, We used PhotoStory 3 because it was a free Microsoft Download. I was most impressed with their efforts and they have told me it was a most meaningful activity.
  • 127. Presentation online and stories are on my CD  Go to http://electronicportfolios.org and click On-Line Publications “Electronic Portfolios as Digital Stories of Deep Learning”  Go to http://electronicportfolios.org and click Recent Conference Presentations  My CD has examples of digital stories as well as hands-on activities to learn the process on Mac and Windows XP
  • 128. Dr. Helen Barrett  Co-Director ISTE’s Community & Assessment in PT3 Catalyst Grant  Research Director, The REFLECT Initiative  hbarrett@mac.com  Website of Electronic Portfolio: http://electronicportfolios.org/

Editor's Notes

  1. If your e-portfolios are just digital paper (text and images on the screen) you are losing a wonderful opportunity to really tell your story in your own voice . With the capability to add multimedia , audio and video, we can truly create an engaging environment to document the milestones of our lives.
  2. We all have a story to add to our portfolios. These digital stories provide opportunities for a richness not possible in print. Some stories will represent the fresh innocence of youth, some will reflect the experiences of a rich life. The audiences might be worldwide, like the BBC Wales, but most likely the audiences will be small and intimate.
  3. These digital stories aren't just for professional development They aren ’ t just for skills-based portfolios They are our legacy for those who come after us...the stories of our lives we give to our children's grandchildren