Reflection, Integration, Identity, and Institutional Change: Lessons for Seven Years of the Inter/National Coalition for E...
Context, Results, and Future Directions<br />Barbara – Contextualizing the Inter/National Coalition for Electronic Portfol...
Contextualizing the Inter/National Coalition for Electronic Portfolio Research<br />
Three premises of the I/NCEPR<br />Building social capital is essential for change.<br />Intermediaries are essential to e...
Building Social Capital is Essential for Change<br />Bonding social capital<br />Institutional research teams<br />Bridgin...
Intermediaries are Essential to Explain the Local<br />“The strongest theme that emerged form each group was that research...
Designed inquiry emerging from a local question and leading to findings shared with a wider audience exemplifies the schol...
	Educational capital is “the progressive accumulation, in forms usable by educators, to validate experience and knowledge ...
	“Both the research literature and the participants identified the importance of intermediaries and trusted individuals to...
I/NCEPR as Intermediary<br />Internally<br />Calls<br />Critical friend exercises<br />Synthesizing and recirculating<br /...
Defining the “Non-Negotiable Core” is Essential for the Future of Eportfolios<br />Are there certain features of eportfoli...
(Selected) Findings from the Inter/National<br />Coaltion for Electronic <br />Portfolio<br />Research<br />
The Power of Collective Expertise<br /><ul><li>Common question played across different sites
The rhythm of the questioning
The importance of documenting practice
The role of inquiry and the willingness </li></ul>	to engage in it<br /><ul><li>The importance of connecting the question ...
On virtually every question, students in these ePortfolio-intensive courses tended to score higher in engagement than the ...
Retention data is similarly positive.  For example, analysis of the transcripts of a sample of nearly 2,000 students in eP...
Seton Hall’s contribution to this line of research is to focus on the use of the eportfolio as a site for students’ record...
Implications for Practice: <br />Waterloo and Sheffield Hallam<br /> Learning to reflect is a key skill that needs to be 	...
 PD in ways to promote reflection and assess reflective practice
 Reflection and reflective practice should be built in at the course design stage. Where this is not possible courses shou...
Reflection and Genre<br />Under what conditions do low-stakes<br />portfolios generated for programmatic<br />assessment s...
ePortfolios and Threshold Concepts<br />The Role of Purpose<br />The Role of Learning Activity Design<br />The Role of Pro...
(Selected) Findings from the Inter/National<br />Coaltion for Electronic <br />Portfolio<br />Research<br />Cambridge, Cam...
Future Directions for the Inter/National Coalition for Electronic Portfolio Research<br />
Possible Future Research Focuses<br />Assessment that capitalizes on the distinctive features of eportfolios <br />From in...
University of Cincinnati<br />Comparison of rubric-based assessments of work from eportfolios and CLAP scores<br />Generat...
Beyond VALUE<br />VALUE provides a powerful set of metarubrics for conversations about liberal learning grounded in authen...
VALUE Intercultural Rubric<br />
From individual to collective<br />The eportfolio is strongly associated with an individualist perspective <br />Eportfoli...
Eportfolios in Medical Education<br />Fast, international uptake of eportfolios<br />Existing tradition of reflective prac...
Longitudinal Impact of Eportfolios<br />Lifelong learning a ubiquitous goal of eportfolio projects, but little existing re...
Upcoming SlideShare
Loading in …5
×

Reflection, Integration, Identity, and Institutional Change

1,269 views

Published on

Presentation on the Inter/National Coalition for Electronic Portfolio Research's first seven years at AAEEBL, Boston, MA, July 21, 2010

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,269
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Intercultural knowledge and competence – VALUE = authentic assessment of individual artifacts, often hard to apply to whole portfolio, but some rubrics seems to require one for meaningful judgement
  • Videos to show: 1st Judge SimmonsNew videos from the bloggers, part 2
  • Reflection, Integration, Identity, and Institutional Change

    1. 1. Reflection, Integration, Identity, and Institutional Change: Lessons for Seven Years of the Inter/National Coalition for Electronic Portfolio Research<br />Barbara Cambridge, NCTE<br />Kathleen Blake Yancey, Florida State<br />Darren Cambridge, George Mason<br />AAEEBL, Boston, July 21, 2010<br />
    2. 2. Context, Results, and Future Directions<br />Barbara – Contextualizing the Inter/National Coalition for Electronic Portfolio Research<br />Kathi – Selected Findings <br />Darren – Future directions <br />
    3. 3. Contextualizing the Inter/National Coalition for Electronic Portfolio Research<br />
    4. 4. Three premises of the I/NCEPR<br />Building social capital is essential for change.<br />Intermediaries are essential to explain the local.<br />Defining the “non-negotiable core” is essential for the future of eportfolios.<br />
    5. 5. Building Social Capital is Essential for Change<br />Bonding social capital<br />Institutional research teams<br />Bridging social capital<br />Cohort of multiple teams<br />Network for cohorts<br />International members of a cohort<br />Potential expanded membership<br />
    6. 6. Intermediaries are Essential to Explain the Local<br />“The strongest theme that emerged form each group was that research—whether scientifically based or best practices—must be viewed in relation to the local context.”W. T. Gates Foundation Report, 2010<br />
    7. 7. Designed inquiry emerging from a local question and leading to findings shared with a wider audience exemplifies the scholarship of teaching and learning<br />
    8. 8. Educational capital is “the progressive accumulation, in forms usable by educators, to validate experience and knowledge about successful educational ideas and strategies”<br /> Intermediaries, a category of knowledge builders, “can offer the stability, expert depth, and field-wide research to make assembling and circulating elements of educational capital a signal contribution to their constituents.”<br />Ray Bachetti and Tom Ehrlich, Reconnecting Education and Foundations, 2007, p. 23, 43<br />
    9. 9. “Both the research literature and the participants identified the importance of intermediaries and trusted individuals to increase communication between policy makers and practitioners.”<br /> “All participants in the study seldom, if ever, go to reports of research findings. They almost always seek research indirectly through intermediaries and translators.”<br />W. T. Grant Foundation report, 2010<br />
    10. 10. I/NCEPR as Intermediary<br />Internally<br />Calls<br />Critical friend exercises<br />Synthesizing and recirculating<br />Externally<br />Ten-page reports<br />Need for interpretation for policy makers <br />
    11. 11. Defining the “Non-Negotiable Core” is Essential for the Future of Eportfolios<br />Are there certain features of eportfolios, eportfolio practice, and/or assessment of eportfolios that must be present to justify the name eportfolio?<br />Cohort VI will take up a common research question about the special capacities of eportfolios for assessment<br />
    12. 12. (Selected) Findings from the Inter/National<br />Coaltion for Electronic <br />Portfolio<br />Research<br />
    13. 13. The Power of Collective Expertise<br /><ul><li>Common question played across different sites
    14. 14. The rhythm of the questioning
    15. 15. The importance of documenting practice
    16. 16. The role of inquiry and the willingness </li></ul> to engage in it<br /><ul><li>The importance of connecting the question and its results with larger sets of data</li></li></ul><li>Beginning/Continuing Questions<br />What difference, if any, do eportfolios make in student engagement?<br />What difference, if any, do eportfolios make in student retention?<br />How can/do we define reflection?<br />How can/should we “assign” reflection?<br />What is the relationship between eportfolios and institutional cultures?<br />
    17. 17. On virtually every question, students in these ePortfolio-intensive courses tended to score higher in engagement than the collegewide reported by the LaGuardia Office of Institutional Research. For example, on one critical thinking-related question--Question 5a from the 2005-6 survey: “How much has your coursework emphasized synthesizing and organizing ideas, information, and or experiences in new ways?”--the collegewide mean is 2.85 (a substantial .18 points above the national mean of 2.67). The mean for students in ePortfolio courses was 3.12, an additional .27 points higher than the already positive college mean. The pattern was similar for questions about writing, effort, technology and classroom collaboration. <br />The six questions that were significantly more positive than national and local benchmarks addressed the use of values, critical thinking, writing, teamwork, and a level of engagement. [In addition] Students’ spontaneous, open-ended comments in the survey support our hypothesis that working on the ePortfolio with the values approach is leading students to engage more deeply in their learning, to mention the values in their reflections, and to relate the values to their understanding of their learning.<br />
    18. 18. Retention data is similarly positive. For example, analysis of the transcripts of a sample of nearly 2,000 students in ePortfolio-intensive courses in 2005-6 showed an average one-semester return rate that is 5.6 percentage points higher than the college average.<br />“Not only did I gain technical skills, but I learned how to express myself as a student. The different sections of my ePortfolio made me realize important things about how I see myself starting at LaGuardia, how I see myself now and in my future. My experience with ePortfolio at LaGuardia has made me see more of who I want to be.”<br />
    19. 19. Seton Hall’s contribution to this line of research is to focus on the use of the eportfolio as a site for students’ recording and reflecting upon non-cognitive traits, specifically five such traits, including familial support for success in college and social integration during students’ first year. The intent in this eportfolio project, then, is to foster the development of these non-cognitive factors so that students stay in school. Initial data from this project show two important outcomes: (1) that scoring guides keyed to these traits can be developed and applied to eportfolios and (2) that students who score well on such traits are in fact more likely to stay in school. <br />
    20. 20.
    21. 21. Implications for Practice: <br />Waterloo and Sheffield Hallam<br /> Learning to reflect is a key skill that needs to be scaffolded at key points in the course in a way in which students are clear about the purpose of reflection, and through which the linguistic mean, and technical knowhow are achieved.<br /><ul><li> Sharing private thoughts in public spheres
    22. 22. PD in ways to promote reflection and assess reflective practice
    23. 23. Reflection and reflective practice should be built in at the course design stage. Where this is not possible courses should beredesigned.</li></li></ul><li>
    24. 24. Reflection and Genre<br />Under what conditions do low-stakes<br />portfolios generated for programmatic<br />assessment support student learning?<br />What is the relationship between reflection<br />and argument in portfolio cover essays?<br />“In many ways, our research method highlights the concepts of process and reflection that we now seek to investigate in student portfolios.”<br />
    25. 25. ePortfolios and Threshold Concepts<br />The Role of Purpose<br />The Role of Learning Activity Design<br />The Role of Processes<br />The Role of Ownership<br />The Disruptive Nature of ePortfolios<br />
    26. 26. (Selected) Findings from the Inter/National<br />Coaltion for Electronic <br />Portfolio<br />Research<br />Cambridge, Cambridge, and Yancey, eds. Electronic Portfolios 2.0.<br />Washington, DC: Stylus. 2009.<br />www.ncepr.org<br />Joyes, Gray, and Hartnell-Young, “Effective Practice with E-Portfolios.”<br />Australasian Journal of Educational Technology 26.1 (2010): 15-27.<br />
    27. 27. Future Directions for the Inter/National Coalition for Electronic Portfolio Research<br />
    28. 28. Possible Future Research Focuses<br />Assessment that capitalizes on the distinctive features of eportfolios <br />From individual to collective self-representation<br />Eportfolios in medical education <br />Longitudinal impact of eportfolio practice <br />Methodology for reading across local research <br />
    29. 29. University of Cincinnati<br />Comparison of rubric-based assessments of work from eportfolios and CLAP scores<br />Generative patterns of similarity and difference <br />Through sharing work in progress, realized that their results were about authentic assessment of samples of work, not assessment of eportfolios as such<br />
    30. 30. Beyond VALUE<br />VALUE provides a powerful set of metarubrics for conversations about liberal learning grounded in authentic evidence <br />Metarubrics designed for authentic assessment of individual samples of work rather than portfolios<br />Little attention to reflection, diversity of evidence, and the digital and networked medium <br />
    31. 31. VALUE Intercultural Rubric<br />
    32. 32.
    33. 33. From individual to collective<br />The eportfolio is strongly associated with an individualist perspective <br />Eportfolios can also have value as collective represtations<br />Demonstrated by the Urban Universities Portfolio Project <br />Social media enable new collectivist designs <br />
    34. 34.
    35. 35. Eportfolios in Medical Education<br />Fast, international uptake of eportfolios<br />Existing tradition of reflective practice<br />Experiential learning with both cognitive and affective dimensions<br />Could provide a model for other professions and for developing practical reasoning more generally<br />Challenges of access and cost shared with higher education and illuminated by international dialogue <br />
    36. 36. Longitudinal Impact of Eportfolios<br />Lifelong learning a ubiquitous goal of eportfolio projects, but little existing research beyond the original context of the project <br />Do graduates continue to use eportfolios after leaving the institution and, if so, how? <br />Are there habits of mind instilled through eportfolio practice that persist and continue to develop? <br />How does eportfolios practices transfer between educational levels and settings? <br />
    37. 37. A meta-research topic<br />Can we systematize the way we read across multiple local research projects to draw more general conclusions? <br />Can we find more effective ways to translate those results-in-coalition for broader audiences, such as policy makers? <br />
    38. 38. Electronic Portfolios 2.0: Emergent Findings and Shared Questions<br />Collection of 24 chapters detailing research from cohorts I, II, and III of the Coalition<br />Published by Stylus in 2009 <br />
    39. 39. Coalition website: ncepr.org<br />Member campuses with project descriptions<br />Final reports from Cohorts I-IV<br />Slides at ncepr.org/darren<br />

    ×