Eli Workshop PowerPoint


Published on

Eli Workshop, November 11, 2011

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Bullet 1 annotations - Hayes, 1996; Hayes & Flower, 1986; Sommers, 1980; Wallace et al., 1996 Bullet 2 annotations - Bridwell, 1980; Flower et al., 1986; Galbraith & Torrance, 2004; Hayes & Flower, 1986; Wallace & Hayes, 1991
  • Bullet 1 annotations: Kieft, Rijlaarsdam, Galbraith, and van den Bergh, 2007 *Transition to Bill
  • Bill of Jeff take this
  • Bill of Jeff take this
  • Bill of Jeff take this
  • Eli Workshop PowerPoint

    1. 1. One Writer. Many Reviewers. Better Writing.
    2. 2. Peer Response & Evidence-Based Teaching in the Humanities <ul><li>Bill Hart-Davidson @billhd Mike McLeod @mcleodm3 </li></ul><ul><li>Michigan State University </li></ul><ul><li>WIDE Research Center </li></ul><ul><li>hartdav2@msu [dotty] edu </li></ul>Note: these slides accompany a hands-on activity conducted with elireview.com @elireview
    3. 3. Agenda <ul><li>A brief introduction to and tour of Eli </li></ul><ul><li>Breakout Sessions: </li></ul><ul><li>1. Doing a Review in Eli (Students POV) </li></ul><ul><li>2. Building a Review in Eli (Teacher’s POV) </li></ul><ul><li>3. Discussion: How Do You Use Peer Response? </li></ul><ul><li>Wrap Up, Q&A, lunch! </li></ul>
    4. 4. Origins of Eli <ul><li>Invented by writing teachers for writing teachers </li></ul><ul><li>Design grounded in theory & research (peer reviewed & published) </li></ul><ul><li>Created, tested, and used in our own classes for two years </li></ul><ul><li>Problem: How can we foster (and teach) more review and revision cycles than current technologies and time allow? </li></ul>
    5. 5. Research, Review, Better Writing <ul><li>The 2007 National Assessment of Educational Progress (NAEP) writing assessment: </li></ul>
    6. 6. Research, Review, Better Writing <ul><li>The 2007 National Assessment of Educational Progress (NAEP) writing assessment: </li></ul><ul><ul><li>Routinely engaging in revision was associated with better performance </li></ul></ul><ul><ul><li>Students who stated that they were required to routinely revise scored highest on the assessment </li></ul></ul>
    7. 7. Research, Review, Better Writing <ul><li>It is likely that giving students greater opportunity to revise will lead to improved writing. </li></ul>
    8. 8. Research, Review, Better Writing <ul><li>Yet: </li></ul><ul><ul><li>Students usually do not spontaneously revise at an optimal level and require explicit instruction </li></ul></ul><ul><ul><li>Experts revise more often than novices, who tend not to spend much time revising </li></ul></ul>
    9. 9. Research, Review, Better Writing <ul><li>And so: </li></ul><ul><ul><li>Instruction focused on a revision strategies was most helpful for writers with an undeveloped writing strategy </li></ul></ul><ul><ul><li>High quality revisions must be shaped by high quality review processes—this must (and can) be taught </li></ul></ul>
    10. 10. What is Eli? <ul><li>Coordination tool to facilitate peer review </li></ul><ul><li>Allows teachers to focus on teaching and not: </li></ul><ul><ul><li>Collecting papers </li></ul></ul><ul><ul><li>Compiling drafts, comments, revisions </li></ul></ul><ul><ul><li>Multi-day peer review activities </li></ul></ul>
    11. 11. What is Eli? <ul><li>Drafts, comments, revisions automatically gathered in one place </li></ul><ul><li>Collects data about student writers across courses and across academic careers </li></ul><ul><li>Instant, real-time feedback on writing and reviews </li></ul><ul><li>Powerful analytic data about student writing and review work </li></ul>
    12. 12. What Does Eli Do? <ul><li>Review Analytics: </li></ul><ul><li>All review information is aggregated in a single dashboard view </li></ul><ul><li>Trends that correspond to your learning goals are visible </li></ul><ul><li>Drill down to see individual students ’ work in two important roles: as a writer AND as a reviewer </li></ul>
    13. 13. Working with Eli Today <ul><li>With Mike in Room 305 </li></ul><ul><li>Gain access to today’s workshop via Secret Code </li></ul><ul><li>Short writing & review activity </li></ul><ul><li>With Bill in Room 306 </li></ul><ul><li>Demo: analyzing review results </li></ul><ul><li>Build a review activity </li></ul>
    14. 14. Create an Eli Account <ul><li>Go to http://elireview.com and click ‘Sign Up’ </li></ul><ul><li>Create an account </li></ul><ul><li>If you provide an email address, you’ll be asked to verify it (if you want to be a teacher in Eli you must provide an email address) </li></ul><ul><li>When complete, wait at the Eli dashboard for our secret code </li></ul>
    15. 15. The Writing Activity <ul><li>Write a fancy pants conference title of the sort you’d expect to see included in the program of an academic conference in your discipline. </li></ul><ul><li>Learning goals: </li></ul><ul><ul><ul><li>Students will understand the structural characteristics of the genre </li></ul></ul></ul><ul><ul><ul><li>Students will be able to write a compelling title of their own </li></ul></ul></ul><ul><ul><ul><li>Students will be able to correctly deploy the medial colon </li></ul></ul></ul>
    16. 16. The Mini Review <ul><li>Please read the draft titles submitted by your peer group and offer feedback. Use the check boxes to indicate whether their drafts meet the listed criteria. Answer the star questions, and offer a revision suggestion comment. </li></ul><ul><li>As you will see…the magic happens when we align response types and prompts with our learning goals in ways that will generate helpful data… </li></ul>
    17. 17. The Mini Review, II <ul><li>Criteria Matching </li></ul><ul><li>The draft title contains a medial colon. </li></ul><ul><li>The draft contains a phrase meant to catch attendees attention. </li></ul><ul><li>The draft contains a phrase meant to communicate the presentation’s purpose. </li></ul><ul><li>Scaled Items </li></ul><ul><li>I would attend this presentation. </li></ul><ul><li>I am confident the medial colon was used appropriately. </li></ul><ul><li>Comments </li></ul><ul><li>Describe one change the writer could make to really improve the draft. </li></ul>
    18. 18. Response Types: Criteria Matching <ul><li>In a criteria matching response, the prompt names a trait that you wish reviewers to identify in their peers' work. </li></ul><ul><li>Criteria matching items offer writers formative feedback the helps them prioritize next steps for revision. Criteria matching elements are also aggregated for the whole class, which helps a teacher to see what kinds of issues to prioritize in discussion with the larger group. </li></ul>
    19. 19. Response Types: Scaled Items <ul><li>These are questions that the teacher asks the reviewer to respond to on a scale. They can be used to provide feedback ranging from formal to informal at just about any stage in the process. Like criteria matching, scaled items are aggregated for the whole group so the teacher can see class averages and compare the results of individual students with those of the whole group. </li></ul><ul><li>Eli also identifies &quot;peer exemplars&quot; by showing the teacher those students whose work scores highest on scaled items. </li></ul>
    20. 20. Response Types: Comments <ul><li>Comments are open-ended text responses from reviewers. Comments can be attached to specific passages in a text. Instructors can prompt reviewers to offer specific types of feedback with a comment response if they like. </li></ul><ul><li>All comments from all reviewers are collected in one place, making it easy for a writer to strategize a revision plan. Instructors can view comments from reviewers as they come in during a review. Instructors can also endorse a comment by clicking a button. </li></ul>
    21. 21. One Writer. Many Reviewers. Better Writing. Thank You! @billhd @mcleodm3 @elireview elireview.com