Iswi reception dec 2010

336 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
336
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Iswi reception dec 2010

  1. 1. Does Criterion help students improve their writing?<br />Hank Delcore<br />Jennifer L. Ivie<br />
  2. 2. Automatically-Generated Data<br />Students who made two submissions to ETS Criterion had higher average holistic scores than students who only made one submission.<br />Students with lower initial holistic scores were able to raise their scores, with subsequent submissions, to the same level as those whose initial holistic scores were higher.<br />Intervening variables?<br />
  3. 3. Faculty Scoring Panel<br />Overall, student writing improved in classes that used ETS Criterion.<br />The greatest improvements from first to last submission were made in classes in which the instructors engaged students in substantial discussions of writing and how to use Criterion.<br />Intervening variables?<br />
  4. 4. Music 187<br />Control group study across three sections of Music 187 (Jazz and Rock), an IC course.<br />Group 1: no Criterion<br />Group 2: required 2-4 submissions<br />Group 3: unlimited submissions<br />Group 2 has significantly higher instructor-assigned grades than Group 1.<br />Groups 1 and 3 had no significant difference in grades.<br />
  5. 5. Collegiate Learning Assessment<br />Asignificant difference was found between Criterion users and Criterion non-users on the CLA performance task.<br />No significant differences were found between the two groups on any of the analytic writing task scores.<br />
  6. 6. Faculty/Student Survey Highlights<br />Students felt that Criterion<br />…helps with writing mechanics.<br />…did not help them improve their writing skills.<br />But, ESL students were more likely than English as First Language students to respond that Criterion helped them improve their writing. And, they ESL students preferred Criterion feedback to instructor feedback.<br />Faculty felt that Criterion<br />…did not reduce their workload.<br />…did not do as much as they had hoped.<br />…made grading simpler.<br />…encouraged students to spend more time improving their writing.<br />… overall improved student writing.<br />
  7. 7. Faculty Learning Community<br />Faculty commented positively on<br />…the ease and convenience of using ETS Criterion.<br />…the added ability it gave them to focus on course content rather than grammar and mechanics.<br />…the fact that students using Criterion were more engaged with the writing process.<br />Drawbacks included<br />…the inability of the program to recognize technical terms or subject-specific writing conventions.<br />…perceived inaccuracies in holistic scoring.<br />…lack of compatibility with TurnItIn and Blackboard.<br />
  8. 8. Conclusion<br />Some evidence that Criterion helps students improve writing, likely in combination with good instructor practices.<br />Criterion seems to help most with mechanics.<br />Convergence of survey and FLC data: faculty agree that students who use Criterion are more engaged with the writing process.<br />Next steps…<br />

×