IS THERE A ROBOT IN THIS CLASS?
THE MECHANIZATION OF STUDENT, TEACHER, AND TEXT IN THE WRITING
CLASSROOM
@JasonCKTham
DEFINITION
Automated essay scoring (AES) is the use of
specialized computer programs to assign grades to
essays written in...
The transferability of skills and
cost to how students perceive
writing…
THE APPEAL
“More information analysis than regurgitation… to
assess students’ writing and reasoning abilities.”
“Partially replacing human graders with computer
grading programs could help make those tests
cheaper, and get results bac...
THE NEW “DEEP BLUE
VS. KASPAROV”
“The results
demonstrated that
overall, automated
essay scoring was
capable of producing
scores similar to
human scores fo...
6
9
States
Software
Any student who can read can be
taught to score very highly on a
machine-graded test.
A DOUBLE-EDGED
SWORD
Agreement with human ratings is not necessarily
the best or only measure of students’ writing
proficiency (or the evidence...
If you go to a business school or an engineering
school, they’re not looking for creative writers.
They’re looking for peo...
Wait, what?
ON MECHANIZING
THE WRITING
CLASSROOM
Teach students to think rhetorically
about literacy and their writing.
Propel research on humanistic
pedagogy and AES programs
Advocate for the true purposes
of writing
CCCC Position Statement on Teaching, Learning,
and Assessing Writing in Digital Environment
Standards for the Assessment o...
CONCLUSION
THANK YOU!
@JasonCKTham
Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
Upcoming SlideShare
Loading in …5
×

Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom

852 views
712 views

Published on

This presentation illustrates how mechanized evaluation of writing may mechanize pedagogy as well as the process to create a written, machine-based product.

Full text available at: http://bit.ly/PKOeJo

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
852
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom

  1. 1. IS THERE A ROBOT IN THIS CLASS? THE MECHANIZATION OF STUDENT, TEACHER, AND TEXT IN THE WRITING CLASSROOM @JasonCKTham
  2. 2. DEFINITION Automated essay scoring (AES) is the use of specialized computer programs to assign grades to essays written in an educational setting. It is a method of educational assessment and an application of natural language processing. Its objective is to classify a large set of textual entities into a small number of discrete categories, corresponding to the possible grades – for example, the numbers 1 to 6. Therefore, it can be considered a problem of statistical classification.
  3. 3. The transferability of skills and cost to how students perceive writing…
  4. 4. THE APPEAL
  5. 5. “More information analysis than regurgitation… to assess students’ writing and reasoning abilities.”
  6. 6. “Partially replacing human graders with computer grading programs could help make those tests cheaper, and get results back to students and teachers faster.”
  7. 7. THE NEW “DEEP BLUE VS. KASPAROV”
  8. 8. “The results demonstrated that overall, automated essay scoring was capable of producing scores similar to human scores for extended-response writing items with equal performance for both source-based and traditional writing genre.
  9. 9. 6 9 States Software
  10. 10. Any student who can read can be taught to score very highly on a machine-graded test.
  11. 11. A DOUBLE-EDGED SWORD
  12. 12. Agreement with human ratings is not necessarily the best or only measure of students’ writing proficiency (or the evidence of proficiency in an essay)… The limitation of human scoring as a yardstick for automated scoring is underscored by the human ratings used for some of the tasks in this study, which displayed strange statistical properties and in some cases were in conflict with documented adjudication procedures.
  13. 13. If you go to a business school or an engineering school, they’re not looking for creative writers. They’re looking for people who can communicate ideas. And that’s what the technology is best at evaluating.
  14. 14. Wait, what?
  15. 15. ON MECHANIZING THE WRITING CLASSROOM
  16. 16. Teach students to think rhetorically about literacy and their writing.
  17. 17. Propel research on humanistic pedagogy and AES programs
  18. 18. Advocate for the true purposes of writing
  19. 19. CCCC Position Statement on Teaching, Learning, and Assessing Writing in Digital Environment Standards for the Assessment of Reading and Writing (rev. ed., 2009) Framework for Success in Postsecondary Writing (2011) Framework for 21st Century Curriculum and Assessment (2008, 2013)
  20. 20. CONCLUSION
  21. 21. THANK YOU! @JasonCKTham

×