Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

A Student Measure of the Quality of Open Digital Textbooks

920 views

Published on

Presentation to be given at OpenEd 2012 in Vancouver, BC.

  • Be the first to comment

A Student Measure of the Quality of Open Digital Textbooks

  1. 1. A Student Measure of the Quality of Open Digital Textbooks Or A Method For Getting Data-Backed Student Opinions TJ Bliss This work is licensed under a Creative Commons Attribution 3.0 Unported License. All credited images fall under Fair Use, are intended for transformative purposes only, and retain full copyright privileges.
  2. 2. John Dewey Education is necessary to the individual “to prepare him for the future life means to give himcommand of himself; it means so to train him that he will have the full and ready use of all his capacities.” Image Credit: http://c250.columbia.edu/
  3. 3. “Serving society is only one of higher education’s functions, but it is surely among the most important. At a time when the nation has its full share of difficulties...the question is notDerek Bok whether universities need to concern themselves with society’s problems but whether they are discharging this responsibility as well as they should.” Image Credit: http://helenedison.ucsd.edu/
  4. 4. Image Credit: http://thethinkerblog.com/
  5. 5. Image Credit: http://thethinkerblog.com/
  6. 6. Image Credit: http://edudemic.com/
  7. 7. Image Credits: flatworldknowledge.com; www.etftrends.com; www.eukicks.com
  8. 8. Image Credits: www.flatworldknowledge.com; www.mindingthecampus.com; www.debatepolitics.com
  9. 9. Dilbert By Scott Adams Image credit: www.dilbert.com
  10. 10. It’s Alive!The Birth of a Textbook Quality Measure Hard data to back up student opinions about the quality of their (open) digital textbooks Image Credit: www.yankeeroundtable.com
  11. 11. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final” Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
  12. 12. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
  13. 13. Project Kaleidoscope8 community colleges and 4-year schools California to New York
  14. 14. Project Kaleidoscope Cross-institutional faculty teamsAggregate OER-based textbook replacements (FWK) 11 courses, 9,000 students in 2011-2012
  15. 15. 490 Student Survey Responses From your perspective, what are thecharacteristics of a high quality digital textbook?Overall, what did you think of the digital textbook you used in your course? How would you rate the quality of the digital textbook you used in your course? Why?
  16. 16. 10 Student Interviews In-depth probing Clarifying questioning Transcriptions
  17. 17. 70 Journal Articles Peer reviewed9 main textbook evaluation criteria
  18. 18. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
  19. 19. Thematic Analysis 7 main stepsData prep, reading, sorting, writing, axial coding, more sorting, finalizing
  20. 20. Target ThemesNavigation, Access, Performance, Interaction, Rel evance, Presentation, Impact, Diversity
  21. 21. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
  22. 22. Mental ModelingIdentify construct relationships
  23. 23. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
  24. 24. Item Development Writing Expert review Revision Cognitive interviews Revision Expert review Revision
  25. 25. Pilot Questionnaire 6 Background Items 44 Main Items 8 Target ThemesOctober 2012 Administration
  26. 26. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
  27. 27. Next Steps Model evaluation and validation (Nov. ‘12) Item revision (Jan. ‘13) “Final” Questionnaire 2.0 (Feb. ‘13)Further evaluation, validation, revision (Apr. ‘13) “Final” Questionnaire 3.0 (May ‘13)

×