A Student Measure of the Quality of      Open Digital Textbooks                 Or   A Method For Getting Data-Backed     ...
John Dewey    Education is necessary to the  individual “to prepare him for the    future life means to give himcommand of...
“Serving society is only one of            higher education’s functions, but            it is surely among the most       ...
Image Credit: http://thethinkerblog.com/
Image Credit: http://thethinkerblog.com/
Image Credit: http://edudemic.com/
Image Credits: flatworldknowledge.com; www.etftrends.com; www.eukicks.com
Image Credits: www.flatworldknowledge.com; www.mindingthecampus.com; www.debatepolitics.com
Dilbert     By Scott Adams          Image credit: www.dilbert.com
It’s Alive!The Birth of a Textbook Quality Measure   Hard data to back up student opinions about    the quality of their (...
student surveysstudent interviews                          Qualitative Dataliterature review                              ...
student surveysstudent interviews                          Qualitative Dataliterature review                              ...
Project Kaleidoscope8 community colleges and 4-year schools       California to New York
Project Kaleidoscope         Cross-institutional faculty teamsAggregate OER-based textbook replacements (FWK)     11 cours...
490 Student Survey Responses     From your perspective, what are thecharacteristics of a high quality digital textbook?Ove...
10 Student Interviews    In-depth probing  Clarifying questioning      Transcriptions
70 Journal Articles          Peer reviewed9 main textbook evaluation criteria
student surveysstudent interviews                          Qualitative Dataliterature review                              ...
Thematic Analysis              7 main stepsData prep, reading, sorting, writing, axial     coding, more sorting, finalizing
Target ThemesNavigation, Access, Performance, Interaction, Rel     evance, Presentation, Impact, Diversity
student surveysstudent interviews                          Qualitative Dataliterature review                              ...
Mental ModelingIdentify construct relationships
student surveysstudent interviews                          Qualitative Dataliterature review                              ...
Item Development        Writing     Expert review       Revision  Cognitive interviews       Revision     Expert review   ...
Pilot Questionnaire    6 Background Items       44 Main Items      8 Target ThemesOctober 2012 Administration
student surveysstudent interviews                          Qualitative Dataliterature review                              ...
Next Steps   Model evaluation and validation (Nov. ‘12)             Item revision (Jan. ‘13)      “Final” Questionnaire 2....
A Student Measure of the Quality of Open Digital Textbooks
A Student Measure of the Quality of Open Digital Textbooks
Upcoming SlideShare
Loading in …5
×

A Student Measure of the Quality of Open Digital Textbooks

771 views
640 views

Published on

Presentation to be given at OpenEd 2012 in Vancouver, BC.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
771
On SlideShare
0
From Embeds
0
Number of Embeds
69
Actions
Shares
0
Downloads
4
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Former President of Harvard University
  • Former President of Harvard University$17.5K up from $7.5KTextbooks – avg. student spends over $900/year
  • One of, if not the most important of motivations behind the open education movement is the desire to do a better job of discharging the great responsibilities of education by lowering costs and increasing access.
  • The power of the open textbook:Reduces costCustomizable
  • We want to give faculty hard data to back up their opinions about how to adapt their open digital textbooks from
  • Version 2.0 will be openly licensed and made publicly available in early 2013.Version 3.0 will be openly licensed and made publicly available in mid 2013
  • A Student Measure of the Quality of Open Digital Textbooks

    1. 1. A Student Measure of the Quality of Open Digital Textbooks Or A Method For Getting Data-Backed Student Opinions TJ Bliss This work is licensed under a Creative Commons Attribution 3.0 Unported License. All credited images fall under Fair Use, are intended for transformative purposes only, and retain full copyright privileges.
    2. 2. John Dewey Education is necessary to the individual “to prepare him for the future life means to give himcommand of himself; it means so to train him that he will have the full and ready use of all his capacities.” Image Credit: http://c250.columbia.edu/
    3. 3. “Serving society is only one of higher education’s functions, but it is surely among the most important. At a time when the nation has its full share of difficulties...the question is notDerek Bok whether universities need to concern themselves with society’s problems but whether they are discharging this responsibility as well as they should.” Image Credit: http://helenedison.ucsd.edu/
    4. 4. Image Credit: http://thethinkerblog.com/
    5. 5. Image Credit: http://thethinkerblog.com/
    6. 6. Image Credit: http://edudemic.com/
    7. 7. Image Credits: flatworldknowledge.com; www.etftrends.com; www.eukicks.com
    8. 8. Image Credits: www.flatworldknowledge.com; www.mindingthecampus.com; www.debatepolitics.com
    9. 9. Dilbert By Scott Adams Image credit: www.dilbert.com
    10. 10. It’s Alive!The Birth of a Textbook Quality Measure Hard data to back up student opinions about the quality of their (open) digital textbooks Image Credit: www.yankeeroundtable.com
    11. 11. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final” Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
    12. 12. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
    13. 13. Project Kaleidoscope8 community colleges and 4-year schools California to New York
    14. 14. Project Kaleidoscope Cross-institutional faculty teamsAggregate OER-based textbook replacements (FWK) 11 courses, 9,000 students in 2011-2012
    15. 15. 490 Student Survey Responses From your perspective, what are thecharacteristics of a high quality digital textbook?Overall, what did you think of the digital textbook you used in your course? How would you rate the quality of the digital textbook you used in your course? Why?
    16. 16. 10 Student Interviews In-depth probing Clarifying questioning Transcriptions
    17. 17. 70 Journal Articles Peer reviewed9 main textbook evaluation criteria
    18. 18. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
    19. 19. Thematic Analysis 7 main stepsData prep, reading, sorting, writing, axial coding, more sorting, finalizing
    20. 20. Target ThemesNavigation, Access, Performance, Interaction, Rel evance, Presentation, Impact, Diversity
    21. 21. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
    22. 22. Mental ModelingIdentify construct relationships
    23. 23. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
    24. 24. Item Development Writing Expert review Revision Cognitive interviews Revision Expert review Revision
    25. 25. Pilot Questionnaire 6 Background Items 44 Main Items 8 Target ThemesOctober 2012 Administration
    26. 26. student surveysstudent interviews Qualitative Dataliterature review thematic analysis item revision Validated Model Target Themes “Final”Questionnaire Final Questionnaire factor analysis mental modeling Pilot Questionnaire Conceptual Model item development
    27. 27. Next Steps Model evaluation and validation (Nov. ‘12) Item revision (Jan. ‘13) “Final” Questionnaire 2.0 (Feb. ‘13)Further evaluation, validation, revision (Apr. ‘13) “Final” Questionnaire 3.0 (May ‘13)

    ×