A Student Measure of the Quality of Open Digital Textbooks
-
Upload
brigham-young-university -
Category
Documents
-
view
963 -
download
3
description
Transcript of A Student Measure of the Quality of Open Digital Textbooks
![Page 1: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/1.jpg)
A Student Measure of the Quality of Open Digital Textbooks
OrA Method For Getting Data-Backed
Student Opinions
TJ Bliss
This work is licensed under a Creative Commons Attribution 3.0 Unported License. All credited images fall under Fair Use, are intended for transformative purposes only,
and retain full copyright privileges.
![Page 2: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/2.jpg)
Education is necessary to the individual “to prepare him for the future life means to give him command of himself; it means so
to train him that he will have the full and ready use of all his capacities.”
Image Credit: http://c250.columbia.edu/
John Dewey
![Page 3: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/3.jpg)
Image Credit: http://helenedison.ucsd.edu/
“Serving society is only one of higher education’s functions, but it is surely among the most important. At a time when the nation has its full share of difficulties...the question is not whether universities need to concern themselves with society’s problems but whether they are discharging this responsibility as well as they should.”
Derek Bok
![Page 4: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/4.jpg)
Image Credit: http://thethinkerblog.com/
![Page 5: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/5.jpg)
Image Credit: http://thethinkerblog.com/
![Page 6: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/6.jpg)
Image Credit: http://edudemic.com/
![Page 7: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/7.jpg)
Image Credits: flatworldknowledge.com; www.etftrends.com; www.eukicks.com
![Page 8: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/8.jpg)
Image Credits: www.flatworldknowledge.com; www.mindingthecampus.com; www.debatepolitics.com
![Page 9: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/9.jpg)
Dilbert By Scott Adams
Image credit: www.dilbert.com
![Page 10: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/10.jpg)
It’s Alive! The Birth of a Textbook Quality Measure
Hard data to back up student opinions about the quality of their (open) digital textbooks
Image Credit: www.yankeeroundtable.com
![Page 11: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/11.jpg)
“Final” Questionnaire
student surveys
student interviews
literature reviewQualitative Data
thematic analysis
Target Themes
mental modeling
Conceptual Model
item development
Pilot Questionnaire
factor analysis
Validated ModelValidated Model
“Final” Questionnaire
factor analysis
item revisionitem revision
![Page 12: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/12.jpg)
Final Questionnaire
student surveys
student interviews
literature reviewQualitative Data
thematic analysis
Target Themes
mental modeling
Conceptual Model
item development
Pilot Questionnaire
factor analysis
Validated ModelValidated Model
“Final” Questionnaire
factor analysis
item revisionitem revision
![Page 13: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/13.jpg)
Project Kaleidoscope
8 community colleges and 4-year schoolsCalifornia to New York
![Page 14: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/14.jpg)
Project Kaleidoscope
Cross-institutional faculty teamsAggregate OER-based textbook replacements (FWK)
11 courses, 9,000 students in 2011-2012
![Page 15: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/15.jpg)
490 Student Survey Responses
From your perspective, what are the characteristics of a high quality digital textbook?
Overall, what did you think of the digital textbook you used in your course?
How would you rate the quality of the digital textbook you used in your course? Why?
![Page 16: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/16.jpg)
10 Student Interviews
In-depth probingClarifying questioning
Transcriptions
![Page 17: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/17.jpg)
70 Journal Articles
Peer reviewed9 main textbook evaluation criteria
![Page 18: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/18.jpg)
Final Questionnaire
student surveys
student interviews
literature reviewQualitative Data
thematic analysis
Target Themes
mental modeling
Conceptual Model
item development
Pilot Questionnaire
factor analysis
Validated ModelValidated Model
“Final” Questionnaire
factor analysis
item revisionitem revision
![Page 19: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/19.jpg)
Thematic Analysis
7 main stepsData prep, reading, sorting, writing, axial coding,
more sorting, finalizing
![Page 20: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/20.jpg)
Target Themes
Navigation, Access, Performance, Interaction, Relevance, Presentation, Impact, Diversity
![Page 21: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/21.jpg)
Final Questionnaire
student surveys
student interviews
literature reviewQualitative Data
thematic analysis
Target Themes
mental modeling
Conceptual Model
item development
Pilot Questionnaire
factor analysis
Validated ModelValidated Model
“Final” Questionnaire
factor analysis
item revisionitem revision
![Page 22: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/22.jpg)
Mental Modeling
Identify construct relationships
![Page 23: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/23.jpg)
![Page 24: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/24.jpg)
Final Questionnaire
student surveys
student interviews
literature reviewQualitative Data
thematic analysis
Target Themes
mental modeling
Conceptual Model
item development
Pilot Questionnaire
factor analysis
Validated ModelValidated Model
“Final” Questionnaire
factor analysis
item revisionitem revision
![Page 25: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/25.jpg)
Item Development
WritingExpert review
RevisionCognitive interviews
RevisionExpert review
Revision
![Page 26: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/26.jpg)
Pilot Questionnaire
6 Background Items44 Main Items
8 Target ThemesOctober 2012 Administration
![Page 27: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/27.jpg)
![Page 28: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/28.jpg)
Final Questionnaire
student surveys
student interviews
literature reviewQualitative Data
thematic analysis
Target Themes
mental modeling
Conceptual Model
item development
Pilot Questionnaire
factor analysis
Validated ModelValidated Model
“Final” Questionnaire
factor analysis
item revisionitem revision
![Page 29: A Student Measure of the Quality of Open Digital Textbooks](https://reader035.fdocuments.net/reader035/viewer/2022062618/54dc628f4a79595c498b4673/html5/thumbnails/29.jpg)
Next Steps
Model evaluation and validation (Nov. ‘12)Item revision (Jan. ‘13)
“Final” Questionnaire 2.0 (Feb. ‘13)Further evaluation, validation, revision (Apr. ‘13)
“Final” Questionnaire 3.0 (May ‘13)