OEI Approves Course Design Rubric - WHCCD · OEI Approves Course Design Rubric ... George Lorenzo...
Transcript of OEI Approves Course Design Rubric - WHCCD · OEI Approves Course Design Rubric ... George Lorenzo...
OEI Approves Course Design Rubric WRITTEN BY GEORGE LORENZO TUESDAY, 02 SEPTEMBER 2014
The steering committee of the California Community Colleges (CCC) Online Education Initiative (OEI) has approved a Course Design Rubric, a set of quality standards for courses that will become part of the OEI Course Exchange.
The rubric, developed by the OEI’s Professional Development Work Group, promotes high quality learning and conforms to important online course and program regulations such as Title of the California Code of Regulations and Section 508 of the United States Rehabilitation Act.
“The rubric does a really good job of bringing out how online courses should be structured and what information should be provided to students in a way that facilitates their success,” said Michelle Pilati, Chief Professional Development Officer for the OEI and a Psychology professor at Rio Hondo College.
A Fusion Of Best Practices
The OEI Professional Development Work Group spent several months reviewing online course rubrics from across the country and then synthesized the most effective and important standards into the OEI Course Design Rubric.
“A lot of professionals commented on this rubric and honed in on different elements to ensure that we have an excellent product,” Pilati explained. “It is an amazing opportunity for us to step back and focus on the quality of online instruction.”
The rubric consists of 14 standards within four major components: course design, interaction and collaboration, assessment, and learner support. Each standard is scored on levels of mastery from zero to six, with zero signifying “not evident,” one as “evident,” two as “promising,” three to four as “accomplished” and five to six as “exemplary.” Before submitting a course for OEI consideration, it is helpful if instructors review these standards and conduct a self-evaluation.
Next Steps
The next step in the overall OEI course review process is to hire course reviewers and instructional designers/advisors through the @ONE Project, a statewide faculty training and online resources provider funded by the CCC Chancellor’s Office Telecommunication and Technology Infrastructure Program (TTIP).
All courses offered through the OEI Course Exchange, to be piloted during summer 2015, will go through an extensive review process to identify possible non-conformance issues related to every aspect of the rubric. OEI
course designers and advisors will then provide any assistance needed to ensure that all OEI Course Exchange offerings ultimately meet every standard.
Best Online Courses Possible
“This is huge and exciting, because often faculty members do not have this kind of assistance when they are developing courses,” Pilati says. “It’s all about thinking through how we can really perfect the quality of our online courses.”
OEI Executive Director Pat James explains: “We want our courses to be the best, and a model for everyone to use. Adhering to all of these standards will help us guarantee as best as feasibly possible that we are gearing students up for success every step of the way.”
To see the entire Course Design Rubric, visit the OEI website at http://ccconlineed.org/.
George Lorenzo is a TechEDge contributing writer, and editor and publisher of The SOURCE on Community College Issues, Trends & Strategies.
George is also president of Lorenzo Associates Inc., a content development service for higher education.
S
promise of being a system that meets the needs of
in his 2014-2015 budget for expanding access to
credit. Many educators felt that this proposal
courses to hundreds or thousands of students through a MOOC is contrary to good practice in
requirements for regular and effective contact.
instead to fund the expansion the existing online education that the California community
doing since the 1990s.
funded by competitive grants. The Request
-http://extranet.cccco.edu/
The Online Education Initiative: A Progress ReportDAN CRUMP, ONLINE EDUCATION STEERING COMMITTEE, ASCCC REPRESENTATIVE AT-LARGE
JOHN FREITAS, ONLINE EDUCATION STEERING COMMITTEE, ASCCC AREA C REPRESENTATIVE
20
ongoing funding of $10 million per year for the
an Online Course Exchange in order to provide seamless access to the online courses and
elements:
courses
little or no cost to participant colleges and
Providing faculty professional development in online pedagogy
Providing student support tools such as online tutoring
assurances that no such separate college is planned or expected.
4
ccconlineed.org
and the Chancellor’s
committee has met
and online. The committee acts as the governance body
as a preeminent expert in online education.
encouraged to select pilot colleges in the summer and start offering courses in the fall. Faculty
and developing a pilot that offers the highest
needed decision to push the start of the pilot to
colleges being announced in August.
forty-four provided requested additional
made a recommendation to select 24 colleges
Faculty contended that the pace of the project was too fast to be workable, with little opportunity for local senates to weigh in on whether or not their colleges should participate in the project.
21
Currently use Open CCC Apply
programs
Require or have substantial professional development for online faculty
Geographical and college size diversity
Capacity to add online courses to their schedules
Participation in the piloting of other
Planning
The colleges selected to test the student readiness modules and the online tutoring
management systems. This level of involvement
Piloting of the student readiness modules and online tutoring system is on schedule to start in Spring 2015. The colleges selected for the
on schedule to start in Summer 2015.5
and launch of the CCMS as a system that meets
Education Planning and Common Assessment
does not support the needs of online faculty
future Online Course Exchange.
Because of the importance of the CCMS to this
for the purpose of identifying the needs of online faculty and developing the technical
5 The reason for launching in summer instead of fall is that a period is needed to test the system
Summer is also a lighter period for the CCC Tech-
to be addressed before Fall 2015 begins.
Because the end goal of this project is to create an Online Course Exchange that will allow students a seamless experience, the project is very complex and includes many issues to be resolved.
22
of teaching and developing course management
Academic Senate.
very complex and includes many issues to be
needed for general education and graduation requirements and courses needed to complete
in registration dates and local enrollment
differences.
The quality of course design must be assured.
Committee to assure that they meet minimum quality standards for course design established
and instructional strategies
instructors that requires interdependent
Antelope Valley Butte
Cabrillo College of the Canyons Coastline
Columbia Foothill
Mira Costa Shasta
Monterey Peninsula Mt SAC Fresno City
Ohlone Pierce
Victor Valley Ventura
OEI PILOT COLLEGES
23
assignment
resources made available to students
to course and course management system.
or not students are receiving regular and
design of the various components of an online course results in regular and effective contact
contact improves the learning experience for the students.
The faculty assigned to teach the courses must also be prepared for teaching in the online learning environment. One of the components of
matures from the pilot phase to the established
online environment and thus improve the quality of online education across the system.
faculty throughout the state must stay informed regarding developments and
senates should have been consulted before their
Given that the solicitation of potential pilot
at the pilot colleges may not have been consulted
senates at the pilot colleges should strongly
impacts participation in the pilot may have on the college and provide regular status reports
the pilot should not mean automatic continued participation in the Exchange after the pilot
senates should remember that faculty primacy on academic and professional matters extends to
the Academic Senate represents the faculty 6
local senates at participant colleges do not lose their right to collegial consultation because of
governing boards or administrators to propose changes to local policies and procedures covered
consulted.
http://asccc.org/resolutions/academic-senate-participation-online-course-exchange
Local senates should be consulted on continued participation in the Exchange, regardless of whether or not they were consulted on participation in the pilot.
24
These standards have been adapted from the iNACOL Standards for Quality Online Teaching
Standards for Quality Online Teaching
Standard 1
The teacher plans, designs and incorporates strategies to encourage active learning,
interaction, participation and collaboration in the online environment.
Demonstrates effective strategies and techniques that actively engage students in the
learning process (e.g., team problem-solving, in-class writing, analysis, synthesis and
evaluation instead of passive lectures).
Facilitates and monitors appropriate interaction among students.
Builds and maintains a community of learners by creating a relationship of trust,
demonstrating effective facilitation skills, establishing consistent and reliable
expectations, and supporting and encouraging independence and creativity.
Promotes learning through group interaction.
Leads online instruction groups that are goal-oriented, focused, project-based and
inquiry-oriented.
Differentiates instruction based on students’ learning styles and needs and assists
students in assimilating information to gain understanding and knowledge.
Demonstrates growth in teaching strategies in order to benefit from current research
and practice.
Creates a warm and inviting atmosphere that promotes the development of a sense of
community among participants.
Encourages students to bring real-life examples into the online classroom.
Mandates participation by setting limits if participation wanes or if the conversation is
headed in the wrong direction.
Provides structure for students but allows for flexibility and negotiation.
Uses best practices to promote participation.
Begins each lesson with a short, student-friendly, summary statement indicating the goal
of the lesson and the primary benchmarks that will be covered.
Provides extended resources and activities to increase achievement levels.
Standard 2
The teacher provides online leadership in a manner that promotes student success through
regular feedback, prompt response and clear expectations.
Models effective communication skills and maintains records of applicable
communications with students.
Encourages interaction and cooperation among students, encourages active learning,
provides prompt feedback, communicates high expectations, and respects diverse
talents and learning styles.
These standards have been adapted from the iNACOL Standards for Quality Online Teaching
Establishes and maintains ongoing and frequent teacher-student interaction, and
student-student interaction.
Provides an online syllabus that defines objectives, concepts and learning outcomes in a
clearly written, concise format.
Provides an online syllabus that defines the terms of class interaction for both teacher
and students, defines clear expectations for both teacher and students, defines the
grading criteria, establishes inappropriate behavior criteria for both teacher and
students, and explains the course organization to students.
Uses student data to inform instruction, guides and monitors students’ management of
their time, monitors learner progress with available tools and develops an intervention
plan for unsuccessful learners.
Provides timely, constructive feedback to students about assignments and questions.
Gives students clear expectations about teacher response time.
Contacts students who are not participating.
Recognizes that student interaction with the lesson has instructional value and therefore
encourages students to participate in leading the instruction and/or demonstrating
mastery of the content in other appropriate ways.
Personalizes feedback (support, growth and encouragement).
Standard 3
The teacher models, guides and encourages legal, ethical, safe and healthy behavior related
to technology use.
Facilitates student investigations of the legal and ethical issues related to technology and
society; teaches students that copyright laws are created for a reason.
Establishes standards for student behavior that are designed to ensure academic
integrity and appropriate uses of the Internet and written communication.
Identifies the risks of academic dishonesty for students.
Demonstrates an awareness of how the use of technology may impact student
assessment performance.
Uses course content that complies with intellectual property rights policies and fair use
standards.
Provides students with an understanding of the importance of Acceptable Use Policies
(AUP).
Demonstrates knowledge of resources and techniques for dealing with issues arising
from inappropriate use of electronically accessed data or information.
Informs students of their rights to privacy and the conditions under which their names
or online submissions may be shared with others.
These standards have been adapted from the iNACOL Standards for Quality Online Teaching
Standard 4
The teacher understands and is responsive to students with special needs in the online
classroom.
Understands that students have varied talents and skills and uses appropriate strategies
designed to include all students.
Provides activities, modified as necessary, that are relevant to the needs of all students.
Adapts and adjusts instruction to create multiple paths to learning objectives.
Encourages collaboration and interaction among all students.
Exhibits the ability to assess student knowledge and instruction in a variety of ways.
Provides student-centered lessons and activities that are based on concepts of active
learning and that are connected to real-world applications.
Identifies options to expand student thinking, address styles of learning and avenues for
enrichment or intervention.
Standard 5
The teacher demonstrates competencies in creating and implementing assessments in online
learning environments in ways that assure validity and reliability of instruments and
procedures along with developing and delivering assessments, projects, and assignments that
meet learning objectives & outcomes, and assesses learning progress by measuring student
achievement.
Creates or selects fair, adequate and appropriate assessment instruments to measure
online learning that reflect sufficient content validity (i.e., that adequately cover the
content they are designed to measure), reliability and consistency over time.
Implements online assessment measures and materials in ways that ensure instrument
validity and reliability.
Includes authentic assessment (i.e., the opportunity to demonstrate understanding of
acquired knowledge and skills as opposed to testing isolated skills or retained facts) as
part of the evaluation process; assesses student knowledge in a forum beyond multiple
guess.
Provides continuous evaluation of students to include pre- and post-testing and student
input throughout the course.
Demonstrates an understanding of the relationships between and among the
assignments, assessments and learning objectives and outcomes.
These standards have been adapted from the iNACOL Standards for Quality Online Teaching
Standard 6
The teacher demonstrates competencies in using data and findings from assessments and
other data sources to modify instructional methods and content and to guide student
learning.
Assesses each student’s background and content knowledge and uses these data to plan
instruction.
Reviews student responses to test items to identify issues related to test validity or
instructional effectiveness.
Uses observational data (e.g., tracking data in electronic courses, Web logs, e-mail) to
monitor course progress and effectiveness.
Creates opportunities for self-reflection or assessment of teaching effectiveness within
the online environment (e.g., classroom assessment techniques, teacher evaluations,
teacher peer reviews).
Addresses multiple intelligences and levels of ability through a variety of alternative
interventions such as adjusting lessons based upon re-teaching and using varied
assessment strategies.
Provides evidence of effective learning strategies that worked for the individual student
and details specific changes in future instruction based upon assessment results and
research study (data-driven and research- based).
Evaluates instructional strategies to determine their accuracy and usefulness for
presenting specific ideas and concepts.
Standard 7
The teacher demonstrates frequent and effective strategies that enable both teacher and
students to complete self- and pre-assessments.
Employs ways to assess student readiness for course content and method of delivery.
Employs ways for students to effectively evaluate and assess their own readiness for
course content and method of delivery.
Understands that student success (e.g., grade, level of participation, mastery of content,
completion percentage) is an important measure of teaching and course success.
Provides opportunities for student self-assessment within courses.
Empowers students to independently define short- and long-term learning goals and
monitors their personal progress.
These standards have been adapted from the iNACOL Standards for Quality Online Teaching
Standard 8
The teacher collaborates with colleagues.
Networks with others involved in online education.
Understands the value of collaborative efforts to create common assessments among
content-area teachers and share assessment results with colleagues to collaboratively
plan instruction that will best meet individual student needs.
Standard 9
The teacher arranges media and content to help students and teachers transfer knowledge
most effectively in the online environment.
Demonstrates the ability to modify and add content and assessment, using an online
Learning Management System (LMS).
Incorporates multimedia and visual resources into an online module.
Demonstrates the ability to effectively use and incorporate subject-specific and
developmentally appropriate software in an online learning module.
Reviews all materials and Web resources for their alignment with course objectives and
state and local standards and for their appropriateness on a continuing basis.
Creates assignments, projects and assessments that are aligned with students’ different
visual, auditory and hands-on ways of learning.
Arranges media and content to help transfer knowledge most effectively in the online
environment.
Course Design Rubric for the Online Education Initiative
Course Design Rubric - OEI In order for a course to be offered as a part of the Online Education Initiative (OEI), it must meet established standards relating to course design, instruction, and accessibility that are intended to promote a quality learning environment that conforms to existing regulations. Prior to the submission of a course for OEI consideration, it is helpful for the faculty member to review these guidelines and conduct a self-evaluation. The outcome of this self-evaluation is a component of the OEI Course Application process. The Course Design Rubric for the Online Education Initiative consists of 4 components:
o A. Course Design - Course Design addresses elements of instructional design. For the purpose of this program, course design includes such elements as structure of the course, learning objectives, organization of content, and instructional strategies.
o B. Interaction and Collaboration - Interaction and Collaboration can take many forms. These criteria place emphasis on the type and amount of interaction and collaboration within an online environment. “Interaction” denotes communication between and among learners and instructors, synchronously or asynchronously. “Collaboration” is a subset of interaction and refers specifically to those activities in which groups are working interdependently toward a shared result. This differs from group activities that can be completed by students working independently of one another and then combining the results, much as one would when assembling a jigsaw puzzle with parts of the puzzle worked out separately then assembled together. A learning community is defined here as the sense of belonging to a group, rather than each student perceiving himself/herself studying independently.
o C. Assessment - Assessment focuses on instructional activities designed to measure progress towards learning outcomes, provide feedback to students and instructor, and/or enable grade assignment. This section addresses the quality and type of student assessments within the course.
o D. Learner Support - Learner Support addresses the support resources made available to students taking the course. Such resources may be accessible within or external to the course environment. Specifically, learner support resources address a variety of student services.
Approved by Online Education Initiative Steering Committee for use during the OEI pilot on __________________. This rubric is designed to inform the work of reviewers for courses being taught in connection with the California Community College Online Education Initiative. It
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
is informed by the National Standards for Quality Online Courses by the International Association for K-12 Online Learning (iNACOL).
For each sub-category (within the main categories of Course Design, Interaction and Collaboration, Assessment, and Learner Support), a weighting value (from .5 to 3) has been assigned to indicate the relative importance of that sub-category. The weighting value appears in parentheses next to each sub-category title. For example, the first sub-category for Course Design will now say Goals and Objectives (x3). Reviewers will assign a numeric score (from 0-6) for each sub-category within the major categories. The numeric scores align with the levels of mastery as follows:
• Exemplary (5-6) • Accomplished (3-4) • Promising (2) • Incomplete (1) • Not Evident (0)
It is common for a course to vary in its level of accomplishment across all items within a single sub-category. For example a course might be very strong in “Content Presentation: Navigation is intuitive”, but somewhat less strong in “Content Presentation: Content is enhanced with visual and auditory elements”, both within the same sub-category of “Content Presentation.” In these cases, the higher score (6 for Exemplary and 4 for Accomplished) should be reserved for courses that are strong across all items in the sub-category. The lower scores (5 for Exemplary and 3 for Accomplished) should be used in cases where most, but not all, of the items in the sub-category are strong.
For a course to be approved for delivery as an OEI consortium course the following criteria must be met:
• A minimum score of 3 (Accomplished) in each sub-category • A minimum weighted score of 40 for the Course Design category • A minimum weighted score of 32 for the Interaction and Collaboration
category • A minimum weighted score of 28 for the Assessment category • A minimum weighted score of 20 for the Learner Support category • Inclusion of a component with content related to the Online Education
Initiative
When it is deemed appropriate, the instructional design team will help a candidate course meet the requirements for accessibility, the OEI component, and other instructional design issues as we can. If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
A. Course Design Sub-
category (weight)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
A-1. Goals and Objectives (x3)
• Goals and objectives are easily located within the course
• Goals and objectives are clearly written at the appropriate level and reflect desired outcomes
• Goals and objectives are written in measurable outcomes (students know what they are expected to be able to do)
• Goals and objectives are made available in a variety of areas in the course (within the syllabus and each individual learning unit or module)
• Goals and objectives are located within the course syllabus or the individual learning units
• Objectives are written to reflect desired learning outcomes, although not all are written as measure- able outcomes
• Students have some understanding of what is expected of them
• Goals and objectives are not easily located within the course
• Goals and objective are not clearly written in measurable learning outcomes
• Students may be unsure of what they are expected to be able to do
• The level does not match the desired outcomes
• Goals and objectives are not easily located within the course
• Some are missing and others poorly written
• The level does not match the desired learning outcomes
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
A-2. Content Presentation (x3)
• Content is made available or “chunked” in manageable segments (i.e., presented in distinct learning units or modules)
• Navigation is intuitive • Content flows in a logical
progression • Content is presented
using a variety of appropriate mechanisms (content modules, single pages, links to external resources, etc.)
• Multimedia elements, if present, are well integrated with other course materials
• Content is made available or “chunked” in manageable segments • Navigation is somewhat intuitive, but some exploring is required to determine the flow of content • Content is presented using a variety of mechanisms (content modules, single pages, links to external resources, RSS Feeds, print material) • Multimedia elements, if present, are integrated with other course materials
• Some content segments are overly large (or possibly too small) for the specified objectives • Navigation is only occasionally intuitive, thus the flow of content is sometimes not easily determined • The design does not avail of the content presentation tools (content modules, single pages, links) • Multimedia elements, if present, are poorly integrated with other course materials
• Content is not “chunked” into manageable segments;
• Navigation is not intuitive and the flow of content is unclear
• The design does not avail of the content presentation tools (content modules, single pages, links)
• Multimedia elements, if present, are not integrated with other course materials
Score and notes
Sub- Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
category (weight)
A-3. Learner Engagement (x3)
• It is clear how the instructional strategies will enable students to reach course goals and objectives
• Course design includes guidance for learners to work with content in meaningful ways
• Individualized instruction, remedial activities, or resources for advanced learning activities, such as integrated publisher resources, are provided
• Instructional strategies are designed to help students to reach course goals and objectives, although this relationship may not be obvious to learners
• Guidance is provided, but could be improved with greater detail or depth
• Differentiated instruction (such as remediation) may be available on a limited basis
• It is not clear how the instructional strategies will help learners achieve course goals and objectives • Guidance in using content materials may only be provided on a limited basis • Differentiated instructional opportunities are not provided, although there may be supplementary content resources available
• Instructional strategies do not provide students with skills needed to achieve course goals and objectives
• Content is provided but it is not clear what students are expected to do with it
• No supplementary resources or activities are provided for remediation or advanced stud
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
A-4. Technology Use (x1)
• Tools available within the CMS are used to facilitate learning by engaging students with course content • CMS tools are used to reduce the labor-intensity of learning (e.g., providing links to needed resources where they will be used in the course, integrating publisher resources that are tailored to the course materials, and providing streamlined access to supplementary materials) • Technologies are used creatively in ways that transcend traditional, teacher-centered instruction • A wide variety of delivery media are incorporated into the course
• Tools available within the CMS could be utilized more (or more creatively) to engage learners with course content
• CMS tools are made available to assist students, but could be organized or arranged for even greater usefulness
• Technologies within the course are used in many cases merely to replicate traditional face-to-face instruction
• There is some variety in the tools used to deliver instruction
• Tools available within the CMS are not used to their full extent or not used when it would be appropriate to do so • Only a few of the available tools within the CMS are used in a way that streamlines access to materials and activities for students • Technologies within the CMS are used primarily by instructors and not students • There is little variety in use of technologies within the CMS
• Technologies used within the CMS do not engage students with learning
• Tools that could reduce the labor- intensity of online instruction are not utilized
• Students are not expected to use technologies available within the CMS
• Only a few technologies available within the CMS are used
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
B. Interaction and Collaboration Sub-category
(weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
B-1. Communication Strategies (x3)
• There are plentiful opportunities for synchronous and/or asynchronous interaction, as appropriate • Asynchronous communication strategies promote critical reflection or other higher order thinking aligned with learning objectives • Synchronous communication activities benefit from real-time interactions and facilitate “rapid response” communication (i.e., students gain practice discussing course content extemporaneously without looking up basic, declarative information)
• Several communication activities (synchronous and/or asynchronous interaction, as appropriate) are included to reinforce the desired learning outcomes
• Asynchronous communications sometimes require reflection or other higher order thinking
• Synchronous interactions are meaningful but may not take full advantage of the real-time presence of instructor and/or peers
• Communication strategies (synchronous and/or asynchronous interaction) are included, however, they may not consistently reinforce desired learning outcomes • Asynchronous communications are focused primarily on lower levels of thinking (e.g., summarizing, describing, interpreting, etc.) • Synchronous interactions are used mostly for instructor explanation or clarification of content, or other instructor-focused activities
• Little to no attention has been devoted to communication strategies • Interaction activities that are included do not invoke critical thinking, reinforce learning, or take advantage of the specific strengths of the communication tools used
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Score and notes
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
B-2. Development of Learning Community (x3)
• Instructors have a plan for initiating contact prior to or at the beginning of class and at regular intervals during the course duration • Communication activities are designed to help build a sense of community among learners • Student-to-student interactions are required as part of the course Students are encouraged to initiate communication with the instructor • Collaboration activities (if included) reinforce course content and learning outcomes, while building workplace-useful skills such as teamwork, cooperation, negotiation, and consensus-building
• Communication activities may help learners build a sense of community, but do not appear to be designed with this in mind • Some student-to-student interaction is built into the course • Students interact with the instructor, although primarily as a result of instructor-initiated contact • Collaboration activities (if included) support some team-building skills, but may not purposefully integrate these elements
• Effort has been devoted to fostering a sense of community in the course, but only minimally.
• More focus is needed on designing activities and a course climate that foster student-to-student interactions as well as student-to-instructor interactions.
• Little to no attention has been devoted to building a sense of community in this course.
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
B-3. Interaction Logistics (x2)
• Guidelines explaining required levels of participation (i.e., quantity of interactions) are provided • Expectations regarding the quality of communications (e.g., what constitutes a “good” answer) are clearly defined • A rubric or equivalent grading document is included to explain how participation will be evaluated • The instructor actively participates in communication activities, including providing feedback to students • The instructor regularly uses communication tools to provide course updates, reminders, special announcements, etc.
• Expectations of student participation in communication activities are given, but would benefit from more detail • Expectations regarding the quality of communications are included, but may be sketchy and lack detail or illustrative examples • Minimal information may be provided regarding grading criteria for communications activities • The instructor is occasionally involved in communication activities • The instructor sometimes takes advantage of CMS tools to post announcements, reminders, etc.
• Instructor expectations of student interactions are not made clear
• Little information is provided regarding what constitutes a “good” response or posting
• Students are not given a clear set of criteria for how communications activities will be graded
• The instructor appears to be largely absent from communication activities
• Few announcements, reminders, or other updates are provided
• Few or no guidelines are provided to students regarding the desired quantity or quality of communications/ interactions within the course
• The instructor does not participate in communications activities with students
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
C. Assessment Sub-
category (weight)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
C-1. Expectations (x3)
• Assessments match the goals & objectives
• Learners are directed to the appropriate objective(s) for each assessment
• Rubrics or descriptive criteria for desired outcomes are provided (models of “good work” may be shown, for example)
• Instructions are written clearly and with sufficient detail to ensure understanding
• Assessments match the goals & objectives
• Rubrics or descriptive criteria for desired outcomes are included for some assessment activities
• Instructions are written clearly, with some detail included
• Students are assessed on the topics described in the course goals and objectives
• There may be some explanation of how assessments will be scored/ graded Instructions lack detail that would help students understand how to complete the activities
• Assessments bear little resemblance to goals & objectives
• Expectations or grading criteria are not provided
• Instructions are limited or absent
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
C-2. Assessment Design (x3)
• Assessments appear to measure the performance they claim to measure (e.g., activities are explained using appropriate reading level and vocabulary) • Higher order thinking is required (e.g., analysis, problem-solving, etc.) • Assessments are designed to mimic authentic environments to facilitate transfer • Assessment activities occur frequently throughout the duration of the course, and the instructor provides meaningful feedback in a timely manner • Multiple types of assessments are used (research project, objective test, discussions, etc.)
• Assessment activities have face validity� (i.e., they appear to match the curriculum)
• Some activities involve higher order thinking
• Assessment activities may focus on tasks similar to real-world application of skills
• Multiple assessments are included; at least three different types of assessments are used
• It is not clear whether the assessment activities actually measure the desired skill
• The vast majority of assessments require only low-level thinking (memorization, for example)
• Assessment activities typically do not include tasks that are relevant beyond the scope of this course; multiple assessments are included
• Two types of assessments are included, at a minimum
• Assessment activities appear to lack validity due to bias, lack of clarity in questions or tasks, or because students are evaluated on performance unrelated to the stated objectives • No higher-order thinking skills are required to complete assessment activities • There is little or no evidence of authenticity built into assessments • Assessments are too few and far apart for the course content
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
C-3. Self-assessment (x1)
• Many opportunities for self-assessment are provided;
• Self-assessments provide constructive, meaningful feedback
• Some self-assessment activities are included
• Self-assessments provide feedback to learners
• There may be self- assessment activities, but they are limited in scope and do not offer useful feedback
• A few self-assessments may be included, but they offer little more feedback than flash cards
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
D. Learner Support
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-1. Orientation to Course and CMS (x.5)
• Clearly labeled tutorial materials that explain how to navigate the CMS and the specific course are included
• Tutorials are found easily (few clicks) whether internal or external to the course, with easy return to other areas of the course
• Tutorial materials support multiple learning modalities: audio, visual, and text based
• Clearly labeled tutorial materials that explain how to navigate the CMS and the specific course are included
• Tutorials may not be easily accessed, or require the learner to leave course site without an easy return
• Tutorial materials support multiple learning modalities: audio, visual, and text based
• Tutorial materials that explain how to navigate the CMS and/or the specific course may be evident, but not easily found
• Materials do not support multiple learning modalities and are text- based only
• Tutorial materials explaining how to navigate the CMS or the specific course may be included but are difficult to find, lack detail, are not well organized, or are incomplete
• Tutorial materials that are included do not support learning modalities
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-2. Supportive Software (If required - it is permissible to award this criterion a 6 if the course does not require software beyond the CMS and browser) (x.5)
• Clear explanations of optional and/or required software including any additional costs are provided within the course
• Software required to use course materials is listed with links to where it can be captured and installed
• Links are located within the course where learners will use the software (i.e., near the materials requiring its use)
• Clear explanations of optional and/or required software (in addition to the CMS) are provided within the course
• Software required to use course materials is listed but links to where it can be captured and installed are not found near where it will be used
• Software (in addition to the CMS) required to use course materials is mentioned, but not explained
• Links to where it can be captured and installed are provided, although they may not be conveniently located
• The need for additional software required to use course materials may be mentioned
• Links to software may be missing or incomplete
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-3. Instructor Role and Information (x1)
• Contact information for the instructor is easy to find and includes multiple forms of communication (e.g., e-mail, phone, chat, etc.)
• Expected response time for email replies (or other communication tool) is included
• The instructor’s role within the course is explained (e.g., whether he/ she will respond to “tech support”� type questions)
• The instructor’s methods of collecting and returning work are clearly explained
• Contact information for the instructor is included but may not be easy to find; contact information includes more than one type of communication tool
• Expected response time for email replies may be included
• Instructor’s role within the course is not clearly spelled out to students
• The instructor’s methods of collecting and returning work are clearly explained
• Contact information for the instructor is provided but not easy to find • Contact information includes only one way to reach the instructor • Information concerning response time for email replies is not included • Little or no information is given regarding the instructor’s role in the course • The instructor’s methods of collecting and returning work are evident but not clearly explained
• Contact information for the instructor is sketchy, at best
• Lacks information concerning response time for email replies
• Information regarding the instructor’s role in the course is not included
• Instructor’s methods of collecting and returning work are confusing or non-existent
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight) Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-4. Course/ Institutional Policies & Support (x.5)
• Software used for the course is adequately supported by the institution, including information for students on where they can obtain help • All activities that might create educational records (as defined by FERPA) or that involve regular effective contact are conducted within district- or college-supported systems • Links to institutional policies, materials, and forms relevant for learner success (e.g., plagiarism policies) are clearly labeled and easy to find • Links allow easy navigation from the course to the information and back • Course/instructor policies regarding decorum, behavior, and
• Links to institutional policies, materials, and forms relevant for learner success (e.g., plagiarism policies) are included but may require searching to find
• Links allow easy navigation from the course to the information and back
• Course/instructor policies regarding decorum, behavior, and netiquette are included and are written clearly to avoid confusion
• Links to institutional services such as the library, writing center, or financial aid office may be included but require searching to find
• Links to some institutional policies, materials, and forms relevant for learner success (e.g., plagiarism policies) are included but are difficult to find
• Course/instructor policies regarding decorum, behavior, and netiquette are included but are not clearly written or would benefit from more detail
• A few links to institutional services such as the library, writing center, or financial aid
• Links to some institutional policies, materials, and forms relevant for learner success (e.g., plagiarism policies) are not included
• Some course/instructor policies regarding decorum, behavior, and netiquette may be included but are not clearly written or would benefit from more detail
• Links to institutional services such as the library, writing center, or financial aid
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
netiquette are easy to find and written clearly to avoid confusion • Links to institutional services such as the library, or writing center, are clearly labeled and easy to find
office may be included but require searching to find
office are not included
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category (weight)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-5. Technical Accessibility Issues (x.5)
• Course materials are compliant with Section 508 and WCAG 2.0 (AA) and can be effectively used with equal ease by all students
• All non-text communications technologies support multiple digital channels with automatic provision of alternate media accommodations in real time
• Course materials are HTML-based and employ formatting styles to create semantic structure that facilitates consistent meaning and sequencing across all digital media types
• All instructional materials can be opened via free and accessible programs or applications, and links are provided for students to download the application with supporting information on how to use the program or application
• Quiz and assessment activities can be completed with equal ease via the keyboard and assistive technologies without adding cognitive load, and provide individual student-based parameters for time, number of attempts, feedback, and completion
• Course materials are compliant with Section 508 and WCAG 2.0 (AA) • All non-text communications technologies support multiple digital channels for the provision of alternate media accommodations in real time. • Course materials employ formatting styles to create semantic structure that allows for consistent meaning and sequencing across all digital media types. • All instructional materials can be opened via free and accessible programs or applications. • All assessment activities can be completed with
• Course materials fail to meet all Section 508 and WCAG 2.0 (AA) criteria completely.
• Some non-text communications technologies support limited means for the provision of alternate media accommodations.
• Course materials employ some formatting styles to create semantic structure but fail to provide reliable and consistent meaning and sequencing across all digital media types.
• Most instructional materials can be opened via free and accessible programs or
• Course materials are significantly non-compliant with Section 508 and WCAG or add cognitive load via inadequate accessibility supports.
• Non-text communications technologies do not support multiple digital channels for the provision of alternate media accommodations
• Course materials do not employ formatting styles to create semantic structure, nor consistent meaning and sequencing across digital media types.
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
equal ease via the keyboard and assistive technologies without adding cognitive load.
applications. • Most quiz and
assessment activities can be completed with equal ease via the keyboard and assistive technologies without adding cognitive load.
• Instructional materials use proprietary and inaccessible media formats.
• Quiz and assessment activities can not be completed with the keyboard or assistive technologies, and/or extra cognitive load is introduced through inadequate accessibility supports.
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category ( i ht)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-6. Accommodations for Disabilities (x1)
• There are no pedagogically-essential learning activities or instructional media that are inherently inaccessible, or in the presence of such inaccessible materials, a DSPS approved plan for accommodation is in place and ready to be provided as necessary for each inaccessible learning activity or instructional media.
• Course CMS settings are configurable by faculty to allow individual student-based accommodations to be provided within the CMS.
• Links to CMS technical support as well as contact information for DSPS support are consistently provided and easy to find, and accompanied by a module within the CMS explaining how to request services or report a problem
• An instructional material inventory of any inherently inaccessible learning objects is provided, and referenced to the
• There are no pedagogically-essential learning activities or instructional media that are inherently inaccessible, or in the presence of such inaccessible materials, faculty and DSPS have agreed to work with OEI to formulate an acceptable plan of accommodation for each inaccessible learning activity or instructional media.
• Course CMS settings can be configured in a timely manner (24 hours) by faculty and/or the CMS System Administrator to allow student accommodations to be provided within the CMS, or alternate plans for
• There are pedagogically-essential learning activities or instructional media that might be inherently inaccessible, but a deeper assessment of the course and institutional resources is required to determine the ability to support accommodations.
• Some of the CMS settings can be configured by faculty or CMS System Administrator to allow student accommodations
• There may be learning activities or instructional media that are inherently inaccessible, or there is no DSPS approved plan for accommodation.
• CMS settings cannot be configured to allow student accommodations to be provided within the CMS.
• CMS settings are not configurable to allow for student accommodations
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
accompanying course outline with plans for accommodating students with disabilities for each inaccessible learning object or activity
accommodation have been created and approved by DSPS.
• Links to CMS technical support and DSPS support are provided, and easy to find
• An instructional material inventory of any inherently inaccessible learning objects is provided, along with some potential accommodations for each learning object or activity
to be provided within the CMS.
• CMS technical support is provided, or a link to DSPS department web page, but not always easy to find
• An instructional material inventory of any inherently inaccessible learning objects is provided
• No link to technical support or DSPS department is provided
• Inherently inaccessible learning objects have not been identified, and no accommodations have been conceived or approved
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.
Course Design Rubric for the Online Education Initiative
Sub-category ( i ht)
Exemplary (5-6) Accomplished (3-4) Promising 2 Incomplete 1
D-7. Feedback (x1)
• Learners have the opportunity to give feedback to the instructor regarding course design and course content both during course delivery and after course completion
• Feedback mechanisms allow students to participate anonymously in course evaluation
• Learners have the opportunity to give feedback to the instructor regarding course design and/or course content, but only after course completion
• Feedback mechanisms allow students to participate anonymously in course evaluation
• Learners have the opportunity to give feedback to the instructor regarding course design or course content, but only after course completion
• Feedback mechanisms do not guarantee privacy to the student
• Learners do not have the opportunity to give feedback to the instructor regarding course design or course content
• Feedback mechanisms do not guarantee privacy to the student
Score and notes
If there is no evidence provided to support a sub-category, a numeric score of 0 should be assigned that represents the “Not Evident” level of mastery.