QM Internal Online Course Reviews

The members of the review team should be provided with student-level and instructor-level access in a course shell. Providing a copy of the most recent archive of the course under review, with steps taken to ensure student privacy rights, is a common way to provide access to the review team. 

For purposes of protecting the confidentiality of student information, the institution should provide a shell copy, rather than access to a live course. QM only reviews the design of the course, and reviewers should not be provided the ability to review student activity or information or to have any contact with students in any course submitted for review. By submitting the application for a course review, the institution acknowledges that Quality Matters bears no responsibility for any consequences of providing a live course for review or a course without anonymized student information.

If external or third-party material is used in a course, reviewers will also need login access for that content.

Responsibilities of the Course Representative (CR)/Instructor

Quality Matters (QM) internal course reviews at Seton Hill University begin with the CR/instructor applying for a review in the MyQM Course Review Management System (CRMS); copying the course to an LMS sandbox shell; preparing the course in the sandbox shell by removing dates, prerequisites, etc.; and filling out the QM Course Worksheet for context. 

What's Needed:

• A MyQM Account (see ITLC staff if you are unable to log into the platform)

• Access to the QM Rubric (workbook or online tool in the CRMS platform)

• Institutional Support (ITLC staff, Director of Faculty Development)

Key Tools:

• Sandbox Course Shell: A "clean" copy of the course in the LMS course shell to be used by the Review Team. Contact the LMS Administrator to create a sandbox course shell and copy the course.

• Course Review Management System (CRMS): Your central hub for managing the review process.

• QM Course Worksheet: Provides context for the review team.

• QM HE Rubric, 7th ed: The framework for evaluating course design against standards.

===============================

Step 1: Identify the Course to be Reviewed

A course that has been offered at least twice in an online, blended, or hybrid modality may be submitted for an internal course review. The course may be presented for review by the course representative (CR) (typically the instructor), the dean or program director, or, based on institutional need. The CR/instructor will be notified by email when the course has been scheduled for review and should immediately complete Step 2. 

Step 2: Initiate the Course Review -- CR/Instructor ONLY

Log into MyQM, access the Course Review Management System (CRMS), and submit a Course Review Application, selecting the Internal Review option. All internal course review activities are conducted within the MyQM CRMS platform. 

Watch the following video for a review of this process: 
Submitting a Course Review Application (03:21)

Step 3: Prepare the Course -- CR/Instructor ONLY

Submit a support request to the Solution Center directing the LMS Administrator to create a sandbox course shell in the LMS for internal course review purposes and to copy the live course--provide the course number and section number (e.g., SED 861 75) as well as the term (FA-2526-SED 861 75).

Once the course is copied, the CR/instructor must prepare the course for review following the guidelines available on the Prepare Your Course for Internal Review page. Provide login info for any third-party tools or publisher content used within the course.
Proceed to Step 4.

Step 4: Complete the Course Worksheet -- CR/Instructor ONLY

Fill out the QM Course Worksheet in the CRMS to provide the Review Team with context about the course design and goals. 

Watch the following video for a review of this process:
Completing the Course Worksheet (03:40)

Step 5: Applying the Rubric -- Review Team ONLY

An internal Review Team comprised of three individuals will be assigned to review the course and apply the Quality Matters Higher Education Rubric, 7th ed. The Review Team includes the Director of Faculty Development, an Instructional Designer, and a full-time faculty member. The Review Team is expected to review at least five (5) different courses per semester, completing one course review every three weeks.

The internal course review is conducted by evaluating the course against all Specific Review Standards included in the Quality Matters Higher Education Rubric, 7th edition, identifying strengths and weaknesses. The QM HE Rubric is available in the CRMS. It is highly recommended that faculty who teach online, blended, or hybrid courses complete the APPQMR Workshop offered each spring semester to foster continuous improvement in the design of online, blended, or hybrid courses.

The Review Team will generate a report of its findings and share the report with the CR/instructor. The report will include recommendations for improvement and identify course strengths. 

Step 6: Collaborate & Revise -- CR/Instructor ONLY

Work with the instructional designer and/or Director of Faculty Development to implement changes based on the findings of the internal course review.

Tracking Progress -- CR/Instructor & Review Team

The CRMS platform is used throughout the internal course review process to manage the review, submit feedback, and track revisions.