Continuous Improvement of the QM Rubric and Review Processes: Scholarship of Integration and Application
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An internally designed rubric, often based on the Quality Matters (QM) Rubric, is the most common way to measure course quality.
“Previous research has suggested that an internally designed rubric, often based on the Quality Matters (QM) Rubric, is the most common way to measure course quality (Lenert & Janes, 2017; Shattuck et al., 2014).”
From Instructional Designers’ Perceptions of Accessible and Inclusive Online Course Design (2024) · cites this paper as Shattuck et al., 2014
Cites
Situated Learning: Legitimate Peripheral Participation.
Bloch, M. E. F., Lave, J., & Wenger, É. (1994) · Man · doi:10.2307/2804509 · Cited by 39,359 · see citing works
The Reflective Practitioner: How Professionals Think in Action
Checkoway, B. N., & Schön, D. A. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324262 · Cited by 21,311 · see citing works
Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial
Hallgren, K. A. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p023 · Cited by 3,884 · see citing works
Glassick, C. E. (2000) · Academic Medicine · doi:10.1097/00001888-200009000-00007 · Cited by 430 · see citing works
The Scholarship of Teaching and Learning Reconsidered: Institutional Integration and Impact
Hutchings, P., Huber, M. T., & Ciccone, A. A. (2011) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 309 · see citing works
A learning college for the 21st century
O’Banion, T. U. (1997) · Cited by 192 · see citing works
Psychological Testing: A Practical Introduction
Hogan, T. P. (2002) · Cited by 163 · see citing works
Designs for network learning: a communities of practice perspective
Cousin, G., & Deepwell, F. (2004) · Studies in Higher Education · doi:10.1080/0307507052000307795 · Cited by 105 · see citing works
The Politics of Responsibility: A Theory of Program Planning Practice for Adult Education
Cervero, R. M., & Wilson, A. L. (1994) · Adult Education Quarterly · doi:10.1177/0741713694045001001 · Cited by 83 · see citing works
Guldberg, K., & Pilkington, R. M. (2006) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2006.00171.x · Cited by 70 · see citing works
Comparison between Inter-rater Reliability and Inter-rater Agreement in Performance Assessment
Liao, S. C., Hunt, E. A., & Chen, W. (2010) · Annals of the Academy of Medicine, Singapore · doi:10.47102/annals-acadmedsg.v39n8p613 · Cited by 65 · see citing works
Quality Matters: Collaborative Program Planning at a State Level.
Shattuck, K. (2007) · Online journal of distance learning administration · Cited by 31 · see citing works
Self-citationParent-Professional Congruence
Suen, H. K., Logan, C., Neisworth, J. T., & Bagnato, S. J. (1995) · Journal of Early Intervention · doi:10.1177/105381519501900307 · Cited by 31 · see citing works
Bulding Knowledge for Teaching and Learning:The Promise of Scholarship in a Networked Environment
Hatch, T., Bass, R., Iiyoshi, T., & Mace, P. (2004) · Change The Magazine of Higher Learning · doi:10.1080/00091380409604984 · Cited by 20 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Online Course Design in Higher Education: A Review of National and Statewide Evaluation Instruments
Baldwin, S., Ching, Y., & Hsu, Y. (2017) · TechTrends · doi:10.1007/s11528-017-0215-z · Cited by 124 · see citing works
Lowenthal, P., & Hodges, C. (2015) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v16i5.2348 · Cited by 116 · see citing works
Sadaf, A., Martin, F., & Ahlgrim‐Delzell, L. (2019) · Online Learning · doi:10.24059/olj.v23i4.2009 · Cited by 60 · see citing works
Evaluating Online Course Quality: A Study on Implementation of Course Quality Standards
Zimmerman, W. A., Altman, B. W., Simunich, B., Shattuck, K., & Burch, B. (2020) · Online Learning · doi:10.24059/olj.v24i4.2325 · Cited by 51 · see citing works
Self-citationStudents’ Perceptions of Online Course Quality: How Do They Measure Up to the Research?
Ralston‐Berg, P., Buckenmeyer, J. A., Barczyk, C., & Hixon, E. (2015) · Internet learning · doi:10.18278/il.4.1.2 · Cited by 33 · see citing works
Pezaro, S., Jenkins, M. D., & Bollard, M. (2021) · Nurse Education Today · doi:10.1016/j.nedt.2021.105163 · Cited by 24 · see citing works
Quality MattersTM: An Educational Input in an Ongoing Design-Based Research Project
Adair, D., & Shattuck, K. (2015) · American Journal of Distance Education · doi:10.1080/08923647.2015.1057094 · Cited by 20 · see citing works
Self-citationMoorefield-Lang, H. M., Copeland, C. A., & Haynes, A. S. (2016) · Education for Information · doi:10.3233/efi-150966 · Cited by 19 · see citing works
Letaw, L., Garcia, R., Garcia, H. M., Perdriau, C., & Burnett, M. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469742 · Cited by 15 · see citing works
Adelstein, D., & Barbour, M. K. (2016) · Touro Scholar (Touro College) · Cited by 14 · see citing works
Does Using a Course Design Framework Better Engage our Online Nursing Students?
Gaston, T., & Lynch, S. H. (2018) · Teaching and learning in nursing · doi:10.1016/j.teln.2018.11.001 · Cited by 13 · see citing works
Shang, S., & Du, C. (2022) · Library Hi Tech · doi:10.1108/lht-08-2021-0290 · Cited by 13 · see citing works
Internationalizing Quality Matters™: The China Case
Gao, Y., & Legon, R. (2015) · American Journal of Distance Education · doi:10.1080/08923647.2015.1059077 · Cited by 9 · see citing works
FACULTY DEVELOPMENT FOR ONLINE LEARNING USING A COGNITIVE APPRENTICESHIP MODEL
Wiss, A., DeLoia, J. A., Posey, L., Waight, N., & Friedman, L. H. (2018) · International journal on innovations in online education · doi:10.1615/intjinnovonlineedu.2018025705 · Cited by 8 · see citing works
Student Perceptions of Quality Matters Standards on Engagement and Learning
Conklin, S. A., & Barreto, D. (2023) · American Journal of Distance Education · doi:10.1080/08923647.2023.2242734 · Cited by 7 · see citing works
Still Forgotten Teachers in K-12 Online Learning
Barbour, M. K., Adelstein, D., & Morrison, J. (2018) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-5466-0.ch005 · Cited by 7 · see citing works
Health Promotion MOOCs (hpMOOCs): A Dual Lens for Assessing Quality
Escobedo, I. M., Doherty, K., & Eccleston, C. E. A. (2024) · American Journal of Distance Education · doi:10.1080/08923647.2024.2325845 · Cited by 7 · see citing works
Developing Peer Review of Instruction in an Online Master Course Model
Haubrick, J., Cruz, L. E., & Levy, D. R. (2021) · Online Learning · doi:10.24059/olj.v25i3.2428 · Cited by 7 · see citing works
Designing an E-Learning Health Promotion Course: Meeting the National Benchmarks
Kanekar, A. S. (2017) · Pedagogy in Health Promotion · doi:10.1177/2373379917733752 · Cited by 7 · see citing works
Deuser, K., Sanchez, R. P., Mendoza-Moran, A., Winzeler, B., Zheng, Y., & Trivedi, S. (2023) · Translational Animal Science · doi:10.1093/tas/txad112 · Cited by 3 · see citing works
البیشی, د. م. ب. ع. م. ا. (2017) · مجلة البحث العلمى فى التربية · doi:10.21608/jsre.2018.8404 · Cited by 3 · see citing works
Krusen, N. E. (2015) · Internet Learning · doi:10.18278/il.4.2.6 · Cited by 2 · see citing works
Developing an International Pool of Certified Quality Reviewers
Adair, D. (2017) · American Journal of Distance Education · doi:10.1080/08923647.2017.1337875 · Cited by 2 · see citing works
Self-citationStudents’ Agreement with QM® Rubrics as Benchmarks for Online Course Quality
Sanosi, A. (2023) · The Electronic Journal of e-Learning · doi:10.34190/ejel.21.3.2954 · Cited by 2 · see citing works
Robinson, D., & McFadden, C. (2018) · International Journal of Technology in Teaching and Learning · doi:10.37120/ijttl.2018.14.2.02 · Cited by 2 · see citing works
Instructional Designers’ Perceptions of Accessible and Inclusive Online Course Design
Lomellini, A., Lowenthal, P. R., Trespalacios, J., & Snelson, C. (2024) · Online Learning · doi:10.24059/olj.v28i4.3719 · Cited by 2 · see citing works
Measuring Cultural Responsiveness in Online Learning
Velasco, E. D. L. M., Kaletski-Maisel, G., & Jardaneh, S. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-3276-5.ch011 · Cited by 1 · see citing works
Structuring Online Instruction by Dynamic Design, Delivery, and Assessment
Koç, S., & Boboc, M. (2017) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-2399-4.ch008 · Cited by 1 · see citing works
Care and Cultural Responsiveness of Online College Courses
Heitner, K. L., Sherman, K. C., & Jennings, M. E. (2019) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-7802-4.ch016 · Cited by 1 · see citing works
The Online Teaching Practice of the Tunnel Engineering During the COVID-19 Pandemic
Jian-qin, M. (2023) · Science Journal of Education · doi:10.11648/j.sjedu.20231103.12 · Cited by 1 · see citing works
A Framework to Assess Appropriate Interaction to Meet Accreditation Quality Guidelines
Orellana, A. (2016) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-0877-9.ch013 · Cited by 1 · see citing works
WHAT IS GDPR AND WHY SHOULD YOU CARE?
Spicer, D. Z. (2018) · International journal on innovations in online education · doi:10.1615/intjinnovonlineedu.2018026049 · Cited by 1 · see citing works
Web Mining MOOCs Quality Evaluation Influencing Factors
吴, 冰. (2019) · Advances in Education · doi:10.12677/ae.2019.94077 · Cited by 1 · see citing works
Lowenthal, P. R., Lomellini, A., Smith, C., & Greear, K. (2021) · Quarterly Review of Distance Education · doi:10.1108/qrde-12-2021-0002
Educator's Learning Alignment Instrument (ELAI):
Vining, R. D., & Millard, T. (2020) · Journal of Chiropractic Education · doi:10.7899/jce-19-4
Evidence-Based Course Design: Does It Matter?Preprint
Nininger, J. M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3371512
Care and Cultural Responsiveness of Online College Courses
Heitner, K. L., Sherman, K. C., & Jennings, M. E. (2021) · IGI Global eBooks · doi:10.4018/978-1-7998-9026-3.ch017
Redefining the Quality of Online Courses: From A Smiley Test To A Seven-Star Rating
Osman, M. (2022) · European Journal of Humanities and Social Sciences · doi:10.24018/ejsocial.2022.2.4.294
Tessema, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5087402
Tessema, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5200092
- Authors
- Shattuck, K., Zimmerman, W. A., & Adair, D.
- ORCID
- Shattuck, Kay
- Venue
- Internet Learning
- Publisher
- Policy Studies Organization
- Published
- 2014
- ISSN
- 2325-0577 (ISSN-L)
- 2325-0585
- OpenAlex
- W1437171973
- Cited by
- 39
- References
- 14
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 4 · 2022: 2 · 2021: 4 · 2020: 2 · 2019: 3 · 2018: 7 · 2017: 5 · 2016: 3 · 2015: 5
- FWCI
- 22.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Internet learning (publishedVersion)
- Topics
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Education › Evaluation of Teaching Practices
- Social Sciences › Business, Management and Accounting › Strategy and Management › Management Systems and Quality Improvement
- Keywords
- quality assurance review, continuous improvement, scholarship of integration, scholarship of application, online learning quality, higher education quality assurance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review