Making sense of learning gain in higher education
Open accessAbstract
Internationally, the political appetite for educational measurement capable of capturing a metric of value for money and effectiveness has momentum. While most would agree with the need to assess costs relevant to quality to help support better governmental policy decisions about public spending, poorly understood measurement comes with unintended consequences. This article provides a comprehensive overview of the development of measures of learning gain in higher education, exploring political contexts, methodological challenges, and the multiple purposes and potential of learning gain metrics for quality assurance, accountability and enhancement, and most importantly, we argue, the enhancement of learning and teaching. Learning gain approaches should be integral to curriculum design and delivery and not extraneous to it. Enhancing shared understandings of concepts, measures, and instruments, transparency in reporting and investment in developing pedagogical research literacy, including effective use of data are essential in the pursuit of meaningful approaches to measuring learning gain within higher education.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is a lack of in-depth analysis of the similarities and differences in learning gains across different contexts, which raises new questions regarding how to meaningfully and practically assess cognitive, affective, and behavioral learning gains.
“However, there is a lack of in-depth analysis of the similarities and differences in learning gains across different contexts, which raises new questions regarding how to meaningfully and practically assess cognitive, affective, and behavioral learning gains (22–24).”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1× · see citing works
“This publication bias, also known as the file-drawer problem (Rosenthal, 1979), requires the calculation of a fail-safe number which estimates the number of unpublished studies in meta-analyses required to bring the meta-analytic mean effect down to a statistically insignificant level.”
BackgroundWhat is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1× · see citing works
“Cronbach’s alpha is widely used as the measure of reliability, but it only captures one component of reliability, there are many others, and it depends on the sources of variance that are considered to be relevant (Cortina, 1993).”
MethodProcess evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204 · see citing works
Applying the Rasch Model: Fundamental Measurement in the Human Sciences
Bond, T. G., & Fox, C. M. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01103.x · Cited by 4,503 · see citing works
Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413495237 · Cited by 3,931 · see citing works
Richardson, M., Abraham, C., & Bond, R. (2012) · Psychological Bulletin · doi:10.1037/a0026838 · Cited by 3,646 · see citing works
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138 · see citing works
High-Impact Educational Practices: What They Are, Who Has Access to Them, and Why They Matter
Kuh, G. D. (2008) · Medical Entomology and Zoology · Cited by 3,015 · see citing works
Individual differences in reasoning: Implications for the rationality debate?
Stanovich, K., & West, R. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003435 · Cited by 2,987 · see citing works
Duncker, K. (1945) · Psychological Monographs · doi:10.1037/h0093599 · Cited by 2,938 · see citing works
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814 · see citing works
Kridel, C. (2010) · Encyclopedia of Curriculum Studies · doi:10.4135/9781412958806.n175 · Cited by 2,583 · see citing works
The two disciplines of scientific psychology.
Cronbach, L. J. (1957) · American Psychologist · doi:10.1037/h0043943 · Cited by 2,556 · see citing works
Levitt, H. M., Bamberg, M., Creswell, J. W., Frost, D. M., Josselson, R., & Suárez-Orozco, C. (2018) · American Psychologist · doi:10.1037/amp0000151 · Cited by 2,286 · see citing works
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661 · see citing works
Rethinking models of feedback for learning: the challenge of design
Boud, D., & Molloy, E. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2012.691462 · Cited by 1,636 · cited 2× · see citing works
“…learning over more objective measures, students can accurately assess their experiences of the learning environment, and with focused attention on developing their self-regulatory capacity can make accurate estimates of their learning (Boud & Molloy, 2013; Evans, 2016, 2018; Waring & Evans, 2015).”
BackgroundBiesta, G. (2008) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-008-9064-9 · Cited by 1,623 · see citing works
Thought and Knowledge: An Introduction to Critical Thinking
Halpern, D. F. (1989) · Cited by 1,601 · see citing works
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449 · see citing works
Vlăsceanu, L., & Barrows, L. C. (2004) · Cited by 1,275 · see citing works
The Productivity Argument for Investing in Young Children
Heckman, J. J., & Masterov, D. V. (2007) · Review of Agricultural Economics · doi:10.1111/j.1467-9353.2007.00359.x · Cited by 1,217 · see citing works
Variables associated with achievement in higher education: A systematic review of meta-analyses.
Schneider, M., & Preckel, F. (2017) · Psychological Bulletin · doi:10.1037/bul0000098 · Cited by 1,162 · see citing works
Resolution Adopted By The General Assembly
(1984) · International Legal Materials · doi:10.1017/s002078290003076x · Cited by 1,150 · see citing works
Making Sense of Assessment Feedback in Higher Education
Evans, C. (2013) · Review of Educational Research · doi:10.3102/0034654312474350 · Cited by 1,143 · see citing works
Bond, T. G. (2015) · Routledge eBooks · doi:10.4324/9781315814698 · Cited by 1,062 · see citing works
Duckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993 · see citing works
Engagement through partnership: students as partners in learning and teaching in higher education
Bryson, C. (2016) · The International Journal for Academic Development · doi:10.1080/1360144x.2016.1124966 · Cited by 868 · see citing works
Komarraju, M., & Nadler, D. (2013) · Learning and Individual Differences · doi:10.1016/j.lindif.2013.01.005 · Cited by 851 · see citing works
Psychometrics: An Introduction.
Furr, R. M., & Bacharach, V. R. (2007) · Cited by 788 · see citing works
Edwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688 · see citing works
Collini, S. (2012) · Cited by 668 · see citing works
Reporting standards for research in psychology: why do we need them? What might they be?
APA Publications and Communications Board Working Group on Journal Article Reporting Standards (2008) · American Psychologist · doi:10.1037/0003-066x.63.9.839 · Cited by 571 · see citing works
Howard (1980) · doi:10.1177/0193841x8000400105 · Cited by 531 · see citing works
Good Education in an Age of Measurement
Biesta, G. (2015) · Routledge eBooks · doi:10.4324/9781315634319 · Cited by 458 · see citing works
Developing Effective Assessment in Higher Education: A Practical Guide
Bloxham, S., & Boyd, P. (2007) · Insight (University of Cumbria) · Cited by 377 · see citing works
(2013) · VTechWorks (Virginia Tech) · Cited by 345 · see citing works
Vermunt, J. D. H. M., & Donche, V. (2017) · Educational Psychology Review · doi:10.1007/s10648-017-9414-6 · Cited by 341 · see citing works
UN Decade of Education for Sustainable Development
Abe, O. (2006) · TRENDS IN THE SCIENCES · doi:10.5363/tits.11.4_46 · Cited by 329 · see citing works
Assessing outcomes and improving achievement : tips and tools for using rubrics
Rhodes, T. L. (2010) · Medical Entomology and Zoology · Cited by 317 · see citing works
A method of scaling psychological and educational tests.
Thurstone, L. (1925) · Journal of Educational Psychology · doi:10.1037/h0073357 · Cited by 301 · see citing works
Asikainen, H., & Gijbels, D. (2017) · Educational Psychology Review · doi:10.1007/s10648-017-9406-6 · Cited by 265 · see citing works
Domains and predictors of first-year student success: A systematic review
van der Zanden, P. J. A. C., Denessen, E. J. P. G., Cillessen, A. H. N., & Meijer, P. C. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.01.001 · Cited by 220 · see citing works
Learning Analytics in Higher Education
Lester, J., Klein, C., Rangwala, H., & Johri, A. (2017) · ASHE Higher Education Report · doi:10.1002/aehe.20121 · Cited by 217 · see citing works
Fulfilling our potential: teaching excellence, social mobility and student choice
Skills (2015) · Cited by 193 · see citing works
Dropout and completion in higher education in Europe: main report
Vossensteyn, H., Kottmann, A., Jongbloed, B. W. A., Kaiser, F., Cremonini, L., Stensaker, B., Hovdhaugen, E., & Wollscheid, S. (2015) · University of Twente Research Information · doi:10.2766/826962 · Cited by 190 · see citing works
Cognitive Style as Environmentally Sensitive Individual Differences in Cognition
Kozhevnikov, M., Evans, C., & Kosslyn, S. M. (2014) · Gothic.net · doi:10.1177/1529100614525555 · Cited by 189 · see citing works
Kuh, G. D., O’Donnell, K., & Schneider, C. G. (2017) · Change The Magazine of Higher Learning · doi:10.1080/00091383.2017.1366805 · Cited by 173 · see citing works
Infusing Neuroscience Into Teacher Professional Development
Dubinsky, J. M., Roehrig, G., & Varma, S. (2013) · Educational Researcher · doi:10.3102/0013189x13499403 · Cited by 166 · see citing works
What Can Medical Education Learn From the Neurobiology of Learning?
Friedlander, M. J., Andrews, L., Armstrong, E. G., Aschenbrenner, C. A., Kass, J. S., Ogden, P. E., Schwartzstein, R. M., & Viggiano, T. R. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31820dc197 · Cited by 160 · see citing works
The learning outcomes race: the value of self-reported gains in large research universities
Douglass, J. A., Thomson, G., & Zhao, C.-M. (2012) · Higher Education · doi:10.1007/s10734-011-9496-x · Cited by 156 · see citing works
Thought and Knowledge: An Introduction to Critical Thinking, 4th Edition
Halpern, D. F. (2002) · Cited by 148 · see citing works
Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.028 · Cited by 147 · see citing works
Students as change agents: new ways of engaging with learning and teaching in higher education
Brown, A., & Nurser, T. (2011) · Bristol Research (University of Bristol) · Cited by 141 · see citing works
A comparison of high and low achieving students on self-regulated learning variables
DiFrancesca, D., Nietfeld, J. L., & Cao, L. (2016) · Learning and Individual Differences · doi:10.1016/j.lindif.2015.11.010 · Cited by 141 · see citing works
Gibson, S. (2015) · International Journal of Inclusive Education · doi:10.1080/13603116.2015.1015177 · Cited by 134 · see citing works
Toward a Dynamic, Multidimensional Research Framework for Strategic Processing
Dinsmore, D. L. (2017) · Educational Psychology Review · doi:10.1007/s10648-017-9407-5 · Cited by 134 · see citing works
Thanks, but no-thanks for the feedback
Forsythe, A., & Johnson, S. (2016) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2016.1202190 · Cited by 133 · see citing works
Personality and Cognitive Ability as Predictors of Effective Performance at Work
Schmitt, N. (2013) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-031413-091255 · Cited by 126 · see citing works
Are Higher Education Institutions Prepared for Learning Analytics?
Ifenthaler, D. (2017) · TechTrends · doi:10.1007/s11528-016-0154-0 · Cited by 124 · see citing works
Richardson, J. T. E. (2013) · Journal of Further and Higher Education · doi:10.1080/0309877x.2013.858680 · Cited by 116 · see citing works
Causes of differences in student outcomes
Zimdars, A. K., Sabri, D., Moore, J., Sanders, J., Jones, S., & Higham, L. (2015) · Digital Education Resource Archive (University College London) · doi:10.13140/rg.2.2.34621.36326 · Cited by 108 · see citing works
A revised learning transfer system inventory: factorial replication and validation
Bates, R. A., Holton, E. F., & Hatala, J. P. (2012) · Human Resource Development International · doi:10.1080/13678868.2012.726872 · Cited by 106 · see citing works
Caspersen, J., Smeby, J., & Aamodt, P. O. (2017) · European Journal of Education · doi:10.1111/ejed.12205 · Cited by 104 · see citing works
A 10-year case study on the changing determinants of university student satisfaction in the UK
Burgess, A., Senior, C., & Moores, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192976 · Cited by 100 · see citing works
Building teachers’ research literacy: integrating practice and research
Evans, C., Waring, M., & Christodoulou, A. (2017) · Research Papers in Education · doi:10.1080/02671522.2017.1322357 · Cited by 95 · see citing works
Bliuc, A., Ellis, R. A., Goodyear, P., & Hendreș, D. M. (2011) · European Journal of Psychology of Education · doi:10.1007/s10212-011-0065-6 · Cited by 94 · see citing works
Using concept inventories to measure understanding
Sands, D., Parker, M., Hedgeland, H., Jordan, S., & Galloway, R. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1433546 · Cited by 89 · see citing works
Learning Gain in Higher Education
McGrath, C. H., Guerin, B., Harte, E., Frearson, M., & Manville, C. (2021) · International Perspectives on Higher Education Research · doi:10.7249/rr996 · Cited by 87 · see citing works
(2014) · ePrints Soton (University of Southampton) · Cited by 84 · see citing works
Lessons from the Wabash National Study of Liberal Arts Education
Pascarella, E. T., & Blaich, C. F. (2013) · Change The Magazine of Higher Learning · doi:10.1080/00091383.2013.764257 · Cited by 84 · see citing works
Willetts, D. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780198767268.001.0001 · Cited by 83 · see citing works
Modeling and Measuring Competencies in Higher Education
Blömeke, S., Sriraman, J., Kuhn, C., & Zlatkin‐Troitschanskaia, O. (2013) · SensePublishers eBooks · doi:10.1007/978-94-6091-867-4 · Cited by 77 · see citing works
The Conditional Nature of High Impact/Good Practices on Student Learning Outcomes
Seifert, T. A., Gillig, B., Hanson, J. M., Pascarella, E. T., & Blaich, C. F. (2014) · The Journal of Higher Education · doi:10.1353/jhe.2014.0019 · Cited by 63 · see citing works
Engaged student learning. High Impact strategies to enhance student achievement
Evans, C., Mujis, D., & Tomlinson, D. R. (2015) · ePrints Soton (University of Southampton) · Cited by 62 · see citing works
Peeters, J., Backer, F. D., Kindekens, A., Triquet, K., & Lombaerts, K. (2016) · Learning and Individual Differences · doi:10.1016/j.lindif.2016.10.014 · Cited by 61 · see citing works
Enhancing assessment feedback practice in higher education: The EAT Framework
Evans, C. (2016) · ePrints Soton (University of Southampton) · Cited by 61 · see citing works
Undergraduate research, learning gain and equity: the impact of final year research projects
Parker, J. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1425097 · Cited by 56 · see citing works
Shavelson, R. J., Zlatkin‐Troitschanskaia, O., & Mariño, J. P. (2018) · Methodology of educational measurement and assessment · doi:10.1007/978-3-319-74338-7_10 · Cited by 54 · see citing works
Perceptions of science graduating students on their learning gains
Varsavsky, C., Matthews, K. E., & Hodgson, Y. (2014) · International Journal of Science Education · doi:10.1080/09500693.2013.830795 · Cited by 53 · see citing works
What contemporary work are student ratings actually doing in higher education?
Darwin, S. (2016) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2016.08.002 · Cited by 52 · see citing works
Frost, T. (2016) · Figshare · Cited by 52 · see citing works
Students’ interpretations of the meanings of questionnaire items in the National Student Survey
Bennett, R., & Kane, S. (2014) · Quality in Higher Education · doi:10.1080/13538322.2014.924786 · Cited by 51 · see citing works
Academic life in the measured university: pleasures, paradoxes and politics
Peseta, T. L., Barrie, S. C., & McLean, J. (2017) · Higher Education Research & Development · doi:10.1080/07294360.2017.1293909 · Cited by 50 · see citing works
Köhler, T., Landis, R. S., & Cortina, J. M. (2017) · Academy of Management Learning and Education · doi:10.5465/amle.2017.0079 · Cited by 49 · see citing works
Engaging university students : international insights from system-wide studies
Coates, H. B., & McCormick, A. C. (2014) · Springer eBooks · doi:10.1007/978-981-4585-63-7 · Cited by 48 · see citing works
Sharing successes and hiding failures: ‘reporting bias’ in learning and teaching research
Dawson, P., & Dawson, S. L. (2016) · Studies in Higher Education · doi:10.1080/03075079.2016.1258052 · Cited by 48 · see citing works
Vermunt, J. D., Ilie, S., & Vignoles, A. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1484672 · Cited by 46 · see citing works
On the practices and challenges of measuring higher education value added: the case of Colombia
Shavelson, R. J., Domingue, B. W., Mariño, J. P., Mantilla, A. M., Morales‐Forero, A., & Wiley, E. W. (2016) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2016.1168772 · Cited by 40 · see citing works
Barr, N. (2005) · University of Toronto Press eBooks · doi:10.3138/9781442680333-025 · Cited by 38 · see citing works
Ruge, G., & McCormack, C. (2017) · Architectural Engineering and Design Management · doi:10.1080/17452007.2017.1328351 · Cited by 35 · see citing works
Toward a set of measures of student learning outcomes in higher education: evidence from Brazil
Melguizo, T., & Wainer, J. (2015) · Higher Education · doi:10.1007/s10734-015-9963-x · Cited by 33 · see citing works
Behavioural Approaches to Understanding Student Choice.
Diamond, A., Vorley, T., Roberts, J., & Jones, S. (2012) · Cited by 32 · see citing works
Aloisi, C., & Callaghan, A. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1449128 · Cited by 26 · see citing works
Teaching Excellence and Student Outcomes Framework (TEF) 2019Preprint
Bishop, D. (2019) · OSF Preprints (OSF Preprints) · Cited by 23 · see citing works
Assessment could demonstrate learning gains, but what is required for it to do so?
Boud, D. J. (2017) · Higher Education Pedagogies · doi:10.1080/23752696.2017.1413671 · Cited by 21 · see citing works
The 16 P.F. and basic personality structure: A reply to Eysenck.
Cattell, R. B. (1972) · Cited by 21 · see citing works
Overeducation among Italian graduates: do different measures diverge?
Cattani, L., Guidetti, G., & Pedrini, G. (2017) · Economia Politica · doi:10.1007/s40888-017-0075-1 · Cited by 17 · see citing works
Lessons in learning gain: insights from a pilot project
Arico, F., Gillespie, H., Lancaster, S. J., Ward, N., & Ylönen, A. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1454845 · Cited by 15 · see citing works
Enhancing Employability through Enterprise Education: Examples of Good Practice in Higher Education
Owens, J., & Tibby, M. (2014) · Worcester Research and Publications (University of Worcester) · Cited by 14 · see citing works
Measuring learning gains and examining implications for student success in STEM
Scalise, K., Douskey, M. C., & Stacy, A. M. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1425096 · Cited by 13 · see citing works
Ipsative Assessment and Personal Learning Gain
Hughes, G. (2017) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-137-56502-0 · Cited by 12 · see citing works
Predicting gainful learning in Higher Education; a goal-orientation approach
Forsythe, A., & Jellicoe, M. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1435298 · Cited by 12 · see citing works
Speight, L. J., Crawford, K., & Haddelsey, S. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1476827 · Cited by 12 · see citing works
Which first-year students are making most learning gains in STEM subjects?
Rogaten, J., & Rienties, B. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1484671 · Cited by 11 · see citing works
A brief history of the Fail Safe Number in Applied ResearchPreprint
Heene, M. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1010.2326 · Cited by 10 · see citing works
Strang, L., Bélanger, J., Manville, C. M., & Meads, C. (2016) · Cited by 10 · see citing works
Cameron, A., Wharton, Y., & Scally, J. B. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1435297 · Cited by 10 · see citing works
The digital revolution: the impact of the fourth industrial revolution on employment and education
Baker, K. F., & Barón (2016) · Cited by 10 · see citing works
Turner, R., Sutton, C., Muneer, R., Gray, C., Schaefer, N., & Swain, J. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1449127 · Cited by 9 · see citing works
Towards a measure of learning gain. A journey. With obstacles
Baume, D. (2018) · Higher Education Pedagogies · doi:10.1080/23752696.2018.1467213 · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 113 references couldn’t be matched to a known paper.
Research works printed but not linked: 8
- Academy of Management Learning and Education (AMLE). (2017). Editorial: Establishing methodological rigor in quantitative management learning and education research: The role of design, statistical methods, and reporting standards. Academy of Management Learning & Education , 16 (2), 173 -192.
- Arum, R., & Roska, J. (2011). Academically adrift . Chicago, USA: University of Chicago Press.
- Coates, H. (2016). The market for learning: Leading transparent higher education . Melbourne, Australia: Springer.
- Fisherman, T., Ludgate, A., & Tutak, J. (2017). Success by design, improving outcomes in American higher education. A Deloitte center for higher education excellence series on student success. Deloitte University Press. Retrieved from https://www2.deloitte.com/ insights/us/en/focus/reimagining-higher-education.html.
- Havergal, C. (2017). Cambridge looks to crack measurement of ' learning gain ' . Times Higher Educational Supplement, December 7, 2017. Retrieved from https://www.timeshighereduca tion.com/news/cambridge-looks-crack-measurement-learning-gain
- HEFCE/OfS. (2015). Listed in hefce/office for students (ofs) grant letters for 2015-2016 . London/ Bristol: Higher Education Funding Council for England
- Kuh, G., O ' Donnell, K., & Schneider, C.G. (2017). HIPs at ten. Change: The Magazine of Higher Learning , 49 (5), 8 -16.
- Rosenfeld, M., & Rosenfeld, S. (2011). Illustrating a complementary paradigm for styles research: From a third-person to a second-person perspective. In S. Rayner & E. Cools (Eds.), Style differences in cognition, learning, and management: Theory, research and practice (pp. 143 -159). New York, NY: Routledge.
Cited by
Sorted by citations
Williamson, B. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12849 · Cited by 166 · see citing works
What constitutes high quality higher education pedagogical research?
Evans, C., Howson, C. K., Forsythe, A., & Edwards, C. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1790500 · Cited by 68 · see citing works
Synergies of Learning Analytics and Learning Design: A Systematic Review of Student Outcomes
Blumenstein, M. (2020) · Journal of Learning Analytics · doi:10.18608/jla.2020.73.3 · Cited by 54 · see citing works
Mtawa, N. N., & Nkhoma, N. M. (2020) · Higher Education Pedagogies · doi:10.1080/23752696.2020.1788969 · Cited by 37 · see citing works
Acton, R. (2019) · Education Sciences · doi:10.3390/educsci9040269 · Cited by 30 · see citing works
Valero, M. D. R., Reid, T., Dell, G. C., Stacey, D., Hatt, J., Moore, Y., & Clift, S. E. (2020) · Higher Education Pedagogies · doi:10.1080/23752696.2020.1816846 · Cited by 21 · see citing works
McCarthy, B., & Eagle, L. C. (2021) · Australian Journal of Environmental Education · doi:10.1017/aee.2021.11 · Cited by 19 · see citing works
Abegglen, S., Greif, R. T., Balmer, Y., Znoj, H. J., & Nabecker, S. (2022) · Advances in Simulation · doi:10.1186/s41077-022-00222-3 · Cited by 16 · see citing works
Student video production within health professions education: A scoping review
Liu, Q., Geertshuis, S. A., Gladman, T., & Grainger, R. (2022) · Medical Education Online · doi:10.1080/10872981.2022.2040349 · Cited by 15 · see citing works
Morgan, A., Jobe, R. L., Konopa, J. K., & Downs, L. D. (2022) · Higher Learning Research Communications · doi:10.18870/hlrc.v12i1.1301 · Cited by 14 · see citing works
The Development and Validation of the Feedback in Learning Scale (FLS)
Jellicoe, M., & Forsythe, A. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00084 · Cited by 13 · see citing works
Andrew Brasher, A., Whitelock, D. M., Holmes, W., Pozzi, F., Persico, D., Manganello, F., Passarelli, M., & Sangrà, A. (2022) · European Journal of Education · doi:10.1111/ejed.12497 · Cited by 12 · see citing works
Behle, H. (2021) · Higher Education Quarterly · doi:10.1111/hequ.12318 · Cited by 11 · see citing works
Assessment Literacy in the Higher Education Context: A Critical Review
Pastore, S. (2022) · Intersection A Journal at the Intersection of Assessment and Learning · doi:10.61669/001c.39702 · Cited by 10 · see citing works
Conceptualising Graduate Outcomes with Critical Realism
Fryer, T. B. (2021) · Higher Education Policy · doi:10.1057/s41307-021-00232-2 · Cited by 10 · see citing works
Redefining Mathematics Education in the Age of Artificial Intelligence
Zreık, M. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-2873-6.ch002 · Cited by 13 · see citing works
Higher education students’ conceptions of learning gain
Ilie, S., Forbes, K., Curran, S., & Vermunt, J. D. H. M. (2024) · Active Learning in Higher Education · doi:10.1177/14697874241270461 · Cited by 9 · see citing works
Polkinghorne, M., O’Sullivan, H., Taylor, J., & Roushan, G. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1703132 · Cited by 9 · see citing works
The Tyranny of ‘Teaching and Learning’
Buckley, A. (2021) · Studies in Philosophy and Education · doi:10.1007/s11217-021-09769-6 · Cited by 7 · see citing works
Zhong, L., Li, X., Sun, S., Law, R., Qi, X., & Dong, Y. (2022) · Sustainability · doi:10.3390/su142416601 · Cited by 7 · see citing works
A Critical Review of Learning Gains Methods and Approaches
Rogaten, J., & Rienties, B. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-362820210000014003 · Cited by 6 · see citing works
Othman, R., Mukherjee, D., Mostofa, S. M., & Hasan, K. K. (2021) · The International Islamic University Malaysia Repository (The International Islamic University Malaysia) · doi:10.22059/jitm.2021.80357 · Cited by 6 · see citing works
Value Added in Higher Education: Brief History, Measurement, Challenges, and Future Directions
Roohr, K. C., Olivera‐Aguilar, M., & Liu, O. L. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-362820210000014005 · Cited by 6 · see citing works
Existing Research on Learning Gain in Higher Education
Tight, M. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-362820210000014002 · Cited by 6 · see citing works
Comparing Knowledge Retention in Adult English Courses: Face-to-Face, Online, or Blended?
Ginzburg, T., & Daniela, L. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09841-x · Cited by 5 · see citing works
Svendsen, E. J., Opheim, R., Hermansen, B. E., & Hardeland, C. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287438 · Cited by 5 · see citing works
Exploring the Use of Immersive Technologies to Enhance the Student Experience
Dermott, G. M., Byrne, A., McLaughlin, R., O’Connor, N., & Griselain, S. (2023) · Ubiquity Proceedings · doi:10.5334/uproc.98 · Cited by 5 · see citing works
Seeking an educational Utopia: an alternative model for evaluating student Learning Gain
Polkinghorne, M., Roushan, G., & Taylor, J. (2020) · Journal of Further and Higher Education · doi:10.1080/0309877x.2020.1826035 · Cited by 5 · see citing works
Learning by watching others learn: the use of videoed tutorials in undergraduate business education
Geertshuis, S. A., Liu, Q., Rix, N., Murdoch, O., & McConnell, M. L. (2021) · Higher Education Pedagogies · doi:10.1080/23752696.2021.1916980 · Cited by 5 · see citing works
Tate, A., & Glazzard, J. (2024) · International Journal of Educational and Life Transitions · doi:10.5334/ijelt.77 · Cited by 4 · see citing works
Etzel, J. M., Heinze, A., Neumann, K., Bernholt, S., Retelsdorf, J., Köller, O., & Nagy, G. (2025) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2025.102336 · Cited by 5 · see citing works
John, W. S., & Kamin, Y. (2021) · Universal Journal of Educational Research · doi:10.13189/ujer.2021.090805 · Cited by 4 · see citing works
O’Sullivan, H., Polkinghorne, M., & Taylor, J. (2022) · Businesses · doi:10.3390/businesses2020015 · Cited by 4 · see citing works
Are Assessment Practices Well Aligned Over Time? A Big Data Exploration
Rogaten, J., Clow, D., Edwards, C. B., Gaved, M., & Rienties, B. (2020) · The enabling power of assessment · doi:10.1007/978-3-030-41956-1_11 · Cited by 4 · see citing works
Siddiqui, N., Nahar, N., Hossain, M., Tazmeen, A., & Ali, K. S. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2380638 · Cited by 3 · see citing works
Students’ Learning Gains in Extracurricular Challenge-Based Learning Teams
Bravo, E., Jacobs, D. B., van der Veen, J. T., & Reymen, I. M. M. J. (2024) · European Journal of Engineering Education · doi:10.1080/03043797.2024.2386108 · Cited by 3 · see citing works
Resilience through Hybridization: The Development of Higher Education in the Sultanate of Oman
Bigagli, F. (2020) · Νημερτής · doi:10.26220/aca.3441 · Cited by 3 · see citing works
Efficiency of University Course during the Covid-19 Pandemic
Vejačka, M. (2021) · TEM Journal · doi:10.18421/tem104-13 · Cited by 3 · see citing works
Maximising Student Success through the Development of Self-Regulation
Evans, C., Zhu, X., Winstone, N., Balloo, K., Hughes, A., & Bright, C. (2019) · ePrints Soton (University of Southampton) · doi:10.13140/rg.2.2.21930.44481 · Cited by 3 · see citing works
Mukherjee, D., & Hasan, K. K. (2022) · Springer proceedings in business and economics · doi:10.1007/978-981-19-0357-1_15 · Cited by 3 · see citing works
Wei, S., Wei, W., & Zou, G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1832598 · Cited by 2 · see citing works
Diver, A. (2020) · Higher Education Quarterly · doi:10.1111/hequ.12260 · Cited by 2 · see citing works
Liang, X. (2025) · Higher Education · doi:10.1007/s10734-025-01498-w · Cited by 2 · see citing works
Rethinking educational gain in higher education: beyond metrics to a multi-dimensional model
Wong, B. (2025) · Journal of Higher Education Policy and Management · doi:10.1080/1360080x.2025.2545624 · Cited by 2 · see citing works
Dukhan, S. (2021) · Critical Studies in Teaching and Learning · doi:10.14426/cristal.v9isi.334 · Cited by 2 · see citing works
de Lange, T., Möystad, A., Torgersen, G. R., Ahlqvist, J. B., & Jäghagen, E. L. (2023) · European Journal Of Dental Education · doi:10.1111/eje.12959 · Cited by 1 · see citing works
Extracurricular student teams: learning gains in interdisciplinary projects
Bravo, E., Jacobs, D. B., van der Veen, J. T., & Reymen, I. M. M. J. (2025) · European Journal of Engineering Education · doi:10.1080/03043797.2025.2543775 · Cited by 1 · see citing works
Khan, A., Fang, S., & Zeb, I. (2026) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe-10-2025-1234 · Cited by 1 · see citing works
Pastore, S. (2026) · Higher Education Quarterly · doi:10.1111/hequ.70117 · Cited by 1 · see citing works
Intending to Teach Critical Thinking
Lilly, T., Darr, P., SCHMOLESKY, M. T., Lindley, T., Schilpzand, M. C., Ludolph, P., Higgins, R., Shim, Y., Weinstein, A., Deutsch, D. V., et al. (2022) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v22i3.31801 · Cited by 1 · see citing works
Mitra, A. (2023) · Advances in higher education and professional development book series · doi:10.4018/978-1-6684-9472-1.ch001 · Cited by 1 · see citing works
de Souza, É. M. A., Machado, P. A. D. S., Santos, L. C. G. D. S., de Lima, T. H., Rodrigues, J. M., & Diniz, H. A. G. (2025) · Revista de Gestão e Secretariado (Management and Administrative Professional Review) · doi:10.7769/gesec.v16i1.4466 · Cited by 1 · see citing works
Measuring Language Gains in a Foreign Language Context
Muñoz, A. P., Carvajal, I. V., Muñoz, A. L., & Avendaño-Franco, R. A. (2020) · Colombian Applied Linguistics Journal · doi:10.14483/22487085.14171
Pursuing Learning Gain in Australian Universities
Evans, D. J. R. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-362820210000014010
A Review in our Present Teaching Pedagogies: Traditional, Digital and Flipped Learning
Shun, C. L. K. (2020) · Scholars Journal of Physics Mathematics and Statistics · doi:10.36347/sjpms.2020.v07i12.001
A Review in Our Present Teaching Pedagogies: Traditional, Digital and Flipped LearningPreprint
Lam, K. S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3339031
Antecedentes do ganho de aprendizagem na educação superior
de Azevedo, A. A., & Neto, A. C. (2021) · Debates em educação · doi:10.28998/2175-6600.2021v13nesp2p795-815
Grabarnik, G. Y., & Yaskolko, L. K.-T. A. S. (2022) · doi:10.33965/el2022_202203l004
Бондаренко, В. И., & Shein, V. (2023) · Bulletin of Kharkov National Automobile and Highway University · doi:10.30977/bul.2219-5548.2023.100.0.145
Konaszewski, K., Muszyńska, J., Skalski‐Bednarz, S. B., & Surżykiewicz, J. (2023) · Polska Myśl Pedagogiczna · doi:10.4467/24504564pmp.23.016.18245
Finney, S. J. (2013) · Journal of Student Affairs Inquiry Improvement and Impact · doi:10.18060/27922
Dukhan, S. (2021) · Critical Studies in Teaching and Learning · doi:10.14426/cristal.v9isi.1800
Lins, M. P. E., Câmara, M. K., & de Souza, A. L. L. (2024) · RAIRO - Operations Research · doi:10.1051/ro/2024208
A Tailored Co-creation Approach to Contextualising the Student Voice in Higher Education
Polkinghorne, M., McIntyre‐Bhatty, T., & Roushan, G. (2024) · Springer eBooks · doi:10.1007/978-3-031-66316-1_4
Li, W., Liang, K., Huang, C., & Zhang, S. (2025) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-025-00975-1
Liu, Y., Song, Q., & Zheng, Q. (2025) · Oxford Review of Education · doi:10.1080/03054985.2025.2590460
Abegglen, S., Greif, R., Balmer, Y., Znoj, H. J., & Nabecker, S. (2022) · Figshare · doi:10.6084/m9.figshare.21009545
Abegglen, S., Greif, R., Balmer, Y., Znoj, H. J., & Nabecker, S. (2022) · Figshare · doi:10.6084/m9.figshare.21009554
Abegglen, S., Greif, R., Balmer, Y., Znoj, H. J., & Nabecker, S. (2022) · Figshare · doi:10.6084/m9.figshare.21009542
Abegglen, S., Greif, R., Balmer, Y., Znoj, H. J., & Nabecker, S. (2022) · Figshare · doi:10.6084/m9.figshare.21009551
Abegglen, S., Greif, R., Balmer, Y., Znoj, H. J., & Nabecker, S. (2022) · Figshare · doi:10.6084/m9.figshare.21009548
A Framework for Assessing the Effectiveness of Adult Language Courses
Ginzburg, T. (2026) · The Journal of Continuing Higher Education · doi:10.1080/07377363.2026.2681398
Neville, P., Staines, K. S., & Tseloudi, C. (2026) · Biomedical visualization · doi:10.1007/978-3-032-12305-3_9
Learning gains from work placements: Innovative behavior and the role of emotional competencies
Furlotti, M., & Shipton, H. J. (2026) · European Management Review · doi:10.1111/emre.70066
Timmis, M. A., Pike, C. V. S., & Latham, K. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1831859
Aliyev, R., Backhaus, J., Westphale, S., & Koenig, S. (2026) · JMIR Medical Education · doi:10.2196/75516
Li, C., Bailey, R. P., & Samsudin, N. (2026) · SAGE Open · doi:10.1177/21582440261468596
Enhancing Introduction to Computer and Data Science Based on Python Course Using Gen AI
Grabarnik, G. Y., & Yaskolko, S. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28463-1_37
- Authors
- Evans, C., Kandiko Howson, C., & Forsythe, A.
- Affiliations
- University of Southampton (GB)
- King’s College London, University of London, London, UK
- University of Liverpool (GB)
- Corresponding author
- Evans, C.
- Venue
- Higher Education Pedagogies
- Publisher
- Informa UK Limited
- Published
- 2018-01
- Volume
- 3
- Issue
- 1
- Pages
- 1-45
- ISSN
- 2375-2696 (ISSN-L)
- OpenAlex
- W2892120767
- Cited by
- 81
- References
- 113
- Citations by year
- 2026: 10 · 2025: 8 · 2024: 7 · 2023: 6 · 2022: 15 · 2021: 16 · 2020: 10 · 2019: 6 · 2018: 2 · 2013: 1
- FWCI
- 27.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Higher Education Pedagogies (publishedVersion, cc-by)
- ePrints Soton (University of Southampton) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
- Griffith Research Online (submittedVersion, cc-by)
- Wolverhampton Intellectual Repository and E-Theses (University of Wolverhampton) (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Evaluation of Teaching Practices
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Political Science and International Relations › Higher Education Governance and Development
- Keywords
- learning gains, higher education, educational testing, value for money, quality assurance, accountability, curriculum development, learning analytics, education policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review