Non-traditional learners' immediate and delayed responses to anonymous peer feedback in online collaborative learning
The DOI matches its Crossref record; 71 of the 72 references it cites were found in a registry or an index.
Abstract
Non-traditional learners as a fastest-growing student population indicated their unique learning culture in online higher education. However, limited research investigated non-traditional learners’ feedback literacy and their responses to anonymous peer feedback in online learning contexts. Guided by the framework of students’ internal mechanisms of feedback processing and the Unified Theory of Acceptance and Use of Technology model, the quantitative research aimed to explore the relationships among five variables in non-traditional learners’ immediate and delayed feedback processing mechanisms (including four independent variables: meaning-making, judgment, expected efforts, and emotions, and one dependent variable: decision-making) and a longitudinal change between their immediate and delayed responses. We distributed an online survey containing a 6-point Likert scale with an open-ended question to collect non-traditional learners’ immediate and delayed responses to 95 pieces of anonymous peer feedback at two-time points. The results showed that expected effort was the unique predictor of non-traditional learners’ decision-making on feedback adoption at Time 1, but no longer the significant predictor at Time 2. Students’ internal processing mechanisms positively improved after three weeks, including meaning-making, judgment, and expected efforts. We concluded by discussing the implications of designing peer feedback activities and developing feedback literacy for non-traditional learners in online higher education.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035
The development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428 · cited 1×
“Therefore, it is necessary to prepare students for feedback literacy, especially increasing their knowledge to appreciate, understand, analyze, and adopt feedback in a critique-based learning environment (Carless & Boud, 2018; Tripodi et al., 2021).”
The unified theory of acceptance and use of technology (UTAUT): a literature review
Williams, M. D., Rana, N. P., & Dwivedi, Y. K. (2015) · Journal of Enterprise Information Management · doi:10.1108/jeim-09-2014-0088 · Cited by 1,339
Using the UTAUT model to understand students’ usage of e-learning systems in developing countries
Abbad, M. M. M. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10573-5 · Cited by 645 · cited 1×
“Especially, when first exposed to a new technology, the ease of use would increase students ’ positive intentions toward technology adoption (Abbad, 2021).”
Shute, V. J. (2007) · ETS Research Report Series · doi:10.1002/j.2333-8504.2007.tb02053.x · Cited by 455
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07014 · Cited by 405
A review of feedback models and typologies: Towards an integrative model of feedback elements
Panadero, E., & Lipnevich, A. A. (2022) · Educational Research Review · doi:10.1016/j.edurev.2021.100416 · Cited by 389 · cited 1×
“Feedback as one of the effective formative assessment interventions plays a crucial role in improving student learning performance and outcomes in various teaching and learning contexts (Bürgerme-ister et al., 2021; McCarthy, 2016; Panadero & Lipnevich, 2022).”
Huisman, B., Saab, N., van den Broek, P., & van Driel, J. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1545896 · Cited by 306
A development research agenda for online collaborative learning
Reeves, T. C., Herrington, J., & Oliver, R. (2004) · Educational Technology Research and Development · doi:10.1007/bf02504718 · Cited by 218
Fidan, M., & Gencel, N. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221077901 · Cited by 186
Cheng, K.-H., Liang, J.-C., & Tsai, C.-C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.001 · Cited by 174 · cited 1×
“…teaching and learning practices in higher education, many researchers further investigated the implementation of peer feedback to promote students ’ academic performance and knowledge improvement in online courses (Cheng et al., 2015; Kerman et al., 2024; Liu et al., 2019; Su et al., 2024).”
Latifi, S., Noroozi, O., & Talaee, E. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13054 · Cited by 163 · cited 1×
“It has been widely used as an efficient technique to promote collaborative and social learning environments in diverse disciplines (Latifi et al., 2021; Su et al., 2024; Tan & Chen, 2022), such as essay writing (Jin et al., 2024; Zou et al., 2023), financial education (Chen & Liu, 2023),…”
Rotsaert, T., Panadero, E., & Schellens, T. (2018) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0339-8 · Cited by 126
Learning from feedback: Spacing and the delay–retention effect.
Smith, T. A., & Kimball, D. R. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017407 · Cited by 123
Emotional Presence in Building an Online Learning Community Among Non-traditional Graduate Students
Jiang, M., & Koo, K. K. (2020) · Online Learning · doi:10.24059/olj.v24i4.2307 · Cited by 117
Online peer feedback patterns of success and failure in argumentative essay writing
Kerman, N. T., Noroozi, O., Banihashem, S. K., Karami, M., & Biemans, H. J. A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2093914 · Cited by 116
Delayed versus immediate feedback in children's and adults' vocabulary learning
Metcalfe, J., Kornell, N., & Finn, B. (2009) · Memory & Cognition · doi:10.3758/mc.37.8.1077 · Cited by 115
Lin, G.-Y. (2018) · Computers & Education · doi:10.1016/j.compedu.2017.08.010 · Cited by 111 · cited 1×
“Therefore, it was needed for instructors to investigate potential solutions to mitigate students ’ negative perceptions of peer feedback and increase their knowledge and skills in receiving and providing effective feedback (Kasch et al., 2021; Lin, 2018; Tan & Chen, 2022).”
Rabourn, K. E., BrckaLorenz, A., & Shoup, R. (2018) · The Journal of Continuing Higher Education · doi:10.1080/07377363.2018.1415635 · Cited by 111
Online peer feedback in higher education: A synthesis of the literature
Kerman, N. T., Banihashem, S. K., Karami, M., Er, E., van Ginkel, S., & Noroozi, O. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12273-8 · Cited by 109 · cited 2×
“…providing constructive feedback to their peers than receiving feedback (Filius et al., 2019; Yu & Schunn, 2023), enhancing their knowledge and skills in argumentation, negotiation, evaluation, reflection, judgment, critical thinking, decision-making, and communication skills (Kerman et al., 2023).”
Peer feedback to support collaborative knowledge improvement: What kind of feedback feed-forward?
Tan, J. S. H., & Chen, W. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104467 · Cited by 105
Using learning analytics to understand student perceptions of peer feedback
Misiejuk, K., Wasson, B., & Egelandsdal, K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106658 · Cited by 98 · cited 5×
“Among various feedback sources, peer feedback has been increasingly used as a learning strategy to supplement teacher feedback in higher education (Bürgermeister et al., 2021; Misiejuk et al., 2021).”
InfluentialZou, D., Xie, H., & Wang, F. L. (2023) · Journal of Computing in Higher Education · doi:10.1007/s12528-022-09337-y · Cited by 90
Unified Theory of Acceptance and Use of Technology
(2003) · doi:10.1037/t57185-000 · Cited by 85
Audio peer feedback to promote deep learning in online education
Filius, R. M., de Kleijn, R. A. M., Uijl, S. G., Prins, F. J., van Rijen, H. V. M., & Grobbee, D. E. (2019) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12363 · Cited by 84
Howard, C. D., Barrett, A. F., & Frick, T. W. (2010) · Journal of Educational Computing Research · doi:10.2190/ec.43.1.f · Cited by 78 · cited 1×
“For instance, anonymous peer feedback showed the advantages in promoting a safe environment to decrease students ’ anxiety while increasing their confidence in providing critical comments (Howard et al., 2010; Rot-saert et al., 2018).”
Supporting Peer Feedback on Learning Strategies: Effects on Self-Efficacy and Feedback Quality
Bürgermeister, A., Glogger‐Frey, I., & Saalbach, H. (2021) · Psychology Learning & Teaching · doi:10.1177/14757257211016604 · Cited by 78
Zembylas, M. (2008) · Adult Education Quarterly · doi:10.1177/0741713608325171 · Cited by 75
Becoming a competent self: A developmental process of adult distance learning
Lee, K., Choi, H., & Cho, Y. H. (2019) · The Internet and Higher Education · doi:10.1016/j.iheduc.2018.12.001 · Cited by 75
Guldberg, K., & Pilkington, R. M. (2006) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2006.00171.x · Cited by 73
Sutherland, K. E., Brock, G., Scheepers, M. D. V., Millear, P. M. R., Norman, S., Strohfeldt, T., Downer, T., Masters, N. M., & Black, A. L. (2023) · Journal of Computing in Higher Education · doi:10.1007/s12528-023-09354-5 · Cited by 72
Using achievement goal-based personalized motivational feedback to enhance online learning
Wang, H., & Lehman, J. D. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-09940-3 · Cited by 72
Lui, A. M., & Andrade, H. L. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.751548 · Cited by 71 · cited 11×
“For instance, we adapted the existing subscale of the Responses to Feedback survey developed by Lui and Andrade (2022b) to measure students ’ meaning making (n = 3, Cronbach ’ s alpha = .97), judgment (n = 4, Cronbach ’ s alpha = .99), and emotions (n = 2, Cron-bach ’ s alpha = .97).”
Influential‘You’re thrown in the deep end’: adult learner identity formation in higher education
Brunton, J., & Buckley, F. (2020) · Studies in Higher Education · doi:10.1080/03075079.2020.1767049 · Cited by 68
Demir, M. (2017) · Higher Education · doi:10.1007/s10734-017-0146-9 · Cited by 67
Effects of student engagement in peer feedback on writing performance in higher education
Jin, X., Jiang, Q., Xiong, W., Feng, Y., & Zhao, W. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2081209 · Cited by 67
Effects of online peer assessment on higher‐order thinking: A meta‐analysis
Zhan, Y., Yan, Z., Wan, Z. H., Wang, X., Zeng, Y., Yang, M., & Yang, L. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13310 · Cited by 66
Wang, H., Tlili, A., Lehman, J. D., Lu, H., & Huang, R. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00241-6 · Cited by 63
Factors influencing students’ peer feedback uptake: instructional design matters
Mercader, C., Ion, G., & Díaz-Vicario, A. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1726283 · Cited by 56
Lee, Y.-F., Lin, C.-J., Hwang, G., Fu, Q.-K., & Tseng, W.-H. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2021.1916763 · Cited by 55
Money, W. H., & Dean, B. P. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.03.013 · Cited by 53
Adult learners' needs in online and blended learning
(2019) · Cited by 52
Lui, A. M., & Andrade, H. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.751549 · Cited by 52
Hsia, L., & Hwang, G. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.12986 · Cited by 51
Chang, C., Lee, D., Tang, K., & Hwang, G. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104123 · Cited by 50
Liaqat, A., Munteanu, C., & Epp, C. D. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00204-4 · Cited by 50
Students’ perceptions of the peer-feedback experience in MOOCs
Kasch, J., van Rosmalen, P., Löhr, A., Klemke, R., Antonaci, A., & Kalz, M. (2021) · Distance Education · doi:10.1080/01587919.2020.1869522 · Cited by 44
Understanding the what and when of peer feedback benefits for performance and transfer
Yu, Q., & Schunn, C. D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107857 · Cited by 43
Huisman, B., Admiraal, W., Pilli, O., van de Ven, M., & Saab, N. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12520 · Cited by 42
Singh, J., Matthees, B., & Odetunde, A. (2021) · Quality Assurance in Education · doi:10.1108/qae-12-2020-0147 · Cited by 42
Supporting the development of collaboration and feedback skills in instructional designers
Lowell, V. L., & Ashby, I. V. (2018) · Journal of Computing in Higher Education · doi:10.1007/s12528-018-9170-8 · Cited by 40 · cited 5×
“Instructors often encounter challenges in increasing student participation and engagement in online collaborative learning (Lowell & Ashby, 2018).”
InfluentialTHE EFFECTS OF IMMEDIATE AND DELAYED FEEDBACK ON SECONDARY DISTANCE LEARNERS
Lemley, D. C., Sudweeks, R. R., Howell, S. L., Laws, R. D., & Sawyer, O. (2007) · Quarterly review of distance education · doi:10.1108/qrde-09-2007-0007 · Cited by 38
Ren, X. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11153-x · Cited by 37
Self-citationUsing Peer Assessment to Enhance Higher Order Thinking Skills
(2019) · doi:10.18421/tem81-34 · Cited by 36
Effects of a mobile-based peer-assessment approach on enhancing language-learners’ oral proficiency
Chang, C., & Lin, H.-C. K. (2020) · Innovations in Education and Teaching International · doi:10.1080/14703297.2019.1612264 · Cited by 35
Lai, C.-Y., Chen, L., Yen, Y.-C., & Lin, K.-Y. (2019) · Australasian Journal of Educational Technology · doi:10.14742/ajet.4341 · Cited by 35
Ting, Y., & Yeh, Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2170418 · Cited by 34
Liu, J., Guo, X., Gao, R., Fram, P., Ling, Y., Zhang, H., & Jin, W. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1542659 · Cited by 34
Video feedback: is it worth the effort? A response to Borup et al.
Lowenthal, P. R. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09872-4 · Cited by 30
Does anonymity matter? Examining quality of online peer assessment and students' attitudes
Kobayashi, M. (2020) · Australasian Journal of Educational Technology · doi:10.14742/ajet.4694 · Cited by 29 · cited 5×
“Instructors could emphasize the benefits of peer feedback in enhancing students ’ learning performance to increase their engagement and positive perceptions (Kasch et al., 2021; Kobayashi, 2020).”
InfluentialSu, Y., Ren, J., & Xiaohui, S. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2022.2131833 · Cited by 27
Hoang, L. P., Le, H. T., Tran, H. V., Phan, T. C., Vo, D. M., Le, P. A., Nguyen, D. T., & Pong-inwong, C. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10763-1 · Cited by 27
Satisfaction with current martial arts’ uniforms and purchase intention of new uniforms
Perry, A. L., & Lee, J. (2017) · Fashion and Textiles · doi:10.1186/s40691-016-0085-6 · Cited by 22
McDonald, D., Holmes, Y. M., & Prater, T. (2020) · e-journal of business education & scholarship of teaching · Cited by 20
Neubaum, G., Wichmann, A., Eimler, S. C., & Krämer, N. C. (2014) · International Symposium on Open Collaboration · doi:10.1145/2641580.2641604 · Cited by 18
Cho, J., Kim, B., Jeon, J., & Park, S. (2020) · Journal of Gerontological Social Work · doi:10.1080/01634372.2020.1760992 · Cited by 16
Peer feedback as a strategy to foster feedback literacy in first-year allied health students
Tripodi, N., Vaughan, B., & Wospil, R. (2021) · MedEdPublish · doi:10.15694/mep.2021.000115.1 · Cited by 10
McCarthy, J. (2015) · Interactive Learning Environments · doi:10.1080/10494820.2014.994532 · Cited by 10
Chen, H.-L., & Liu, C. (2023) · TechTrends · doi:10.1007/s11528-023-00856-8 · Cited by 6
Designing a Writing Program for non-traditional adult students: a case study (HETL Scotland 2017)
Hayes, N. A., Fry, S. T., & Cummings, K. (2018) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-04-2017-0046 · Cited by 3
Cited by
Ren, X., Zhou, Y., & Detrick, R. (2025) · Distance Education · doi:10.1080/01587919.2025.2571899
Self-citationLi, S., & Zhu, Q. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2026.2641596
Metadata
- Authors
- Ren, X., & Zhou, Y.
- Affiliations
- Old Dominion University (US)
- Ohio University (US)
- Corresponding author
- Ren, Xinyue
- Venue
- Interactive Learning Environments
- Publisher
- Informa UK Limited
- Published
- 2025-03-18
- Volume
- 33
- Issue
- 9
- Pages
- 5269-5286
- ISSN
- 1049-4820 (ISSN-L)
- 1744-5191
- OpenAlex
- W4408576944
- Cited by
- 3
- References
- 72
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 9.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Interactive Learning Environments (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- non-traditional students, online collaborative learning, feedback literacy, UTAUT, meaning-making, judgment, expected effort, emotions, decision-making, online higher education, longitudinal change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.