A mixed methods approach to the assessor's targeting behavior during online peer assessment: effects of anonymity and underlying reasons
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
This study examined the effects of identity revelation and concealment on the number of times students' work was assessed in an online peer assessment context. It also examined the underlying reasons guiding the assessor's targeting behavior. Two fifth-grade classes participated. The one-group pretest–posttest experimental research design coupled with qualitative research method was adopted. The results from social network analysis (SNA) showed a high redundancy rate for both high- and low-targeted assessees in identity-revealed and identity-concealed conditions for both classes. Moreover, the density metrics indicated that all sociograms were similarly sparse. The Wilcoxon tests further confirmed that there were no significant differences in the assessees' ranking in the two conditions for both classes. Finally, analysis of students' self-reflective data revealed that the features/content of the work to be assessed, rather than who the question-author was, was the determining factor when it came to deciding the target for online peer assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
Peer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173 · cited 5×
“…and sense of responsibility toward the learning process, as well as raise the level of performance and overall attitudes toward learning (Brindley & Scoffield, 1998; Falchikov & Goldfinch, 2000; Gatfield, 1999; van Gennip et al., 2009; Hanrahan & Isaacs, 2001; Purchase, 2000; Topping, 1998, 2009).”
BackgroundInfluentialSome Unique Properties of Eigenvector Centrality
Bonacich, P. (2007) · Social Networks · doi:10.1016/j.socnet.2007.04.002 · Cited by 1,572 · cited 3×
““Degree” (also called “degree centrality”) is defined as the number of direct connections (i.e. edges) between one actor and its adjacent actors (Bonacich, 2007; Freeman, 1979).”
BackgroundStudent Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170 · cited 3×
“…and sense of responsibility toward the learning process, as well as raise the level of performance and overall attitudes toward learning (Brindley & Scoffield, 1998; Falchikov & Goldfinch, 2000; Gatfield, 1999; van Gennip et al., 2009; Hanrahan & Isaacs, 2001; Purchase, 2000; Topping, 1998, 2009).”
BackgroundTopping, K. J. (2009) · Theory Into Practice · doi:10.1080/00405840802577569 · Cited by 785
The nature of feedback: How different types of peer feedback affect writing performance
Nelson, M. M., & Schunn, C. D. (2009) · Instructional Science · doi:10.1007/s11251-008-9053-x · Cited by 602 · cited 1×
“In addition, the importance of providing high-quality feedback (i.e. identification and explanations of problems, with clear suggestions for improvement) to lead to improved work or performance of peers, as suggested by Nelson and Schunn (2009), was highlighted.”
BackgroundChinese students' perceptions of ESL peer response group interaction
Carson, J. G., & Nelson, G. L. (1996) · Journal of Second Language Writing · doi:10.1016/s1060-3743(96)90012-0 · Cited by 351
Ballantyne, R., Hughes, K., & Mylonas, A. (2002) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293022000009302 · Cited by 329
Zhang, Y., Fang, Y., Wei, K.-K., & Chen, H. (2010) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2010.02.003 · Cited by 306 · cited 6×
“…(Franzoi, 2006; Lea, Spears, & de Groot, 2001; Moral-Toranzo, Canto-Ortiz, & Gómez-Jacinto, 2007; Palme & Berglund, 2002; Postmes & Lea, 2000; Zhang et al., 2010), anonymity can mean that the negative emotions frequently associated with identifiable peer assessment activities, such as a…”
BackgroundInfluentialPeer reviewers learn from giving comments
Cho, Y. H., & Cho, K. (2011) · Instructional Science · doi:10.1007/s11251-010-9146-1 · Cited by 294 · cited 1×
“…familiarize the assessor with these evaluation criteria, and thus to develop knowledge on what constitutes good work, and what needs to be avoided, which can be further adopted when monitoring one’s own work and regulating one’s learning (Cho & Cho, 2011; Ohlsson, 1996; Pharo & de Salas, 2009).”
Background
Research works printed but not linked: 63
- 10.1080/1057356980140303 · DOI
- Bandura A., 1986, Social foundations of thought and action: A social cognitive theory
- 10.1111/j.1745-3984.1979.tb00092.x · doi:10.1111/j.1745-3984.1979.tb00092.x
- 10.1016/S0378-8733(96)00301-2 · DOI · Paper page
- 10.1080/0260293990240405 · DOI · Paper page
- 10.1080/1356215980030106 · DOI · Paper page
- Creswell J. W., 2007, Designing and conducting mixed methods research
- 10.1007/s11412-007-9006-4 · DOI · Paper page
- 10.1207/s15328023top1202_9 · doi:10.1207/s15328023top1202_9
- Ediger M., 2006, Journal of Instructional Psychology, 33, 179
- 10.1111/j.1745-3984.1965.tb00393.x · DOI
- 10.1080/13562510120045212 · DOI · Paper page
- Faust K., 2006, Metodoloski zvezki, 3, 185
- Franzoi S. L., 2006, Social psychology
- 10.1016/0378-8733(78)90021-7 · DOI · Paper page
- Gagné R. M., 1965, The conditions of learning and theory of instruction
- 10.1080/0260293990240401 · DOI
- 10.1080/08832320109599648 · DOI
- Habeshaw S., 1986, Interesting ways to assess your students
- 10.1207/s15324818ame0201_3 · DOI · Paper page
- Hannemann R., 2005, Introduction to social network methods
- 10.1080/07294360123776 · DOI · Paper page
- Hansen D. L., 2011, Analyzing social media networks with NodeXL: Insights from a connected world
- 10.1002/9780470756942.ch9 · DOI · Paper page
- 10.1016/j.leaqua.2006.04.007 · DOI
- 10.1080/10463283.2012.741134 · DOI · Paper page
- Hosack I., 2004, Language and its Universe, 3, 297
- 10.1080/0260293042000227272 · DOI · Paper page
- 10.2307/256287 · DOI · Paper page
- 10.1007/s11251-010-9133-6 · DOI · Paper page
- 10.1016/j.learninstruc.2009.08.005 · DOI · Paper page
- 10.1177/0146167201275002 · DOI · Paper page
- 10.14742/ajet.1245 · DOI · Paper page
- 10.1016/j.chb.2005.10.005 · DOI · Paper page
- 10.1016/0147-1767(85)90062-8 · DOI · Paper page
- Lu R., 2007, Journal of Interactive Online Learning, 6, 100
- 10.1016/j.compedu.2003.06.001 · DOI · Paper page
- 10.1177/089443939000800102 · DOI
- Miyazoe T., 2011, Educational Technology and Society, 14, 175
- 10.1016/j.chb.2005.09.002 · DOI
- 10.1097/00006199-199103000-00014 · DOI · Paper page
- 10.1037/0033-295X.103.2.241 · doi:10.1037/0033-295x.103.2.241 · Paper page
- 10.1080/0260293950200113 · DOI · Paper page
- Osterlind S. J., 1998, Constructing test items: Multiple-choice, constructed-response, performance and other formats
- Palonen T., 2000, Fourth international conference of the learning sciences, 334
- 10.1007/s10551-012-1274-x · DOI
- 10.1080/03098260802276748 · DOI
- 10.1080/02602930120052396 · DOI · Paper page
- 10.1080/00140130050084978 · DOI · Paper page
- 10.1080/026029300449245 · DOI · Paper page
- R Core Team, 2013, R: A language and environment for statistical computing
- 10.14742/ajet.452 · DOI · Paper page
- 10.1016/j.socnet.2006.08.002 · DOI · Paper page
- 10.3102/00346543066002181 · doi:10.3102/00346543066002181 · Paper page
- Tajfel H., 1982, Social identity and intergroup relations
- Tajfel H., 1986, Psychology of intergroup relations, 7
- 10.3102/00346543068003249 · doi:10.3102/00346543068003249 · Paper page
- 10.1080/1470329032000103816 · DOI · Paper page
- 10.1111/j.1099-0860.2009.00260.x · DOI · Paper page
- White E., 2009, Asian EFL Journal, 33, 1
- Yelon S. L., 1996, Powerful principles of instruction
- 10.1016/j.chb.2009.05.002 · DOI
- Zimbardo P. G., 1969, Nebraska symposium on Motivation, 17, 237
Cited by
Panadero, E., & Alqassab, M. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1600186 · Cited by 232
Rotsaert, T., Panadero, E., & Schellens, T. (2018) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0339-8 · Cited by 126
Rotsaert, T., Panadero, E., Schellens, T., & Raes, A. (2018) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0329-x · Cited by 38
Masked ball for all: how anonymity affects students' perceived comfort levels in peer feedback
Su, W. (2023) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2022.2089348 · Cited by 21
Investigating the effectiveness of anonymous online peer feedback in translation technology teaching
Sha, L., Wang, X., Ma, S., & Mortimer, T. A. (2022) · The Interpreter and Translator Trainer · doi:10.1080/1750399x.2022.2097984 · Cited by 10
Metadata
- Authors
- Yu, F.-Y., & Sung, S.
- Venue
- Interactive Learning Environments
- Publisher
- Informa UK Limited
- Published
- 2015-05-14
- Volume
- 24
- Issue
- 7
- Pages
- 1674-1691
- ISSN
- 1049-4820 (ISSN-L)
- 1744-5191
- OpenAlex
- W1654655934
- Cited by
- 26
- References
- 16
- FWCI
- 11.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- National Science Council Taiwan (NSC 102-2511-S-006 -003 -MY3,NSC 99-2511-S-006 -015 -MY3)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A mixed methods approach to the assessor's targeting behavior during online peer assessment: effects of anonymity and underlying reasons. https://app.cochat.ai/papers/10.1080/10494820.2015.1041405
- The paper
- Yu, F.-Y., & Sung, S. (2016). A mixed methods approach to the assessor's targeting behavior during online peer assessment: effects of anonymity and underlying reasons. Interactive Learning Environments. https://doi.org/10.1080/10494820.2015.1041405
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.