Ineffectiveness of Reverse Wording of Questionnaire Items: Let’s Learn from Cows in the Rain
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: We examined the effectiveness of reverse worded items as a means of reducing or preventing response bias. We first distinguished between several types of response bias that are often confused in literature. We next developed arguments why reversing items is probably never a good way to address response bias. We proposed testing whether reverse wording affects response bias with item-level data from the Multidimensional Fatigue Inventory (MFI-20), an instrument that contains reversed worded items. METHODS: With data from 700 respondents, we compared scores on items that were similar with respect either to content or to direction of wording. Psychometric properties of sets of these items worded in the same direction were compared with sets consisting of both straightforward and reversed worded items. RESULTS: We did not find evidence that ten reverse-worded items prevented response bias. Instead, the data suggest scores were contaminated by respondent inattention and confusion. CONCLUSIONS: Using twenty items, balanced for scoring direction, to assess fatigue did not prevent respondents from inattentive or acquiescent answering. Rather, fewer mistakes are made with a 10-item instrument with items posed in the same direction. Such a format is preferable for both epidemiological and clinical studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In this context, a study by Sonderen et al. (2013) showed that reverse-worded items may lead to inattention when responding to a questionnaire.”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as Sonderen et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“The latter could indicate a measurement issue related to including both positively and negatively phrased items in a scale [111].”
From Validation of the compassionate engagement and action scales, compassion scale, and Sussex-Oxford compassion scales in a French-Canadian sample (2024) · cites this paper as [111]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · cited 2×
“We consider this a variety of the Multi-Trait-Multi-Method matrix discussed by Campbell & Fiske [29].”
MethodA three-component conceptualization of organizational commitment
Meyer, J. P., & Allen, N. J. (1991) · Human Resource Management Review · doi:10.1016/1053-4822(91)90011-z · Cited by 11,049 · cited 2×
“1) Meyer and Allen’s [11] scale to assess affective commitment, of which Merritt [12] demonstrated that the answers on reversed items were prone to careless responding and cognitive fatigue.”
BackgroundDevelopment and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099 · cited 1×
“’s [14] scale to assess worry contains 11 positively and five reversed worded items, leading Fresco et al.”
BackgroundThe Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734 · cited 2×
“The process of obtaining survey data is complex, with many possibilities of discrepancies arising between the state or opinion the researcher wants to elicit and the answer given by the respondent [3].”
BackgroundSmets, E. M. A., Garssen, B., Bonke, B., & De Haes, J. C. J. M. (1995) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(94)00125-o · Cited by 3,613 · cited 2×
“[28] constructed a version with seven categories, but in accordance with their adaptation in 1996 [27], a version is used with five answer categories, ranging from 1 (‘yes, that is true’) to 5 (‘no, that is not true’).”
BackgroundMethodMeasurement and Control of Response Bias
Paulhus, D. L. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50006-x · Cited by 3,598
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852 · cited 1×
“Krosnick [7] mentions a satisficing response style, whereby the respondent deliberately makes less effort to understand all subtleties of the question.”
On the bipolarity of positive and negative affect.
Russell, J. A., & Carroll, J. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.1.3 · Cited by 1,481 · cited 1×
“More researchers attribute the claim of multidimensionality that is often made in scales with reversed worded items, not to conceptual differences, but to artificial factors resulting from response bias [20–25].”
BackgroundResponse Styles in Marketing Research: A Cross-National Investigation
Baumgartner, H., & Steenkamp, J.-B. E. M. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.2.143.18840 · Cited by 1,255
Do We Really Need Multiple-Item Measures in Service Research?
Drolet, A. L., & Morrison, D. G. (2001) · Journal of Service Research · doi:10.1177/109467050133001 · Cited by 736 · cited 2×
“As Drolet and Morrison [9] demonstrate, respondents sometimes just answer the first item and assume that this answer also holds for subsequent (considered similar or even identical) items.”
Background
Cited by
Items 401–500 of 543
Oleksy, T., & Lassota, I. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.102943 · Cited by 2
Athlete Mindfulness Questionnaire (AMQ)
Zhang, C. (2025) · Springer eBooks · doi:10.1007/978-3-031-47219-0_55 · Cited by 1
Quinn, J. F., Cola, P. A., Cooper, M., & Miller, C. W. (2025) · PLoS ONE · doi:10.1371/journal.pone.0328308 · Cited by 2
“The initial QMCA mixed negatively and positively worded items to reduce response bias, however, recent research has shown that this approach can be ineffective and including negatively worded items can rather threaten validity and reliability of scales [53,54].”
Valarezo-Bravo, O. F., Méndez-Fuentes, E., Atencio‐Quevedo, D., Manríquez-Fuenzalida, C., Guzmán‐González, M., Tay‐Karapas, K., & Domic‐Siede, M. (2025) · Emerging Adulthood · doi:10.1177/21676968251396995 · Cited by 1
“Prior research has shown that reverse-coded items may reduce internal consistency and distort factor structure due to misunderstanding or inattentive responding (Sonderen et al., 2013; Swain et al., 2008).”
Initial validation of a single-item burnout measure among rural healthcare professionals
Qeadan, F., Locke, A., Tingey, B., Egbert, J. S., Morrow, E. H., Arshad, A., Vanderloo, M. J., & Call, M. (2025) · SAGE Open Medicine · doi:10.1177/20503121251393441 · Cited by 1
“42,43 Accordingly, the item’s broad self-assessment wording supports content validity by aligning with established single-item burnout measures (e.g. the Mini-Z EE item) while preserving a format suitable for system-wide surveillance.”
Algueró-Boronat, M., Moliner‐Tena, M., Rodríguez-Artola, R., & Cornejo-Ortega, J. L. (2026) · Annals of Leisure Research · doi:10.1080/11745398.2026.2620724 · Cited by 1
“This decision is supported by previous research (Sonderen, Sanderman, and Coyne 2013), which highlights that negatively or reverse-worded items may cause confusion and inattentive responding, potentially compromising data quality.”
Mohammadi, M., & Ghanbari, N. (2026) · BMC Public Health · doi:10.1186/s12889-026-26498-y · Cited by 1
“…decision was based on empirical evidence indicating that although reverse-worded items are traditionally used to control for acquiescence bias, they often introduce confusion, reduce response consistency, and may compromise internal validity, especially among general population samples [30, 73–75].”
Lignier, B., Petot, J., Oliveira, P. D., Nicolas, M., Canada, B., Courtois, R., John, O. P., Plaisant, O., & Soto, C. J. (2026) · L Encéphale · doi:10.1016/j.encep.2025.11.004 · Cited by 1
Yi, J.-S. (2026) · Journal of Intercultural Communication · doi:10.36923/jicc.v26i1.1312 · Cited by 4
“…about reducing ambiguity in question wording (Cronbach, 1946), criticism persists regarding negatively worded items, as scoring may be affected by respondent carelessness (Schmitt & Stults, 1985), mindless consistency (Drolet & Morrison, 2001), and confusion (Sonderen, Sanderman, & Coyne, 2013).”
Cwik, J. C., Woud, M. L., Blackwell, S. E., Teismann, T., Keita, I., & Margraf, J. (2026) · BMC Psychology · doi:10.1186/s40359-026-04627-x · Cited by 1
“Furthermore, three items with negative polarity were also excluded because of marginal benefits but considerable disadvantages for the psychometric properties and dimensionality of the scale [51].”
Soto‐Ramírez, P., Narea, M., Morales, M. F., & Caqueo‐Urízar, A. (2026) · Education Sciences · doi:10.3390/educsci16050711 · Cited by 1
A Theoretical Framework and The Development of a Multidimensional Scale of Purpose in Life
Fang, L. L., Allan, A., & Dickson, J. M. (2026) · Journal of Happiness Studies · doi:10.1007/s10902-026-01067-7 · Cited by 1
“No items were reverse scored as previous literature has shown this to be ineffective at reducing response biases and negatively affects the psychometric prop - erties of the scale (van Sonderen et al., 2013; Woods, 2006).”
Boettcher, J., Zapf, H., Daubmann, A., SCHIMMELMANN, B. G., Bindt, C., Hohmann, S., & Micheel, J. (2026) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-026-07423-z · Cited by 1
Campos, L. A. G., Carreño-Flores, O. D., Tello, B. M., & Kajatt, J. U. (2026) · Administrative Sciences · doi:10.3390/admsci16080388 · Cited by 1
“Reverse-worded items can introduce methodological variance, comprehension problems, and artificial factors, especially when agreement response styles vary (Sonderen et al., 2013; Zhang et al., 2016).”
Alhamad, H., Alotaibi, N., حسن, ن. ن., Ahmad, F. M., Alenezi, A., & Alnaser, M. Z. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1929366 · Cited by 1
“The 33-item SSEIT (Gignac et al., 2005; Schutte et al., 1998) was administered in English on a 5-point scale (items 5, 28, and 33 reverse-scored; on the known hazards of reverse-worded items see Suárez-Álvarez et al., 2018; van Sonderen et al., 2013; Weijters et al., 2013).”
Al-Ghadban, F., & Salman, A. (2026) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe16090133 · Cited by 2
“…is generally attributed to acquiescent responding combined with the greater cognitive difficulty of verifying a negated statement (Weijters & Baumgartner, 2012; Weijters et al., 2013), and reverse wording appears to create more measurement problems than it solves (van Sonderen et al., 2013).”
A psychometric assessment of the LPME scale for the South African skills development context.
Tshilongamulenzhe, M. C. (2015) · Risk Governance and Control Financial Markets & Institutions · doi:10.22495/rgcv5i3c2art11 · Cited by 1
“Such items may be employed primarily to ease response pattern bias (Hazlett-Stevens et al., 2004; Idaszak and Drasgow, 1987; Van Sonderen et al., 2013).”
BackgroundPsychometric properties of the Subjective Happiness Scale in Four Asian countries
Powell, M. G., Bateman, C. J., Gerasimova, D., Bateman, A. G., & Peltzer, K. (2020) · Journal of Well-Being Assessment · doi:10.1007/s41543-021-00045-5 · Cited by 1
Examining the Psychometric Properties of the Taiwanese Version of the Hospice Quality of Life Index
Longcoy, L.-T. H., Tai, C., Dai, H.-D., McMillan, S. C., & Doorenbos, A. Z. (2022) · Journal of Hospice and Palliative Nursing · doi:10.1097/njh.0000000000000911 · Cited by 1
Hazaimeh, M., & Alquraan, M. F. (2022) · Journal of Applied Mathematics and Physics · doi:10.4236/jamp.2022.1010212 · Cited by 1
Athlete Mindfulness Questionnaire (AMQ)
Zhang, C. (2023) · Springer eBooks · doi:10.1007/978-3-030-77644-2_55-1 · Cited by 1
Misgivings about Environmental Outreach as a Barrier in a Neighborhood Opinion Leader Campaign
Woude, T. V., Shaw, B. R., & Oberhauser, K. S. (2024) · Society & Natural Resources · doi:10.1080/08941920.2024.2310247 · Cited by 1
“…changes to allow rainwater to soak into the ground” Pro-environmental outreach “encouraging neighbors to do these things” likelihood of adoption, was replaced with a statement expressing easiness so that all items were phrased with a similar valence (van Sonderen, Sanderman, and Coyne 2013).”
BackgroundSzabó, Á., Sieng, V., Du, A., Allen, J., & Yeung, P. (2024) · Journal of global ageing. · doi:10.1332/29767202y2023d000000001 · Cited by 2
Yamazaki, M. (2024) · Japanese Psychological Research · doi:10.1111/jpr.12537 · Cited by 2
Liu, X., Kim, S., & Lee, S. (2025) · International Journal of Sports Science & Coaching · doi:10.1177/17479541251333921 · Cited by 1
Learners, Not Just Data Contributors: Citizen Scientists’ Self-Regulated Learning
Hu, R., Pernaa, J., Aksela, M. K., Xinning, P., & Yu, Y. (2025) · Science & Education · doi:10.1007/s11191-025-00650-3 · Cited by 2
“Prior evidence demonstrated that reversed items induced more respondent errors and confusion, ultimately producing counterproductive effects (Sonderen et al., 2013).”
McFarlane, S. J., Callands, T. A., Francis, D. B., Swartzendruber, A. L., & Divya, S. (2025) · Healthcare · doi:10.3390/healthcare13101106 · Cited by 3
“These recoded items were the only items that participants’ knowledge scores decreased, which supports recent literature suggesting that recoded items may be unreliable and should no longer be included surveys [31–33].”
Dataveillance Duality: Navigating Employee Accountability and Privacy Concerns in the Digital Age
Raddatz, P. A., Raddatz, N. I., Ogunade, K. M., & Kim, S.-H. (2025) · Journal of Information Systems · doi:10.2308/isys-2023-050 · Cited by 4
Long, C., Holzer, K. J., Mancini, M. A., & Dell, N. A. (2025) · Journal of Ethnic & Cultural Diversity in Social Work · doi:10.1080/15313204.2025.2519031 · Cited by 1
Mental Health Assessments for Resettled Afghan Children and Adolescents
Frounfelker, R. L., Dilts, C., Placencio‐Castro, M., Sharifi, F., Arwal, S. H., & Betancourt, T. S. (2025) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-025-02536-0 · Cited by 3
“The challenges of reverse-worded items, particularly in cross-cultural research, are well documented [51, 52], and our findings support their questionable utility in the Afghan community.”
Paraiso-Galang, C. A. Y., & Gomez, M. H. S. (2019) · Philippine Journal of Internal Medicine · doi:10.65564/pjim.660754e163 · Cited by 1
Kashimura, M., 石津, 憲., & Shimoda, Y. (2020) · Journal of Nippon Medical School · doi:10.1272/jnms.jnms.2020_87-507 · Cited by 1
Agbo, A. A. (2021) · Current Psychology · doi:10.1007/s12144-021-01884-4 · Cited by 1
“The negative impact of reverse-scored items on scales’ properties is sometimes blamed on language difficulty, ambiguity of items, or fatigue (Marsh, 1986; Sonderen et al., 2013).”
BackgroundKrpan, D. (2022) · Royal Society Open Science · doi:10.1098/rsos.211373 · Cited by 1
“Moreover, they do not effectively tackle this bias, and a more successful approach involves designing short scales with roughly 10 items phrased in the same direction [48].”
BackgroundThompson, D. L. (2015) · Lincoln University Research Archive (Lincoln University) · Cited by 4
Initial Business-to-Business Sales Encounters. The Impact of the Similarity-Attraction Effect
Dekker, J. J. (2016) · Bradford Scholars (University of Bradford) · Cited by 1
Analysis of consumer-brand engagement with fashion brands in social media
Ananda, A. S. (2019) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.55676 · Cited by 4
Kleve, L., Skarstein, L., & Elgen, I. B. (2020) · doi:10.22541/au.159741542.25593058 · Cited by 1
“However it is well-known that including a mix of both positively and negatively worded questions can also create new challenges (such as confusion and incorrect answers) [28].”
BackgroundBayley, S. H., Wole, D., Yorke, L., Ramchandani, P. G., & Rose, P. M. (2021) · doi:10.35489/bsg-rise-wp_2021/068 · Cited by 2
Kjell, O., & Diener, E. F. (2019) · doi:10.31234/osf.io/kw5qt · Cited by 1
Uniform screening for atypical language development in Dutch child health care
Visser‐Bochane, M. I. (2021) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.171348669 · Cited by 1
Trzeciak, I. G. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/psr8k · Cited by 1
Schreurs, L., Lee, A. Y., Liu, X., & Hancock, J. T. (2023) · doi:10.31219/osf.io/yznu4 · Cited by 1
Tušl, M., Šípová, I., Máčel, M., Cetkovská, K., & Bauer, G. F. (2023) · Research Square · doi:10.21203/rs.3.rs-2723276/v1 · Cited by 1
Determining the Conceptual Independence of Self-Identity in Reasoned Action ModelsPreprint
Snippe, M. H. M., Peters, G.-J., & Kok, G. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ke2vx · Cited by 1
Quinn, J. F., Cola, P. A., Cooper, M., & Miller, C. W. (2024) · Research Square · doi:10.21203/rs.3.rs-4565994/v1 · Cited by 1
Turner, T. N., & Reeb, R. N. (2026) · Journal of Prevention & Intervention in the Community · doi:10.1080/10852352.2026.2669311
Psychological factors related to Buruli ulcer and tuberculosis in Sub-Saharan Africa
Alferink, M. (2015) · University of Groningen research database (University of Groningen / Centre for Information Technology)
Dosen, A. S. (2017) · Figshare · Cited by 1
Strategic logistics outsourcing success framework: a study of Indian businesses
Sangam, V. (2017) · Victoria University Research Repository (Victoria University) · Cited by 1
EXAMINING NEGATIVE WORDING EFFECT IN A SELF-REPORT MEASURE
Xia, X. (2019) · D-Scholarship@Pitt (University of Pittsburgh)
Bansal, P. S. (2019) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2019.002
Validacion de la escala de cultura organizacional de denison (docs) en centros educativos en Chile
Cancino, V. C., & Mellado, C. (2019) · Interciencia
EDUCATIONAL REWARD INFORMATION COMMUNICATION API (ERIC API): A PRELIMINARY STUDY RESULT
Kuo, R., Chen, C., Lu, Z.-X., Chang, M., & Chang, H. (2019) · Revista Produção e Desenvolvimento · doi:10.32358/rpd.2019.v5.395
“Since negative worded questions may not be able to prevent response bias (Van Sonderen, Sanderman, & Coyne, 2013), the research team should consider using positive worded question to investigate participants’ perceived ease of use.”
BackgroundBortoli, P. S. D. (2019) · doi:10.11606/t.83.2019.tde-23102019-202530 · Cited by 1
Bacalá, B. T. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.22.2019.tde-23102019-175338 · Cited by 1
Samuel, D. B., Bucher, M. A., & Suzuki, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.007
Dance for the dead: Belief, anxiety, and social cohesion in the Japanese Bon Festival
Irving, B. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17144435.v1
“Though item 15 was loading higher than item 2, we decided not to include it, as it was only a negative coded version of item 1 and recent research has suggested that negative coding is not helpful and may confuse participants (van Sonderen, Sanderman, and Coyne, 2013).”
BackgroundArmy Command Climate: The Viability of Single-Item Measures
Adis, C., Byrd, C., Wisecarver, M. M., Darrow, J. B., Hoffman, R. C., & Rahill, K. M. (2020)
Evaluation of a new satisfaction questionnaire about the use of imaging : VIPA
Pinkster, H. J. J. (2020)
کارسازی, ح., نصيري, م., & آباد, ت. ه. ن. (2015)
Shaakumeni, S. N. (2020) · SZTE Repository of Dissertations (University of Szeged) · doi:10.14232/phd.10450
Διαμαντοπούλου, Γ., & Πλατσίδου, Μ. (2021) · Psychology the Journal of the Hellenic Psychological Society · doi:10.12681/psy_hps.26231 · Cited by 1
“Vachon & Lynam, 2016. van Sonderen et al., 2013) αλλά το καθιστά ένα εργαλείο για την ταυτότητα που θα μπορούσε να χορηγηθεί σε άτομα μικρότερης ηλικίας ή/και άτομα με (ανα)γνωστικές δυσκολίες (Marsh, 1986).”
Investigating the Reliability of Self-report Survey in the Wild: The Quest for Ground TruthPreprint
Gao, N., Rahaman, M. S., Shao, W., & Salim, F. D. (2021) · arXiv (Cornell University)
Sorenson, J. (2021) · The Atrium (University of Guelph)
Social Comparisons on Instagram and Adolescent Identity Development: A Mixed-Methods Study
Noon, E. J. (2020) · Sheffield Hallam University · doi:10.7190/shu-thesis-00393 · Cited by 2
New Zealanders’ Attitudes towards Biculturalism in Aotearoa New Zealand
McSweeney-Novak, M. (2021) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.16834789 · Cited by 1
Frikha, A. (2019) · Wiley eBooks · doi:10.1002/9781119671374.refs
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.005
Blackwood, J., Carpentier, S. T., Deng, W., & de Winckel, A. V. (2022) · medRxiv · doi:10.1101/2022.03.09.22272162
“I’ve Got Your Six”: The Importance of Peer Support to Women Working in Non-Traditional Roles
Shipley, D. (2021) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2021-14516
Development and Validation of the Social Adjustment Scale for Adolescent Cancer SurvivorsPreprint
Oh, S., Lee, H., Kim, S., Kim, S., Lyu, C. J., Park, C.-G., & Kang, H. J. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4189398
Peran Mediasi Ethical Behavior pada Pengembangan Organizational Citizenship Behaviors Auditor Publik
Acanthus, E. V., & Desiana, P. M. (2022) · Journal of Government and Politics (JGOP) · doi:10.31764/jgop.v4i1.5362
Blended assessment in the age of new norms
Smythe, I. S. (2020) · Assessment and Development Matters · doi:10.53841/bpsadm.2020.12.3.19
The native speaker model and language learners: developing a measurement instrument
Harris, J. (2023) · Asian Englishes · doi:10.1080/13488678.2022.2158264
Development and Psychometric Properties of Prosocial Behaviour Scale for Rescue Workers
Khattak, A. Z., Bhati, M. I., & Wazir, S. T. M. (2022) · Annals of Human and Social Sciences · doi:10.35484/ahss.2022(3-iii)48
Evidence of method effects in the authoritarianism-conservatism-traditionalism scales
Ng, D. X., Chew, P. K. H., & Ramsay, J. E. (2023) · Journal of Pacific Rim Psychology · doi:10.1177/18344909231161773 · Cited by 2
“One strategy involves using only positive-worded items (Chyung et al., 2018; Lindwall et al., 2012; Van Sonderen et al., 2013).”
BackgroundMethodInfluentialA practical primer on the use of inverted items in psychometric self-report scalesPreprint
Blötner, C. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/j7dp9
da Veiga, D. R., Picha, K. J., & Rebustini, F. (2023) · Revista Enfermagem UERJ · doi:10.12957/reuerj.2023.73954
الله, ع. ا. م. ح. (2023) · مجلة كلية التربية جامعة بنها · doi:10.21608/jfeb.2023.312489
การพัฒนามาตรวัดความสุขในการเรียนของนักเรียนมัธยมศึกษาตอนต้นในเขตกรุงเทพมหานคร
กิตติมงคลชัย, ส. (2019) · Chula Digiverse · doi:10.58837/chula.the.2019.782
Mapping Children’s Sense of Wonder The Development of the Wonder ChartPreprint
Broekhof, E., & Schinkel, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4554977
Act Your Age! Generational Differences in Political Participation in Finland 2007–2019
Huttunen, J., & Christensen, H. S. (2024) · Routledge eBooks · doi:10.4324/9781003452287-7 · Cited by 2
Examining the Wording Effect: What Are We Measuring?
Kılıç, A. F., Güvendir, M. A., GÜLER, G., & Kaçak, T. (2024) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2024.2329505
“Furthermore, inconsistent responses can occur when respondents do not carefully distinguish between positive and negative expressions, leading to inconsistencies in their answers compared to other items (Roszkowski & Soven, 2010; Van Sonderen et al., 2013; Weijters et al., 2013).”
InfluentialValidation and Measurement Invariance of the German and Spanish Gender Bias Scale for Women Leaders
Algner, M., Fay, D., & Lorenz, T. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09946-7 · Cited by 2
“However, scholars have argued the use of reverse-worded items could confuse participants or increase the frequency of inattentive response behaviors (van Sonderen et al., 2013).”
Personalidad oscura, empatía y problemas de conducta en adultos argentinos
Resett, S. A., & Caino, P. C. G. (2024) · Psicodebate · doi:10.18682/pd.v24i1.9229
“Por ende, muchos investigadores sugieren colocarlas todas en la misma orientación (Suárez et al., 2018; Solís Salazar, 2015; Sonderen et al., 2013).”
BackgroundProduce Safety Behaviors, Motivators, Barriers, and Beliefs in Pediatric Cancer Patient Caretakers
Gomez, C. B., Stump, T., Turner, M. M., Mitchell, J., & Marks, B. P. (2024) · Journal of Food Protection · doi:10.1016/j.jfp.2024.100400 · Cited by 1
GEOH, M. K., Razaob, N. A., Rasdi, H. F. M., Kadar, M., & Yunus, F. W. (2024) · Malaysian Journal of Medicine and Health Sciences · doi:10.47836/mjmhs.20.4.2
Procedural justice and language barriers in a Swiss penitentiary
Albrecht, J. N., Rossegger, A., Dreifuss, M. S., Singh, J. P., Naegeli, A., & Endrass, J. (2025) · European Journal of Criminology · doi:10.1177/14773708251315301
“It may have been that reverse items might just have been too complicated, and participants may not have adjusted their response behavior accordingly (Sonderen et al., 2013; Weijters and Baumgartner, 2012).”
Rogier, G., Bertolini, M., Bruno, S., Cataudella, S., & Velotti, P. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.101838 · Cited by 2
Reis, C., Santos, M. L., & Marôco, J. P. (2025) · Fatigue Biomedicine Health & Behavior · doi:10.1080/21641846.2025.2498285
Ali, A. M., AL-Dossary, S. A., Abuhammad, S., Laranjeira, C., Khatatbeh, H., Al-Amer, R. M., Zoromba, M. A., Aljubilah, A. F., & Atalla, A. D. G. (2025) · Research Square · doi:10.21203/rs.3.rs-6598461/v1
Vukojević, I., Masnikosa, I., Gjurković, M., Drobac, N., Butković, A., Lozić, M., Bratko, D., & Šnajder, J. (2025) · Journal of Research in Personality · doi:10.1016/j.jrp.2025.104634
Jinchang, K., & Jarunratanakul, P. (2025) · Body Image · doi:10.1016/j.bodyim.2025.101964
Persian Mentalized Affectivity Scale (MAS): Reliability, Validity, and Cultural Considerations
Jafarpoor, F., Shayegh, E., Haghjoo, P., & Ghanbari, S. (2025) · Brain and Behavior · doi:10.1002/brb3.70880 · Cited by 1
Metadata
- Authors
- Sonderen, E. V., Sanderman, R., & Coyne, J. C.
- Affiliations
- University Medical Center Groningen (NL)
- Corresponding author
- Sonderen, Eric van
- ORCID
- Sanderman, Robbert
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-31
- Volume
- 8
- Issue
- 7
- Pages
- e68967
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3729568
- OpenAlex
- W2141632279
- Cited by
- 544
- References
- 29
- Citations by year
- 2026: 44 · 2025: 50 · 2024: 49 · 2023: 48 · 2022: 54 · 2021: 59 · 2020: 70 · 2019: 51 · 2018: 44 · 2017: 27 · 2016: 29 · 2015: 16 · 2014: 3
- FWCI
- 49.55
- Type
- journal article
- Language
- en
- Update notices
- correction (2013-09-13)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, cc-by)
- University of Twente Research Information (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Universiteit Maastricht
- Maastricht Universitair Medisch Centrum
- Universitair Medisch Centrum Groningen
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- response bias, acquiescence bias, questionnaire design, Multidimensional Fatigue Inventory, fatigue measurement, psychometric properties
- MeSH terms
- Animals, Cattle, Fatigue, Humans, Psychometrics, Surveys and Questionnaires, Reproducibility of Results, Inflammatory Bowel Diseases, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.