Ineffectiveness of Reverse Wording of Questionnaire Items: Let’s Learn from Cows in the Rain
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: We examined the effectiveness of reverse worded items as a means of reducing or preventing response bias. We first distinguished between several types of response bias that are often confused in literature. We next developed arguments why reversing items is probably never a good way to address response bias. We proposed testing whether reverse wording affects response bias with item-level data from the Multidimensional Fatigue Inventory (MFI-20), an instrument that contains reversed worded items. METHODS: With data from 700 respondents, we compared scores on items that were similar with respect either to content or to direction of wording. Psychometric properties of sets of these items worded in the same direction were compared with sets consisting of both straightforward and reversed worded items. RESULTS: We did not find evidence that ten reverse-worded items prevented response bias. Instead, the data suggest scores were contaminated by respondent inattention and confusion. CONCLUSIONS: Using twenty items, balanced for scoring direction, to assess fatigue did not prevent respondents from inattentive or acquiescent answering. Rather, fewer mistakes are made with a 10-item instrument with items posed in the same direction. Such a format is preferable for both epidemiological and clinical studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In this context, a study by Sonderen et al. (2013) showed that reverse-worded items may lead to inattention when responding to a questionnaire.”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as Sonderen et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“The latter could indicate a measurement issue related to including both positively and negatively phrased items in a scale [111].”
From Validation of the compassionate engagement and action scales, compassion scale, and Sussex-Oxford compassion scales in a French-Canadian sample (2024) · cites this paper as [111]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · cited 2×
“We consider this a variety of the Multi-Trait-Multi-Method matrix discussed by Campbell & Fiske [29].”
MethodA three-component conceptualization of organizational commitment
Meyer, J. P., & Allen, N. J. (1991) · Human Resource Management Review · doi:10.1016/1053-4822(91)90011-z · Cited by 11,049 · cited 2×
“1) Meyer and Allen’s [11] scale to assess affective commitment, of which Merritt [12] demonstrated that the answers on reversed items were prone to careless responding and cognitive fatigue.”
BackgroundDevelopment and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099 · cited 1×
“’s [14] scale to assess worry contains 11 positively and five reversed worded items, leading Fresco et al.”
BackgroundThe Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734 · cited 2×
“The process of obtaining survey data is complex, with many possibilities of discrepancies arising between the state or opinion the researcher wants to elicit and the answer given by the respondent [3].”
BackgroundSmets, E. M. A., Garssen, B., Bonke, B., & De Haes, J. C. J. M. (1995) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(94)00125-o · Cited by 3,613 · cited 2×
“[28] constructed a version with seven categories, but in accordance with their adaptation in 1996 [27], a version is used with five answer categories, ranging from 1 (‘yes, that is true’) to 5 (‘no, that is not true’).”
BackgroundMethodMeasurement and Control of Response Bias
Paulhus, D. L. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50006-x · Cited by 3,598
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852 · cited 1×
“Krosnick [7] mentions a satisficing response style, whereby the respondent deliberately makes less effort to understand all subtleties of the question.”
On the bipolarity of positive and negative affect.
Russell, J. A., & Carroll, J. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.1.3 · Cited by 1,481 · cited 1×
“More researchers attribute the claim of multidimensionality that is often made in scales with reversed worded items, not to conceptual differences, but to artificial factors resulting from response bias [20–25].”
BackgroundResponse Styles in Marketing Research: A Cross-National Investigation
Baumgartner, H., & Steenkamp, J.-B. E. M. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.2.143.18840 · Cited by 1,255
Do We Really Need Multiple-Item Measures in Service Research?
Drolet, A. L., & Morrison, D. G. (2001) · Journal of Service Research · doi:10.1177/109467050133001 · Cited by 736 · cited 2×
“As Drolet and Morrison [9] demonstrate, respondents sometimes just answer the first item and assume that this answer also holds for subsequent (considered similar or even identical) items.”
Background
Cited by
Items 201–300 of 543
Perrig, S. A. C., von Felten, N., Honda, M., Opwis, K., & Brühlmann, F. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2258634 · Cited by 15
“Additional results by van Sonderen et al. (2013) indicated that reversed items do not prevent inattentive or acquiescent response behavior, rather causing inattention and confusion among participants, increasing respondent mistakes.”
InfluentialLorentzen, V., Handegård, B. H., Moen, C. M., Solem, K. M., Lillevoll, K. R., & Skre, I. (2020) · BMC Psychology · doi:10.1186/s40359-020-00459-5 · Cited by 17
Elek, D., Cígler, H., Grüning, D. J., & Ježek, S. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1684612 · Cited by 16
Chai, W., & Shek, D. T. L. (2024) · Applied Research in Quality of Life · doi:10.1007/s11482-024-10277-1 · Cited by 14
“In this study, the two reverse-code items were taken out from the measure as the reverse-code items were criticized and shown as causing confusion and being ineffective in preventing response bias (Sonderen et al., 2013).”
Smith, S. K., Burns-O’Connell, G., Knibb, R. C., Greenwood, R., Hussain, S., Shaw, R. L., Straus, J., Banks, J., Hall, A. J., Dhanda, N., et al. (2024) · Health Expectations · doi:10.1111/hex.70088 · Cited by 11
Carrard, S., Mooser, C., Hilfiker, R., & Hager, A.-G. M. (2022) · Health and Quality of Life Outcomes · doi:10.1186/s12955-022-01950-w · Cited by 14
Kam, C. C. S. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1502194 · Cited by 11
“Do reverse-keyed items have poorer psychometric properties than regular-keyed items, as some researchers have suggested (e.g., van Sonderen et al., 2013)?”
BackgroundLi, C., Waid-Ebbs, J. K., Velozo, C. A., & Heaton, S. C. (2015) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2015.1044458 · Cited by 11
“…that in future studies, all items should be worded in one direction, either positively or negatively, since changing between positively and negatively worded items could add further cognitive burden for individuals with TBI, as well as cause additional measurement error (van Sonderen et al., 2013).”
Brophy, K., Emery, M., MacDonald, C., Côté, C. I., & Körner, A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305776 · Cited by 10
Liu, X., Rietz, T., & Maedche, A. (2024) · Universal Access in the Information Society · doi:10.1007/s10209-024-01122-1 · Cited by 15
“Such negatively worded questions can cause confusion [57], especially since our experimental tasks required a certain amount of effort for rational analysis and were not inherently entertaining, making the question itself misleading.”
Validity and Reliability of the Tampa Scale for Kinesiophobia for Adolescents with Heart Disease
WHITE, D. A., BLACK, W. R., Cramer, E., Malloy-Walton, L. E., Walton, M. M., Martis, L. B., Enneking, B., Teson, K. M., Watson, J. S., & Gross‐Toalson, J. (2025) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000003642 · Cited by 11
“In addition to the content expert consensus, research has shown that reverse coding or negative wording items do not reduce respondent error and, in some cases, increases confusion, inattention, and response bias (61).”
A transparency statement improves trust in community-police interactions
Dobson, K. S. H., Dittmann, A. G., & Yeager, D. S. (2025) · Nature Communications · doi:10.1038/s41467-024-55709-6 · Cited by 27
“In effect, there were no treatment effects on the single item that showed very low reliability and appeared to confuse participants due to its reverse wording 67 , but there was a meaningful effect on the two other items combined.”
Measuring transparency in intelligent robots
Angelopoulos, G., Lacroix, D., Wullenkord, R., Rossi, A., Rossi, S., & Eyssel, F. (2025) · Scientific Reports · doi:10.1038/s41598-025-29685-w · Cited by 17
Paap, M. C. S., Lenferink, L. I. M., Herzog, N., Kroeze, K. A., & van der Palen, J. A. M. (2016) · Health and Quality of Life Outcomes · doi:10.1186/s12955-016-0500-0 · Cited by 10
Preece, D. A., Parry, C. L., Allan, M. M., & Allan, A. (2020) · Criminal Behaviour and Mental Health · doi:10.1002/cbm.2176 · Cited by 14
“In the general psychometric literature (see van Sonderen et al., 2013), reverse-scored items are often found to have problematic effects, in terms of reducing levels of reliability and creating a ‘method factor’ in the factor structure (i.e., where some variance in these items is accounted for by…”
BackgroundHungarian PROMIS-29+2: psychometric properties and population reference values
Jenei, B., Bató, A., Mitev, A. Z., Brodszky, V., & Rencz, F. (2023) · Quality of Life Research · doi:10.1007/s11136-023-03364-7 · Cited by 12
“Yet, several studies reported that such items can lead to measurement problems, including low reliability and poor model fit and some argue that they would prevent respondents from inattentive or acquiescent answering [56].”
BackgroundKim, S., Oh, T., Lee, S., & Andrew, D. P. S. (2018) · Sport Management Review · doi:10.1016/j.smr.2018.06.007 · Cited by 14
Balwant, P. T., Jueanville, O., & Ramdeo, S. (2019) · Work · doi:10.3233/wor-193006 · Cited by 12
Pygmalion in the pipeline: How managers' perceptions influence racial differences in turnover
Sabat, I. E., Goldberg, C., King, E. B., Dawson, J., & Zhang, L. (2020) · Human Resource Management · doi:10.1002/hrm.22044 · Cited by 14
Happiness and poverty in the very poor Peru: measurement improvements and a consistent relationship
Mateu, P., Vásquez, E., Zúñiga, J., & Ibáñez, F. (2020) · Quality & Quantity: International Journal of Methodology · doi:10.1007/s11135-020-00974-y
Liu, Q., Ho, K.-Y., Lam, K. K. W., Lam, W., Cheng, H., Ching, S. S. Y., Belay, G. M., & Wong, F. K. Y. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1065854 · Cited by 10
“Increasing evidence suggests that negatively worded items do not match the overall logic of other items that are positively worded, and hence people may respond incorrectly if they do not pay sufficient attention to distinguishing negatively worded items from positively worded items (Sonderen et al., 2013; Salazar, 20…”
BackgroundPROMIS Scores for Plantar Fasciitis Before and After Gastrocnemius Recession
Sanchez, T., Sankey, T., Schick, S., Arthur, R. Y., Young, M., Underwood, M., Harrelson, W. M., & Shah, A. B. (2023) · Foot & Ankle International · doi:10.1177/10711007231159105 · Cited by 9
Ahola, K., Butavicius, M., McCormac, A., & Sturman, D. (2024) · Information and Computer Security · doi:10.1108/ics-11-2023-0214 · Cited by 11
Denovan, A., Dagnall, N., Artamonova, E. G., & Papageorgiou, K. Α. (2024) · Current Psychology · doi:10.1007/s12144-024-06562-9 · Cited by 11
“Despite possessing potential merit, some theorists question the usefulness of negatively worded items, contending that they do not actually reduce response bias and produce data contaminated by respondent inattention and confusion (Sonderen et al., 2013).”
BackgroundValidation of the Anxiety Scale for Pregnancy in a Sample of Iranian Women
Mortazavi, F., & Akaberi, A. (2017) · International Journal of Women s Health and Reproduction Sciences · doi:10.15296/ijwhr.2018.12 · Cited by 12
Plessis, C., Altıntaş, E., Romo, L., & Guerrién, A. (2021) · The Canadian Journal of Psychiatry · doi:10.1177/0706743721990796 · Cited by 12
Haruta, J., & Goto, R. (2021) · Journal of Interprofessional Care · doi:10.1080/13561820.2021.1951188 · Cited by 9
“However, it was reported that inclusion of reversed items may cause confusion among the respondents (Sonderen et al., 2013) and distort the factor structure (Savalei & Falk, 2014; Zhang et al.”
BackgroundTavel, P., Jozefiaková, B., Teličák, P., Fürstová, J., Puza, M., & Kaščáková, N. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19010511 · Cited by 12
“Such items can be problematic because of their potentially unclear meaning to respondents [51,52], and thus the data can be contaminated by respondents’ inattention and confusion [53], especially in the case of double-negative formulations [54].”
BackgroundÁlvarez, M. C., Albuquerque, M. L. L., Neiva, H. P., Cid, L., Teixeira, D., Matos, R. M. N., Antunes, R., Lúcio, L., Sant’Ana, L. D. O., & Monteiro, D. (2022) · Medicina · doi:10.3390/medicina58081097 · Cited by 13
“, “On the whole, I am satisfied with myself”), as the negatively coded items can contaminate results [67].”
BackgroundThe reinforcement sensitivity theory of personality in children: A new questionnaire
Cooper, A. J., Stirling, S., Dawe, S., Pugnaghi, G., & Corr, P. J. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.028 · Cited by 11
Chua, K., Boehnke, J. R., Prince, M. J., & Banerjee, S. (2019) · Psychological Assessment · doi:10.1037/pas0000743 · Cited by 10
Plouffe, R. A., Kowalski, C. M., Tremblay, P. F., Saklofske, D. H., Rogoza, R., Pierro, R. D., & Chahine, S. (2021) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000634 · Cited by 12
Son, D. V., Marin, C. E., Boutris, P., Rey, Y., Lebowitz, E. R., Pettit, J. W., & Silverman, W. K. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102399 · Cited by 10
Blackwood, J., Carpentier, S. T., Deng, W., & de Winckel, A. V. (2023) · PLoS ONE · doi:10.1371/journal.pone.0286657 · Cited by 12
“There is also debate in the research community as to whether combining positively and negatively worded items in the same scale may result in measurement inaccuracies [86, 87].”
Structural and construct validity of the Leeds Multiple Sclerosis Quality of Life scale
Ensari, I., Motl, R. W., & McAuley, E. (2015) · Quality of Life Research · doi:10.1007/s11136-015-1202-5 · Cited by 13
“possible redundancy among items 6 and 7 and supported removal of the longer, reverse-scored item 7 [26].”
BackgroundNovel Insights Into Item Keying/Valence Effect Using Latent Difference (LD) Modeling Analysis
Kam, C. C. S. (2017) · Journal of Personality Assessment · doi:10.1080/00223891.2017.1369095 · Cited by 11
Factors influencing consumers’ willingness to participate in new food product development activities
Hoppe, A., de Barcellos, M. D., Perin, M. G., Jacobsen, L., & Lähteenmäki, L. (2018) · British Food Journal · doi:10.1108/bfj-06-2017-0346 · Cited by 9
Measurement of Parenting Self-efficacy Among Female HIV-Affected Caregivers in Uganda
Augustinavicius, J., Murray, S. M., Familiar, I., Boivin, M. J., Mutebe, A., Arima, E. G., & Bass, J. (2020) · Maternal and Child Health Journal · doi:10.1007/s10995-019-02855-9 · Cited by 12
Szabó, Á., & Ward, C. A. (2021) · Assessment · doi:10.1177/10731911211000108 · Cited by 10
“Furthermore, redundancy due to repeated items may increase inattentive responding, thus leading to response bias (van Sonderen et al., 2013), which is another reason why unnecessary duplication of items should be avoided.”
BackgroundShamsalinia, A., Moradi, M., Rad, R. E., Ghadimi, R., Farahani, M. A., Masoudi, R., Rabiei, L., & Ghaffari, F. (2021) · BMC Neurology · doi:10.1186/s12883-021-02139-2 · Cited by 10
Lyhne, J. D., Smith, A. B., Timm, S., Simard, S., Jensen, L. H., Frostholm, L., & Fink, P. (2023) · Supportive Care in Cancer · doi:10.1007/s00520-023-08159-7 · Cited by 13
Trimble, A. C., Robinson, K., & Preece, D. (2024) · Australian Psychologist · doi:10.1080/00050067.2023.2285513 · Cited by 8
“Reverse-scored items can disrupt the psychometric properties of measures (for a review, see Van Sonderen et al., 2013), and have been found to contribute to EOT item issues for the TAS-20 in adults (e.g., Gignac et al., 2007; Megank et al., 2008; Preece et al., 2018b).”
Fekih‐Romdhane, F., Postigo, Á., Malaeb, D. N., Dine, A. S. E., Moawad, M., Hallit, R. R., Obeïd, S., & Hallit, S. R. (2025) · BMC Psychology · doi:10.1186/s40359-025-02441-5 · Cited by 10
Design and content validation of the Oral Hygiene Habits Scale.
Facultad de Odontología, U. A. D. N. L. M., Rodríguez, N. I., Facultad de Psicología, U. A. D. N. L. M., & Moral, J. (2016) · Journal Of Oral Research · doi:10.17126/joralres.2016.035 · Cited by 9
A Cross-cultural Validation of Adapted Questionnaire for Assessing Motivation to Learn Science
Shaakumeni, S. N., & Csapó, B. (2018) · African Journal of Research in Mathematics Science and Technology Education · doi:10.1080/18117295.2018.1533157 · Cited by 10
Stuck on pain? Assessing children’s vigilance and awareness of pain sensations
Heathcote, L. C., & Simons, L. E. (2020) · European Journal of Pain · doi:10.1002/ejp.1581 · Cited by 12
Smith, C. J., Matthias, T., Beam, E. L., Wampler, K., Pounds, L., Nickol, D., Shope, R. J., Carlson, K., & Michael, K. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-06105-5 · Cited by 11
Development of the Pet Owner Connectedness Scale (POCS)
Oliva, J. L., & Johnston, K. L. (2022) · Anthrozoös · doi:10.1080/08927936.2022.2027095 · Cited by 8
“All statements were positively worded as evidence suggests reverse-worded items do not necessarily prevent response bias and may lead to respondent inattention and confusion (see, e.g., van Sonderen et al., 2013).”
BackgroundBe yourself or adapt yourself? Authenticity, self-monitoring, behavioural integrity, and trust
Nguyen, B., Leroy, H., Gill, C., & Simons, T. L. (2022) · Journal of Trust Research · doi:10.1080/21515581.2022.2093211 · Cited by 10
“Dropping negatively worded items in a field study has been shown to increase validity as negatively worded items tend to increase confusion (van Sonderen et al., 2013).”
BackgroundRosenfeldt, A. B., Koop, M. M., Penko, A. L., Zimmerman, E. M., Miller, D. M., & Alberts, J. L. (2022) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2022.102867 · Cited by 9
Validation of the attitudes towards people living with HIV/AIDS scale in nursing students
Gázquez‐López, M., García-García, I., González‐García, A., Salvador, A. M., Pérez‐Morente, M. Á., Martínez-García, E., & Álvarez‐Serrano, M. A. (2023) · BMC Nursing · doi:10.1186/s12912-023-01414-6 · Cited by 9
“[57], the inclusion of negatively worded items does not influence the response bias of the questionnaires, but rather the bias comes from the lack of attention of the respondents, it is preferable, for epidemiological and clinical studies, to develop short questionnaires (around 10 items) in the same direction.”
BackgroundPollet, T. V., Saxton, T. K., & Mitchell, M. (2018) · Interpersona An International Journal on Personal Relationships · doi:10.5964/ijpr.v12i2.316 · Cited by 8
Preece, D. A., Kiekens, G., Boyes, M. E., Mortier, P., Nock, M. K., Kessler, R. C., Bruffaerts, R., & Hasking, P. A. (2020) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12721 · Cited by 13
“These findings are consistent with a growing body of literature in the psychological assessment field, which highlights that reverse-scored items often adversely affect the psychometric performance of self-report measures (van Sonderen et al., 2013).”
MethodResultBah, A. J., Wurie, H. R., Samai, M., Horn, R., & Ager, A. (2025) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2024.100852 · Cited by 7
Development of a Naturalness Preference Scale
Bayerman, S. F., Li, M., Syed, A., & Scherer, L. D. (2023) · Medical Decision Making · doi:10.1177/0272989x231189494 · Cited by 7
“Based on these results, and research questioning the usefulness of reverse-coded items, 24,25 we dropped these items.”
Result“I find it hard to change poor food habits”: Measuring food choice motives in an emerging economy
Dlamini, N. N., Ramkilawon, G., Tuorila, H., & de Kock, H. L. (2024) · Appetite · doi:10.1016/j.appet.2024.107535 · Cited by 8
“…the benefits of negatively worded items, i.e., reduced response bias (Aithal & Aithal, 2020; Sauro & Lewis, 2011), such items can be misread or misunderstood (Sonderen et al., 2013), especially when they are alternated with positively worded items (Jaeger & Cardello, 2022) - as was the case here.”
BackgroundFörster, K., & Strauß, T. (2025) · Telematics and Informatics Reports · doi:10.1016/j.teler.2025.100198 · Cited by 12
Peasgood, T., Chang, J.-Y. A., Mir, R., Mukuria, C., & Powell, P. A. (2021) · Quality of Life Research · doi:10.1007/s11136-021-02801-9 · Cited by 9
Hübner, N., Wagner, W., Meyer, J., & Watt, H. M. G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.816358 · Cited by 5
Sanabria‐Mazo, J. P., Gómez-Acosta, A., Annicchiarico-Lobo, J., Luciano, J. V., & Sanz, A. (2024) · Revista Latinoamericana de Psicología · doi:10.14349/rlp.2024.v56.3 · Cited by 16
“The psychometric problem of “method effects” (or “item wording”), reported in this study, has been widely addressed in the scientific literature (van Sonderen et al., 2013).”
Panizza, M. E., Cuevasanta, D., & Mels, C. (2020) · Estudos de Psicologia (Campinas) · doi:10.1590/1982-0275202037e190066 · Cited by 12
Lyhne, J. D., Smith, A. B., Jensen, L. H., Hansen, T. F., Frostholm, L., & Timm, S. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02236-z · Cited by 9
“Cases that missed the reversed wording of item 5 on the FCRI-SF and presented with a response pattern of “0” were excluded, as this was interpreted as inattention or lack of motivation [34], see Fig.”
Likert Tipi Ölçeklerde Olumsuz Madde ve Kategori Sayısı Sorunu: Rasch Modeli ile Bir İnceleme
Güler, N., & İlhan, M. (2017) · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · doi:10.21031/epod.321057 · Cited by 7
Lim, S., Powell, T. W., Xue, Q., Towe, V. L., Taylor, R. B., Ellen, J. M., & Sherman, S. G. (2018) · Journal of Health Psychology · doi:10.1177/1359105318769349 · Cited by 8
“Future scale development should consider items assessing powerlessness in the past to allow for a more complete representation of all domains (Kane, 2006; Messick, 1989) and should ideally include only positive items (Solis Salazar, 2015; Van Sonderen et al., 2013).”
BackgroundMelchers, M., Plieger, T., Montag, C., Reuter, M., Spinath, F. M., & Hahn, E. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.05.023 · Cited by 9
Gruber, M., Rumpold, T., Schrank, B., Sibitz, I., Otzelberger, B., Jahn, R., Amering, M., & Unger, A. (2018) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796018000471 · Cited by 9
Teye‐Kwadjo, E. (2021) · Current Psychology · doi:10.1007/s12144-021-02164-x · Cited by 8
Bowen, P. A., Govender, R., & Edwards, P. (2018) · BMC Public Health · doi:10.1186/s12889-018-6100-7 · Cited by 7
“The use of items posed in the same direction is advocated, noting that such a format is preferable for both epidemiological and clinical studies [38, 39].”
BackgroundCaycho‐Rodríguez, T., Tomás, J. M., Ventura‐León, J., Cadena, C. H. G., Reyes-Bossio, M. A., Moreta‐Herrera, R., Maguiña, J. L., & Vilca, L. W. (2023) · Psychological Thought · doi:10.37708/psyct.v16i1.712 · Cited by 6
Murire, O. T., Cilliers, L., & Chinyamurindi, W. (2024) · Higher Education Skills and Work-based Learning · doi:10.1108/heswbl-12-2023-0330 · Cited by 6
Asp, L., Klapp, A., & Rosén, M. (2025) · Large-scale Assessments in Education · doi:10.1186/s40536-025-00238-x · Cited by 13
“…2022; Lee & Chen, 2019), others have separated the items that differ in their wording into two different sets (Roszkowski & Soven, 2010; van Sonderen et al., 2013), or used the transformed scale provided by ILSAs like TIMSS (e.g., Berger et al., 2020), whereas others include four…”
Dambi, J. M., Jelsma, J. M., Mlambo, T., & Chiwaridzo, M. (2017) · European Journal of Physiotherapy · doi:10.1080/21679169.2017.1381313 · Cited by 6
Ardyansyah, B. D., Cordier, R., Brewer, M. L., & Parsons, D. N. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302834 · Cited by 7
Tušl, M., Šípová, I., Máčel, M., Cetkovská, K., & Bauer, G. F. (2024) · BMC Psychology · doi:10.1186/s40359-024-01805-7 · Cited by 12
Development and Validation of the Krio Version of the WHOQOL-BREF for Use in Sierra Leone
Price, B. K., Conteh, J. A., & Esliker, R. (2019) · SN Comprehensive Clinical Medicine · doi:10.1007/s42399-019-00181-3 · Cited by 7
Zeytinoğlu‐Saydam, S., Erdem, G., & Söylemez, Y. (2020) · Family Relations · doi:10.1111/fare.12446 · Cited by 6
Fear of Missing Out Scale Indonesian Version: An Internal Structure Analysis
Wibaningrum, G., & Aurellya, C. D. (2020) · Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I) · doi:10.15408/jp3i.v9i2.16283 · Cited by 11
Yu, Y., Wu, A. M. S., Wing, Y. K., Chan, J. W. Y., Lau, M. M. C., & Lau, J. T. F. (2022) · Sleep And Breathing · doi:10.1007/s11325-022-02598-y · Cited by 6
“Notably, seven removed items involved reversed expressions, which were often problematic and might be subjected to lower validity and errors due to inattention and confusion [26].”
BackgroundLiu, Q., Yuen, J. W. M., Ho, K.-Y., Lam, K. K. W., Lam, W., Cheng, H., Yang, D. L., Ching, S. S. Y., & Wong, F. K. Y. (2023) · Scientific Reports · doi:10.1038/s41598-023-33838-0 · Cited by 6
Mirabootalebi, N., Meidani, Z., Akbari, H., Jeddi, F. R., Tagharrobi, Z., Swoboda, W. J., & Holl, F. (2024) · JMIR Human Factors · doi:10.2196/55324 · Cited by 8
Green, T., & Rodgers, M. A. (2019) · Journal of Educational Administration · doi:10.1108/jea-05-2017-0058 · Cited by 7
Bossink, L. W. M., van der Putten, A. A. J., Steenbergen, H. A., & Vlaskamp, C. (2019) · Journal of Intellectual Disability Research · doi:10.1111/jir.12631 · Cited by 8
Le fonctionnement optimal psychologique : apports conceptuels et méthodologiques
Jaotombo, F. (2019) · Psychologie du Travail et des Organisations · doi:10.1016/j.pto.2019.06.001 · Cited by 7
Putman, S. M., Wang, C., Rickelman, B., Crossley, A., & Mittag, W. (2020) · Education and Information Technologies · doi:10.1007/s10639-019-10066-6 · Cited by 6
“Prior research (see Sonderen et al. 2013) has revealed that variation in items that incorporate a contrary focus can cause misunderstandings, especially after translation.”
BackgroundVeronese, G., Pepe, A., Sala, G., & Vigliaroni, M. (2019) · International Journal of Migration Health and Social Care · doi:10.1108/ijmhsc-07-2018-0043 · Cited by 9
Pregnancy Anxiety and Associated Factors in Pregnant Women
Ghezi, S., Eftekhariyazdi, M., & Mortazavi, F. (2021) · Zahedan Journal of Research in Medical Sciences · doi:10.5812/zjrms.99953 · Cited by 11
“There are studies that have yielded similar results (23-25).”
ResultIndicadores de salud y bienestar social en población inmigrante y chilena: un estudio comparativo
Martini, H. A., Cárdenas, M., Durán, W. F., & Eguren, P. (2021) · Acta Colombiana de Psicología · doi:10.14718/acp.2021.24.1.7 · Cited by 8
McDaniels, B. W., Lee, C.-L., & Bishop, M. L. (2021) · Journal of Parkinson s Disease · doi:10.3233/jpd-212772 · Cited by 6
“ThemodifiedEFAalsosuggeststhat,duetothehigh frequencyofcognitiveimpairmentamongthosewith PD,itemswithreversed-scoredwordingmaycreate potentialrisksandthreatstointernalvalidityandreli-abilityduetoitemineffectivenessandacquiescence responsebiasoragreement[41,42].”
Roberts, P., & Schmidtke, K. A. (2019) · Review of Philosophy and Psychology · doi:10.1007/s13164-019-00437-w · Cited by 6
“Negation items were not used in Experiment 1, because past research suggests that negatively worded items may confuse participants and so make surveys less reliable (Sonderen et al. 2013).”
Fatima, S., Pallath, V., & Hong, W. (2025) · PLoS ONE · doi:10.1371/journal.pone.0319763 · Cited by 11
Motivation Profiles of Engineering Doctoral Students and Implications for Persistence
Perkins, H., Tsugawa, M., Bahnson, M., Satterfield, D. J., Parker, M. C., Kirn, A. N., & Cass, C. A. P. (2019) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie43999.2019.9028565 · Cited by 5
“Two of these six constructs, Speed and Realistic Future Possible Self, used reverse-coded items that have been known to behave problematically in latent variable analyses (such as latent profile analysis and factor analyses), and so were dropped from this study [16][17].”
MethodGallo, T., Heise, C. W., Woosley, R. L., Tisdale, J. E., Antonescu, C. C., Gephart, S. M., & Malone, D. C. (2022) · Journal of Patient Safety · doi:10.1097/pts.0000000000000996 · Cited by 5
“13 Because the alert is issued an average of 54 times per day throughout the 29-hospital system, it is unlikely that an individual clinician would encounter the advisory frequently.”
BackgroundSetiawati, F. A., Nurhayati, S. R., Amelia, R., & Darojat, A. A. (2022) · The Open Psychology Journal · doi:10.2174/18743501-v15-e2208150 · Cited by 8
Cross-national examination of the Distress Tolerance Scale using Rasch methodology
Oorjitham, S., Medvedev, O. N., Bravo, A. J., Cross-Cultural Addictions Study Team, Conway, C., Henson, J. M., Hogarth, L., Ibáñez, M. I., Kaminer, D., Keough, M. T., et al. (2024) · Current Psychology · doi:10.1007/s12144-024-05894-w · Cited by 7
Creating a culture of care: What leaders can do to enhance employee engagement and employee advocacy
Young, S. L., Ang, M., & Campbell, K. (2025) · Communication Quarterly · doi:10.1080/01463373.2025.2455565 · Cited by 6
“…removal of all reverse-coded items; the choice was made to delete these items because reverse-coded items often lead to confusion for respondents (Sonderen et al., 2013) and can load onto one (Schriesheim & Eisenbach, 1995) often futile (Woods, 2006) factor; moreover, reverse-coded items do not…”
Brinker, A. Y., Nolte, S., Fischer, F. H., Obbarius, A., Rose, M., & Liegl, G. (2025) · Journal of General Internal Medicine · doi:10.1007/s11606-025-09496-5 · Cited by 5
Influencing Greater Adoption of Eco-Driving Practices Using an Associative Graphical Display
Potvin-Bernal, J., Hansma, B. J., Donmez, B., Lockwood, P., & Shu, L. H. (2020) · Journal of Mechanical Design · doi:10.1115/1.4045968 · Cited by 6
“Reverse wording was avoided to reduce misinterpretation of questions, which often results in the emergence of a separate unintended factor [37].”
BackgroundThe development of a contextually appropriate measure of psychological distress in Sierra Leone
Horn, R., Jailobaeva, K., Arakelyan, S., & Ager, A. (2021) · BMC Psychology · doi:10.1186/s40359-021-00610-w · Cited by 6
Peters, J., Visser, R. M., & Kindt, M. (2022) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2022.102602 · Cited by 6
da Silva, W. R., Donofre, G. S., Neves, Â. N., Marôco, J. P., Teixeira, P. A., & Campos, J. Á. D. B. (2022) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-022-01439-x · Cited by 6
Metadata
- Authors
- Sonderen, E. V., Sanderman, R., & Coyne, J. C.
- Affiliations
- University Medical Center Groningen (NL)
- Corresponding author
- Sonderen, Eric van
- ORCID
- Sanderman, Robbert
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-31
- Volume
- 8
- Issue
- 7
- Pages
- e68967
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3729568
- OpenAlex
- W2141632279
- Cited by
- 544
- References
- 29
- Citations by year
- 2026: 44 · 2025: 50 · 2024: 49 · 2023: 48 · 2022: 54 · 2021: 59 · 2020: 70 · 2019: 51 · 2018: 44 · 2017: 27 · 2016: 29 · 2015: 16 · 2014: 3
- FWCI
- 49.55
- Type
- journal article
- Language
- en
- Update notices
- correction (2013-09-13)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, cc-by)
- University of Twente Research Information (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Universiteit Maastricht
- Maastricht Universitair Medisch Centrum
- Universitair Medisch Centrum Groningen
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- response bias, acquiescence bias, questionnaire design, Multidimensional Fatigue Inventory, fatigue measurement, psychometric properties
- MeSH terms
- Animals, Cattle, Fatigue, Humans, Psychometrics, Surveys and Questionnaires, Reproducibility of Results, Inflammatory Bowel Diseases, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.