The impact of midpoint responses and reverse coding on survey data

Weems, Gail H.; Onwuegbuzie, Anthony J.

doi:10.1080/07481756.2002.12069033

Cited by 196Psychometric Methodologies and TestingSurvey Methodology and NonresponseReliability and Agreement in Measurement

The impact of midpoint responses and reverse coding on survey data

Weems, Gail H., Onwuegbuzie, Anthony J.·2001·Measurement and Evaluation in Counseling and Development

DOI 10.1080/07481756.2002.12069033

Open this paper in CoChat — free account

Abstract

Counselors conducting survey research have many item format options to contemplate. This study examined midpoint selection and the effect on reliability of (a) including or excluding midpoint options and (b) using both positively and negatively worded items. Findings indicate that reliability can be affected by both midpoint options and reverse coding.

Integrity signals

Registry

Crossref · 10.1080/07481756.2002.12069033

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Use of midpoint responses negatively impacts score reliability.
“the use of midpoint responses negatively impacts score reliability [79].”
From Telemonitoring in Chronic Pain Management Using Smartphone Apps: A Randomized Controlled Trial Comparing Usual Assessment against App-Based Monitoring with and without Clinical Alarms (2020) · cites this paper as [79]

Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · see citing works
Survey research methods
(1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90039-v · Cited by 2,468 · see citing works
Surveys in Social Research
Goyder, J., & de Vaus, D. (1987) · The Canadian Journal of Sociology · doi:10.2307/3340954 · Cited by 2,274 · see citing works
Public opinion quarterly
(1983) · Electoral Studies · doi:10.1016/0261-3794(83)90143-9 · Cited by 553 · see citing works
Effects of Stem and Likert Response Option Reversals on Survey Internal Consistency: If You Feel the Need, There is a Better Alternative to Using those Negatively Worded Stems
Barnette, J. J. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970592 · Cited by 529 · see citing works
A Psychometric Evaluation of 4-Point and 6-Point Likert-Type Scales in Relation to Reliability and Validity
Chang, L. (1994) · Applied Psychological Measurement · doi:10.1177/014662169401800302 · Cited by 502 · see citing works
The Survey Research Handbook.
Stephens, S. A., Alreck, P. L., & Settle, R. B. (1986) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2069328 · Cited by 473 · see citing works
The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes
ALWIN, D. F., & KROSNICK, J. A. (1991) · Sociological Methods & Research · doi:10.1177/0049124191020001005 · Cited by 403 · see citing works
The Survey Research Handbook
Albaum, G., Alreck, P. L., & Settle, R. B. (1985) · Journal of Marketing Research · doi:10.2307/3151595 · Cited by 391 · see citing works
Satisficing in surveys: Initial evidence
Krosnick, J. A., Narayan, S., & Smith, W. R. (1996) · New Directions for Evaluation · doi:10.1002/ev.1033 · Cited by 364 · see citing works
Magnitude estimations of expressions of frequency and amount.
Bass, B. M., Cascio, W. F., & O’Connor, E. J. (1974) · Journal of Applied Psychology · doi:10.1037/h0036653 · Cited by 284 · see citing works
Research Design In Counseling
Gruenewald, K. (2016) · Choice Reviews Online · doi:10.5860/choice.29-5971 · Cited by 265 · see citing works
Expanding the Framework of Internal and External Validity in Quantitative Research.
Onwuegbuzie, A. J. (2000) · Research in the schools · Cited by 225 · see citing works
Self-citation
THE IMPACT OF ITEM PHRASING ON THE VALIDITY OF ATTITUDE SCALES FOR ELEMENTARY SCHOOL CHILDREN
Benson, J., & Hocevar, D. (1985) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1985.tb01061.x · Cited by 207 · see citing works
Library anxiety: Characteristics of ‘at-risk’ college students
Jiao, Q. G., Onwuegbuzie, A. J., & Lichtenstein, A. A. (1996) · Library & Information Science Research · doi:10.1016/s0740-8188(96)90017-1 · Cited by 178 · see citing works
Self-citation
Should We Take Don't Know for an Answer?
Gilljam, M., & Granberg, D. O. (1993) · Public Opinion Quarterly · doi:10.1086/269380 · Cited by 137 · see citing works
Applied Psychological Measurement
(1977) · Applied Psychological Measurement · doi:10.1177/014662167700100401 · Cited by 121 · see citing works
An Investigation of the Factor Structure of the Teacher Efficacy Scale
Deemer, S. A., & Minke, K. M. (1999) · The Journal of Educational Research · doi:10.1080/00220679909597624 · Cited by 112 · see citing works
THE RELATIONSHIP BETWEEN NUMBER OF RESPONSE CATEGORIES AND RELIABILITY OF LIKERT‐TYPE QUESTIONNAIRES1
MASTERS, E. R. (1974) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1974.tb00970.x · Cited by 103 · see citing works
The Middlemost Choice on Attitude Items
Klopfer, F. J., & Madden, T. M. (1980) · Personality and Social Psychology Bulletin · doi:10.1177/014616728061014 · Cited by 99 · see citing works
Sex Differences in Attitude Expression: A Generational Explanation
Rapoport, R. B. (1982) · Public Opinion Quarterly · doi:10.1086/268701 · Cited by 95 · see citing works
College Student Experiences Questionnaire
Leong, F. T. L. (2008) · Encyclopedia of Counseling · doi:10.4135/9781412963978.n519 · Cited by 95 · see citing works
An Analysis of the Meaning of the Question Mark Response Category in Attitude Scales
Dubois, B., & Burns, J. A. (1975) · Educational and Psychological Measurement · doi:10.1177/001316447503500414 · Cited by 87 · see citing works
Characteristics of Nonopinion and No Opinion Response Groups
Faulkenberry, G. D., & Mason, R. D. (1978) · Public Opinion Quarterly · doi:10.1086/268478 · Cited by 79 · see citing works
The Effects of a "Don't Know" Response on Palmore's Facts on Aging Quizzes
Courtenay, B., & Weidemann, C. (1985) · The Gerontologist · doi:10.1093/geront/25.2.177 · Cited by 74 · see citing works
Factors Associated with Achievement in Educational Research Courses.
Onwuegbuzie, A. J., Slate, J. R., Paterson, F. R. A., Watson, M. H., & Schwartz, R. A. (2000) · Research in the schools · Cited by 72 · see citing works
Self-citation
Argumentative Complexity of Abortion Discourse
Dillon, M. (1993) · Public Opinion Quarterly · doi:10.1086/269377 · Cited by 35 · see citing works
Defeating Ourselves: Common Errors in Counseling Research
Fong, M. L., & Malone, C. (1994) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1994.tb00303.x · Cited by 31 · see citing works
The Likert Scale's Midpoint in Communications Research
Ryan, M. G. (1980) · Journalism Quarterly · doi:10.1177/107769908005700216 · Cited by 23 · see citing works
An Examination of Methodological Issues Relevant to the Use and Interpretation of the Semantic Differential
Mann, I. T., Phillips, J. L., & Thompson, E. G. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300211 · Cited by 22 · see citing works
The "Cannot Decide" Option in Thurstone-Type Attitude Scales
Madden, T. M., & Klopfer, F. J. (1978) · Educational and Psychological Measurement · doi:10.1177/001316447803800207 · Cited by 22 · see citing works
Alternative Approaches for Interpreting Alpha with Homogeneous Subsamples.
Roberts, J. K., & Onwuegbuzie, A. J. (2000) · Cited by 7 · see citing works
Self-citation

Flagged first, then by citations

Sorted by citations

Evidence-Based Survey Design: The Use of a Midpoint on the Likert Scale
Chyung, S. Y., Roberts, K., Swanson, I., & Hankinson, A. (2017) · Performance Improvement Journal · doi:10.1002/pfi.21727 · Cited by 851 · see citing works
The effect of rating scale format on response styles: The number of response categories and response category labels
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 813 · see citing works
On the Validity of Student Evaluation of Teaching
Spooren, P., Brockx, B., & Mortelmans, D. (2013) · Review of Educational Research · doi:10.3102/0034654313496870 · Cited by 669 · see citing works
Stuck in the middle: The use and interpretation of mid-points in items on questionnaires
Nadler, J. T., Weston, R., & Voyles, E. C. (2015) · The Journal of General Psychology · doi:10.1080/00221309.2014.994590 · Cited by 396 · see citing works
First Comes Love, Then Comes Google: An Investigation of Uncertainty Reduction Strategies and Self-Disclosure in Online Dating
Gibbs, J. L., Ellison, N. B., & Lai, C.-H. (2011) · Communication Research · doi:10.1177/0093650210377091 · Cited by 390 · see citing works
Method Effects, Measurement Error, and Substantive Conclusions
Lance, C. E., Dawson, B. L., Birkelbach, D. B., & Hoffman, B. J. (2010) · Organizational Research Methods · doi:10.1177/1094428109352528 · Cited by 358 · see citing works
Conspicuous consumption orientation: Conceptualisation, scale development and validation
Chaudhuri, H. R., Mazumdar, S., & Ghoshal, A. (2011) · Journal of Consumer Behaviour · doi:10.1002/cb.364 · Cited by 212 · see citing works
Advancing measurement of work and family domain boundary characteristics
Matthews, R. A., Barnes-Farrell, J. L., & Bulger, C. A. (2010) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2010.05.008 · Cited by 200 · see citing works
Middle category endorsement in odd-numbered Likert response scales: Associated item characteristics, cognitive demands, and preferred meanings
Kulas, J., & Stachowski, A. (2008) · Journal of Research in Personality · doi:10.1016/j.jrp.2008.12.005 · Cited by 170 · see citing works
Collapsing Categories is Often More Advantageous than Modeling Sparse Data: Investigations in the CFA Framework
DiStefano, C., Shi, D., & Morgan, G. B. (2020) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2020.1803073 · Cited by 135 · see citing works
A Framework for Reporting and Interpreting Internal Consistency Reliability Estimates
Onwuegbuzie, A. J., & Daniel, L. G. (2002) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069052 · Cited by 130 · see citing works
Self-citation
Job crafting towards strengths and job crafting towards interests in overqualified employees: Different outcomes and boundary effects
Zhang, F., Wang, B., Qian, J., & Parker, S. K. (2021) · Journal of Organizational Behavior · doi:10.1002/job.2517 · Cited by 123 · see citing works
Financing buyer–supplier dyads: an empirical analysis on financial collaboration in the supply chain
Wandfluh, M., Hofmann, E., & Schönsleben, P. (2015) · International Journal of Logistics Research and Applications · doi:10.1080/13675567.2015.1065803 · Cited by 121 · see citing works
The Short Form-12 Health Survey was a valid instrument in Chinese adolescents
Fong, D., Lam, C. L. K., Mak, K. K., Lo, W. S., Lai, Y. K., Ho, S. Y., & Lam, T. H. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.011 · Cited by 99 · see citing works
A meta-validation model for assessing the score-validity of student teaching evaluations
Onwuegbuzie, A. J., Daniel, L. G., & Collins, K. M. T. (2007) · Quality & Quantity · doi:10.1007/s11135-007-9112-4 · Cited by 95 · see citing works
Self-citation
Integrating skills profiling and purchasing portfolio management: An opportunity for building purchasing capability
Knight, L. A., Tu, Y.-H., & Preston, J. (2013) · International Journal of Production Economics · doi:10.1016/j.ijpe.2013.06.013 · Cited by 92 · see citing works
An IRT Examination of the Psychometric Functioning of Negatively Worded Personality Items
Sliter, K. A., & Zickar, M. J. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413504584 · Cited by 87 · see citing works
Pre-pregnancy counselling for women with chronic kidney disease: a retrospective analysis of nine years’ experience
Wiles, K., Bramham, K., Vais, A., Harding, K., Chowdhury, P., Taylor, C., & Nelson‐Piercy, C. (2015) · BMC Nephrology · doi:10.1186/s12882-015-0024-6 · Cited by 83 · see citing works
Characteristics of respondents who respond differently to positively and negatively worded items on rating scales
Weems, G. H., Onwuegbuzie, A. J., Schreiber, J. B., & Eggers, S. J. (2003) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293032000130234 · Cited by 82 · see citing works
Self-citation
Understanding the motivations of patients: A co‐designed project to understand the factors behind patient engagement
McCarron, T. L., NOSEWORTHY, T. W., Moffat, K., Wilkinson, G., Zelinsky, S., White, D., Hassay, D. N., Lorenzetti, D., & Marlett, N. J. (2019) · Health Expectations · doi:10.1111/hex.12942 · Cited by 66 · see citing works
Primary Pre-Service Teachers' Attitudes Towards Inclusion Across the Training Years
Goddard, C., & Evans, D. (2018) · The Australian journal of teacher education · doi:10.14221/ajte.2018v43n6.8 · Cited by 63 · see citing works
Development and Validation of a Work Mattering Scale (WMS)
Jung, A., & Heppner, M. J. (2015) · Journal of Career Assessment · doi:10.1177/1069072715599412 · Cited by 62 · see citing works
The Process Model of Emotion Regulation Questionnaire: Assessing Individual Differences in Strategy Stage and Orientation
Olderbak, S. G., Uusberg, A., MacCann, C., Pollak, K. M., & Gross, J. J. (2022) · Assessment · doi:10.1177/10731911221134601 · Cited by 59 · see citing works
A measure of teamwork perceptions for team-based learning
Gallegos, P. J., & Peeters, J. M. (2010) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2010.10.004 · Cited by 54 · see citing works
Classifying Residents who use Landscape Irrigation: Implications for Encouraging Water Conservation Behavior
Warner, L. A. S., Lamm, A. J., Rumble, J. N., Martin, E. T., & Cantrell, R. A. (2016) · Environmental Management · doi:10.1007/s00267-016-0706-2 · Cited by 52 · see citing works
Adoption of open source software in organizations: A socio-cognitive perspective
Marsan, J., Paré, G., & Beaudry, A. (2012) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2012.05.004 · Cited by 51 · see citing works
Sex differences in jealousy: Misinterpretation of nonsignificant results as refuting the theory
Edlund, J. E., & Sagarin, B. J. (2009) · Personal Relationships · doi:10.1111/j.1475-6811.2009.01210.x · Cited by 50 · see citing works
Towards a taxonomy of personality facets
Paul Irwing, B., Hughes, D. J., Tokarev, A., & Booth, T. (2023) · European Journal of Personality · doi:10.1177/08902070231200919 · Cited by 58 · see citing works
Confirming the Factor Structure of the Cognitive Test Anxiety Scale: Comparing the Utility of Three Solutions
Cassady, J. C., & Finch, W. H. (2014) · Educational Assessment · doi:10.1080/10627197.2014.934604 · Cited by 48 · see citing works
Public attitudes towards the use of automatic facial recognition technology in criminal justice systems around the world
Ritchie, K. L., Cartledge, C., Growns, B., Yan, A., Wang, Y., Guo, K., Kramer, R. S. S., Edmond, G., Martire, K. A., Roque, M. S., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258241 · Cited by 46 · see citing works
School culture, self-efficacy, outcome expectation, and teacher agency toward reform with curricular autonomy in South Korea: a social cognitive approach
Min, M.-N. (2019) · Asia Pacific Journal of Education · doi:10.1080/02188791.2019.1626218 · Cited by 46 · see citing works
A Dollar for a Tree or a Tree for a Dollar? The Behavioral Effects of Measurement Basis on Managers' CSR Investment Decision
Church, B. K., Jiang, W., Kuang, X., & Vitalis, A. (2018) · The Accounting Review · doi:10.2308/accr-52332 · Cited by 45 · see citing works
Elementary Science Students’ Motivation and Learning Strategy Use: Constructivist Classroom Contextual Factors in a Life Science Laboratory and a Traditional Classroom
Milner, A. R., Templin, M. A., & Czerniak, C. M. (2010) · Journal of Science Teacher Education · doi:10.1007/s10972-010-9200-5 · Cited by 46 · see citing works
Profiles of Respondents Who Respond Inconsistently to Positively- and Negatively-worded Items on Rating Scales
Weems, G. H., Onwuegbuzie, A. J., & Lustig, D. C. (2003) · Evaluation & Research in Education · doi:10.1080/14664200308668290 · Cited by 43 · see citing works
Self-citation
A Standardized Rubric to Evaluate Student Presentations
Peeters, M. J., Sahloff, E. G., & Stone, G. E. (2010) · American Journal of Pharmaceutical Education · doi:10.5688/aj7409171 · Cited by 41 · see citing works
Advancing Optimal Development in Children: Examining the Construct Validity of a Parent Reflective Functioning Questionnaire
Roo, M. D., Wong, G., Rempel, G. R., & Fraser, S. N. (2019) · JMIR Pediatrics and Parenting · doi:10.2196/11561 · Cited by 43 · see citing works
A comprehensive reanalysis of the metacognitive self-regulation scale from the MSLQ
Tock, J. L., & Moxley, J. H. (2016) · Metacognition and Learning · doi:10.1007/s11409-016-9161-y · Cited by 66 · see citing works
Approche structurale de la représentation sociale de la drogue : interrogations autour de la technique de mise en cause
Dany, L., & Apostolidis, T. (2007) · Les cahiers internationaux de psychologie sociale · doi:10.3917/cips.073.0011 · Cited by 41 · see citing works
The affective impact of sightseeing bus tour experiences: using Affective Events Theory (AET) to examine length-of-stay and electronic word-of-mouth
Stylos, N. D., Bigné, E., & Bellou, V. (2022) · Tourism Recreation Research · doi:10.1080/02508281.2022.2101273 · Cited by 39 · see citing works
ADHD-specific knowledge and attitudes of teachers (ASKAT): Development and validation of a new research instrument
Mulholland, S. (2016) · International Journal of Educational Research · doi:10.1016/j.ijer.2016.03.010 · Cited by 33 · see citing works
Telemonitoring in Chronic Pain Management Using Smartphone Apps: A Randomized Controlled Trial Comparing Usual Assessment against App-Based Monitoring with and without Clinical Alarms
Suso-Ribera, C., Castilla, D., Zaragozá, I., Mesas, Á., Server, A., Medel, J., & García-Palacios, A. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17186568 · Cited by 38 · see citing works
A compliance—integrity framework for ethics management: An empirical analysis of local government practice
Perlman, B. J., Reddick, C. G., & Demir, T. (2023) · Public Administration Review · doi:10.1111/puar.13610 · Cited by 46 · see citing works
The Effect of Strategic Message Selection on Residents' Intent to Conserve Water in the Landscape
Warner, L. A. S., Rumble, J. N., Martin, E. T., Lamm, A. J., & Cantrell, R. A. (2015) · Journal of Agricultural Education · doi:10.5032/jae.2015.04059 · Cited by 38 · see citing works
Reverse-Coded Items Do Not Work in Spanish: Data From Four Samples Using Established Measures
Venta, A. C., Bailey, C. A., Walker, J. H., Mercado, A., Colunga-Rodríguez, C., Ángel-González, M., & Dávalos-Picazo, G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.828037 · Cited by 37 · see citing works
Global communication skills: contextual factors fostering their development at internationalised higher education institutions
Dauber, D., & Spencer‐Oatey, H. (2023) · Studies in Higher Education · doi:10.1080/03075079.2023.2182874 · Cited by 36 · see citing works
The School-Wide Cultural Competence Observation Checklist for School Counselors: An Exploratory Factor Analysis
Nelson, J. A., Bustamante, R. M., Wilson, E., & Onwuegbuzie, A. J. (2008) · Professional School Counseling · doi:10.5330/psc.n.2010-11.207 · Cited by 36 · see citing works
Self-citation
Evaluation and Revision of the Kiersma-Chen Empathy Scale
Aronson, B. D., Chen, A. M. H., Blakely, M. L., Kiersma, M. E., & Wicker, E. (2021) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe8685 · Cited by 34 · see citing works
Without Supporting Statistical Evidence, Where Would Reported Measures of Substantive Importance Lead? To No Good Effect
Onwuegbuzie, A. J., & Levin, J. R. (2003) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1051747920 · Cited by 34 · see citing works
Self-citation
USE OF INSTRUCTIONAL TECHNOLOGIES IN TEACHER TRAINING COLLEGES IN MALAWI
Kadzera, C. M. (2006) · VTechWorks (Virginia Tech) · Cited by 34 · see citing works
Does the student evaluation of teaching instrument really measure instructors’ teaching effectiveness? An econometric analysis of students’ perceptions in economics courses
Alauddin, M., & Kifle, T. (2014) · Economic Analysis and Policy · doi:10.1016/j.eap.2014.05.009 · Cited by 32 · see citing works
Assessment of SOAP note evaluation tools in colleges and schools of pharmacy
Sando, K. R., Skoy, E. T., Bradley, C. L., Frenzel, J. E., Kirwin, J. L., & Urteaga, E. M. (2017) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2017.03.010 · Cited by 32 · see citing works
Portuguese Mothers and Fathers Share Similar Levels of Work-Family Guilt According to a Newly Validated Measure
Gonçalves, G., Sousa, C., dos Santos, J. V., Silva, T., & Korabik, K. (2017) · Sex Roles · doi:10.1007/s11199-017-0782-7 · Cited by 33 · see citing works
Does the Number of Response Categories Impact Validity Evidence in Self-Report Measures? A Scoping Review
Abulela, M. A. A., & Khalaf, M. A. (2024) · SAGE Open · doi:10.1177/21582440241230363 · Cited by 30 · see citing works
Moral attitudes and willingness to enhance and repair cognition with brain stimulation
Medaglia, J. D., Yaden, D. B., Helion, C., & Haslam, M. (2018) · Brain stimulation · doi:10.1016/j.brs.2018.09.014 · Cited by 31 · see citing works
Investigating the Effectiveness of Using Application-Based Science Education Videos in a General Chemistry Lecture Course
Ramachandran, R., Sparck, E. M., & Levis‐Fitzgerald, M. (2019) · Journal of Chemical Education · doi:10.1021/acs.jchemed.8b00777 · Cited by 29 · see citing works
Testing the Link Between Empathy and Lay Theories of Happiness
Tullett, A. M., & Plaks, J. E. (2016) · Personality and Social Psychology Bulletin · doi:10.1177/0146167216665092 · Cited by 28 · see citing works
Beyond Personal Experiences: Examining Mediated Vicarious Experiences as an Antecedent of Medical Mistrust
Williamson, L. D. (2021) · Health Communication · doi:10.1080/10410236.2020.1868744 · Cited by 25 · see citing works
Psychometric Evaluation of the Parental Reflective Functioning Questionnaire in Chinese Parents
Ye, P., Ju, J., Zheng, K., Dang, J., & Bian, Y. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.745184 · Cited by 23 · see citing works
Government Partisanship and Property Rights: Cross‐Country Firm‐Level Evidence
Weymouth, S. J., & Broz, J. L. (2013) · Economics and Politics · doi:10.1111/ecpo.12011 · Cited by 24 · see citing works
Latent Profile Analyses of Depressive Symptoms in Younger and Older Oncology Patients
Saracino, R. M., Cham, H., Rosenfeld, B. D., & Nelson, C. J. (2018) · Assessment · doi:10.1177/1073191118784653 · Cited by 23 · see citing works
An Analysis of Blogs as a Teaching Tool as Perceived by Hospitality Management Students
Çobanoğlu, C. (2006) · Journal of Hospitality Leisure Sport & Tourism Education · doi:10.3794/johlste.52.138 · Cited by 23 · see citing works
An Item-Level Examination of the Factorial Validity of NEO Five-Factor Inventory Scores
Hull, D. M., Beaujean, A. A., Worrell, F. C., & Verdisco, A. E. (2010) · Educational and Psychological Measurement · doi:10.1177/0013164410378091 · Cited by 21 · see citing works
Assessing Internal Consistency in Counseling Research
Leech, N. L., Onwuegbuzie, A. J., & O'Conner, R. (2011) · Counseling Outcome Research and Evaluation · doi:10.1177/2150137811414873 · Cited by 20 · see citing works
Self-citation
Conditional reliability of admissions interview ratings: extreme ratings are the most informative
Stansfield, R. B., & Kreiter, C. D. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02634.x · Cited by 20 · see citing works
The Hidden Measurement Crisis in Criminology
Graham, A., Cullen, F. T., & Link, B. G. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009558549 · Cited by 18 · see citing works
Factor structure of the critical consciousness scale in juvenile legal system‐involved boys and girls
Singh, S., Javdani, S., Berezin, M. N., & Sichel, C. E. (2020) · Journal of Community Psychology · doi:10.1002/jcop.22362 · Cited by 19 · see citing works
Measuring rater judgment within learning assessments—Part 1: Why the number of categories matters in a rating scale
Peeters, M. J. (2015) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2015.06.015 · Cited by 19 · see citing works
Teacher Victimization and Teacher Burnout: Multilevel Moderating Role of School Climate in a Large-scale Survey Study
Yang, C., Chan, M. M., Lin, X., & Chen, C. (2022) · Journal of School Violence · doi:10.1080/15388220.2022.2041023 · Cited by 18 · see citing works
Ambidextrous search and product innovation: moderating effects of resource and structural attributes
Zhang, W., Zhao, Y., Wang, D., Wang, H., & Li, J. (2017) · The Journal of Technology Transfer · doi:10.1007/s10961-017-9641-5 · Cited by 18 · see citing works
In Search of Emotional–Social Giftedness: A Potentially Viable and Valuable Concept
Bar‐On, R., & Maree, J. G. (2009) · Springer eBooks · doi:10.1007/978-1-4020-6162-2_26 · Cited by 17 · see citing works
Addressing Psychometric Limitations of the Attentional Control Scale via Bifactor Modeling and Item Modification
Clauss, K. E., & Bardeen, J. R. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1521417 · Cited by 17 · see citing works
Examining the psychometric properties of the FRIEDBEN Test Anxiety Scale using exploratory structural equation modeling
Thomas, C. L., Cassady, J. C., & Heath, J. A. (2018) · International Journal of School & Educational Psychology · doi:10.1080/21683603.2018.1522281 · Cited by 16 · see citing works
Who deserves what and why during the COVID ‐19 pandemic: Applying the CARIN principles of deservingness to the American welfare state
Crabtree, D., & Wehde, W. W. (2022) · Social Policy and Administration · doi:10.1111/spol.12859 · Cited by 16 · see citing works
Capturing Fluctuations in Pathogen Avoidance: the Situational Pathogen Avoidance Scale
Makhanova, A., Plant, E. A., & Maner, J. K. (2020) · Evolutionary Psychological Science · doi:10.1007/s40806-020-00256-8 · Cited by 16 · see citing works
Structural Model Analysis of Factors Affecting Sustainable Teacher Job Satisfaction in Korea: Evidence from TALIS 2018
Jung, J.-Y., & Woo, J.-G. (2022) · Sustainability · doi:10.3390/su14138014 · Cited by 15 · see citing works
Investigating the reliability of foreign language classroom anxiety scale (FLCAS): An application of generalizability theory
Lee, K., & Ye, Y. (2022) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2022.100036 · Cited by 19 · see citing works
A Guide to Key Decision Criteria for Likert‐Scale Use in Survey Research
Taufique, K. M. R., Sabbir, M. M., & Rabbanee, F. K. (2026) · Global Business and Organizational Excellence · doi:10.1002/joe.70032 · Cited by 14 · see citing works
Trust and subjective knowledge influence perceived risk of lead exposure
Goebel, M., & Wardropper, C. B. (2023) · Risk Analysis · doi:10.1111/risa.14212 · Cited by 14 · see citing works
An examination of the reliability and validity of the Work-Family Guilt Scale
McElwain, A. K. (2008) · The Atrium (University of Guelph) · Cited by 14 · see citing works
Cultural Cognition and Ideological Framing Influence Communication About Zoonotic Disease in the Era of COVID-19
Beall, J. M., Casola, W. R., Peterson, M. N., Larson, L. R., Carr, W., Seekamp, E., Stevenson, K. T., & Jackson, S. B. (2021) · Frontiers in Communication · doi:10.3389/fcomm.2021.645692 · Cited by 15 · see citing works
Effects of work-family and family-work conflict and guilt on job and life satisfaction
Sousa, C., Pinto, E. A. M., dos Santos, J. V., & Gonçalves, G. (2021) · Polish Psychological Bulletin · doi:10.24425/ppb.2020.135463 · Cited by 13 · see citing works
Establishing Content-Related Validity Evidence for Assessments in Counseling: Application of a Sequential Mixed-Method Approach
Ermis-Demirtas, H. (2018) · International Journal for the Advancement of Counselling · doi:10.1007/s10447-018-9332-4 · Cited by 14 · see citing works
Gender Differences in the Measurement of Criminal Thinking
Vaske, J. C., Gehring, K. S., & Lovins, B. K. (2016) · Criminal Justice and Behavior · doi:10.1177/0093854816677311 · Cited by 12 · see citing works
A comparison of attitudes toward length and quality of life between community‐dwelling older adults and patients with advanced cancer
Malhotra, C., Xiang, L., Özdemir, S., Kanesvaran, R., Chan, N. G. C., & Finkelstein, E. A. (2016) · Psycho-Oncology · doi:10.1002/pon.4344 · Cited by 12 · see citing works
You say you can, but can you? The impact of entrepreneurship education on unwarranted and gendered entrepreneurial self-efficacy - a calibration study
van Ewijk, A. R. (2024) · International Journal of Entrepreneurial Behaviour & Research · doi:10.1108/ijebr-08-2023-0803 · Cited by 14 · see citing works
Unraveling relevant factors for effective on farm demonstration: the crucial role of relevance for participants and structural set up
Alexopoulos, G., Pappa, E., Perifanos, I., Marchand, F., Cooreman, H., Debruyne, L., Chiswell, H. M., Ingram, J., & Koutsouris, A. (2021) · The Journal of Agricultural Education and Extension · doi:10.1080/1389224x.2021.1953550 · Cited by 11 · see citing works
Ascertaining the “Halalness” of restaurants – scale development and validation
Khan, G., & Khan, F. (2018) · Journal of Islamic marketing · doi:10.1108/jima-04-2018-0067 · Cited by 11 · see citing works
Developing flourishing among employees in the college sport workplace
Schuetz, L., Paek, B., Oja, B. D., & Kim, M. (2021) · Sport Business and Management An International Journal · doi:10.1108/sbm-09-2020-0096 · Cited by 12 · see citing works
Inverted-U effects generalize to the judgment of subjective properties of faces
Mignault, A., Marley, A. A. J., & Chaudhuri, A. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.7.1274 · Cited by 11 · see citing works
The psychometric properties of the Personality Assessment Inventory–Adolescent’s Borderline Features Scale across two high-risk samples.
Venta, A. C., Magyar, M. S., Hossein, S., & Sharp, C. (2018) · Psychological Assessment · doi:10.1037/pas0000528 · Cited by 10 · see citing works
Psychometric evaluation of the Parental Reflective Functioning Questionnaire in Polish mothers
Kamza, A., Luyten, P., & Piotrowski, K. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299427 · Cited by 10 · see citing works
Together on the path to construction innovation: yet another example of escalation of commitment?
Rutten, M. E. J., Dorée, A. G., & Halman, J. I. M. (2014) · Construction Management and Economics · doi:10.1080/01446193.2014.933855 · Cited by 10 · see citing works
Gender role strain and the precarious manhood of sexual minority Kenyan men.
Granderson, R. M., Harper, G. W., Wade, R. M., Odero, W., Onyango, D. P., & Fields, E. L. (2019) · Psychology of Sexual Orientation and Gender Diversity · doi:10.1037/sgd0000340 · Cited by 9 · see citing works
Measurement of Angler Catch-Related Attitudes: An Assessment of Model Structure and Metric Invariance
Hutt, C. P., Hunt, K. M., & Anderson, D. K. (2013) · Leisure Sciences · doi:10.1080/01490400.2013.797716 · Cited by 9 · see citing works
Evaluating team effectiveness: Examination of the TEAM Assessment Tool.
Cantu, C. J. (2007) · doi:10.12794/metadc3990 · Cited by 9 · see citing works
Confidence in mathematics is confounded by responses to reverse-coded items
Antoniou, F., & Alghamdi, M. H. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1489054 · Cited by 9 · see citing works
Validación de la Versión Abreviada de la Escala de Homonegatividad Moderna en Jóvenes Chilenos
Gómez, F., Cumsille, P. E., & González, R. (2022) · Psykhe (Santiago) · doi:10.7764/psykhe.2020.22563 · Cited by 8 · see citing works
Factor structure of a male involvement index to increase the effectiveness of prevention of mother-to-child HIV transmission (PMTCT) programs: revised male involvement index
Rodriguez, V. J., Soni, M., Jones, D. L., & Peltzer, K. (2020) · AIDS Care · doi:10.1080/09540121.2020.1786000 · Cited by 8 · see citing works
The student engagement scale: evidence of psychometric validity in Chinese and English language subjects from grade 4 to grade 6 in China
Zhu, Y., Pang, W., & Chen, B. (2023) · Educational Psychology · doi:10.1080/01443410.2023.2169253 · Cited by 6 · see citing works
Validation study of the Early Childhood Educators’ Spiritual Practices in the Classroom (ECE-SPC) instrument using Rasch
Mata-McMahon, J., Haslip, M. J., & Kruse, L. (2023) · International Journal of Children s Spirituality · doi:10.1080/1364436x.2023.2218590 · Cited by 7 · see citing works

Authors: Weems, G. H., & Onwuegbuzie, A. J.
Affiliations: University of Memphis (US)
Howard University (US)
Corresponding author: Weems, Gail H.
ORCID: Onwuegbuzie, Anthony J.
Venue: Measurement and Evaluation in Counseling and Development
Publisher: Informa UK Limited
Published: 2001-10-01
Volume: 34
Issue: 3
Pages: 166-176
ISSN: 0748-1756 (ISSN-L)
1947-6302
DOI: 10.1080/07481756.2002.12069033
OpenAlex: W1634025776
Cited by: 196
References: 34
Citations by year: 2026: 5 · 2025: 10 · 2024: 14 · 2023: 15 · 2022: 15 · 2021: 16 · 2020: 13 · 2019: 6 · 2018: 13 · 2017: 14 · 2016: 12 · 2015: 9 · 2014: 4 · 2013: 8 · 2012: 1
FWCI: 2.27
Type: journal article
Language: en
Open access: closed
Locations: Measurement and Evaluation in Counseling and Development (publishedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: reliability statistics, survey data quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The impact of midpoint responses and reverse coding on survey data

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks