Cited by 1,889Health Education and ValidationPsychometric Methodologies and TestingReliability and Agreement in Measurement

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

A Psychometric Toolbox for Testing Validity and Reliability

DeVon, Holli A., Block, Michelle E., Moyle‐Wright, Patricia, Ernst, Diane M., Hayden, Susan J., Lazzara, Deborah J., Savoy, Suzanne M., Kostas‐Polston, Elizabeth·2007·Journal of Nursing Scholarship

DOI 10.1111/j.1547-5069.2007.00161.x

Open this paper in CoChat — free account

Abstract

Purpose To review the concepts of reliability and validity, provide examples of how the concepts have been used in nursing research, provide guidance for improving the psychometric soundness of instruments, and report suggestions from editors of nursing journals for incorporating psychometric data into manuscripts. Methods CINAHL, MEDLINE, and PsycINFO databases were searched using key words: validity, reliability, and psychometrics. Nursing research articles were eligible for inclusion if they were published in the last 5 years, quantitative methods were used, and statistical evidence of psychometric properties were reported. Reports of strong psychometric properties of instruments were identified as well as those with little supporting evidence of psychometric soundness. Findings Reports frequently indicated content validity but sometimes the studies had fewer than five experts for review. Criterion validity was rarely reported and errors in the measurement of the criterion were identified. Construct validity remains underreported. Most reports indicated internal consistency reliability (alpha) but few reports included reliability testing for stability. When retest reliability was asserted, time intervals and correlations were frequently not included. Conclusions Planning for psychometric testing through design and reducing nonrandom error in measurement will add to the reliability and validity of instruments and increase the strength of study findings. Underreporting of va…

Integrity signals

Registry

Crossref · 10.1111/j.1547-5069.2007.00161.x

Cites

0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
The content validity index: Are you sure you know what's being reported? Critique and recommendations
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 2×
“The published literature, including texts and research articles, include extensive definitions of validity and reliability, though many pertain to comprehensive exploration of a single psychometric concept (Polit & Beck, 2006).”
BackgroundMethod
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Advanced Design in Nursing Research
Brink, P., & Wood, M. (1998) · doi:10.4135/9781452204840 · Cited by 433

Show all 0 references

Research works printed but not linked: 25

10.1097/00006199-200609000-00007 · DOI
10.1136/bmj.314.7080.572 · DOI · Paper page
DiCenso A., 2005, Evidence‐based nursing, 432
DeVellis R.F., 2003, Scale development: Theory and application
10.1097/00008483-200303000-00010 · DOI
10.1002/nur.4770130612 · DOI
10.1097/00006199-200507000-00009 · DOI
10.1080/074811801750058609 · DOI
10.1023/A:1025809921592 · DOI
Hulley S.B., 2001, Designing clinical research: An epidemiologic approach
10.1177/0193945905284726 · DOI
10.1097/00006199-198611000-00017 · DOI · Paper page
10.1081/CNV-120005902 · DOI
Munro B.H., 2005, Statistical methods for health care research
10.4135/9781412985772 · DOI
10.1097/00024665-200211000-00013 · DOI
Nunnally J.C., 1994, Psychometric theory
10.1097/00008483-200311000-00008 · DOI
10.1891/jnum.2005.13.2.147 · DOI
Polit D.F., 2004, Nursing research: Principles and methods
10.1111/j.1547-5069.2005.00061.x · DOI
Schultz K.S., 2005, Measurement theory in action
10.1097/00006199-200511000-00008 · DOI
Trochim W.M.K., 2001, The research methods knowledge base
Waltz C.F., 2005, Measurement in nursing and health research

Sorted by citations

Items 701–800 of 1,000

Validity and Reliability of the Newly Developed Malay-Language Health Belief of Bloating (HB-Bloat) Scale
Abdullah, N., Kueh, Y. C., Kuan, G., Wong, M. S., Yahaya, F. H., & Lee, Y. Y. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17082773 · Cited by 12
“40 were regarded as significantly relevant and were kept for further analysis [29,30].”
Background
Statistical validity and reliability of the Persian version of the Western Ontario Meniscal Evaluation Tool (WOMET) according to the COSMIN checklist
Ebrahimi, N., Naghdi, S., Ansari, N. N., Jalaie, S., & Salsabili, N. (2020) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-3171-2 · Cited by 8
Tailoring a Comprehensive Bundled Intervention for ED Fall Prevention.
Pop, H. L., Lamb, K., Livesay, S., Altman, P., Sanchez, A., & Nora, M. (2020) · Journal of Emergency Nursing · doi:10.1016/j.jen.2019.11.010 · Cited by 8
Development of a new tool for the early identification of communication-support needs in people living with dementia: An Australian face-validation study.
Krein, L., Jeon, Y., & Amberber, A. M. (2020) · Health and Social Care in the community · doi:10.1111/hsc.12887 · Cited by 8
Healthcare professionals' perceptions of the pre‐requisites and realisation of interprofessional collaboration in cancer care
Moilanen, T., Leino‐Kilpi, H., Koskela, I., Kuusisto, H., Siekkinen, M., Sulosaari, V., Vahlberg, T. J., & Stolt, M. (2019) · European Journal of Cancer Care · doi:10.1111/ecc.13197 · Cited by 8
Psychometric Properties of the Self-Efficacy Scale among Undergraduate Students in Malaysia
Ting, L. K., Kuan, G., Arifin, W. N., & Kueh, Y. C. (2019) · Malaysian Journal of Medical Sciences · doi:10.21315/mjms2019.26.3.10 · Cited by 7
“(23), the standardised factor loading more than 0.”
Background
The Brief Perceived Cognitive Impairment Scale–Korean
Kim, H., & Barsevick, A. M. (2018) · Cancer Nursing · doi:10.1097/ncc.0000000000000578 · Cited by 9
Validation of the Chinese Manchester foot pain and disability index (C-MFPDI) among patients with inflammatory arthritis
Erh, B. X. Y., He, H.-G., Carter, K., Cheung, P., Tan, D., Wang, W.-R., & Rome, K. (2019) · Journal of Foot and Ankle Research · doi:10.1186/s13047-019-0316-3 · Cited by 8
“Permission from the participants in the primary group was sought before they were invited to complete the C-MFPDI again 2 weeks [38] after the first time data collection to establish the test-retest reliability.”
Background
Measuring competence in systemic practice: development of the ‘Systemic Family Practice – Systemic Competency Scale’ (SPS)
Butler, C., Sheils, E., Lask, J., Joscelyne, T., Pote, H. L., & Crossley, J. (2018) · Journal of Family Therapy · doi:10.1111/1467-6427.12251 · Cited by 12
ADAPTAÇÃO TRANSCULTURAL DE UM INSTRUMENTO DE AVALIAÇÃO DE FERIDAS
Domingues, E. A. R., de Carvalho, M. R. F., & Kaizer, U. A. D. O. (2018) · Cogitare Enfermagem · doi:10.5380/ce.v23i3.54927 · Cited by 8
“Para a pesquisa, foi estipulado o nível de concordância igual ou superior a 0,8(16-17).”
Background
The Classroom Environment Questionnaire (CEQ): Development and preliminary structural validity
Lyons, C., Brown, T., & Bourke-Taylor, H. M. (2018) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12474 · Cited by 8
A Standardized Clinical Performance Grading Rubric: Reliability Assessment.
Kopp, M. (2018) · The Journal of Nursery Education · doi:10.3928/01484834-20180815-06 · Cited by 8
Translation, Cross-Cultural Adaptation, Reliability and Validity of the Malay Version of Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) V3.1
Muhamad, N. A., Mihat, O., Ramly, R., Aziz, A. A., Kamaruddin, R. B., Arifin, W. N., Abdullah, N. H., Noor, M. A. M., Ismail, R., Wisman, W. A., et al. (2018) · Health · doi:10.4236/health.2018.107073 · Cited by 10
“Following the process of content validation, in fulfilling the need of face validation, the translated questionnaire was distributed to a sample of paramedics, staff nurses, medical officers and counsellors to assess the appropriateness, readability, organization and logical flow of the questionnaires [30] [32].”
Method
Dealing with severe dementia in clinical practice: A validity and reliability study of Severe Mini‐Mental State Examination in Greek population
Mougias, A. A., Christidi, F., Kiosterakis, G., Messinis, L., & Politis, A. M. (2018) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4915 · Cited by 8
Development, validation and cultural-adaptation of the knowledge about psychosis questionnaire for African-Caribbean people in the UK
Degnan, A., Berry, K., James, S., & Edge, D. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.03.013 · Cited by 8
“Face validity (FV) was examined to measure the extent to which the CaKAP was acceptable to African-Caribbean people in terms of language and layout, user-friendliness and culturallyappropriateness (DeVon et al., 2007).”
Background
Reliability and Validity of the Korean Person-centered Climate Questionnaire-resident Version
Yoon, J. Y., Kim, D. E., Bae, S., David, E., & Chang, S. J. (2018) · Journal of Korean Gerontological Nursing · doi:10.17079/jkgn.2018.20.1.10 · Cited by 8
Designing and Determination of Validity and Reliability of the Questionnaire Increasing the Duration of using the Hearing Protection Device by Workers based on BASNEF Model
Monazam, M., Laal, F., Sarsangi, V., Madvari, R. F., Najafi, K., & Fallahmadvari, A. (2018) · doi:10.29252/sjimu.25.6.21 · Cited by 8
Cross-cultural adaptation and measurement properties of the Brazilian version of the Exercise Preference Questionnaire()
Caetano, L. C. G., Teixeira‐Salmela, L. F., Ribeiro-Samora, G. A., & Scianni, A. A. (2017) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2016.08.001 · Cited by 9
Knowledge of Atrial Fibrillation and Stroke Prevention
Mohamed, S., Razak, T. A., Hashim, R., & Ali, Z. M. (2016) · Journal of Pharmacy Technology · doi:10.1177/8755122516681820 · Cited by 7
“5 is an indication of substantial low correlation between the scales, demonstrating that the scales are distinct from each other.(11,17) Result showed that the correlation was low, ranging from .”
BackgroundMethodInfluential
Staff nurse perceptions' of nurse manager caring behaviors: Psychometric testing of the Caring Assessment Tool-Administration (CAT-adm(c))
Wolverton, C. (2016) · doi:10.7912/c2m88t · Cited by 8
Reliability and Validity of a Tool to Assess Oncology Nurses' Experiences With Prognosis-Related Communication
Newman, A. R., & Helft, P. R. (2014) · Oncology nursing forum · doi:10.1188/15.onf.64-73 · Cited by 9
Assessment of Patient Participation in Physical Rehabilitation Activities: An Integrative Review
Rettke, H., Geschwindner, H. M., & van den Heuvel, W. J. (2014) · Rehabilitation Nursing · doi:10.1002/rnj.157 · Cited by 10
“The criteria mainly focus on validity and reliability as both being “basic requirements for research” (DeVon et al., 2007, p. 161).”
Influential
Reliability and Validity of the Menopausal Symptom Scale
Choi, M., & Shin, H. (2015) · Women & health · doi:10.1080/03630242.2014.972017 · Cited by 8
“Criterion-related validity shows the extent of the relationship between an instrument and factors that are theoretically expected to be associated with it (DeVon et al. 2007; Roberts, Dolansky, and Weber 2010).”
Background
Psychometric Properties of an Instrument to Measure Facilitators and Barriers to Nurses’ Participation in Continuing Education Programs
Hamzehgardeshi, Z., & Shahhosseini, Z. (2014) · Global Journal of Health Science · doi:10.5539/gjhs.v6n5p219 · Cited by 8
“Internal consistency reflecting the extent to which each item measures the same construct by creating an average of all possible inter-item correlations by using Cronbach’s alpha coefficient (Bland & Altman, 1997; DeVon et al., 2007).”
Method
Assistive technology assessment tools for assessing switch use of children: A systematic review and descriptive analysis
Hoppenbrouwers, G., Stewart, H., & Kernot, J. (2014) · doi:10.3233/tad-140405 · Cited by 8
“The best assessment tools have adequate levels of sensitivity reﬂected by statistically signiﬁcant levels of reliability and validity [26].”
Design of an instrument to measure alcohol-related psychosocial influences in the development of norms among 13-year-old to 17-year-old adolescents
Hildebrand, J., Maycock, B. R., Burns, S. K., Zhao, Y., ALLSOP, S. J., Howat, P. A., & Lobo, R. C. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-003571 · Cited by 9
“It is recommended that for content validity at least seven experts are consulted.(51) The selected scales will be subject to review by the expert panel at several stages during instrument development to obtain qualitative comments regarding the devised items and the overall tool.”
Background
Patient evaluation of infertility management in an ISO 9001:2008-certified centre for reproductive medicine.
VandenBroeck, U., Spiessens, C., Dancet, E., Bakelants, E., Vrancken, A., Demyttenaere, K., Enzlin, P., & D'Hooghe, T. (2012) · Reproductive Biomedicine Online · doi:10.1016/j.rbmo.2011.11.020 · Cited by 8
Development of a scale to measure parental self‐efficacy in the care of pre‐school children during periods of health and minor illness: integrating health and social policy methods
Purssell, E., & While, A. (2011) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2010.03591.x · Cited by 5
“Criterion validity, that is, the demonstrable evidence of a relationship between elements of the scale and some other variable (DeVon et al. 2007) presents a challenge where there is no other validated variable against which to correlate, or, as was the case here, where the scale has context specificity.”
Background
Validity and reliability of Charlson Comorbidity Index (CCI) among Iranian community-dwelling older adults
Hosseini, R., Momtaz, Y. A., Shahboulaghi, F. M., & Aghamaleki, M. (2020) · AFMN Biomedicine · doi:10.5937/afmnai2002160h · Cited by 8
“In other words, predictive validity is the degree to which test scores predict performance on some future criterion (33).”
Background
Phonation Quotient Using Three Aerodynamic Instruments in the Disordered Voice.
Joshi, A., Watts, C. R., & Hathway, J. R. (2018) · Journal of Voice · doi:10.1016/j.jvoice.2018.08.002 · Cited by 8
Development and Validation of the Artificial Intelligence in Mental Health Scale: Application for AI Mental Health Chatbots
Katsiroumpa, A., Konstantakopoulou, O., Moisoglou, I., Gallos, P., Galani, O., Lialiou, P., Tsiachri, M., & Galanis, P. (2025) · Healthcare · doi:10.3390/healthcare13243269 · Cited by 9
“Inter-item correlations were compared against the recommended range of 0.15 to 0.75 [66], while corrected item-total correlations needed to exceed 0.30 to confirm sufficient discriminatory power [67].”
Influential
The Online Misinformation Susceptibility Scale: Development and Initial Validation
Katsiroumpa, A., Moisoglou, I., Μangoulia, P., Konstantakopoulou, O., Gallos, P., Tsiachri, M., & Galanis, P. (2025) · Healthcare · doi:10.3390/healthcare13172252 · Cited by 13
“Inter-item correlations were evaluated against the recommended threshold of 0.15 to 0.75 [59].”
Influential
Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language ModelsPreprint
Ye, H., Zhang, T.-Z., Xie, Y., Zhang, L., Ren, Y., Zhang, X., & Song, G.-J. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2502.02444 · Cited by 7
“To benchmark LLM value systems, we propose three tasks based on psychometric principles (DeVon et al., 2007) and AI priorities (Anwar et al., 2024): Confirmatory Factor Analysis for assessing structural validity, LLM Safety Prediction for examining predictive validity, and LLM Value Alignment for…”
Development and validation of the self-regulation of blood donation scale for blood donors
Kermani, F. R., Amini‐Kafiabad, S., Maghsudlu, M., Hosseini, K. M., Mohammadali, F., & Mohammadjafari, A. (2024) · Hematology Transfusion and Cell Therapy · doi:10.1016/j.htct.2024.09.2482 · Cited by 10
Development and validation of the Telehealth Etiquette Competency Checklist: A Delphi study
Pittmann, R., Danaher‐Garcia, N., White, B. A. A., & Thompson, A. (2024) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x241279494 · Cited by 9
“” 34 For both rounds, item-level agreement was calculated by dichotomizing responses into two categories.”
Cross-National Study on the Convergent, Discriminant, and Concurrent Validity of the “Body Size Perception” Item in the Health Behaviour in School-aged Children Survey
Rouche, M., Lebacq, T., Dzielska, A., Kelly, C. N. M., Gabhainn, S. N., Mertens, C., & Castetbon, K. (2024) · Current Developments in Nutrition · doi:10.1016/j.cdnut.2024.104445 · Cited by 7
“The convergent validity, a type of construct validity, aims to assess the degree of convergence between 2 measures intended to evaluate the same construct, one of which is a more comprehensive and complex reference measure that is dif ﬁ cult to include in large surveys [39].”
BackgroundInfluential
Advanced Practice Nurses and Their Roles in Swiss Cancer Care: A Cross-Sectional Study
Geese, F., Bryant‐Lukosius, D., Zwakhalen, S. M. G., & Hahn, S. (2024) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2024.151626 · Cited by 8
Psychometric evaluation of the Chinese version of the Scale of Effects of Social Media on Eating Behaviour and research of its influencing factors
Xu, K., Liang, C., Zhao, Y., Zhang, F., Zhang, C., Zhang, Y., Zhang, Y., & Jiang, Z. (2024) · BMC Public Health · doi:10.1186/s12889-024-17923-1 · Cited by 8
“When I-CVI ≥ 0.78, S-CVI/UA ≥ 0.8, and S-CVI/Ave ≥ 0.9, the scale has good content validity [49].”
BackgroundInfluential
Measurement Properties and Optimal Cutoff Point of the WHO-5 Among Chinese Healthcare Students
Yang, N., Ma, H., Huang, M., Lau, E. Y. Y., Fong, D., Wang, M., Wang, P., Xu, S., Xu, J., Jiang, C., et al. (2023) · Psychology Research and Behavior Management · doi:10.2147/prbm.s437219 · Cited by 8
Exploring Student Perspectives and Experiences of Online Opportunities for Virtual Care Skills Development: Sequential Explanatory Mixed Methods Study
Nowell, L. S., Dolan, S., Johnston, S., Jacobsen, M., Lorenzetti, D., & Paolucci, E. O. (2024) · JMIR Nursing · doi:10.2196/53777 · Cited by 9
“Their suggested edits were incorporated before survey distribution [7,10,11].”
Background
Validation of the vaccination attitudes examination scale in a South African context in relation to the COVID-19 vaccine: quantifying dimensionality with bifactor indices
Padmanabhanunni, A., Pretorius, T. B., & Isaacs, S. A. (2023) · BMC Public Health · doi:10.1186/s12889-023-16803-4 · Cited by 7
How does teachers' noticing of students' fixed mindsets relate to teachers’ knowledge, beliefs, and experience? An exploratory study
Zeeb, H., Ibach, A., Voss, T., & Renkl, A. (2023) · Teaching and Teacher Education · doi:10.1016/j.tate.2023.104170 · Cited by 12
Development of Knowledge, Attitude and Practice Questionnaire for age-related macular degeneration patients
Rahman, M. H. A., Sharanjeet-Kaur, S., Narayanasamy, S., Rasdi, H. F. M., & Bastion, M.-L. C. (2023) · International Journal of Ophthalmology · doi:10.18240/ijo.2023.04.13 · Cited by 5
Exploring Barriers to Healthy Eating Among Women in Their Role as New Mothers with a Theory-Driven Questionnaire
Moura, A. F., & Aschemann‐Witzel, J. (2023) · Maternal and Child Health Journal · doi:10.1007/s10995-023-03622-7 · Cited by 6
Development and Validation of the Nurses’ Spiritual Sensitivity Scale in Southeastern Iran
Akbari, O., Dehghan, M., & Tirgari, B. (2023) · Journal of Religion and Health · doi:10.1007/s10943-023-01805-8 · Cited by 8
Psychometrics of the Sickle Cell Disease Health-Related Stigma Scale-Short Form
Jenerette, C., O’Brien, J., Jaja, C., Carvalho, E. S. D. S., Brewer, C. A., & Hickman, R. (2022) · Western Journal of Nursing Research · doi:10.1177/01939459221142164 · Cited by 7
The Chinese version of the skin tear knowledge assessment instrument (OASES): Cultural adaptation and validation
Feng, L., Chen, H., Li, J., Ying, Y., Chen, L., Wei, H., Liang, H., & Hu, H. (2022) · Journal of Tissue Viability · doi:10.1016/j.jtv.2022.12.004 · Cited by 7
Development and Testing of the Texas Christian University Criminal Thinking Scales 3.0
Sease, T. B., & Knight, K. K. (2022) · Crime & Delinquency · doi:10.1177/00111287221134917 · Cited by 7
“Components with an eigenvalue greater than one were retained, and scale items with item-total correlations less than 0.40 were removed (DeVon et al., 2007).”
Influential
Development and validation of the information security attitude questionnaire (ISA‐Q) for nurses
Kang, J., & Seomun, G. (2022) · Nursing Open · doi:10.1002/nop2.1353 · Cited by 7
“Therefore, it can be considered a stable and reliable questionnaire because the test– retest correlation coefficient is above 0.70 (DeVon et al., 2007).”
BackgroundInfluential
The Assessment of the Psychomotor Profile in Children: Preliminary Psychometric Analysis of the Portuguese Version of the Batterie d’Evaluation des Fonctions Neuropsychomotrices de L’enfant (NPmot.pt)
Amorim, N. D., Parreiral, J., & Santos, S. (2022) · Children · doi:10.3390/children9081195 · Cited by 8
“The construct validity was analyzed through domain inter-correlations (Table 5) using Pearson’s correlation coefficient [53,63] to measure the degree of independence of the domains among themselves [54].”
Method
Development, acceptability and construct validity of the Aboriginal Women’s Experiences of Partner Violence Scale (AEPVS): a co-designed, multiphase study nested within an Australian Aboriginal and Torres Strait Islander birth cohort
Glover, K., Gartland, D., Leane, C., Nikolof, A., Weetra, D., Clark, Y., Giallo, R., & Brown, S. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059576 · Cited by 8
Diabetes Distress in Emerging Adulthood: Content Validity of the Problem Areas in Diabetes—Emerging Adult Version (PAID-EA) Using Qualitative Analysis
Wentzell, K., Vitale, R. J., & Laffel, L. M. (2022) · The Science of Diabetes Self-Management and Care · doi:10.1177/26350106221110817 · Cited by 8
Validation of the National Institute of Health Toolbox Cognition Battery (NIHTB-CB) in Children and Adolescents with and without HIV Infection in Lusaka, Zambia
Kabundula, P., Mbewe, E. G., Mwanza-Kabaghe, S., Birbeck, G. L., Mweemba, M., Wang, B., Menon, J. A., Bearden, D., & Adams, H. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03669-7 · Cited by 7
“, does the test appear to measure what it is supposed to measure [28, 29].”
Background
Development and validation of assessment tool of knowledge, attitude, and practice of outdoor workers regarding heat stress
Khorsandi, M., Dehghan, S. F., Pirposhteh, E. A., Abbasinia, M., Afshari, M., Ghanadzadeh, M., & Asghari, M. (2022) · Work · doi:10.3233/wor-205297 · Cited by 7
Development and validation of contextual measures of sexual harassment perceptions, experiences, and coping for women employees in Ethiopian hospitality workplaces
Worke, M. D., Koricha, Z. B., & Debelew, G. T. (2022) · Archives of Public Health · doi:10.1186/s13690-022-00828-z · Cited by 11
“Despite its low place in the validity hierarchy [14, 74], content validity is a significant quality indicator of an instrument validity and provides insight into its feasibility and practicability [72, 75, 76].”
Background
Translation and Validation of American Diabetes Association Diabetes Risk Test: The Malay Version
Fauzi, N. F. M., Wafa, S. W., Abdullah, M. I., Raj, N. B., & Hassan, N. M. (2022) · Malaysian Journal of Medical Sciences · doi:10.21315/mjms2022.29.1.11 · Cited by 9
Reliability and Validity of the State-Trait Hopelessness Scale in a Primarily Rural Population of Adults With Ischemic Heart Disease in the US Great Plains
Dunn, S. L., Bomgaars, D., Griend, K. M. V. D., Jensen, G. A., White, L. L., Goodyke, M. P., Luong, A., Gutierrez-Kapheim, M., & Tintle, N. L. (2022) · The Journal of Cardiovascular Nursing · doi:10.1097/jcn.0000000000000886 · Cited by 8
“45 or greater were considered strong in this study, consistent with previous literature.(28) Principal component analysis with promax rotation was used to elicit factor structure of the STHS within the 2 subscales and, subsequently, within the 2 identified factors of each subscale.”
Method
Psychometric evaluation of the Lebanese Arabic version of the Dental Fear Survey: a cross-sectional study
Hajj, H. K. E., Fares, Y., & Abou-Abbas, L. (2021) · BMC Oral Health · doi:10.1186/s12903-021-02015-y · Cited by 7
“Results showed that the Saudi Arabian version of the DFS have high validity and reliability and confirm its feasibility to assess the dental patient’s anxiety and fear.”
Background
Assessing preferences for leisure activities of people receiving adult day services: a study protocol for concept mapping and psychometric testing
Rommerskirch‐Manietta, M., Purwins, D., Haitsma, K. S. V., Abbott, K. H., Recchia, D. R., & Roes, M. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-055069 · Cited by 7
Screening for distress in women with gynaecological cancer: Adaptation of the distress thermometer for gynaecological oncology patients
Harbeck, E., Chambers, S. K., Porter‐Steele, J., Anderson, D. J., Sanmugarajah, J., Hughes, F., Nehill, C., & Seib, C. A. (2021) · European Journal of Cancer Care · doi:10.1111/ecc.13486 · Cited by 8
Evaluating physical environments for older people-Validation of the Swedish version of the Sheffield Care Environment Assessment Matrix for use in Finnish long-term care.
Wahlroos, N., Stolt, M., Nordin, S., & Suhonen, R. (2021) · International Journal of Older People Nursing · doi:10.1111/opn.12383 · Cited by 7
“There was no need for the expert panel to complete numerical evaluation since complete agreement was reached after review (DeVon et al., 2007).”
Background
Translation and Psychometric Evaluation of the German Version of the Thirst Distress Scale for Patients With Heart Failure
Wefer, F., Inkrot, S., Waldréus, N., Jaarsma, T., von Cube, M., & Kugler, C. (2020) · The Journal of Cardiovascular Nursing · doi:10.1097/jcn.0000000000000780 · Cited by 7
The Impact of Human Resource Management (HRM) Practices on Graduate Volunteer Performance: A Case Study of Microfinance Institutions in Cameroon
Fomude, A. H., Kang, S. G., Abangbila, L., Ganiyu, S. A., Mukete, N., & Meena, M. E. (2020) · Open Journal of Business and Management · doi:10.4236/ojbm.2020.85136 · Cited by 6
“Cronbach’s alpha is the most widely used reliability statistic employed by many researchers to measure internal consistency reliability (Spiliotopoulou, 2009; Devon et al., 2007).”
Method
The development and validation of a measurement instrument to investigate determinants of health care utilisation for low back pain in Ethiopia
Beyera, G. K., O’Brien, J., & Campbell, S. J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0227801 · Cited by 15
“It is also important that a psychometrically sound measurement instrument is the foundation of rigorous research design [26].”
Background
Vicdan Stresi Ölçeği’ nin Türkçe Geçerlilik Güvenilirliği
Aksoy, S., Mert, K., & Çetin, İ. (2020) · Kocaeli Üniversitesi Sağlık Bilimleri Dergisi · doi:10.30934/kusbed.584086 · Cited by 7
Behavioural and operational outcomes of a Master’s programme on improvement knowledge and leadership
Nordin, A. M. M., & Josefsson, K. A. (2019) · Leadership in health services · doi:10.1108/lhs-09-2018-0049 · Cited by 6
Validating the Development of Instrument for Measuring Nurses’ Performance Scale
Haron, S., Ariffin, A. S., & Idrus, D. (2019) · Journal of Management Info · doi:10.31580/jmi.v6i1.495 · Cited by 7
“On the other hand, items’ reliability refers to the ability of an instrument to consistently measure an attribute (DeVon et al., 2007).”
BackgroundMethod
Development of the Persian patient satisfaction questionnaire
Nouri, M., Ghaffarifar, S., & Sadeghi‐Bazargani, H. (2018) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa-06-2017-0101 · Cited by 6
Brief Intervention on Nurses’ Knowledge and Behavior Regarding Smoking Cessation
Hughes, J., Smith, L. S., & Garrett-Wright, D. (2018) · Journal for Nurses in Professional Development · doi:10.1097/nnd.0000000000000465 · Cited by 7
Development of a pictorial scale for assessing functional interference with chronic pain: the Pictorial Pain Interference Questionnaire
Cook, A. J., Roberts, D., Nelson, K., Clark, B. R., & Parker, B. E., Jr. (2018) · Journal of Pain Research · doi:10.2147/jpr.s160801 · Cited by 9
“45 for discriminant validity.(48) For this study, a coefficient of 0.”
Assessing managerial information needs: Modification and evaluation of the Hospital Shift Leaders' Information Needs Questionnaire
Peltonen, L.-M., Lundgrén‐Laine, H., Siirala, E., Löyttyniemi, E., Aantaa, R., & Salanterä, S. (2018) · Journal of Nursing Management · doi:10.1111/jonm.12515 · Cited by 7
Evaluating interest in acids–bases: development of an acid–base interest scale (ABIS) and assessment of pre-service science teachers' interest
ÇİÇEK, Ö., & İlhan, N. (2017) · Chemistry Education Research and Practice · doi:10.1039/c6rp00238b · Cited by 8
Translation and validation of the Arabic version of generic medicines scale
Alefan, Q., Karasneh, A., El-Dahiyat, F., Alshara, M., & Abunaser, D. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2016.05.050 · Cited by 7
“This could also be due to the fact that Cronbach’s alpha coefficient is sample-specific, and it measures internal consistency for the test responses from current respondents only.(40) However, the overall alpha value (0.”
Background
Measuring staff perception of end-of-life experience of older adults in long-term care
Cornally, N., Coffey, A., Daly, E., McGlade, C., Weathers, E., O’Herlihy, E. A., Ó’Caoimh, R., McLoughlin, K., Svendrovski, A., & Molloy, W. (2015) · Applied Nursing Research · doi:10.1016/j.apnr.2015.05.015 · Cited by 6
“Content, face and construct validity, are essential to establish scale validity (DeVon et al., 2007; Streiner & Kottner, 2014).”
Background
Differences in Perceived Benefit, Use, and Learner Satisfaction between Open Source LMS and Proprietary LMS
Rafi, A., Samsudin, K., & Hanafi, H. F. (2015) · doi:10.5772/60670 · Cited by 7
“7 [20].”
Establishing Construct and Predictive Validity of the Prison Inmate Inventory for Use With Female Inmates
Degiorgio, L. (2013) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x13506393 · Cited by 6
Reliability of a seminar grading rubric in a grand rounds course
MacLaughlin, E. J., Fike, Alvarez, Seifert, & Blaszczyk (2010) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s12346 · Cited by 10
Evaluating a new scale for infertility psychological distress: psychometric evidence from China
Jiang, L., Yang, L., Yao, J., Yang, J., Wu, M., Yuan, M., Zhang, K., Chen, Y., Hu, Z., Zhu, Z., et al. (2025) · BMC Psychology · doi:10.1186/s40359-025-02991-8 · Cited by 6
“The sample size was estimated based on the sample requirements for factor analysis [29], taking into account the number of questionnaire items and potential invalid responses.”
Assessment measures for chemotherapy-induced peripheral neuropathy among pediatric oncology patients: an updated systematic review
Mao, T., Yorke, J., Shi, Y. X., Shen, N., Wang, H., Wong, F. K. Y., Lam, K. K. W., Tang, L. N., Liu, Q., Abu‐Odah, H., et al. (2025) · Supportive Care in Cancer · doi:10.1007/s00520-025-09515-5 · Cited by 3
“In our updated systematic review, we used the psychometric toolbox for testing reliability and validity that proposed by DeVon et al. [40] in 2007 to summarize the psychometric properties of the identified tools.”
Methodological Recommendations for Content Validation of Community Resilience Indicators
Gerst, M. D., Dillard, M., & Loerzel, J. (2025) · Natural Hazards Review · doi:10.1061/nhrefo.nheng-2179 · Cited by 6
“1) as one part of an overall process of assessing an indicator framework ’ s soundness or adequacy (Broniatowski and Tucker 2017; DeVon et al. 2007; Ferguson 2004).”
The Political Competence Scale for Nurses (PCS-N): Instrument Development and Psychometric Evaluation
Han, N., Kim, G. S., Kim, S., Lee, T., & Chung, W. (2025) · Journal of Nursing Management · doi:10.1155/jonm/4683994 · Cited by 6
“As the test criterion of DeVon et al. [48], a correlation coefcient of 0.70 or higher is acceptable as a stable tool.”
Influential
Risk perception scale for laboratory safety: Development and validation
Lin, C.-H., Zheng, K., & Man, S.-S. (2025) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2024.103689 · Cited by 6
The validity and reliability of the Indonesian version of the Diabetes Mellitus Self-Efficacy Scale (DMSES-I)
Marlina, T. T., Haryani, H., & Widyawati, W. (2024) · Journal of research in nursing · doi:10.1177/17449871241276816 · Cited by 7
“Cronbach’s alpha was determined with an acceptable coefficient of > 0.70 (Devon et al., 2007).”
Influential
Measuring health-related quality of life in a Chinese Mainland adolescent population: psychometric properties of the Mandarin Chinese self-reported KIDSCREEN-27 and KIDSCREEN-10 index
Li, J., Zhu, Y., Zhu, G., Qiu, Z., Wang, J., Kaman, A., Erhart, M., Adedeji, A., Liu, Y., Wu, D., et al. (2024) · BMC Psychology · doi:10.1186/s40359-024-01876-6 · Cited by 7
“The intra-class correlation coefficient (ICC) was used, specifically the ICC (two-way mixed-effects model, single measure, and consistency type) [63, 85, 86], with an ICC value > 0.70 generally considered acceptable [25, 76, 88, 109].”
BackgroundMethodInfluential
Exploring the integration of culturally and linguistically diverse nurses and nursing students in healthcare: A cross-sectional study.
Martikainen, R., Kuivila, H., Koskenranta, M., Kamau, S., Oikarainen, A., Matinlompolo, N., Juntunen, J., & Mikkonen, K. (2024) · Nurse Education in Practice · doi:10.1016/j.nepr.2024.104129 · Cited by 6
Critical care nurses' competence in mentoring students in intensive care units—A cross-sectional study
Rasi, M., Hanssen, T. A., Norbye, B., Mikkonen, K., & Kvande, M. E. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106322 · Cited by 6
Development and validation of Adolescent Sexual and Reproductive Health – Knowledge, Attitude, and Self-Efficacy Questionnaires (ASRH-KASeQ)
Setiyorini, A., Sitaresmi, M. N., & Nisman, W. A. (2024) · International Journal of Adolescent Medicine and Health · doi:10.1515/ijamh-2024-0073 · Cited by 8
Spiritual assessment models for palliative care chaplains: a narrative review
Galchutt, P. (2024) · Journal of Health Care Chaplaincy · doi:10.1080/08854726.2024.2368999 · Cited by 6
“Last, with the advent of Open Notes through the Cures Act in the U.S. (Salmi et al., 2021), it will be important to collaborate with seriously ill patients and family members to strengthen these spiritual assessment models through face and content validity testing (DeVon et al., 2007).”
Preparedness for a forgotten disaster: A case study Coimbatore, India
Prakash, E. L., Anand, K. B., & Kolathayar, S. (2024) · Progress in Disaster Science · doi:10.1016/j.pdisas.2024.100340 · Cited by 7
Competence of healthcare professionals in stroke care pathways: a cross-sectional study.
Kipinä, P., Oikarinen, A., Mikkonen, K., Kääriäinen, M., Tuomikoski, A., Merilainen, M., Karsikas, E., Rantala, A., jounila-Ilola, P., Koivunen, K., et al. (2024) · Journal of Vascular Nursing · doi:10.1016/j.jvn.2024.02.004 · Cited by 6
Psychometric properties and gender invariance of the 8-item emotion regulation questionnaire (ERQ-8) among Chinese university students
Zhao, M., Kuan, G., Zhou, K., Musa, R. M., Majeed, A. P. P. A., & Kueh, Y. C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296035 · Cited by 5
Psychometric Evaluation of the Warwick-Edinburgh Mental Well-Being Scale on Indonesian Students
Ramadhana, M. R. (2023) · Journal An-Nafs Kajian Penelitian Psikologi · doi:10.33367/psi.v8i2.3817 · Cited by 3
“The higher the scale's validity, the more accurately the target construct fits its purpose (de Von et al., 2007).”
Background
Glocalizing English Language Teaching in the Arabian Gulf: Professional Development's Mediating Influence
Ahmad, H. (2023) · Register Journal · doi:10.18326/register.v16i2.301-322 · Cited by 4
“To ensure content validity, Lawshe's Content Validity Ratio (CVR) (Wilson et al., 2012) and Content Validity Index (CVI) (Devon et al., 2007) were calculated.”
MethodInfluential
Self-Management Analysis in Chronic Conditions (SMACC) checklist: an international consensus-based tool to develop, compare and evaluate self-management support programmes
Moreels, T., Cruyt, E., Baets, S. D., Andries, L., Arts-Tielemans, M., Rodríguez‐Bailón, M., Bergström, A., Boete, K., Bormans, I., Costa, U. M., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-075676 · Cited by 6
“28 29 Participant selection and recruitment A purposive opt-in snowball sampling method was used to form the expert panel.”
Method
Assessing Anhedonia in Adolescents: The Psychometric Properties and Validity of the Dimensional Anhedonia Rating Scale
Hewitt, J. M. A., Zareian, B., & LeMoult, J. (2023) · The Journal of Early Adolescence · doi:10.1177/02724316231207290 · Cited by 6
“The ﬁ nal sample included 400 adolescents which exceeds the minimum of 5 participants per item recommended in the extant psychometrics literature (DeVon et al., 2007).”
BackgroundMethodInfluential
Development and psychometric testing of hybrid education competence instrument for social and health care, and health sciences educators.
Jokinen, H., Pramila-Savukoski, S., Kuivila, H., Jämsä, R., Juntunen, J., Törmänen, T., Koskimäki, M., & Mikkonen, K. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105999 · Cited by 6
Development and psychometric properties testing of the Non-Cognitive Skills Scale for nursing students
Chew, H. S. J., Ang, W. H. D., Rusli, K. D. B., Liaw, S. Y., Ang, E. N. K., & Lau, Y. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105996 · Cited by 8
Analysis of The Aiken Index to Measure The Content Validity of The Wolio Language and Culture Preservation Model Instrument
Mansyur, F., Arsyad, & Manaf, A. (2023) · ELS Journal on Interdisciplinary Studies in Humanities · doi:10.34050/elsjish.v6i3.29667 · Cited by 6
“Content validity shows the content of the attributes studied (DeVon et al., 2007).”
Training civil servants in promoting the reputation of the country in the settings of crisis communication
Kyrychok, A., Harbuza, T., Teslenko, N., Okhrimenko, O., & Zalizniuk, V. (2023) · Teaching Public Administration · doi:10.1177/01447394231191928 · Cited by 6
Developing and validating an instrument to assess women’s empowerment in dealing with domestic violence in Iran: a mixed-methods study protocol
Mataji-Amirroud, M., Ghaffari, M., Ramezankhani, A., & Soori, H. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-073826 · Cited by 6

Authors: DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas‐Polston, E.
Affiliations: Purdue University Northwest (US)
Corresponding author: DeVon, Holli A.
Block, Michelle E.
Moyle‐Wright, Patricia
Ernst, Diane M.
Hayden, Susan J.
Lazzara, Deborah J.
Savoy, Suzanne M.
ORCID: DeVon, Holli A.
Venue: Journal of Nursing Scholarship
Publisher: Wiley
Published: 2007-05-23
Volume: 39
Issue: 2
Pages: 155-164
ISSN: 0363-2792 (ISSN-L)
1527-6546
1547-5069
DOI: 10.1111/j.1547-5069.2007.00161.x
OpenAlex: W2162602057
Cited by: 1,889
References: 0
Citations by year: 2026: 87 · 2025: 128 · 2024: 186 · 2023: 176 · 2022: 148 · 2021: 163 · 2020: 145 · 2019: 144 · 2018: 131 · 2017: 113 · 2016: 96 · 2015: 105 · 2014: 83 · 2013: 51 · 2012: 40
FWCI: 15.03
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Journal of Nursing Scholarship (publishedVersion)
PubMed (publishedVersion)
ePublications at Regis University (Regis University) (submittedVersion)
Topics: Health Sciences › Nursing › Research and Theory › Health Education and Validation
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: psychometric properties, reliability statistics, validity, content validity, criterion validity, construct validity, internal consistency, test-retest reliability, measurement error, nursing equipment, nursing research
MeSH terms: Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Mathematics, Periodicals as Topic, Planning Techniques, Predictive Value of Tests, Psychometrics, Research Design, Time Factors, Reproducibility of Results, Nursing Research, Bias, Discriminant Analysis, Guidelines as Topic, Peer Review, Research, Statistics, Nonparametric, Editorial Policies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A Psychometric Toolbox for Testing Validity and Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Metadata

Record

About these checks