Cited by 1,889Health Education and ValidationPsychometric Methodologies and TestingReliability and Agreement in Measurement

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

A Psychometric Toolbox for Testing Validity and Reliability

DeVon, Holli A., Block, Michelle E., Moyle‐Wright, Patricia, Ernst, Diane M., Hayden, Susan J., Lazzara, Deborah J., Savoy, Suzanne M., Kostas‐Polston, Elizabeth·2007·Journal of Nursing Scholarship

DOI 10.1111/j.1547-5069.2007.00161.x

Open this paper in CoChat — free account

Abstract

Purpose To review the concepts of reliability and validity, provide examples of how the concepts have been used in nursing research, provide guidance for improving the psychometric soundness of instruments, and report suggestions from editors of nursing journals for incorporating psychometric data into manuscripts. Methods CINAHL, MEDLINE, and PsycINFO databases were searched using key words: validity, reliability, and psychometrics. Nursing research articles were eligible for inclusion if they were published in the last 5 years, quantitative methods were used, and statistical evidence of psychometric properties were reported. Reports of strong psychometric properties of instruments were identified as well as those with little supporting evidence of psychometric soundness. Findings Reports frequently indicated content validity but sometimes the studies had fewer than five experts for review. Criterion validity was rarely reported and errors in the measurement of the criterion were identified. Construct validity remains underreported. Most reports indicated internal consistency reliability (alpha) but few reports included reliability testing for stability. When retest reliability was asserted, time intervals and correlations were frequently not included. Conclusions Planning for psychometric testing through design and reducing nonrandom error in measurement will add to the reliability and validity of instruments and increase the strength of study findings. Underreporting of va…

Integrity signals

Registry

Crossref · 10.1111/j.1547-5069.2007.00161.x

Cites

0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
The content validity index: Are you sure you know what's being reported? Critique and recommendations
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 2×
“The published literature, including texts and research articles, include extensive definitions of validity and reliability, though many pertain to comprehensive exploration of a single psychometric concept (Polit & Beck, 2006).”
BackgroundMethod
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Advanced Design in Nursing Research
Brink, P., & Wood, M. (1998) · doi:10.4135/9781452204840 · Cited by 433

Show all 0 references

Research works printed but not linked: 25

10.1097/00006199-200609000-00007 · DOI
10.1136/bmj.314.7080.572 · DOI · Paper page
DiCenso A., 2005, Evidence‐based nursing, 432
DeVellis R.F., 2003, Scale development: Theory and application
10.1097/00008483-200303000-00010 · DOI
10.1002/nur.4770130612 · DOI
10.1097/00006199-200507000-00009 · DOI
10.1080/074811801750058609 · DOI
10.1023/A:1025809921592 · DOI
Hulley S.B., 2001, Designing clinical research: An epidemiologic approach
10.1177/0193945905284726 · DOI
10.1097/00006199-198611000-00017 · DOI · Paper page
10.1081/CNV-120005902 · DOI
Munro B.H., 2005, Statistical methods for health care research
10.4135/9781412985772 · DOI
10.1097/00024665-200211000-00013 · DOI
Nunnally J.C., 1994, Psychometric theory
10.1097/00008483-200311000-00008 · DOI
10.1891/jnum.2005.13.2.147 · DOI
Polit D.F., 2004, Nursing research: Principles and methods
10.1111/j.1547-5069.2005.00061.x · DOI
Schultz K.S., 2005, Measurement theory in action
10.1097/00006199-200511000-00008 · DOI
Trochim W.M.K., 2001, The research methods knowledge base
Waltz C.F., 2005, Measurement in nursing and health research

Sorted by citations

Items 201–300 of 1,000

Assessing factorial and convergent validity and reliability of a food behaviour checklist for Spanish-speaking participants in US Department of Agriculture nutrition education programmes
Banna, J. C., & Townsend, M. S. (2011) · Public Health Nutrition · doi:10.1017/s1368980010003058 · Cited by 31
“Test–retest reliability—Test–retest reliability of individual items on the FBC was indicated by the Spearman rank-order correlation between the scores for a given item at the two time points, as well as the intraclass correlation coefficient(14,24), two methods that are commonly used together in assessing test–retest…”
Method
A systematic review of health‐related quality of life instruments used for people with venous ulcers: an assessment of their suitability and psychometric properties
Palfreyman, S. J., Tod, A., Brazier, J. E., & Michaels, J. A. (2010) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2010.03269.x · Cited by 30
“This involved an assessment of its practicality/acceptability, reliability, construct validity and sensitivity (Dijkers 1999, DeVon et al. 2007).”
Background
Development and Validation of a Patient-Centered Health-Related Quality-of-life Measure
Dunderdale, K., Thompson, D. R., Beer, S. F., Furze, G., & Miles, J. N. V. (2008) · The Journal of Cardiovascular Nursing · doi:10.1097/01.jcn.0000317439.82704.e8 · Cited by 34
“Finally, it could be argued that the sample size for factor analysis should be 5 subjects per variable.(29) However, the exact sample size needed for a study depends on many factors, including the size of the model, distribution of the variables, amount of missing data, reliability of the variables, and strength of th…”
Background
Development and validation of a psychometric scale for assessing healthcare professionals' knowledge in radiation protection
Schroderus-Salo, T., Hirvonen, L., Henner, A., Ahonen, S., Kääriäinen, M., Miettunen, J., & Mikkonen, K. (2019) · Radiography · doi:10.1016/j.radi.2018.12.010 · Cited by 31
Development and Validation of Knowledge, Attitude and Practice on Healthy Lifestyle Questionnaire (KAP-HLQ) for Malaysian Adolescents
Hiew, C. C., Chin, Y. S., Chan, Y. M., & Desa, M. N. M. (2015) · Journal of Nutrition and Health Sciences · doi:10.15744/2393-9060.2.407 · Cited by 27
“[45] that content validity should refer to the process stated by Lynn [46] or Lawshe [29], with at least three experts for adequate inter-rater agreement [28,46].”
BackgroundMethod
The Development and Validation of the Osteoporosis Prevention and Awareness Tool (OPAAT) in Malaysia
Toh, L. S., Lai, P. S. M., Wu, D. B.-C., Wong, K. T., Low, B. Y., & Anderson, C. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124553 · Cited by 34
Measuring the quality of life in mild to very severe dementia: Testing the inter-rater and intra-rater reliability of the German version of the QUALIDEM
Dichter, M., Schwab, C. G. G., Meyer, G., Bartholomeyczik, S., Dortmann, O., & Halek, M. (2014) · International Psychogeriatrics · doi:10.1017/s1041610214000052 · Cited by 32
“For intra-rater reliability assessment, the data collection was guided by the same rater at both measurement points.”
Method
Measuring safety and efficiency in the operating room: development and validation of a metric for evaluating task execution in the operating room.
Russ, S., Arora, S., Wharton, R., Wheelock, A., Hull, L., Sharma, E., Darzi, A., Vincent, C., & Sevdalis, N. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2012.12.013 · Cited by 32
Validity of the interRAI Acute Care based on test content: a multi-center study
Wellens, N. I. H., Deschodt, M., Boonen, S., Flamaing, J., Gray, L., Moons, P., & Milisen, K. (2011) · Aging Clinical and Experimental Research · doi:10.1007/bf03325244 · Cited by 36
Involving Stakeholders’ Knowledge in Co-designing Social Valuations of Biodiversity and Ecosystem Services: Implications for Decision-Making
Asah, S. T., & Blahna, D. (2019) · Ecosystems · doi:10.1007/s10021-019-00405-6 · Cited by 31
The validity and reliability of the English version of the diabetes distress scale for type 2 diabetes patients in Malaysia
Chin, Y. W., Lai, P. S. M., & Chia, Y. C. (2017) · BMC Family Practice · doi:10.1186/s12875-017-0601-9 · Cited by 35
Questionnaire development and validity to measure sexual intention among youth in Malaysia
Muhammad, N. A., Shamsuddin, K., Amin, R. M., Omar, K., & Ramayah, T. (2017) · BMC Public Health · doi:10.1186/s12889-016-3949-1 · Cited by 33
“Face validity was used to review grammar, syntax, organisation and appropriateness of the questionnaire [28].”
BackgroundMethod
Three questionnaires to assess the perception of fixed orthodontic therapy before, during and after treatment: validity and reliability
Yassir, Y. A., McIntyre, G. T., & Bearn, D. (2016) · European Journal of Orthodontics · doi:10.1093/ejo/cjw076 · Cited by 32
Development, Validation, and Field-Testing of an Instrument for Clinical Assessment of HIV-Associated Neuropathy and Neuropathic Pain in Resource-Restricted and Large Population Study Settings
Woldeamanuel, Y. W., Kamerman, P. R., Veliotes, D. G. A., Phillips, T., Asboe, D., Boffito, M., & Rice, A. S. C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164994 · Cited by 33
“CVR was then computed as CVR = (ne—”
MethodInfluential
Efficient Digital Signage-Based Online Store Layout: An Experimental Study
Ijaz, M. F., Wu, T., Rhee, J., Kang, Y.-S., & Alfian, G. (2016) · Sustainability · doi:10.3390/su8060511 · Cited by 30
“The internal consistency was accessed by using Cronbach’s alpha test, which is commonly used to check the internal consistency to measure the inter-item correlations within the scale and to specify how well the items ﬁt together theoretically [68].”
Method
Nursing students' attitudes towards information and communication technology: an exploratory and confirmatory factor analytic approach.
Lee, J. J., & Clarke, C. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12611 · Cited by 31
Cross-sectional measurement of adherence to a proposed sustainable and healthy dietary pattern among United States adults using the newly developed Planetary Health Diet Index for the United States
Parker, M. K., Misyak, S. A., Gohlke, J. M., & Hedrick, V. E. (2023) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2023.09.009 · Cited by 32
A systematic review of the psychometric properties of the Jebsen-Taylor Hand Function Test (JTHFT).
Fabbri, B., Berardi, A., Tofani, M., Panuccio, F., Ruotolo, I., Sellitto, G., & Galeoto, G. (2021) · Hand Surgery and Rehabilitation · doi:10.1016/j.hansur.2021.05.004 · Cited by 30
Developing a quantitative tool to measure the extent to which public spaces meet user needs
Alwah, A. A. Q., Li, W., Alwah, M. A. Q., & Shahrah, S. (2021) · Urban forestry & urban greening · doi:10.1016/j.ufug.2021.127152 · Cited by 29
Physical activity correlates in children and adolescents, adults, and older adults with an intellectual disability: a systematic review
Vancampfort, D., Damme, T. V., Firth, J., Stubbs, B., Schuch, F., Suetani, S., Arkesteyn, A., & van Biesen, D. (2021) · Disability and Rehabilitation · doi:10.1080/09638288.2021.1909665 · Cited by 30
“The acceptability of the psychometric properties of measurement tools was assessed according to previous recommendations [38].”
Method
Brief version of the coping health inventory for parents (CHIP) among family caregivers of children with chronic diseases
Toledano‐Toledano, F., de la Rubia, J. M., McCubbin, L. D., Cauley, B., & Luna, D. (2020) · Health and Quality of Life Outcomes · doi:10.1186/s12955-020-01357-5 · Cited by 30
The Catholic University Of America
Jenkins, M. (2019) · A Service Beyond All Recompense · doi:10.1016/0161-5890(89)90134-x · Cited by 30
“70 or more statistically accepted (DeVon et al., 2007).”
Method
Visually Induced Dizziness in Children and Validation of the Pediatric Visually Induced Dizziness Questionnaire
Pavlou, M., Whitney, S. L., Alkathiry, A. A., Huett, M., LUXON, L. M., Raglan, E., Godfrey, E. L., & Bamiou, D. (2017) · Frontiers in Neurology · doi:10.3389/fneur.2017.00656 · Cited by 34
“7 for a new instrument (72, 73) indicated high internal consistency and a ≥0.”
Background
Translation and validation of the Malay version of the Stroke Knowledge Test
Sowtali, S. N., Yusoff, D. M., Harith, S., & Mohamed, M. (2015) · Journal of Arrhythmia · doi:10.1016/j.joa.2015.10.003 · Cited by 34
“Content validity Validity is defined as the ability of the instrument to measure the attributes of the construct under study [14].”
BackgroundInfluential
Enhancing Young Hispanic Dual Language Learners' Achievement: Exploring Strategies and Addressing Challenges
Ackerman, D. J., & Tazi, Z. (2015) · ETS Research Report Series · doi:10.1002/ets2.12045 · Cited by 38
“Also of interest may be the degree to which scores are stable over time, particularly when there otherwise is no reason to expect a change in children’s performance (Crocker & Algina, 2006; DeVon et al., 2007).”
Background
Development and validation of Chronic Kidney Disease Knowledge, Attitude, and Practices (CKD-KAP) questionnaire
Tariq, M. H., Sulaiman, S. A. S., Farrukh, M. J., Goh, K. W., & Ming, L. C. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.956449 · Cited by 27
“Similar procedures were applied by other researchers (24, 25).”
Result
Continuance Use of Cloud Computing in Higher Education Institutions: A Conceptual Model
Qasem, Y. A. M., Abdullah, R., Yaha, Y., & Atana, R. (2020) · Applied Sciences · doi:10.3390/app10196628 · Cited by 53
“The reliability of the instrument was acceptable, with reﬂective factor loadings in excess of 0.505 (i.e., greater than the recommended level of 0.5) [209].”
BackgroundInfluential
Older people nursing in care homes: An examination of nursing professionals' self-assessed competence and its predictors.
Kiljunen, O., Partanen, P., Välimäki, T., & Kankkunen, P. (2019) · International Journal of Older People Nursing · doi:10.1111/opn.12225 · Cited by 29
Head, Heart, and Gut in Decision Making: Development of a Multiple Brain Preference Questionnaire
Soosalu, G., Henwood, S. M., & Deo, A. (2019) · SAGE Open · doi:10.1177/2158244019837439 · Cited by 52
“CVI scores ranged from 9 to 10, with a cutoff of 0.87 (DeVon et al., 2007).”
BackgroundResultInfluential
Person-centered Climate Questionnaire-Patient in English: A psychometric evaluation study in long-term care settings.
Yoon, J., Roberts, T. J., Grau, B., & Edvardsson, D. (2015) · Archives of gerontology and geriatrics (Print) · doi:10.1016/j.archger.2015.03.010 · Cited by 29
“45 were considered substantial and high for convergent validity with a similar construct (DeVon et al., 2007).”
Background
Construct Validity of the Chinese Version of the Self-care of Heart Failure Index Determined Using Structural Equation Modeling
Kang, X.-F., Himmelfarb, C. D. D., Li, Z., Zhang, J., Lv, R., & Guo, J. (2015) · Journal of Cardiovascular Nursing · doi:10.1097/jcn.0000000000000134 · Cited by 29
“94, indicating that the content of the simplified Chinese version of the SCHFI was acceptable.(11)”
Background
Reliability of the Swedish version of the Exercise Self-Efficacy Scale (S-ESES): a test–retest study in adults with neurological disease
Ahlström, I., Hellström, K., Emtner, M., & Anens, E. (2014) · Physiotherapy Theory and Practice · doi:10.3109/09593985.2014.982776 · Cited by 31
“According to others, the alpha coefficient should be at least 0.90, but that the ideal is 0.95 (DeVon et al, 2007), while some suggest 0.80 (Nunnally and Bernstein, 1993).”
BackgroundInfluential
Digitised audio questionnaire for assessment of informed consent comprehension in a low-literacy African research population: development and psychometric evaluation
Afolabi, M. O., Bojang, K., D’Alessandro, U., Ota, M. O. C., Imoukhuede, E. B., Ravinetto, R., Larson, H. J., McGrath, N. M., & Chandramohan, D. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-004817 · Cited by 25
“sistently measure an attribute and how well the question items conceptually agree together.(34) 45 Two commonly used indicators of reliability, internal consistency and test–retest reliability were employed to examine the reliability of DICCQ.”
Influential
Development of a Survey to Assess Adolescent Perceptions of Teen Parenting
Herrman, J. W., & Nandakumar, R. (2012) · Journal of Nursing Measurement · doi:10.1891/1061-3749.20.1.3 · Cited by 25
“DeVon et al. (2007) supported the use of qualitative data findings as means to generate quantitative survey items.”
BackgroundMethod
Measuring coastal cities' resilience toward coastal hazards: Instrument development and validation
Oktari, R. S., Comfort, L. K., Syamsidik, S., & Dwitama, P. (2019) · Progress in Disaster Science · doi:10.1016/j.pdisas.2019.100057 · Cited by 34
Exploring the synergistic effects of circular economy, Industry 4.0 technology, and green human resource management practices on sustainable performance: Empirical evidence from Indian companies
De, T., Verma, P., Gangaraju, P. K., Bhaskar, A. N. S., Mahlawat, S., Kumar, V., & Singh, S. (2024) · Business Strategy & Development · doi:10.1002/bsd2.70002 · Cited by 32
Face, content, criterion and construct validity assessment of a newly developed tool to assess and classify work–related stress (TAWS– 16)
Roy, R., Sukumar, G., Philip, M., & Gopalakrishna, G. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280189 · Cited by 28
The Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) Psychometric Characteristics: II European Portuguese Version (II EP CAPE-V).
de Almeida, S. C., Mendes, A. P., & Kempster, G. (2019) · Journal of Voice · doi:10.1016/j.jvoice.2018.02.013 · Cited by 28
“Content validity reflects the items included adequacy to the domain of the instrument.(10) Construct validity is the degree to which an instrument measures the construct under study.”
Background
The Dyadic Communicative Resilience Scale (DCRS): scale development, reliability, and validity
Chernichky-Karcher, S. M., Venetis, M. K., & Lillie, H. M. (2019) · Supportive Care in Cancer · doi:10.1007/s00520-019-04763-8 · Cited by 30
Timing of Insulin Injections, Adherence, and Glycemic Control in a Multinational Sample of People with Type 2 Diabetes: A Cross-Sectional Analysis
Schaper, N. C., Nikolajsen, A., Sandberg, A., Buchs, S., & Bøgelund, M. (2017) · Diabetes Therapy · doi:10.1007/s13300-017-0317-9 · Cited by 27
“70 indicates ‘‘acceptable’’ internal consistency [27].”
Puzzle game-based learning: a new approach to promote learning of principles of coronary artery bypass graft surgery
Khorammakan, R., Omid, A., Mirmohammadsadeghi, M., & Ghadami, A. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04156-w · Cited by 30
Digitalization of supply chains in Industry 4.0 environment of manufacturing organizations: conceptualization, scale development & validation
Mishra, R., Singh, R. K., & Gunasekaran, A. (2023) · Production Planning & Control · doi:10.1080/09537287.2023.2172622 · Cited by 33
“Content validity is established by reviewing the items by seven or more experts (Devon et al. 2007).”
Gastronomy as a factor of tourists' overall experience: a study of Jeonju, South Korea
Carpio, N., Napod, W. F., & Do, H. (2021) · doi:10.1108/ihr-08-2020-0031 · Cited by 27
Development and psychometric property testing of a skin tear knowledge assessment instrument (OASES) in 37 countries.
Tiggelen, H. V., Alves, P., Ayello, E., Bååth, C., Baranoski, S., Campbell, K., Dunk, A., Gloeckner, M., Hevia, H., Holloway, S., et al. (2020) · Journal of Advanced Nursing · doi:10.1111/jan.14713 · Cited by 27
Challenges of implementation of hospital accreditation in Iran: an exploratory factor analysis
Tashayoei, N., Raeissi, P., & Nasiripour, A. (2020) · Journal of Egyptian Public Health Association · doi:10.1186/s42506-019-0033-6 · Cited by 27
Age-group differences in risk perceptions of non-communicable diseases among adults in Diepsloot township, Johannesburg, South Africa: A cross-sectional study based on the Health Belief Model
Kaba, Z., Khamisa, N., & Tshuma, N. (2017) · South African Medical Journal · doi:10.7196/samj.2017.v107i9.12168 · Cited by 29
“70) as recommended in the literature.[31,32]”
Incorporating traditional Chinese medicine syndrome differentiation in randomized trials: Methodological issues
Chung, V. C., Ho, R. S. T., Wu, X., & Wu, J. C. Y. (2016) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2016.08.164 · Cited by 28
Measuring nursing assistants' knowledge, skills and attitudes in a palliative approach: A literature review
Karacsony, S., Chang, E. M. L., Johnson, A., Good, A., & Edenborough, M. (2015) · Nurse Education Today · doi:10.1016/j.nedt.2015.05.008 · Cited by 25
Initial development and testing of a questionnaire of parental self‐efficacy for enacting healthy lifestyles in their children
Decker, J. W. (2012) · Journal for Specialists in Pediatric Nursing · doi:10.1111/j.1744-6155.2012.00330.x · Cited by 29
“41 for the items on the 4-point scale (DeVon et al., 2007; Lynn, 1986).”
Background
Nurses’ perception of the use of computerised information systems in practice: questionnaire development
Oroviogoicoechea, C., Watson, R. A., Beortegui, E., & Remirez, S. (2009) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2009.03003.x · Cited by 20
Reliability and validity evaluation of the appropriate antibiotic use self-efficacy scale for Chinese adults
Wang, L., Liang, C., Yu, H., Zhang, H., & Yan, X. (2022) · BMC Public Health · doi:10.1186/s12889-022-13729-1 · Cited by 23
“7 will be used as the recommended threshold [68].”
Method
Childbirth Readiness Scale (CRS): instrument development and psychometric properties
Mengmei, Y., Meizhen, Z., Tieying, Z., Wu, M., Ye, C., Zhang, K., & AiQing, T. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-04574-6 · Cited by 32
“The sample size was estimated to satisfy the criteria of factor analysis [27].”
Method
Development and validation of a knowledge, attitude, and practice questionnaire regarding cardiovascular diseases in an Iranian general population
Koohi, F., Amiri, P., Mehrabi, Y., Karimi, M., & Khalili, D. (2021) · BMC Public Health · doi:10.1186/s12889-021-12135-3 · Cited by 27
“The test-retest reliability of the CVD-KAP29 was determined by the intra-class correlation coefficient (ICC) between the first and second administrations of the questionnaire with a two-week interval, a duration considered appropriate, as it is neither too short to remember the responses nor is too long to change thei…”
Method
Validation and Reliability of Healthcare Workers’ Knowledge, Attitude, and Practice Instrument for Uncomplicated Malaria by Rasch Measurement Model
Ismail, N. E., Jimam, N. S., Dapar, M. P., & Ahmad, S. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.01521 · Cited by 26
Development and Assessment of Respectful Maternity Care Questionnaire in Iran
Taavoni, S., Goldani, Z., Rostami-Gooran, N., & Haghani, H. (2018) · International Journal of Community Based Nursing and Midwifery · doi:10.30476/ijcbnm.2018.40840 · Cited by 26
Assessment tools of immediate risk of self-harm and suicide in children and young people: A scoping review
Carter, T., Walker, G., Aubeeluck, A., & Manning, J. C. (2018) · Journal of Child Health Care · doi:10.1177/1367493518787925 · Cited by 32
Development and testing of the CALDs and CLES+T scales for international nursing students’ clinical learning environments
Mikkonen, K., Elo, S., Miettunen, J., Saarikoski, M., & Kääriäinen, M. (2017) · Journal of Advanced Nursing · doi:10.1111/jan.13268 · Cited by 26
Psychometric properties of the Violent Experiences Questionnaire
King, A. R., & Russell, T. D. (2017) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2017.02.008 · Cited by 25
“…and concurrent validity was provided by: alphas >0.80 (Nunnally, 1967); test-retest coefficients >0.70 (Cook & Beckman, 2006; Cronbach, 1970; DeVon et al., 2007); kappa coefficients >0.50 (Cicchetti & Sparrow, 1981; Viera & Garrett, 2005); and concurrent validity coefficients >0.45 (DeVon…”
Influential
Measurement of students' perceptions of nursing as a career.
Matutina, R. E., Newman, S., & Jenkins, C. (2010) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2010.01358.x · Cited by 27
Psychometric properties of the COVID stress scales (CSS) within Arabic language in a Palestinian context
Mahamid, F. A., Veronese, G., Bdier, D., & Pancake, R. (2022) · Current Psychology · doi:10.1007/s12144-021-01794-5 · Cited by 25
“Accordingly, 31 items correlated positively and significantly with CSS’s total score and fit together conceptually (DeVon et al., 2007).”
Background
Anxiety in Brief: Assessment of the Five-Item Trait Scale of the State-Trait Anxiety Inventory in South Africa
Pretorius, T. B., & Padmanabhanunni, A. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20095697 · Cited by 25
“50, as it demonstrates that all items contribute to the measurement of the latent variable [38,39].”
Background
Emotional Intelligence: Emotional Expression and Emotional Regulation for Intrinsic and Extrinsic Emotional Satisfaction
Husain, W., Inam, A., Wasif, S., & Zaman, S. (2022) · Psychology Research and Behavior Management · doi:10.2147/prbm.s396469 · Cited by 48
“This procedure is referred to content validity which is also an important technique to make the scale as much valid as possible before the actual data collection.(43) The researchers analyzed the ratings of the panel and found significant positive correlations between the ratings of all the 5 experts, for all the init…”
Measuring digital transformation in higher education institutions – content validity instrument
Benavides, L. M. C., Arias, J. A. T., Burgos, D., & Martens, A. (2022) · Applied Computing and Informatics · doi:10.1108/aci-03-2022-0069 · Cited by 43
Development and validation of the Fat Attitudes Assessment Toolkit (FAAT): A multidimensional nonstigmatizing measure of contemporary attitudes toward fatness and fat people
Cain, P., Donaghue, N., & Ditchburn, G. J. (2022) · Journal of Applied Social Psychology · doi:10.1111/jasp.12882 · Cited by 32
Developing Nutrition Knowledge and Attitude Measures for Athletes With the Knowledge–Attitude–Behavior Model
Teo, C. J. H., Burns, S. F., & 川端, 雅. (2022) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2021.1942771 · Cited by 24
“First, the content validity of the initial version of the instruments was evaluated by an expert panel of sports dietitians (n = 3) from a national sports institute, as recommended by DeVon et al. (2007) and Parmenter and Wardle (2000).”
Method
A systematic and psychometric review of tests measuring nurses' wound care knowledge
Kielo‐Viljamaa, E., Suhonen, R., Ylönen, M., Viljamaa, J., Wahlroos, N., & Stolt, M. (2020) · International Wound Journal · doi:10.1111/iwj.13417 · Cited by 29
“The content validity index (CVI) can then be calculated, and the instrument and its items can be adjusted on the basis of feedback from the experts before it is administered to a larger sample.(16,17) The final stages of the development process according to DeVellis(15) are administering the items to a development sam…”
Method
Psychometric Testing of the European Organisation for Research and Treatment of Cancer (EORTC) QLQ-CIPN20 Using Pooled Chemotherapy-Induced Peripheral Neuropathy Outcome Measures Standardization (CI-PeriNomS) and Alliance for Clinical Trials in Oncology (Alliance) A151408 Study Data
Smith, E. M. L., Banerjee, T., Yang, J. J., Bridges, C. M., Alberti, P., Sloan, J., & Loprinzi, C. (2019) · Cancer Nursing · doi:10.1097/ncc.0000000000000596 · Cited by 25
“Internal consistency reliability was assessed using Cronbach"s ! and item-item correlations.(43) Strong psychometric properties were indicated by ! coefficients of .”
Development and validation of a questionnaire to assess the doctors and nurses knowledge of acute oxygen therapy
Desalu, O., Aladesanmi, A., Ojuawo, O., Opeyemi, C., Ibraheem, R. M., Suleiman, Z. A., Oyedepo, O., Adesina, K. T., Oloyede, T., & Sanya, E. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211198 · Cited by 25
Quality of leadership in multidisciplinary cancer tumor boards: development and evaluation of a leadership assessment instrument (ATLAS)
Jalil, R., Soukup, T., Akhter, W., Sevdalis, N., & Green, J. (2018) · World journal of urology · doi:10.1007/s00345-018-2255-1 · Cited by 25
“A CVI represents the proportion of experts who rated an item 4 or 5 on the 5-point content validation scale of its importance for MTB leadership [20].”
Background
Validity Evidence for a Chinese Version of the Online Self-Regulated Learning Questionnaire With Average Students and Mathematically Talented Students
Fung, J. J. Y., Yuen, M.-T., & Yuen, A. H. K. (2018) · doi:10.1080/07481756.2017.1358056 · Cited by 25
“737, indicating that the questions discriminate effectively (DeVon et al., 2007).”
BackgroundInfluential
School self-evaluation for school improvement: Examining the measuring properties of the LEAD surveys
Antoniou, P., Myburgh-Louw, J., & Gronn, P. (2016) · Australian Journal of Education · doi:10.1177/0004944116667310 · Cited by 27
“Content Validity refers to the extent to which the content of the measuring instruments is appropriate and relevant to the survey purpose (DeVon et al., 2007).”
Background
Reliability and validity of a Turkish version of the Global Pelvic Floor Bother Questionnaire
Doğan, H., Özengin, N., Bakar, Y., & Duran, B. (2016) · International Urogynecology Journal · doi:10.1007/s00192-016-3014-8 · Cited by 25
Self-reported physical activity behavior of a multi-ethnic adult population within the urban and rural setting in Suriname
Baldew, S.-S. M., Krishnadath, I. S. K., Smits, C. C., Toelsie, J. R., Vanhees, L., & Cornelissen, V. (2015) · BMC Public Health · doi:10.1186/s12889-015-1807-1 · Cited by 25
“Finally, in our study, the validation of the translated GPAQ was based on the face-validation [22,23] procedure whereby, as part of a pilot study, a small sample of participants was interviewed by a trained interviewer.”
Method
Knowledge tests in patient education: a systematic review.
Kesänen, J., Leino-Kilpi, H., Arifulla, D., Siekkinen, M., & Valkeapää, K. (2014) · Nursing and Health Sciences · doi:10.1111/nhs.12097 · Cited by 25
Validity, reliability, and feasibility of the German version of the Caregiver Reaction Assessment scale (G-CRA): a validation study
Stephan, A., Mayer, H., Guiteras, A. R., & Meyer, G. (2013) · International Psychogeriatrics · doi:10.1017/s1041610213001178 · Cited by 28
The Pain Disability Questionnaire: a reliability and validity study.
Giordano, P. C. M., Alexandre, N. M., Rodrigues, R., & Coluci, M. Z. O. (2012) · Revista Latino-Americana de Enfermagem · doi:10.1590/s0104-11692012000100011 · Cited by 25
“Regarding the reliability of the PDQ, this study found high internal consistency(13).”
Method
Evidence-Based School Behavior Assessment of Externalizing Behavior in Young Children
Bagner, D. M., Boggs, S. R., & Eyberg, S. M. (2009) · Education and Treatment of Children · doi:10.1353/etc.0.0084 · Cited by 23
“The lower reliability scores in this study may be due to the smaller sample size of diagnosed children (DeVon et al., 2007).”
Background
Using machine learning and qualitative interviews to design a five-question survey module for women’s agency
Jayachandran, S., Biradavolu, M. R., & Cooper, J. E. (2022) · World Development · doi:10.1016/j.worlddev.2022.106076 · Cited by 40
“How well a psychometric captures the concept it is trying to measure is called its validity (DeVon et al., 2007; Jose, Bhan, & Raj, 2017).”
Background
The pedestrian behaviour scale: A systematic review of its validation around the world
Vandroux, R., Granié, M.-A., Jay, M., Sueur, C., & Pelé, M. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.106509 · Cited by 28
Vietnamese Version of the General Medication Adherence Scale (GMAS): Translation, Adaptation, and Validation
Nguyen, T. H., Truong, H. V., Vi, M. T., Taxis, K., Nguyen, T. N., & Nguyen, T. N. (2021) · Healthcare · doi:10.3390/healthcare9111471 · Cited by 18
Social, health care and rehabilitation educators' competence in professional education-Empirical testing of a model.
Mikkonen, K., Kuivila, H., Sjögren, T., Korpi, H., Koskinen, C., Koskinen, M., Koivula, M., Koskimäki, M., Lähteenmäki, M., Saaranen, T., et al. (2021) · Health and Social Care in the community · doi:10.1111/hsc.13414 · Cited by 24
Review of the Reliability and Validity of the Apgar Score
Michel, A. (2021) · Advances in Neonatal Care · doi:10.1097/anc.0000000000000859 · Cited by 28
Evaluation of Studies on the Measurement Properties of Self-Reported Instruments
Lee, E., Kang, E. H., & Kang, H. (2020) · Asian Nursing Research · doi:10.1016/j.anr.2020.11.004 · Cited by 29
Theoretical and Operational Consideration of Mindfulness, Resilience, and Resourcefulness
Musil, C. M., Wallace, M. K., Jeanblanc, A., Toly, V. B., Zauszniewski, J. A., & Burant, C. J. (2020) · Western Journal of Nursing Research · doi:10.1177/0193945920956684 · Cited by 31
“…resilience, and resourcefulness; and third, we examined the correlations of these three constructs with a set of relevant external psychosocial variables, thereby evaluating construct validity, criterion-convergent validity and criterion-concurrent validity, respectively (DeVon et al., 2007).”
BackgroundMethod
Development and testing of an instrument (HeSoEduCo) for health and social care educators' competence in professional education.
Mikkonen, K., Tuomikoski, A., Sjögren, T., Koivula, M., Koskimäki, M., Lähteenmäki, M., Mäki-Hakola, H., Wallin, O., Sormunen, M., Saaranen, T., et al. (2019) · Nurse Education Today · doi:10.1016/j.nedt.2019.104239 · Cited by 24
Rapid Food Hygiene Inspection Tool (RFHiT) to assess hygiene conformance index (CI) of street food vendors
Soon, J. M. (2019) · LWT · doi:10.1016/j.lwt.2019.108304 · Cited by 30
Measures for social support in raising a child with a disability: A scoping review
Langeveldt, A. M., Dada, S., & Boshoff, K. (2019) · Child Care Health and Development · doi:10.1111/cch.12646 · Cited by 35
Reliability analysis of the Manchester Triage System: inter-observer and intra-observer agreement
de Souza, C. D., Chianca, T., Cordeiro, W., Rausch, M., & Nascimento, G. F. L. (2018) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.2205.3005 · Cited by 24
“It is the instrument ́s ability to measure consistently and accurately what it is intended to measure and to reproduce a result consistently in time and space, or with different observers(6).”
Background
Advancement of the German version of the moral distress scale for acute care nurses—A mixed methods study
Kleinknecht‐Dolf, M., Spichiger, E., Müller, M., Bartholomeyczik, S., & Spirig, R. (2017) · Nursing Open · doi:10.1002/nop2.91 · Cited by 26
“Construct validity was assessed by analysing participant results (Bannigan & Watson, 2009; DeVon et al., 2007).”
Method
Development of a multidimensional assessment tool for uraemic pruritus: Uraemic Pruritus in Dialysis Patients (UP-Dial)
Nochaiwong, S., Ruengorn, C., Awiphan, R., Panyathong, S., Noppakun, K., Chongruksut, W., & Chiewchanvit, S. (2016) · British Journal of Dermatology · doi:10.1111/bjd.15268 · Cited by 23
Validation of Finnish Neecham Confusion Scale and Nursing Delirium Screening Scale using Confusion Assessment Method algorithm as a comparison scale
Poikajärvi, S., Salanterä, S., Katajisto, J., & Junttila, K. (2017) · BMC Nursing · doi:10.1186/s12912-016-0199-6 · Cited by 20
“Validity denotes the ability of the instrument to measure the attributes of the phenomenon under study, and this was tested with concurrent validity (how well the scores in the scale under testing correlate with scores in the comparison scale) and face validity (how well the instrument seems to measure the phenomenon…”
Method
Development of the competency scale for primary care managers in Thailand: Scale development
Kitreerawutiwong, K., Sriruecha, C., & Laohasiriwong, W. (2015) · BMC Family Practice · doi:10.1186/s12875-015-0388-5 · Cited by 24
“If an instrument contains two or more subscales, Cronbach’s alpha should be computed for each subscale as well as the entire scale [23, 24].”
Method
Cognitive Themes Emerging from Air Photo Interpretation Texts Published to 1960
Bianchetti, R. A., & MacEachren, A. M. (2015) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi4020551 · Cited by 26
“In instances where only a single coder is used, it is possible to use rate-rerate method to compute a consistency measure [76,77].”
Method
Knowledge, attitudes and practices of neonatal staff concerning neonatal pain management.
Khoza, S., & Tjale, A. (2014) · Curationis · doi:10.4102/curationis.v37i2.1246 · Cited by 24
“In this study translational validity was established using Trochim's (2001, in DeVon et al. 2007) definition, which consists of both face and content validity.”
Reliability and validity of the Turkish version of the knee injury and osteoarthritis outcome score-physical function short-form (KOOS-PS)
Gul, E., Yilmaz, O., & Bodur, H. (2013) · Journal of Back and Musculoskeletal Rehabilitation · doi:10.3233/bmr-130406 · Cited by 24
“In the literature, it is stated that Cronbach’s alpha values greater than or equal to 0.7 are sufﬁcient to show the consistency of the sub-categories [10].”
Influential
Cross-cultural adaptation of the VISA-P questionnaire for Greek-speaking patients with patellar tendinopathy
Korakakis, V., Patsiaouras, A., & Malliaropoulos, N. (2012) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091339 · Cited by 24
A Comprehensive Review of Psychosocial, Academic, and Psychological Issues Faced by University Students in India
Gull, M., Kaur, N., Abuhasan, W. M. F., Kandi, S., & Nair, S. M. (2025) · Annals of Neurosciences · doi:10.1177/09727531241306571 · Cited by 29
“Following the guidelines proposed by, 24 if five out of six content experts rated an item as either relevant (3) or very relevant (4), it met the required standard, and the key-word was retained.”
Psychometric properties of the Parkinson’s disease Questionnaire−39 and its short form Parkinson’s disease Questionnaire−8: A systematic review and meta-analysis
Ruotolo, I., Sellitto, G., Berardi, A., Simeon, R., Panuccio, F., Amadio, E., Ugolini, A., Fabbrini, G., & Galeoto, G. (2024) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2024.03.032 · Cited by 30
Content Validation of an Instrument for the Assessment of School Teachers’ Levels of Knowledge of Diabetes through Expert Judgment
Luque-Vara, T., Linares-Manrique, M., Fernández-Gómez, E., Salvador, A. M., Sánchez‐Ojeda, M. A., & Enrique-Mirón, C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228605 · Cited by 30
“, validity and reliability, so that they can be used by researchers in their studies [14,15] while ensuring the integrity of their results [12].”
Background
Support Needs Approach for Patients (SNAP) tool: a validation study
Gardener, C., Ewing, G., Mendonça, S., & Farquhar, M. C. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-032028 · Cited by 23

Authors: DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas‐Polston, E.
Affiliations: Purdue University Northwest (US)
Corresponding author: DeVon, Holli A.
Block, Michelle E.
Moyle‐Wright, Patricia
Ernst, Diane M.
Hayden, Susan J.
Lazzara, Deborah J.
Savoy, Suzanne M.
ORCID: DeVon, Holli A.
Venue: Journal of Nursing Scholarship
Publisher: Wiley
Published: 2007-05-23
Volume: 39
Issue: 2
Pages: 155-164
ISSN: 0363-2792 (ISSN-L)
1527-6546
1547-5069
DOI: 10.1111/j.1547-5069.2007.00161.x
OpenAlex: W2162602057
Cited by: 1,889
References: 0
Citations by year: 2026: 87 · 2025: 128 · 2024: 186 · 2023: 176 · 2022: 148 · 2021: 163 · 2020: 145 · 2019: 144 · 2018: 131 · 2017: 113 · 2016: 96 · 2015: 105 · 2014: 83 · 2013: 51 · 2012: 40
FWCI: 15.03
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Journal of Nursing Scholarship (publishedVersion)
PubMed (publishedVersion)
ePublications at Regis University (Regis University) (submittedVersion)
Topics: Health Sciences › Nursing › Research and Theory › Health Education and Validation
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: psychometric properties, reliability statistics, validity, content validity, criterion validity, construct validity, internal consistency, test-retest reliability, measurement error, nursing equipment, nursing research
MeSH terms: Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Mathematics, Periodicals as Topic, Planning Techniques, Predictive Value of Tests, Psychometrics, Research Design, Time Factors, Reproducibility of Results, Nursing Research, Bias, Discriminant Analysis, Guidelines as Topic, Peer Review, Research, Statistics, Nonparametric, Editorial Policies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A Psychometric Toolbox for Testing Validity and Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Metadata

Record

About these checks