Cited by 1,889Health Education and ValidationPsychometric Methodologies and TestingReliability and Agreement in Measurement

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

A Psychometric Toolbox for Testing Validity and Reliability

DeVon, Holli A., Block, Michelle E., Moyle‐Wright, Patricia, Ernst, Diane M., Hayden, Susan J., Lazzara, Deborah J., Savoy, Suzanne M., Kostas‐Polston, Elizabeth·2007·Journal of Nursing Scholarship

DOI 10.1111/j.1547-5069.2007.00161.x

Open this paper in CoChat — free account

Abstract

Purpose To review the concepts of reliability and validity, provide examples of how the concepts have been used in nursing research, provide guidance for improving the psychometric soundness of instruments, and report suggestions from editors of nursing journals for incorporating psychometric data into manuscripts. Methods CINAHL, MEDLINE, and PsycINFO databases were searched using key words: validity, reliability, and psychometrics. Nursing research articles were eligible for inclusion if they were published in the last 5 years, quantitative methods were used, and statistical evidence of psychometric properties were reported. Reports of strong psychometric properties of instruments were identified as well as those with little supporting evidence of psychometric soundness. Findings Reports frequently indicated content validity but sometimes the studies had fewer than five experts for review. Criterion validity was rarely reported and errors in the measurement of the criterion were identified. Construct validity remains underreported. Most reports indicated internal consistency reliability (alpha) but few reports included reliability testing for stability. When retest reliability was asserted, time intervals and correlations were frequently not included. Conclusions Planning for psychometric testing through design and reducing nonrandom error in measurement will add to the reliability and validity of instruments and increase the strength of study findings. Underreporting of va…

Integrity signals

Registry

Crossref · 10.1111/j.1547-5069.2007.00161.x

Cites

0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
The content validity index: Are you sure you know what's being reported? Critique and recommendations
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 2×
“The published literature, including texts and research articles, include extensive definitions of validity and reliability, though many pertain to comprehensive exploration of a single psychometric concept (Polit & Beck, 2006).”
BackgroundMethod
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Advanced Design in Nursing Research
Brink, P., & Wood, M. (1998) · doi:10.4135/9781452204840 · Cited by 433

Show all 0 references

Research works printed but not linked: 25

10.1097/00006199-200609000-00007 · DOI
10.1136/bmj.314.7080.572 · DOI · Paper page
DiCenso A., 2005, Evidence‐based nursing, 432
DeVellis R.F., 2003, Scale development: Theory and application
10.1097/00008483-200303000-00010 · DOI
10.1002/nur.4770130612 · DOI
10.1097/00006199-200507000-00009 · DOI
10.1080/074811801750058609 · DOI
10.1023/A:1025809921592 · DOI
Hulley S.B., 2001, Designing clinical research: An epidemiologic approach
10.1177/0193945905284726 · DOI
10.1097/00006199-198611000-00017 · DOI · Paper page
10.1081/CNV-120005902 · DOI
Munro B.H., 2005, Statistical methods for health care research
10.4135/9781412985772 · DOI
10.1097/00024665-200211000-00013 · DOI
Nunnally J.C., 1994, Psychometric theory
10.1097/00008483-200311000-00008 · DOI
10.1891/jnum.2005.13.2.147 · DOI
Polit D.F., 2004, Nursing research: Principles and methods
10.1111/j.1547-5069.2005.00061.x · DOI
Schultz K.S., 2005, Measurement theory in action
10.1097/00006199-200511000-00008 · DOI
Trochim W.M.K., 2001, The research methods knowledge base
Waltz C.F., 2005, Measurement in nursing and health research

Sorted by citations

Items 101–200 of 1,000

Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses
Taffarel, M. O., Luna, S., de Oliveira, F. A., Cardoso, G., Alonso, J. D. M., Pantoja, J. C., Brondani, J., Love, E., Taylor, P., White, K., et al. (2015) · BMC Veterinary Research · doi:10.1186/s12917-015-0395-8 · Cited by 57
“Thereafter the scale must be scrutinized for both content and face validity and finally the scale must undergo reliability testing [6].”
Background
Fostering Future Leadership in Quality and Safety in Health Care through Systems Thinking.
Phillips, J. M., Stalter, A. M., Dolansky, M. A., & Lopez, G. M. (2016) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2015.06.003 · Cited by 57
Development and Validation of a Knowledge, Attitudes and Practices Questionnaire on COVID-19 (KAP COVID-19)
Park, D.-I. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147493 · Cited by 56
“All rigorous research designs should incorporate psychometrically sound measurement tools, and, therefore, the use of an instrument that lacks evidence of validity and reliability is considered critically problematic and decreases the strength of study findings [13,14].”
Background
Reliability and validity of an ergonomics-related Job Factors Questionnaire
Coluci, M. Z. O., Alexandre, N. M. C., & Rosecrance, J. C. (2009) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2009.08.011 · Cited by 45
Psychometric Properties of the Clinical Dementia Rating — Sum of Boxes and other Cognitive and Functional Outcomes in a Prodromal Alzheimer's Disease Population
McDougall, F., Edgar, C. J., Mertes, M., Delmar, P., da Fontoura, P. P., Abi‐Saab, D., Lansdall, C. J., Boada, M., & Doody, R. S. (2021) · The Journal of Prevention of Alzheimer s Disease · doi:10.14283/jpad.2020.73 · Cited by 60
“7 is considered an appropriate target for internal consistency (30, 32, 33).”
BackgroundMethodResult
Validation of the Unesp-Botucatu composite scale to assess acute postoperative abdominal pain in sheep (USAPS)
Silva, N. E. O. F., Trindade, P. H. E., de Oliveira, A. R., Taffarel, M. O., Moreira, M. A. P., Denadai, R., da Rocha, P. B., & Luna, S. P. L. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239622 · Cited by 66
Estimadores de consistencia interna en las investigaciones en salud: el uso del coeficiente alfa
da Silva, F. C., Gonçalves, E., Arancibia, B. A. V., Bento, S. G., Castro, T. L. D. S., Hernández, S. S. S., & da Silva, R. (2015) · Revista Peruana de Medicina Experimental y Salud Pública · doi:10.17843/rpmesp.2015.321.1585 · Cited by 76
The influence of government support and awareness on rural farmers’ intention to adopt mobile government services in Tanzania
Mandari, H. E., Chong, Y.-L., & Wye, C. (2017) · Journal of Systems and Information Technology · doi:10.1108/jsit-01-2017-0005 · Cited by 60
Work from Home and Musculoskeletal Pain in Telecommunications Workers During COVID-19 Pandemic: a Pilot Study
Radulović, A. H., Žaja, R., Milošević, M., Radulović, B., Luketić, I., & Božić, T. (2021) · Arhiv za Higijenu Rada i Toksikologiju · doi:10.2478/aiht-2021-72-3559 · Cited by 53
Moderation-mediation framework connecting internal branding, affective commitment, employee engagement and job satisfaction: an empirical study of BPO employees in Indian context
Kaur, P., Malhotra, K., & Sharma, S. K. (2020) · Asia-Pacific Journal of Business Administration · doi:10.1108/apjba-10-2019-0217 · Cited by 57
Muslim Daily Religiosity Assessment Scale (MUDRAS): A New Instrument for Muslim Religiosity Research and Practice
Olufadi, Y. (2017) · doi:10.1037/rel0000074 · Cited by 53
Validation of the Hester Davis Scale for Fall Risk Assessment in a Neurosciences Population
Hester, A., & Davis, D. M. (2013) · Journal of Neuroscience Nursing · doi:10.1097/jnn.0b013e31829d8b44 · Cited by 52
“Reliability pertains to the instrument’s ability to consistently measure an attribute (DeVon et al., 2007).”
Background
An integrative review of literature examining psychometric properties of instruments measuring anxiety or fear in hospitalized children.
Foster, R., & Park, J.-H. (2012) · Pain Management Nursing · doi:10.1016/j.pmn.2011.06.006 · Cited by 52
A confirmatory factor analysis of consumer styles inventory: Evidence from Greece
Tarnanidis, T. K., Owusu‐Frimpong, N., Nwankwo, S., & Omar, M. (2014) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2014.07.001 · Cited by 58
The Chinese version of the Perceived Stress Questionnaire: development and validation amongst medical students and workers
Meng, R., Li, J., Wang, Z., Zhang, D., Liu, B., Luo, Y., Hu, Y., & Yu, C. (2020) · Health and Quality of Life Outcomes · doi:10.1186/s12955-020-01307-1 · Cited by 58
“45 is recommended by many researchers [72].”
Background
A comparative evaluation of manufacturing flexibility adoption in SMEs and large firms in India
Mishra, R. (2016) · Journal of Manufacturing Technology Management · doi:10.1108/jmtm-11-2015-0105 · Cited by 48
Designing and Implementing the Objective Structured Clinical Examination in Anesthesiology
Hastie, M. J., Spellman, J. L., Pagano, P. P., Hastie, J. M., & Egan, B. (2013) · Anesthesiology · doi:10.1097/aln.0000000000000068 · Cited by 56
Development of a Competency Framework for Quality Improvement in Family Medicine: A Qualitative Study
Czabanowska, K., Klemenc–Ketiš, Z., Potter, A., Rochfort, A., Tomasik, T., Csiszar, J., & Bussche, P. V. (2012) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.21142 · Cited by 47
Validated Digital Literacy Measures for Populations with Low Levels of Internet Experiences
Ali, A., Qazi, I. A., & Raza, A. A. (2023) · Social Science Research Network · doi:10.2139/ssrn.4149495 · Cited by 49
Why Teach With PBL? Motivational Factors Underlying Middle and High School Teachers’ Use of Problem-Based Learning
Lee, H.-C., & Blanchard, M. R. (2018) · Interdisciplinary Journal of Problem-based Learning · doi:10.7771/1541-5015.1719 · Cited by 68
“Cronbach’s alpha has been the most widely used indicator of the reliability of an instrument (Davenport, Davison, Liou, & Love, 2015; DeVon et al., 2007; Streiner, 2003).”
Method
A Malay version of the Child Oral Impacts on Daily Performances (Child-OIDP) index: assessing validity and reliability
Yusof, Z. Y. M., & Jaafar, N. (2012) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-10-63 · Cited by 49
“perceived satisfaction with mouth, perceived oral health status and toothache experience in the previous 3 months [21,22].”
Background
How Experiments with Children Inform Economics
List, J. A., Petrie, R., & Samek, A. S. (2021) · National Bureau of Economic Research · doi:10.3386/w28825 · Cited by 13
Adaptation of the Pittsburgh Sleep Quality Index in Chinese adults with type 2 diabetes
Zhu, B., Xie, M., Park, C. G., & Kapella, M. C. (2017) · Journal of the Chinese Medical Association · doi:10.1016/j.jcma.2017.06.021 · Cited by 50
“The construct validity of the resultant model was further examined by using contrasted groups.(19) Gender and age have frequently been reported as factors affecting sleep quality.”
Method
Initial development and preliminary psychometric properties of the Prodromal Inventory of Negative Symptoms (PINS)
Pelletier‐Baldelli, A., Strauss, G. P., Visser, K. H., & Mittal, V. A. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2017.01.055 · Cited by 54
A Psychometric Review of Measures Assessing Discrimination Against Sexual Minorities
Morrison, T. G., Bishop, C., Morrison, M. A., & Parker, K. (2015) · Journal of Homosexuality · doi:10.1080/00918369.2015.1117903 · Cited by 52
“…concept requiring an “evidentiary chain which clearly links the interpretation of the assessment scores or data to a network of theory, hypotheses, and logic which are presented to support or refute the reasonableness of the desired interpretations” (DeVon et al., 2007; Downing, 2003, p. 831).”
Background
Are measurements of patient safety culture and adverse events valid and reliable? Results from a cross sectional study
Farup, P. G. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0852-x · Cited by 71
“Criterion validity (the relation between the measurement and some other variable) and responsiveness (the ability to detect changes within groups) are important properties that have not been satisfactorily studied [14,31-33].”
BackgroundMethod
Physical Activity Correlates in Persons with Binge Eating Disorder: A Systematic Review
Vancampfort, D., Vanderlinden, J., Stubbs, B., Soundy, A., Pieters, G., Binder, M. D., & Probst, M. (2013) · European Eating Disorders Review · doi:10.1002/erv.2255 · Cited by 50
Development and validation of generative artificial intelligence attitude scale for students
Marengo, A., Karaoglan-Yilmaz, F. G., Yılmaz, R., & Ceylan, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1528455 · Cited by 54
“A test–retest analysis is useful to examine the consistency and stability of the measurement by administering the same test to individuals on two different occasions and calculating the correlation between their scores (DeVon et al., 2007).”
Influential
The Use of Work-Home Practices and Work-Home Conflict: Examining the Role of Volition and Perceived Pressure in a Multi-Method Study.
Delanoeije, J., & Verbruggen, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02362 · Cited by 57
A Pilot Study Approach to Assessing the Reliability and Validity of Relevancy and Efficacy Survey Scale
Khanal, B. P., & Chhetri, D. B. (2024) · Janabhawana Research Journal · doi:10.3126/jrj.v3i1.68384 · Cited by 37
“The inter-item statistics for each item ranged from 0.307 to 0.674 and were all positive values, an indication that items fit together conceptually (DeVon et al., 2007).”
BackgroundInfluential
The Endometriosis Impact Questionnaire (EIQ): a tool to measure the long-term impact of endometriosis on different aspects of women’s lives
Moradi, M., Parker, M. A., Sneddon, A., López, V., & Ellwood, D. A. (2019) · BMC Women s Health · doi:10.1186/s12905-019-0762-x · Cited by 53
Business networks and localization effects for new Swedish technology-based firms’ innovation performance
Rydehell, H., Isaksson, A., & Löfsten, H. (2018) · The Journal of Technology Transfer · doi:10.1007/s10961-018-9668-2 · Cited by 43
“…differ about the ideal Cronbach’s alpha value; some experts have recommended a value of at least 0.900 for instruments used in clinical settings (Nunnally and Bernstein 1994), while others have suggested that an alpha of 0.700 is acceptable for a new instrument (DeVellis 1991; DeVon et al. 2007).”
BackgroundInfluential
Temperament and adolescent problematic Internet use: The mediating role of deviant peer affiliation
Li, X., Newman, J., Li, D., & Zhang, H. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.02.075 · Cited by 52
Translation of Health Surveys Using Mixed Methods
Baker, D. L., Melnikow, J. A., Ly, M. Y., Shoultz, J., Niederhauser, V. P., & Diaz-Escamilla, R. (2010) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2010.01368.x · Cited by 45
Validation of Edinburgh postnatal depression scale for adolescent mothers
Logsdon, M. C., Usui, W. M., & Nering, M. L. (2009) · Archives of Women s Mental Health · doi:10.1007/s00737-009-0096-z · Cited by 44
“If an instrument was originally developed with a population that was vastly different from the proposed study population (e.g., adult, middle class women) pilot studies are necessary to establish preliminary reliability and validity of the instrument before use in a larger study (DeVon et al. 2007).”
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
Sovey, S., Osman, K., & Mohd-Matore, M. E. E. (2022) · European Journal of Educational Research · doi:10.12973/eu-jer.11.2.639 · Cited by 46
“Thus, the findings emphasize construct validity, or the degree to which an instrument's items correspond to a significant theoretical construct (DeVon et al., 2007).”
BackgroundMethodInfluential
In Search of a Gold Standard Patient-Reported Outcome Measure for Use in Chemotherapy- Induced Peripheral Neuropathy Clinical Trials
Smith, E., Knoerl, R., Yang, J. J., Kanzawa-Lee, G. A., Lee, D., & Bridges, C. M. (2018) · Cancer Control · doi:10.1177/1073274818756608 · Cited by 45
“70.(66) For test–retest reliability, we assessed the Pearson correlation between the 2 CIPN15 scores from the same patient at the 12-week visit.”
Method
Development of an instrument to measure Faculty’s information and communication technology access (FICTA)
Soomro, K. A., Kale, U., Curtis, R., Akcaoğlu, M., & Bernstein, M. (2017) · Education and Information Technologies · doi:10.1007/s10639-017-9599-9 · Cited by 53
Questionnaire-Based Assessment of Executive Functioning: Psychometrics
Castellanos, I., Kronenberger, W., & Pisoni, D. (2016) · Applied neuropsychology. Child · doi:10.1080/21622965.2016.1248557 · Cited by 46
“70 (DeVellis, 2012; DeVon et al., 2007; Hair, Black, Babin, & Anderson, 2010).”
Arabic translation, adaptation and modification of the dialysis symptom index for chronic kidney disease stages four and five
Almutary, H. H., Bonner, A., & Douglas, C. (2015) · BMC Nephrology · doi:10.1186/s12882-015-0036-2 · Cited by 47
“7 is generally accepted to estimate the internal consistency of a new scale [29].”
The De-Escalating Aggressive Behaviour Scale: development and psychometric testing.
Nau, J., Halfens, R., Needham, I., & Dassen, T. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05087.x · Cited by 46
The revised Bristol Rheumatoid Arthritis Fatigue measures and the Rheumatoid Arthritis Impact of Disease scale: validation in six countries
HEWLETT, S. E., Kirwan, J., Bode, C., Cramp, F. L., Carmona, L., Dures, E. K., Englbrecht, M., Fransen, J., Greenwood, R., Hagel, S., et al. (2017) · Lara D. Veeken · doi:10.1093/rheumatology/kex370 · Cited by 53
Chemotherapy-Induced Peripheral Neuropathy Assessment Tools: A Systematic Review
Haryani, H., Fetzer, S. J., Wu, C.-L., & Hsu, Y.-Y. A. (2017) · Oncology nursing forum · doi:10.1188/17.onf.e111-e123 · Cited by 61
“The frames of reference for the psychometric properties are based on the criteria proposed by DeVon et al. (2007) and Peacock and Peacock (2011).”
Method
Validation of a short form of the practice environment scale of the nursing work index: The PES-5
Lake, E. T., Gil, J., Moronski, L. S., Mchugh, M. D., Aiken, L., & Lasater, K. (2024) · Research in Nursing and Health · doi:10.1002/nur.22388 · Cited by 44
“The Cronbach's alphas of 0.81 on average is considered high reliability (DeVon et al., 2007).”
Influential
Stoic beliefs and health: development and preliminary validation of the Pathak-Wieten Stoicism Ideology Scale
Pathak, E. B., Wieten, S. E., & Wheldon, C. W. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015137 · Cited by 44
Assessing the influence of work-life balance dimensions among nurses in the healthcare sector
Poulose, S., & Sudarsan, N. (2017) · Journal of Management Development · doi:10.1108/jmd-12-2015-0188 · Cited by 63
Health Care Students' Attitudes Toward Addressing Sexual Health in Their Future Profession: Validity and Reliability of a Questionnaire
Josefsson, K. A., Juuso, P., Gard, G. E., Rolander, B., & Larsson, A. (2016) · International Journal of Sexual Health · doi:10.1080/19317611.2016.1199453 · Cited by 42
“Internal consistency reliability was analysed with Cronbach’s alpha (DeVon et al., 2007) for the factors with the highest loadings.”
BackgroundMethod
The psychometric properties of cancer multisymptom assessment instruments: a clinical review
Aktaş, A., Walsh, D., & Kirkova, J. (2015) · Supportive Care in Cancer · doi:10.1007/s00520-015-2732-7 · Cited by 45
Measurements in quantitative research: how to select and report on research instruments.
Hagan, T. (2014) · Oncology Nursing Forum · doi:10.1188/14.onf.431-433 · Cited by 44
The Pediatric Vestibular Symptom Questionnaire: A Validation Study
Pavlou, M., Whitney, S., Alkathiry, A. A., Huett, M., LUXON, L. M., Raglan, E., Godfrey, E. L., & Bamiou, D. (2015) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2015.09.075 · Cited by 45
“7 for a new instrument[41, 42] is considered reliable.”
Background
Validating of Knowledge, Attitudes, and Practices Questionnaire for Prevention of COVID-19 infections among Undergraduate Students: A RASCH and Factor Analysis
Fauzi, A., Saefi, M., Kristiana, E., Adi, W. C., Muchson, M., Setiawan, M. E., Islami, N. N., Ningrum, D. E. A. F., Ikhsan, M. A., & Ramadhani, M. (2020) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/9352 · Cited by 46
“Expert validation with CVI values greater than 0.80 indicates that this instrument should be suitable for measuring students’ KAP toward the prevention of COVID-19 (Burns et al., 2008; DeVon et al., 2007).”
BackgroundMethodInfluential
Tools for Assessment of Communication Skills of Hospital Action Teams: A Systematic Review
Rehim, S. A., DeMoor, S., Olmsted, R. W., Dent, D. L., & Parker-Raley, J. (2016) · Journal of surgical education · doi:10.1016/j.jsurg.2016.09.008 · Cited by 41
BCQ: A Body Constitution Questionnaire to Assess Yin-Xu
Lin, J.-D., Chen, L.-L., Lin, J., Chang, C., Huang, Y.-C., & Su, Y. (2012) · Forschende Komplementärmedizin / Research in Complementary Medicine · doi:10.1159/000343580 · Cited by 43
Design and validation of a new Healthcare Systems Usability Scale (HSUS) for clinical decision support systems: a mixed-methods approach
Ghorayeb, A., Darbyshire, J. L., Wronikowska, M. W., & Watkinson, P. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-065323 · Cited by 36
Validation of Standardized Questionnaires Evaluating Symptoms of Depression in Rheumatoid Arthritis Patients: Approaches to Screening for a Frequent Yet Underrated Challenge
Englbrecht, M., Alten, R., Aringer, M., Baerwald, C., Burkhardt, H., Eby, N. L., Fliedner, G., Gauger, B., Henkemeier, U., Hofmann, M. W., et al. (2016) · Arthritis Care & Research · doi:10.1002/acr.23002 · Cited by 43
“70, the recommended reliability of a test (39,40).”
Background
A confiabilidade no desenvolvimento e avaliação de instrumentos de medida na área da saúde
Alexandre, N. M. C., Gallasch, C. H., Lima, M. H. M., & Rodrigues, R. C. M. (2013) · Revista Eletrônica de Enfermagem · doi:10.5216/ree.v15i3.20776 · Cited by 37
“Por medir as respostas dos sujeitos da pesquisa em curso, deve ser verificada cada vez que o instrumento for utilizado((25)).”
BackgroundMethodInfluential
A Reliability and Validity Study of the Bergen Shift Work Sleep Questionnaire in Nurses Working Three-Shift Rotations
Flo, E., Bjorvatn, B., Folkard, S., Moen, B. E., Grønli, J., Nordhus, I. H., & Pallesen, S. (2012) · Chronobiology International · doi:10.3109/07420528.2012.699120 · Cited by 51
“It is essential that a questionnaire of this type be based on a theoretical framework and properly validated (DeVon et al., 2007; Rattray & Jones, 2007).”
Method
Validation of the Chinese version of the Perceived Stress Scale-10 integrating exploratory graph analysis and confirmatory factor analysis
Jiang, C., Ma, H., Luo, Y., Fong, D., Umucu, E., Zheng, H., Zhang, Q., Liu, X., Liu, X., Spruyt, K., et al. (2023) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2023.07.008 · Cited by 41
Translation and Validation of the System Usability Scale in a Danish Mental Health Setting Using Digital Technologies in Treatment Interventions
Hvidt, J. C. S., Christensen, L. F., Sibbersen, C., Helweg-Jørgensen, S., Hansen, J. P., & Lichtenstein, M. B. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1680922 · Cited by 43
“According to the recommendations (DeVon et al., 2007; Nunnally & Bernstein, 1994), a Chronbach ’ s alpha between 0.7 – 0.9 is considered to reflect good internal consistency of an assessment tool.”
MethodInfluential
Measuring early childhood development in Brazil: validation of the Caregiver Reported Early Development Instruments (CREDI)
Altafim, E., McCoy, D., Brentani, A., Escobar, A. M. D. U., Grisi, S., & Fink, G. (2018) · Jornal de Pediatria · doi:10.1016/j.jped.2018.07.008 · Cited by 40
“Renda relativa autorrelatada (1-100) -0,002 -0,00290”
Validation of a Survey Questionnaire on Organ Donation: An Arabic World Scenario
Singh, R., Agarwal, T., Al-Thani, H., Maslamani, Y. A., & El-Menyar, A. (2018) · Journal of Transplantation · doi:10.1155/2018/9309486 · Cited by 40
“Each domain score in the form of index variable at pre- and postlevel was also calculated using intraclass correlation [22].”
Method
Psychometric Evaluation of the Physical Activity Enjoyment Scale in Adults with Functional Limitations
Murrock, C. J., Bekhet, A. K., & Zauszniewski, J. A. (2016) · Issues in Mental Health Nursing · doi:10.3109/01612840.2015.1088904 · Cited by 44
“An exploratory factor analysis (EFA) using principal components analysis with varimax rotation was conducted to explore underlying factors present in the PACES that were specific to the sample of adults with functional limitations (DeVon et al., 2007).”
BackgroundMethodInfluential
Psychometric properties of the J efferson S cale of E mpathy‐ H ealth P rofessional S tudent's version: An I talian validation study with nursing students
Montanari, P., Petrucci, C., Russo, S., Murray, I., Dimonte, V., & Lancia, L. (2015) · Nursing and Health Sciences · doi:10.1111/nhs.12221 · Cited by 41
“Two weeks to one month is the generally accepted time for retesting (DeVon et al., 2007).”
Background
Measurement error and reliability testing: Application to rehabilitation
Bialocerkowski, A. E., & Bragge, P. (2008) · International Journal of Therapy and Rehabilitation · doi:10.12968/ijtr.2008.15.10.31210 · Cited by 42
Edinburgh Feeding Evaluation in Dementia (EdFED) scale: cross-cultural validation of the Chinese version.
Lin, L.-C., Watson, R., Lee, Y.-C., Chou, Y.-C., & Wu, S.-C. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2008.04596.x · Cited by 40
“…variables to provide an interpretive framework for data on the relationships among observable variables such as malnutrition; these analyses would offer insight into the convergent and criterion validity of the scale, which fall under the broad heading of construct validity (DeVon et al. 2007).”
BackgroundMethod
Teachers’ professional identity: validation of an assessment instrument for preservice teachers
Gracia, E. P., Rodríguez, R. S., Pedrajas, A. P., & Carpio, A. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e08049 · Cited by 39
Social networking sites usage & needs scale (SNSUN): a new instrument for measuring social networking sites’ usage patterns and needs
Ali, I., Danaee, M., & Firdaus, A. (2019) · Journal of Information and Telecommunication · doi:10.1080/24751839.2019.1675461 · Cited by 39
Online Buyers and Open Innovation: Security, Experience, and Satisfaction
Valdez-Juárez, L. E., Gallardo‐Vázquez, D., & Ramos-Escobar, E. A. (2021) · Journal of Open Innovation Technology Market and Complexity · doi:10.3390/joitmc7010037 · Cited by 69
“Through the content validity index, the group of experts evaluated each of the items of the different dimensions on a scale from 1 to 5, where 1 indicated not very relevant and 5 indicated very relevant [101].”
Method
Measures of evidence-informed decision-making competence attributes: a psychometric systematic review
Belita, E., Squires, J. E., Yost, J., Ganann, R., Burnett, T., & Dobbins, M. (2020) · BMC Nursing · doi:10.1186/s12912-020-00436-8 · Cited by 53
“Cronbach’s alpha is a commonly used statistic in psychometric research perhaps due to its ease of calculation as it can be computed with a one-time administration [156].”
Method
The Effects of Spirituality and Moral Intensity on Ethical Business Decisions: A Cross-Sectional Study
Anderson, S. E., & Burchell, J. (2019) · Journal of Business Ethics · doi:10.1007/s10551-019-04258-w · Cited by 56
Development and psychometric testing of the nursing student mentors' competence instrument (MCI): A cross-sectional study.
Tuomikoski, A., Ruotsalainen, H., Mikkonen, K., Miettunen, J., & Kääriäinen, M. (2018) · Nurse Education Today · doi:10.1016/j.nedt.2018.05.028 · Cited by 38
A comparison of palliative care outcome measures used to assess the quality of palliative care provided in long-term care facilities: a systematic review
Parker, D., & Hodgkinson, B. (2011) · Palliative Medicine · doi:10.1177/0269216310378786 · Cited by 38
Measuring the Quality of End-of-Life Care
Engelberg, R. A., Downey, L., Wenrich, M. D., Carline, J. D., Silvestri, G. A., Dotolo, D. G., Nielsen, E. L., & Curtis, J. R. (2010) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2009.11.313 · Cited by 64
“80, a value that exceeds standards used to support scale development.(43,44) In addition to the models where parameters were freely estimated (designated as ‘‘Model 1’’ for each sample), we evaluated models based on the same indicators as the corresponding Model 1, but with factor loadings constrained to 1.”
Method
Use of the Worklife and Levels of Burnout Surveys to Assess the School Nurse Work Environment
Jameson, B. E., & Bowen, F. (2018) · The Journal of School Nursing · doi:10.1177/1059840518813697 · Cited by 38
“In this study sample, coefficient as for the MBI-HSS and AWS subscales ranged from .71 to .92, more than the established threshold of .70 (DeVon et al., 2007).”
Method
Leveraging business-IT alignment through enterprise architecture—an empirical study to estimate the extents
Alaeddini, M., Asgari, H., Gharibi, A., & Rashidirad, M. (2016) · Information Technology and Management · doi:10.1007/s10799-016-0256-6 · Cited by 34
“Criterion validity refers to the evidence of a relationship among the attributes in a measurement tool with its performance on some other variables [113] and refers to this question, ‘How much were attributes in the tool related to the performance on criteria?’”
BackgroundMethod
Towards Sustainable Knowledge Sharing Practices: An Analysis of Organizational Level Enablers
Cormican, K. T., Chen, M., Sampaio, S. C. D. B., & Wu, Q. (2021) · Sustainability · doi:10.3390/su132312934 · Cited by 39
The 12 items Amharic version WHODAS-2 showed cultural adaptation and used to measure disability among road traffic trauma victims in Ethiopia
Denu, Z. A., Yassin, M. O., Bisetegn, T. A., Biks, G. A., & Gelaye, K. A. (2021) · BMC Psychology · doi:10.1186/s40359-020-00492-4 · Cited by 39
Validity and Reliability of the Flourishing Scale in a Sample of Older Adults in Iran
Ramandi, Z. F., Soleimani, M. A., Allen, K., Görgülü, Ö., & Motalebi, S. A. (2020) · Clinical Interventions in Aging · doi:10.2147/cia.s251067 · Cited by 39
Development and validation of the Family Resilience (FaRE) Questionnaire: an observational study in Italy
Faccio, F., Gandini, S., Renzi, C., Fioretti, C., Crico, C., & Pravettoni, G. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024670 · Cited by 41
Validation of the French Version of the Child and Adolescent Mindfulness Measure (CAMM) Among Samples of French and Indigenous Youth
Dion, J., Paquette, L., Daigneault, I., Godbout, N., & Hébert, M. (2017) · Mindfulness · doi:10.1007/s12671-017-0807-x · Cited by 44
“The contrasted groups approach was used (i.e., comparing child sexual abuse victims to non-victims) as another way of measuring construct validity (DeVon et al. 2007).”
Method
Stigma Scale for Receiving Psychological Help (SSRPH)
Pinto, M. D., Hickman, R. L., & Thomas, T. L. (2014) · Western Journal of Nursing Research · doi:10.1177/0193945914543954 · Cited by 31
“To support concurrent validity, the correlation between the SSRPH and modified r-AQ was expected to be positive and ≥.45 (DeVon et al., 2007).”
Method
Preparedness for students and staff with anaphylaxis.
Morris, P., Baker, D., Belot, C., & Edwards, A. (2011) · Journal of School Health · doi:10.1111/j.1746-1561.2011.00616.x · Cited by 36
Adapting the Individualized Care Scale for cross-cultural comparison.
Suhonen, R., Berg, A., Idvall, E., Kalafati, M., Katajisto, J., Land, L., Lemonidou, C., Schmidt, L., Välimäki, M., & Leino-Kilpi, H. (2010) · Scandinavian Journal of Caring Sciences · doi:10.1111/j.1471-6712.2009.00712.x · Cited by 36
Formative assessment in higher education: an exploratory study within programs for professionals in education
Parmigiani, D., Nicchia, E., Murgia, E., & Ingersoll, M. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1366215 · Cited by 80
Exploring the best policy scenario plan for the dairy supply chain: a DEMATEL approach
Susanty, A., Puspitasari, N., Prastawa, H., & Renaldi, S. (2020) · doi:10.1108/jm2-08-2019-0185 · Cited by 35
Development and Validation of a Questionnaire to Measure Attitude change in Health Professionals after Completion of an Aboriginal Health and Cultural Safety Training Programme
Ryder, C., Mackean, T., Ullah, S., Burton, H., Halls, H., McDermott, D., & Edmondson, W. (2019) · The Australian Journal of Indigenous Education · doi:10.1017/jie.2017.37 · Cited by 35
“A three-point Likert scale similar to Lawshe’s was utilised for content experts to report on each question (DeVon et al., 2009).”
Method
Anatomy education environment measurement inventory: A valid tool to measure the anatomy learning environment
Hadie, S. N. H., Hassan, A., Ismail, Z. I. M., Asari, M. A., Khan, A. A., Kasim, F., Yusof, N. A. M., Sulong, H. A. M., Muda, T. F. M. T., Arifin, W. N., et al. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1683 · Cited by 42
“By measuring the clarity of language used in the inventory, any conflicting perceptions between developers and users concerning the items’ structure were eliminated (DeVon et al., 2007).”
Method
Management of Central Venous Access Device-Associated Skin Impairment
Broadhurst, D., Moureau, N., & Ullman, A. J. (2017) · Journal of Wound Ostomy and Continence Nursing · doi:10.1097/won.0000000000000322 · Cited by 76
Validity and reliability assessment of the Brazilian version of the game addiction scale (GAS)
Lemos, I. L., Cardoso, A., & Sougey, É. B. (2016) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2016.01.014 · Cited by 31
“The test–retest reliability was estimated by administering the survey to the same population on two separate occasions, assuming no substantial changes in the construct between the two assessments [23,24].”
Method
Development and validation of an instrument to assess the knowledge and perceptions of predatory journals
Marar, S. D., Hamza, M. A., Ayyash, M., & Abu-Shaheen, A. K. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e22270 · Cited by 45
“The S-CVI is the average I-CVI, calculated by summing I-CVIs and dividing it by the number of items in each scale [27,28,30].”
Validation of the rabbit pain behaviour scale (RPBS) to assess acute postoperative pain in rabbits (Oryctolagus cuniculus)
Pinho, R. H., Luna, S. P. L., Trindade, P. H. E., Justo, A. A., Cima, D. S., Fonseca, M. W., Minto, B. W., Rocha, F. D. L., Miller, A. L., Flecknell, P. A., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268973 · Cited by 44
Adaptación, validez de constructo y confiabilidad de la escala de riesgo suicida Plutchik en adolescentes colombianos
Yuly, S.-C., Sañudo, J. P., Caballero-Domínguez, C. C., & Pineda-Roa, C. A. (2019) · doi:10.14349/rlp.2019.v51.n3.1 · Cited by 34
“La validez discriminante permite establecer la relación entre las puntuaciones del test y variables externas (Oren, Kennet, Turvall, & Allalouf, 2014), para demostrar que la prueba diferencia entre subgrupos de participantes (Devon et al., 2007).”
Background
Development and Testing of the Nurse Manager EBP Competency Scale
Shuman, C. J., Ploutz-Snyder, R. J., & Titler, M. G. (2017) · Western Journal of Nursing Research · doi:10.1177/0193945917728249 · Cited by 40
“Construct validity is concerned with the degree to which an instrument accurately measures a theoretical construct (DeVon et al., 2007).”
Background
Validity and Reliability of the Persian Version of the Maslach Burnout Inventory (General Survey Version) in Iranian Population
Shamloo, Z. S., Hashemian, S., Khoshsima, H., Shahverdi, A., Khodadost, M., & Gharavi, M. (2017) · Iranian Journal of Psychiatry and Behavioral Sciences · doi:10.5812/ijpbs.8168 · Cited by 34
“CVI was calculated by determining the mean CVR for all the remaining items (21).”
Method
Translation and validation of the Dutch version of the Fear of Cancer Recurrence Inventory (FCRI-NL)
van Helmondt, S. J., van der Lee, M. L., & de Vries, J. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.09.001 · Cited by 31
Body Dysmorphic Symptoms Scale for patients seeking esthetic surgery: cross-cultural validation study
Ramos, T. D., de Brito, M. J. A., Piccolo, M. S., Rosella, M. F. N. D. S. M., Neto, M. S., & Ferreira, L. M. (2016) · Sao Paulo Medical Journal · doi:10.1590/1516-3180.2016.0068160416 · Cited by 38
“30,33 Our hypothesis was that preoccupation with physical”
BackgroundMethodInfluential
Fidelity of Intervention Implementation: A Review of Instruments
Ibrahim, S., & Sidani, S. (2015) · Health · doi:10.4236/health.2015.712183 · Cited by 38
“Reliability demonstrated the ability of an instrument to yield consistent and reproducible results [18] [19].”
Mental health self-management questionnaire: Development and psychometric properties
Coulombe, S., Radziszewski, S., Trépanier, S., Provencher, H. L., Roberge, P., Hudon, C., Meunier, S., Provencher, M. D., & Houle, J. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.04.007 · Cited by 35
An Integrative Review of Self-efficacy Measurement Instruments in Youth With Type 1 Diabetes
Rasbach, L. E., Jenkins, C. M., & Laffel, L. M. (2014) · The Science of Diabetes Self-Management and Care · doi:10.1177/0145721714550254 · Cited by 35
“Most instruments measuring self-efficacy demonstrated internal consistency, a form of equivalence reliability, indicating the items within the instrument conceptually fit with one another.(65) However, it is important to consider that the internal consistency may vary based on the number of response options used in th…”
BackgroundMethodInfluential
Self-Rating Scale of Self-Directed Learning (SRSSDL): preliminary results from the Italian validation process
Cadorin, L., Suter, N., Saiani, L., Williamson, S. N., & Palese, A. (2011) · doi:10.1177/1744987110379790 · Cited by 33
“The time considered adequate between the first and second survey was at least two weeks (Fain, 2004; LoBiondo-Wood and Haber, 2004; De Von et al., 2007).”
Background

Authors: DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas‐Polston, E.
Affiliations: Purdue University Northwest (US)
Corresponding author: DeVon, Holli A.
Block, Michelle E.
Moyle‐Wright, Patricia
Ernst, Diane M.
Hayden, Susan J.
Lazzara, Deborah J.
Savoy, Suzanne M.
ORCID: DeVon, Holli A.
Venue: Journal of Nursing Scholarship
Publisher: Wiley
Published: 2007-05-23
Volume: 39
Issue: 2
Pages: 155-164
ISSN: 0363-2792 (ISSN-L)
1527-6546
1547-5069
DOI: 10.1111/j.1547-5069.2007.00161.x
OpenAlex: W2162602057
Cited by: 1,889
References: 0
Citations by year: 2026: 87 · 2025: 128 · 2024: 186 · 2023: 176 · 2022: 148 · 2021: 163 · 2020: 145 · 2019: 144 · 2018: 131 · 2017: 113 · 2016: 96 · 2015: 105 · 2014: 83 · 2013: 51 · 2012: 40
FWCI: 15.03
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Journal of Nursing Scholarship (publishedVersion)
PubMed (publishedVersion)
ePublications at Regis University (Regis University) (submittedVersion)
Topics: Health Sciences › Nursing › Research and Theory › Health Education and Validation
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: psychometric properties, reliability statistics, validity, content validity, criterion validity, construct validity, internal consistency, test-retest reliability, measurement error, nursing equipment, nursing research
MeSH terms: Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Mathematics, Periodicals as Topic, Planning Techniques, Predictive Value of Tests, Psychometrics, Research Design, Time Factors, Reproducibility of Results, Nursing Research, Bias, Discriminant Analysis, Guidelines as Topic, Peer Review, Research, Statistics, Nonparametric, Editorial Policies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A Psychometric Toolbox for Testing Validity and Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Metadata

Record

About these checks