Cited by 1,889Health Education and ValidationPsychometric Methodologies and TestingReliability and Agreement in Measurement

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

A Psychometric Toolbox for Testing Validity and Reliability

DeVon, Holli A., Block, Michelle E., Moyle‐Wright, Patricia, Ernst, Diane M., Hayden, Susan J., Lazzara, Deborah J., Savoy, Suzanne M., Kostas‐Polston, Elizabeth·2007·Journal of Nursing Scholarship

DOI 10.1111/j.1547-5069.2007.00161.x

Open this paper in CoChat — free account

Abstract

Purpose To review the concepts of reliability and validity, provide examples of how the concepts have been used in nursing research, provide guidance for improving the psychometric soundness of instruments, and report suggestions from editors of nursing journals for incorporating psychometric data into manuscripts. Methods CINAHL, MEDLINE, and PsycINFO databases were searched using key words: validity, reliability, and psychometrics. Nursing research articles were eligible for inclusion if they were published in the last 5 years, quantitative methods were used, and statistical evidence of psychometric properties were reported. Reports of strong psychometric properties of instruments were identified as well as those with little supporting evidence of psychometric soundness. Findings Reports frequently indicated content validity but sometimes the studies had fewer than five experts for review. Criterion validity was rarely reported and errors in the measurement of the criterion were identified. Construct validity remains underreported. Most reports indicated internal consistency reliability (alpha) but few reports included reliability testing for stability. When retest reliability was asserted, time intervals and correlations were frequently not included. Conclusions Planning for psychometric testing through design and reducing nonrandom error in measurement will add to the reliability and validity of instruments and increase the strength of study findings. Underreporting of va…

Integrity signals

Registry

Crossref · 10.1111/j.1547-5069.2007.00161.x

Cites

0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
The content validity index: Are you sure you know what's being reported? Critique and recommendations
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 2×
“The published literature, including texts and research articles, include extensive definitions of validity and reliability, though many pertain to comprehensive exploration of a single psychometric concept (Polit & Beck, 2006).”
BackgroundMethod
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Advanced Design in Nursing Research
Brink, P., & Wood, M. (1998) · doi:10.4135/9781452204840 · Cited by 433

Show all 0 references

Research works printed but not linked: 25

10.1097/00006199-200609000-00007 · DOI
10.1136/bmj.314.7080.572 · DOI · Paper page
DiCenso A., 2005, Evidence‐based nursing, 432
DeVellis R.F., 2003, Scale development: Theory and application
10.1097/00008483-200303000-00010 · DOI
10.1002/nur.4770130612 · DOI
10.1097/00006199-200507000-00009 · DOI
10.1080/074811801750058609 · DOI
10.1023/A:1025809921592 · DOI
Hulley S.B., 2001, Designing clinical research: An epidemiologic approach
10.1177/0193945905284726 · DOI
10.1097/00006199-198611000-00017 · DOI · Paper page
10.1081/CNV-120005902 · DOI
Munro B.H., 2005, Statistical methods for health care research
10.4135/9781412985772 · DOI
10.1097/00024665-200211000-00013 · DOI
Nunnally J.C., 1994, Psychometric theory
10.1097/00008483-200311000-00008 · DOI
10.1891/jnum.2005.13.2.147 · DOI
Polit D.F., 2004, Nursing research: Principles and methods
10.1111/j.1547-5069.2005.00061.x · DOI
Schultz K.S., 2005, Measurement theory in action
10.1097/00006199-200511000-00008 · DOI
Trochim W.M.K., 2001, The research methods knowledge base
Waltz C.F., 2005, Measurement in nursing and health research

Sorted by citations

Items 601–700 of 1,000

Instrument Development Based on Content Analysis
Kääriäinen, M., Mikkonen, K., & Kyngäs, H. A. (2019) · Springer eBooks · doi:10.1007/978-3-030-30199-6_8 · Cited by 14
Assessing the Effectiveness of the Internationalization Process in Higher Education Institutions: A Case Study of Florida International University
Iuspa, F. (2010) · doi:10.25148/etd.fi10120304 · Cited by 11
“Overall, FIU’s development and support of international activities remain a onesided effort, with faculty and Colleges/Schools engaging in international activities - from study abroad programs, offshore programs, to faculty research abroad - as funding permits. The study done by Van Dijk and Meijer (1997) on the inter…”
BackgroundInfluential
The validity and reliability of the Turkish version of the Rheumatoid and Arthritis Outcome Score (RAOS) in patients with rheumatoid arthritis
Karatepe, A. G., Günaydın, R., Türkmen, G., Kaya, T., & Özbek, G. (2008) · Clinical Rheumatology · doi:10.1007/s10067-008-0981-2 · Cited by 11
“7 is generally regarded as satisfactory [14].”
Understanding skill acquisition among registered nurses: the ‘perpetual novice’ phenomenon
Wilson, B., Harwood, L., & Oudshoorn, A. (2015) · Journal of Clinical Nursing · doi:10.1111/jocn.12978 · Cited by 10
“Questions were derived from the two previous studies on the topic (Wilson et al. 2010, 2013), thus contributing to both content and face validity (DeVon et al. 2007).”
BackgroundMethod
Behavioural and innovative traits driving digital transformation and competitive advantage: the role of entrepreneurship orientation
Salem, I. E., Elbaz, A. M., Magdy, A., Hassan, H. M., & Awain, A. M. S. B. (2025) · Asia-Pacific Journal of Business Administration · doi:10.1108/apjba-03-2025-0231 · Cited by 9
Evaluating the psychometric properties of three WHO instruments to assess knowledge about human rights, attitudes toward persons with mental health conditions and psychosocial disabilities, and practices related to substitute decision-making and coercion in mental health
Moro, M. F., Gyimah, L., Susser, E., Ansong, J., Kane, J. C., Amissah, C., Gureje, O., Osei, A. O., Pala, A. N., Taylor, D., et al. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1435608 · Cited by 10
“…said to have content validity when its development includes a review of existing data and literature, and an independent panel of experts in the subject matter under investigation (usually seven or more) con ﬁ rms that the instrument items are relevant and re ﬂ ect the domain of interest (51, 52).”
Background
Development of an entrepreneurship model using the design thinking approach and emotional intelligence for sustainable wellness among the young generation
Menon, R. B., Avadhani, V. D., Menon, P. B., & Das, D. (2023) · Cogent Business & Management · doi:10.1080/23311975.2023.2271243 · Cited by 17
“The entire constructs of EI, design thinking, and entrepreneurial attitude have composite reliability of more than 0.7 among students, indicating that dependability is well established (De Von et al., 2007).”
BackgroundInfluential
Assessing the development of global competence in teacher education programmes: internal consistency and reliability of a set of rubrics
Parmigiani, D., Nir, A. B., Ferguson‐Patrick, K., Forkosh‐Baruch, A., Heddy, E., Impedovo, M. A., Ingersoll, M., Jones, M. M., Kimhi, Y., Lourenço, M., et al. (2023) · Higher Education Pedagogies · doi:10.1080/23752696.2023.2216190 · Cited by 13
“This second case is suitable for the constructs related with GC. Ultimately, DeVon et al. (2007) indicated studies where the average inter-item correlation was considered appropriate with scores between .30 and .70, but the values generated by the GC set of rubrics met the more stringent standards…”
Method
Correlates of sedentary behavior in people with fibromyalgia: A systematic review
Vancampfort, D., Brunner, E., McGrath, R. L., Hemmings, L., & Damme, T. V. (2023) · International Journal of Rheumatic Diseases · doi:10.1111/1756-185x.14678 · Cited by 12
“Employment status (having productive work) (25) F; (30) F 0 0% (0/2)”
Psychometric validation of a chinese version of COVID-19 vaccine hesitancy scale: a cross-sectional study
Huang, Y., Wu, Y., Dai, Z., Xiao, W., Wang, H., Si, M., Wang, W., Gu, X., Ma, L., Li, L., et al. (2022) · BMC Infectious Diseases · doi:10.1186/s12879-022-07746-z · Cited by 10
Factorial validity and measurement invariance of the psychological need satisfaction in exercise scale across gender
Sabo, A., Kueh, Y. C., Musa, R. M., Lu, F. J.-H., & Kuan, G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0269155 · Cited by 13
Development and validation of a multidimensional, culturally and socially inclusive Child Resilience Questionnaire (parent/caregiver report) to measure factors that support resilience: a community-based participatory research and psychometric testing study in Australia
Gartland, D., Riggs, E., Giallo, R., Glover, K., Stowe, M., Mongta, S., Weetra, D., & Brown, S. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061129 · Cited by 10
Revisiting media literacy measurement: Development and validation of 3‐factor media literacy scale
Arshad, A., Ghazal, S., Saleem, N., Hanan, M. A., & Arshad, M. H. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12682 · Cited by 13
Validation and Revision of the Household Emergency Preparedness Instrument (HEPI) by a Pilot Study in the City University of New York
Heagele, T. N., Adams, L. M., McNeill, C., & Alfred, D. M. (2022) · Disaster Medicine and Public Health Preparedness · doi:10.1017/dmp.2022.35 · Cited by 12
Psychometric properties of the Arabic version of the medical outcomes study social support survey in cancer survivors post-HSCT
Alaloul, F., Hall, L., Aburuz, M., & Abusalem, S. K. (2021) · Mental Health, Religion & Culture · doi:10.1080/13674676.2020.1849081 · Cited by 10
“Theywere asked to review the translatedArabic version and comment on its appearance, clarity, and consistency (DeVon et al., 2007).”
Background
Confirmatory Factor Analysis and Validity of the Sexual Harassment Scale in Football Refereeing
Gómez, J. S., Reyes, S. S., Castillo, E., & Nuviala, A. N. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041374 · Cited by 12
Knowledge of patient observation among critical care nurses
Alastalo, M., Salminen, L., Vahlberg, T. J., & Leino‐Kilpi, H. (2020) · Nursing in Critical Care · doi:10.1111/nicc.12573 · Cited by 10
“The content validity index for the whole knowledge test (S-CVI) was 0.93, representing excellent content validity [38].”
Influential
임상간호사의 윤리적 간호역량 자가평가 도구 개발
보라, 강., & 희영, 오. (2020) · Korean Journal of Adult Nursing · doi:10.7475/kjan.2020.32.5.482 · Cited by 10
The Summary of an Urdu Version of Diabetes Self-Care Activities Measure: Psychometric Evaluation and Validation
Ansari, R. M., Harris, M., Hosseinzadeh, H., & Zwar, N. (2020) · Journal of Primary Care & Community Health · doi:10.1177/2150132720935292 · Cited by 10
Value of Performing a Rasch Analysis on a Reliable and Valid Instrument—Case Study of the SA-SH
Josefsson, K. A., & Rolander, B. (2020) · Journal of Nursing Measurement · doi:10.1891/jnm-d-18-00106 · Cited by 12
“Keywords : nursing ; psychometrics; Rasch analysis; sexual health; validity I n the development and translation of instruments to measure outcomes in healthcare, it is important to ensure that the instruments are psychometrically sound (Boone, 2016; DeVon et al., 2007).”
BackgroundInfluential
Development of the IcanSDM scale to assess primary care clinicians’ ability to adopt shared decision-makingPreprint
Giguere, A. M. C., Bogza, L.-M., Coudert, L., Carmichael, P., Renaud, J., Légaré, F., Lindig, A., & Voyer, P. (2020) · medRxiv · doi:10.1101/2020.07.01.20144204 · Cited by 8
Development and Validation of a Uremic Pruritus Treatment Algorithm and Patient Information Toolkit in Patients with Chronic Kidney Disease (CKD) and End Stage Kidney Disease (ESKD).
Ragazzo, J., Cesta, A., Jassal, S., Chiang, N., & Battistella, M. (2020) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2019.10.003 · Cited by 10
Cross-cultural adaptation and validation of the Back Beliefs Questionnaire to the Turkish language
Karaman, Ç. A., & Küçükakkaş, O. (2019) · Disability and Rehabilitation · doi:10.1080/09638288.2019.1677788 · Cited by 11
Development and Psychometric Evaluation of an Instrument to Measure the Use of Intuition in Clinical Practice by Critical Care Nurses
Hassani, P., Abdi, A., Jalali, R., & Salari, N. (2018) · Journal of Nursing Measurement · doi:10.1891/1061-3749.26.3.e142 · Cited by 3
“The stability is related to an attribute with no change expected during a period of time, which the researchers suggest between 2 weeks and 1 month (DeVon et al., 2007; Waltz et al., 2010).”
Psychometric Validation of the Czech Version of the Quality of Life – Alzheimer’s Disease Scale in Patients with Early-Stage Dementia
Kisvetrová, H., Školoudík, D., Herzig, R., Vališ, M., Jurašková, B., Krulová, P., Langová, K., Bermellová, J., & Yamada, Y. (2018) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000492490 · Cited by 15
Assessment of metacognitive beliefs in an at risk mental state for psychosis: A validation study of the Metacognitions Questionnaire‐30
Bright, M., Parker, S., French, P., Morrison, A. P., Tully, S., Stewart, S., & Adrian Wells, A. (2018) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2301 · Cited by 14
“To examine convergent and discriminant validity, correlations with related measures are useful (DeVon et al., 2007).”
Background
Comfort‐Supporting Nursing Activities for End‐of‐Life Patients in an Institutionalized Environment
Kisvetrová, H., Vévodová, Š., & Školoudík, D. (2018) · Journal of Nursing Scholarship · doi:10.1111/jnu.12341 · Cited by 10
First evaluation of the Behavioral Addiction Indoor Tanning Screener ( BAITS ) in a nationwide representative sample
Diehl, K., Görig, T., Breitbart, E. W., Greinert, R., Hillhouse, J., Stapleton, J. L., & Schneider, S. O. (2017) · British Journal of Dermatology · doi:10.1111/bjd.15888 · Cited by 10
Empathy deficits and adolescent sexual offending: A systematic review of the evidence base
Baly, A., & Butler, S. (2017) · Aggression and Violent Behavior · doi:10.1016/j.avb.2017.07.007 · Cited by 9
Preliminary reliability and internal consistency of the Wheelchair Components Questionnaire for Condition
Rispin, K. L., Dittmer, M., McLean, J., & Wee, J. (2017) · Disability and Rehabilitation: Assistive Technology · doi:10.1080/17483107.2016.1277793 · Cited by 10
“If researchers are doing a preliminary study to see which questions to retain, ICC can also be used to compare the two iterations for each rater [23,27].”
BackgroundMethod
Development of a Home Food Safety Questionnaire Based on the PRECEDE Model: Targeting Iranian Women
Esfarjani, F., Hosseini, H., Mohammadi‐Nasrabadi, F., Abadi, A., Roustaee, R., Alikhanian, H., Khalafi, M., Kiaee, M. F., & Khaksar, R. (2016) · Journal of Food Protection · doi:10.4315/0362-028x.jfp-16-029 · Cited by 7
“It is the easiest validation process to undertake; however, it is the weakest form of validity (13).”
BackgroundMethod
Translation, adaptation and psychometric testing of a tool for measuring nurses’ attitudes towards research in Indonesian primary health care
Rachmawati, K., Schultz, T., & Cusack, L. (2016) · Nursing Open · doi:10.1002/nop2.72 · Cited by 9
“Construct validity testing was conducted using factor analysis and homogeneity reliability testing was conducted using Cronbach’s alpha coefficient (Devon et al., 2007; Gillespie & Chaboyer, 2013).”
BackgroundMethodInfluential
Development and Preliminary Validation of Diabetes Adjustment Assessment Scale (DAAS): a New Measure of Adjustment with Type 2 Diabetes
Ebrahimi, H., Moonaghi, H. K., Jafarabadi, M. A., Areshtanab, H. N., & Jouybari, L. M. (2016) · Journal of Caring Sciences · doi:10.15171/jcs.2016.015 · Cited by 9
Assessing the Value of Inductive and Deductive Outcome Measures in Community-Based Programs: Lessons from the City Kidz Evaluation
Janzen, R., Nguyen, N., Stobbe, A., & Araujo, L. (2015) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.30.1.41 · Cited by 5
“Content validity could also have been determined by having steering committee members quantitatively rate whether each survey item was an appropriate indicator of its respective construct during the draft ing of the survey tool ( DeVon et al., 2007 ).”
BackgroundInfluential
Translation, cross-cultural adaptation, and reliability, of the Italian version of the Passive Risk Taking (PRT) Scale
Riva, S., Gorini, A., Cutica, I., Mazzocco, K., & Pravettoni, G. (2015) · Judgment and Decision Making · doi:10.1017/s193029750000704x · Cited by 8
“Internal consistency was computed with the intent both to measure the inter-item correlations within the scale and to specify how well the items fit together theoretically (Nunnally & Bernstein 1994; DeVon et al., 2007).”
BackgroundMethodInfluential
Protocol for the design of an instrument to measure preadolescent children's self-report of covert aggression and bullying
Nelson, H. J., Kendall, G. E., Burns, S. K., & Schonert-Reichl, K. A. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009084 · Cited by 10
“For content validity, a minimum of seven experts will be consulted.(71) The Content Validity Index(72) will be used to rate item relevance and clarity and the”
Method
Translation, validation and psychometric properties of Bahasa Malaysia version of the Perception of Anticoagulant Therapy Questionnaire (PACTQ)
Mohamed, S., Razak, T., & Hashim, R. (2015) · doi:10.15272/ajbps.v5i48.730 · Cited by 10
Psychometric testing of the Revised Humane Caring Scale for adult patients in S ingapore
Goh, M. L., Ang, E. N. K., Chan, Y., He, H. G., & Vehviläinen-Julkunen, K. M. (2015) · Nursing and Health Sciences · doi:10.1111/nhs.12199 · Cited by 11
Trans-adapted, reliability, and validity of children fear survey schedule-dental subscale in Bahasa Indonesia
Suzy, A., Amriwijaya, J., & Fitriana, E. (2015) · doi:10.20473/j.djmkg.v48.i1.p1-6 · Cited by 10
Assessment of Quality of Life of People who Stutter: A Cross-sectional Study
Bajaj, G., Varghese, A. L., Bhat, J. S., & Deepthi, J. (2014) · Rehabilitation Process and Outcome · doi:10.4137/rpo.s19058 · Cited by 10
An integrative review: application of self-efficacy instruments for walking in populations with peripheral arterial disease.
Caldieraro-Bentley, A. J., & Andrews, J. (2013) · Journal of Vascular Nursing · doi:10.1016/j.jvn.2013.01.002 · Cited by 10
[Measurement properties of self-report questionnaires published in Korean nursing journals].
Lee, E.-H., Kim, C.-J., Kim, E. J., Chae, H., & Cho, S. (2013) · Journal of Korean Academy of Nursing · doi:10.4040/jkan.2013.43.1.50 · Cited by 10
“국내 에서 측정도구에 대한 논문은 1980년 후반부터 시작하여 1990년 후 반을 기점으로 편수가 증가하여 2010년에는 22편의 논문이 게재된 것으로 나타났 다. 국외에서도 이와 유사하게 측정도구의 심리계량 적 속성의 중요성이 증가하면서 5년간 간호학 술지에 게재된 논문 들의 심리계량적 속성을 분석하여 측정도구의 신뢰도와 타당도 검 증을 위한 심리계량적 지침을 제시하고 있다(DeVon et al., 2007).”
Influential
Chronic kidney disease stressors influence choice of dialysis modality
Harwood, L., Wilson, B. M., Sontrop, J. M., & Clark, A. M. (2012) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2012.05943.x · Cited by 11
Development and Initial Psychometric Evaluation of Nurses' Ethical Decision Making Around End-of-Life-Care Scale in Korea
Kim, S. (2011) · Journal of Hospice and Palliative Nursing · doi:10.1097/njh.0b013e31820611a4 · Cited by 10
“89, which are sufficient to establish reliability.(33) Regarding the contents of this instrument, the content validity was established through the I-CVI and achieved .”
Background
Empirical Analysis of Factors Contributing to Smartphone Addiction
Meena, M. E., Kang, S. G., Nguchu, B. A., Milly, N., Makwetta, J. J., & Fomude, A. H. (2021) · Open Journal of Business and Management · doi:10.4236/ojbm.2021.91012 · Cited by 17
“Several researchers such as (Adamson & Prion, 2013; Devon et al., 2007) have reported the dominant use of Cronbach’s alpha reliability statistic for measuring internal consistency reliability.”
Method
The gaslighting at work scale: Development and initial validation
Katsiroumpa, A., Moisoglou, I., Konstantakopoulou, O., Tsiachri, M., Kolisiati, A., & Galanis, P. (2025) · Journal of Workplace Behavioral Health · doi:10.1080/15555240.2025.2539157 · Cited by 7
“…correlations, inter-item correlations, and Cronbach’s alpha when a single item was deleted for the 11 items of the final structure model of the GWS. Acceptable values for inter-item correlation range from 0.15 to 0.75 (DeVon et al., 2007) and for item-total correlation are > 0.30 (De Vaus, 2004).”
Influential
Validation and measurement invariance of the Chinese version of the academic self-efficacy scale for university students
Zhao, M.-Y., Kuan, G., Chau, V. H., & Kueh, Y. (2024) · PeerJ · doi:10.7717/peerj.17798 · Cited by 9
“The theoretically expected factor loadings should be greater than 0.4 ( DeVon et al., 2007 ).”
Influential
Gerascophobia or Excessive Fear of Aging Scale (GEFAS): Development, validation, and exploration of psychometric properties of a brief instrument using classical testing theory and item response theory
Husain, W., Ijaz, F., Husain, M. A., Achraf, A., Isa, H. M. A., Trabelsi, K., Pandi-Perumal, S. R., Pakpour, A. H., & Jahrami, H. (2024) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2024.105599 · Cited by 10
Validity and reliability of the Swedish version of the Children’s Sleep Habits Questionnaire (CSHQ-SWE)
Larsson, I., Svedberg, P., Nygren, J., & Malmborg, J. (2024) · BMC Pediatrics · doi:10.1186/s12887-024-04859-z · Cited by 9
The Value of Child Participation in Research —A Qualitative Child-Centered Approach to the Early Development of an Empowerment Inventory for Children
Olsen, R. K. (2024) · Child & Youth Services · doi:10.1080/0145935x.2024.2336914 · Cited by 13
“…tested for usability through workshops with children, with a co-assessment of the appearance of the questionnaire in terms of feasibility, readability, consistency of style and formatting, and the clarity of the language used (DeVon et al., 2007; Haladyna & Hess, 1999; Trochim & Donnelly, 2001).”
The Behavioural Pattern of Investment in the Financial Market: A Study of the Individual Investors
Dar, B. I., & Kumar, J. (2023) · Global Business Review · doi:10.1177/09721509231192229 · Cited by 17
Acquiring Psychopathy and Callousness Traits: Examining the Influence of Childhood Betrayal Trauma and Adult Dissociative Experiences in a Community Sample
Grabow, A. P., & Becker-Blease, K. (2023) · Journal of Trauma & Dissociation · doi:10.1080/15299732.2023.2168827 · Cited by 8
“Although literature generally posits a Cronbach's α value of at least 0.70 is acceptable for psychometric purposes (e.g., DeVon et al., 2007), P. Kline (1999) suggests that a Cronbach's α value of less than 0.70 does not necessarily indicate low reliability when assessing such a diverse…”
BackgroundInfluential
The Association Between Food Addiction and Weight Status in School-Age Children and Adolescents
Wang, D., Huang, K., LaFata, E. M., Zhou, W., Li, H., Hu, Y., & Fu, J. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.824234 · Cited by 9
“0 has good internal and test–retest reliability (40), sound content (41), and convergent validity (42), with acceptable construct validity (43), indicating that it is a reliable measure of addictivelike eating behaviors in developing countries, such as China.”
Background
Effectiveness of a combined web-based and simulation-based continuing education on home-care professionals' competence to evaluate older people's acute care needs in Finland.
Kajander-Unkuri, S., Kämäräinen, P., Hartikainen, T., & Turjamaa, R. (2021) · Health and Social Care in the community · doi:10.1111/hsc.13605 · Cited by 9
Development and psychometric evaluation of the cloud computing acceptance questionnaire for academic libraries
Jahangiri, P., Saberi, M. K., & Vakilimofrad, H. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102395 · Cited by 12
Examination of the psychometric properties of the persian version of the COVID-19-impact on Quality of Life Scale
Dehkordi, A. H., Aslani, M., Ebadi, A., Repišti, S., Moradveisi, B., & Gheshlagh, R. G. (2021) · Health and Quality of Life Outcomes · doi:10.1186/s12955-021-01829-2 · Cited by 14
“The threshold provided by the MDC data allows researchers to be confident that above a certain point, changes in scores are not just due to measurement error (43).”
Background
Evaluating collaborative practice within community-based integrated health and social care teams: a systematic review of outcome measurement instruments
Glover, P., Gray, H. G., Shanmugam, S., & McFadyen, A. K. (2021) · Journal of Interprofessional Care · doi:10.1080/13561820.2021.1902292 · Cited by 8
“Although all types of validity can be considered a form of construct validity (DeVon et al., 2007), for OMI development, the methods differ when testing different types.”
Method
Quick Systemic Lupus Activity Questionnaire (Q-SLAQ): a simplified version of SLAQ for patient-reported disease activity
Svenungsson, E., Gunnarsson, I., Illescas-Bäckelin, V., Trysberg, E., Jönsen, A., Leonard, D., Sjöwall, C., & Pettersson, S. (2021) · Lupus Science and Medicine · doi:10.1136/lupus-2020-000471 · Cited by 9
Saudi cultural adaptation of the “compliance questionnaire of Rheumatology” for Rheumatoid arthritis patients on disease modifying anti-rheumatic drugs (DMARDs)
Aljohani, R., Aljohani, Z., Aljohani, R., & Alsaidalani, R. (2021) · Saudi Pharmaceutical Journal · doi:10.1016/j.jsps.2021.03.007 · Cited by 9
“Content validity is a useful measure to assess the questionnaire’s validity and provides perspective into its applicability and feasibility (DeVon et al., 2007; Haynes et al., 1995; Polit et al., 2007).”
Background
Development and validation of antisnake venom knowledge assessment tool (AKAT) for healthcare practitioners
Bala, A. A., Jatau, A., Yunusa, I., Mohammed, M., Mohammed, A.-K. H., Isa, A., Sadiq, W. A., Gulma, K., Bello, I., Malami, S., et al. (2020) · Toxicon: X · doi:10.1016/j.toxcx.2020.100064 · Cited by 9
Assessment of the effect of application of an educational wiki in flipped classroom on students’ achievement and satisfaction
Khoynaroud, A. A., Akbarzadeh, A., Ghojazadeh, M., & Ghaffarifar, S. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02223-0 · Cited by 9
“Internal consistency of the items was assessed by calculating Cronbach ’ s Alpha and Intra-class Correlation Coefficient (ICC) was calculated to judge the stability of the results [18].”
BackgroundMethod
Validation of a Comprehensive Measure of the Family Caregiver Experience: The Caregiver Reaction Scale
O'Malley, K., & Qualls, S. (2020) · Clinical Gerontologist · doi:10.1080/07317115.2020.1774455 · Cited by 9
“All of the burden subscales of the CRS had strong positive correlations with the ZBI which were well above the accepted standard for determining convergent validity (Devon et al., 2007).”
BackgroundMethod
Translation and psychometric evaluation of the Chinese Adjustment Disorder – New Module 20
Lorenz, L., Ho, G. W. K., Chan, A. C. Y., Bressington, D. T., Chien, W. T., Shevlin, M. E., Hyland, P., Maercker, A. R. A., & Karatzias, T. (2019) · International Journal of Mental Health · doi:10.1080/00207411.2019.1684687 · Cited by 11
An instrument to assess the education needs of nursing assistants within a palliative approach in residential aged care facilities
Karacsony, S., Good, A., Chang, E., Johnson, A., & Edenborough, M. A. (2019) · BMC Palliative Care · doi:10.1186/s12904-019-0447-0 · Cited by 9
Validation of the Early Feeding Skills Assessment Scale for the Evaluation of Oral Feeding in Premature Infants
Bahrami, B., Marofi, M., Farajzadegan, Z., & Barekatain, B. (2019) · doi:10.22038/ijn.2018.32322.1451 · Cited by 9
“7 and higher is the standard for the reliability of a tool (17, 18).”
Background
Validation and Assessment of Osteoporosis Self-Efficacy Among Iraqi General Population
Sahib, M. N. (2018) · The Open Nursing Journal · doi:10.2174/1874434601812010076 · Cited by 10
“Subsequently, discussions between the expert panel, translators, and the researcher were held to resolve any inconsistencies and check the capacity of the items to measure the construct that it proposes to measure then a final version was decided (face validity process) [31].”
Background
Psychometric Testing of the Personal Workplace Safety Instrument for Emergency Nurses
Burchill, C., Bena, J., & Polomano, R. (2018) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12265 · Cited by 9
“, factor analysis) of an instrument with five to six conceptual domains (30–50 responders per factor or subscale; DeVon et al., 2007).”
Background
Reliability and validity of measuring scale for postoperative complications in third molar surgery
Aravena, P., Astudillo, P., Miranda, H., & Manterola, C. (2018) · BMC Oral Health · doi:10.1186/s12903-018-0486-6 · Cited by 9
Pain in elderly patients with knee osteoarthritis: an integrative review of psychosocial factors
Youngcharoen, P., Hershberger, P. E., & Aree‐Ue, S. (2016) · International Journal of Orthopaedic and Trauma Nursing · doi:10.1016/j.ijotn.2016.11.002 · Cited by 10
Promotional support: a formative scale development
Harindranath, R. M., & Jacob, J. (2017) · International Journal of Pharmaceutical and Healthcare Marketing · doi:10.1108/ijphm-04-2016-0023 · Cited by 7
Validity and Reliability of the Test of Everyday Attention for Children (TEACh) in Iranian 8-11 Year Old Normal Students
Fathi, N., Mehraban, A. H., Akbarfahimi, M., & Mirzaie, H. (2016) · Iranian Journal of Psychiatry and Behavioral Sciences · doi:10.5812/ijpbs.2854 · Cited by 8
“Description of TEA-Ch Subtests, Including Attention Subsystem, Subtests’ Names, and Directions for Administration and Scoring (5, 13)”
Selecting symptom instruments for cardiovascular populations
Zimmerman, L. M., Pozehl, B., Vuckovic, K. M., Barnason, S. A., Schulz, P., Seo, Y., Ryan, C. J., Zerwic, J. J., & DeVon, H. A. (2016) · Heart & Lung · doi:10.1016/j.hrtlng.2016.08.012 · Cited by 10
Self-citation
Assessment-based health informatics curriculum improvement
Berner, E., Dorsey, A., Garrie, R. L., & Qu, H.-Y. (2016) · J. Am. Medical Informatics Assoc. · doi:10.1093/jamia/ocw073 · Cited by 9
“We used standard psychometric test validation methods 13 to explore aspects of the examination and curriculum that need improvement.”
BackgroundMethod
Investigating Transitional Care to Decrease Post-pancreatectomy 30-Day Hospital Readmissions for Dehydration or Failure to Thrive
Xourafas, D., Ablorh, A., Clancy, T. E., Swanson, R., & Ashley, S. (2016) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-016-3121-3 · Cited by 9
Developing a Questionnaire for Iranian Women’s Attitude on Medical Ethics in Vaginal Childbirth
Rabor, F. M., Taghipour, A., Mirzaee, M., Mirzaiinajmabadi, K., Fazilatpour, M., & Masoum, S. H. F. (2015) · Nursing and Midwifery Studies · doi:10.17795/nmsjournal29004 · Cited by 9
“The CVI for each item scale was the proportion of experts who rated an item as 3 or 4 on a 4-point scale (19, 20).”
Psychometric Evaluation of the Role Strain Scale: The Persian Version
Kolagari, S., Tafreshi, M. Z., Rassouli, M., & Kavousi, A. (2014) · Iranian Red Crescent Medical Journal · doi:10.5812/ircmj.15469 · Cited by 9
“70 were explained as satisfactory internal consistency (26, 27).”
Background
Exploring the quality of Life at the end of Life (Qual-E) Instrument with Australian Palliative Care Hospital Patients: Hurdles and Directions
Wilkinson, A., Slatyer, S., McCullough, K., & Williams, A. (2014) · Journal of Palliative Care · doi:10.1177/082585971403000103 · Cited by 9
““Face validity” is a subjective evaluation of whether an instrument measures a construct of interest and provides insight into how participants might interpret and respond to the items the instrument contains (16).”
Background
The reliability and validity of the revised Diabetes Family Conflict Scale questionnaire, in a sample of Swedish children
Sand, P., Kleiberg, A. N., & Forsander, G. (2013) · Acta paediatrica · doi:10.1111/apa.12228 · Cited by 9
“reports of the total DFCS scale and the two subscales to evaluate the concurrent validity of the instrument (19).”
Background
Psychometric properties and osteoprotective behaviors among type 2 diabetic patients: osteoporosis self-efficacy scale Malay version (OSES-M)
Abdulameer, S. A., Sulaiman, S. A. S., Hassali, M. A., Subramaniam, K., & Sahib, M. N. (2012) · Osteoporosis International · doi:10.1007/s00198-012-2071-1 · Cited by 10
“The face validity of a measurement item refers to the degree to which the item appears, on its face value, to measure the construct (in this case, the dimension) that it intends to measure [15].”
Background
Validity of St. George's Respiratory Questionnaire for Greek Patients with Chronic Obstructive Pulmonary Disease
Katsoulas, T., Skordilis, E., Myrianthefs, P., Fildisis, G., Theodosopoulou, E., & Baltopoulos, G. (2010) · Perceptual and Motor Skills · doi:10.2466/pms.110.3.772-788 · Cited by 9
Calculation of Minimal Detectable Change of Construct Subscales of a Cultural Competence Instrument
Fike, D., Denton, J. M., Esparza, S., & Palombaro, K. M. (2016) · doi:10.1097/00001416-201630010-00004 · Cited by 9
Prescribing quality in patients with chronic diseases at primary and secondary health care facilities using prescription quality index tool
Suthar, J., & Patel, V. (2014) · doi:10.5455/2319-2003.ijbcp20140626 · Cited by 9
Elements of a Digital Urbanisation Strategy for Türkiye: Evidence from Psychometric Testing
Eren, F., & Çay, K. (2025) · Social Sciences · doi:10.3390/socsci14020089 · Cited by 7
Reliability and validity of the modified Yale Food Addiction Scale 2.0 (mYFAS 2.0) in a sample of individuals with depressive disorders
Lima, V. P., Cavalcante, E. D. O., Leão, M. A., LaFata, E. M., Sampaio, A. M., & Neto, P. R. N. (2024) · Journal of Eating Disorders · doi:10.1186/s40337-024-01108-7 · Cited by 9
“This approach has been adopted in psychometric studies when no gold-standard exter-nal criterion is available for comparison [51, 52].”
A compendium of evidence‐based practice instruments for nursing education, practice and research
Halm, M. A. (2024) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12703 · Cited by 9
Investigation of Neurophobia amongst North American Veterinary Students and Development of a Veterinary Neurophobia Scoring Tool (VetNeuroQ).
Murthy, V. D., Le, L., Heater, H. D., Guess, S., & Chen, A. V. (2023) · Journal of Veterinary Medical Education · doi:10.3138/jvme-2023-0017 · Cited by 8
Development and validation of a tool to assess researchers’ knowledge of human subjects’ rights and their attitudes toward research ethics education in Saudi Arabia
Al-Madaney, M. M., & Fässler, M. (2023) · BMC Medical Ethics · doi:10.1186/s12910-023-00968-z · Cited by 8
“Face validity is used to assess readability, feasibility, and consistency of the style and formatting, and clarity of the language used in the questionnaire’s appearance [19, 20].”
Method
Relational orientation in B2B strategies: Measurement scale development and validation
Zakrzewska-Bielawska, A., Czakon, W., & Kraus, S. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113791 · Cited by 11
Cultural Adaptation and Validation of the Amharic Version of the World Health Organization’s Self Reporting Questionnaire (SRQ-20) Screening Tool Among Pregnant Women in North West Ethiopia, 2022: A Psychometric Validation
Kurbi, H. A., Abebe, S. M., Mengistu, N. W., Ayele, T. A., & Toni, A. T. (2023) · International Journal of Women s Health · doi:10.2147/ijwh.s402865 · Cited by 12
“According to the literature, a content validity index of 78 and above is acceptable when the number of experts is greater than or equal to six.(38) We assessed acceptability qualitatively by assessing the understandability and acceptability of the items.”
Background
Importance of Variety to the Lives and Wellbeing of Elders
Jansen, D. A., Sauve, J. L., & Aubart, S. M. (2023) · Activities Adaptation & Aging · doi:10.1080/01924788.2023.2174732 · Cited by 8
“The interview questions and data from items were reviewed for face validity by three nurse researchers with expertise in aging (DeVon et al., 2007).”
Method
Psychometric Indicators of the Pro-environmental Attitudes' Questionnaire: Colombian Version
Barón, W. S., & Meneses-Báez, A. L. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.886769 · Cited by 8
Dimensionality and Measurement Invariance of the Sexually Aggressive Behaviors Scale across Male and Female Portuguese College Students
Moreira, B., Rosa, P. J., Brazão, N., & Carvalho, J. (2022) · Sexes · doi:10.3390/sexes3030026 · Cited by 10
“As displayed in Table 3, the correlation coefficients are very small and statistically non-significant for all dimensions of the PAIR, meeting the criteria |r| ≤ 0.45 [62] (DeVon et al., 2007) to support discriminant validity.”
Influential
The Development, Content Validation, and Pilot Testing of the Paraphilic Interests and Disorders Scale
Winters, G. M., Jeglic, E. L., & Kaylor, L. E. (2022) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/10790632221078297 · Cited by 8
“Nonetheless, the number of experts required for a content validation study is at least 7 (DeVon et al., 2007; Polit & Hungler, 1999), and previous studies involving experts range from 2 to over 20 (Olson, 2010), so our expert sample comprising both the researchers and clinicians is in the top end…”
BackgroundInfluential
Examining sustainable Shari’ah compliance under shirkah-ul-milk: does Shari’ah-compliant risk matter
Uddin, M. (2022) · International Journal of Islamic and Middle Eastern Finance and Management · doi:10.1108/imefm-05-2020-0212 · Cited by 8
Impact Of Sustainable Supply Chain Management Practices On Organizational Performance In Ghana
Adegoke, I., Chen, M.-B., Abredu, P., Ndafira, G., Amoateng, P. A., & Owusu-Gyan, L. (2021) · Management Science and Business Decisions · doi:10.52812/msbd.32 · Cited by 8
“Composite reliability of 0.60 and Cronbach’s reliability of 0.70 (Devon et al., 2007) was considered satisfactory.”
BackgroundInfluential
Evaluation of the psychometric properties of the Swiss French version of the Older People’s Quality of Life questionnaire (OPQOL-35-SF)
Carrard, S., Mooser, C., Hilfiker, R., & Hager, A.-G. M. (2022) · Health and Quality of Life Outcomes · doi:10.1186/s12955-022-01950-w · Cited by 11
“This enabled the variables to be grouped by factors, and those that were not related to the construct to be eliminated [45, 61].”
Background
Validation of the Korean Version of Impact of Event Scale—Revised (IES-R) in Korean Nurses during the COVID-19 Pandemic
Park, Y. S., Park, K.-H., & Lee, J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182111311 · Cited by 6
“05), which considered substantial for convergent validity [29].”
Background
Knowledge, attitude, and expertise of nurses in intensive care unit regarding oral and dental care in hospitalized patients.
Haghighat, A., Mohammadi, I., Tahani, B., & Teimoori, F. (2021) · Dental Research Journal · doi:10.4103/1735-3327.328751 · Cited by 8
An empirical model of social and healthcare educators' continuing professional development in Finland.
Koskimäki, M., Mikkonen, K., Kääriäinen, M., Lähteenmäki, M., Kaunonen, M., Salminen, L., & Koivula, M. (2021) · Health and Social Care in the community · doi:10.1111/hsc.13473 · Cited by 8
Measuring Entrepreneurial Self-efficacy: A Comprehensive Scale
Chawla, N. T., & Bhatia, H. (2021) · Journal of Entrepreneurship and Innovation in Emerging Economies · doi:10.1177/23939575211019605 · Cited by 9
“According to DeVon et al. (2007) and Kim (2009), content validity indicates that the items of the instrument encompass all the required attributes of the concept being measured and is usually done by seven or more experts.”
Background

Authors: DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas‐Polston, E.
Affiliations: Purdue University Northwest (US)
Corresponding author: DeVon, Holli A.
Block, Michelle E.
Moyle‐Wright, Patricia
Ernst, Diane M.
Hayden, Susan J.
Lazzara, Deborah J.
Savoy, Suzanne M.
ORCID: DeVon, Holli A.
Venue: Journal of Nursing Scholarship
Publisher: Wiley
Published: 2007-05-23
Volume: 39
Issue: 2
Pages: 155-164
ISSN: 0363-2792 (ISSN-L)
1527-6546
1547-5069
DOI: 10.1111/j.1547-5069.2007.00161.x
OpenAlex: W2162602057
Cited by: 1,889
References: 0
Citations by year: 2026: 87 · 2025: 128 · 2024: 186 · 2023: 176 · 2022: 148 · 2021: 163 · 2020: 145 · 2019: 144 · 2018: 131 · 2017: 113 · 2016: 96 · 2015: 105 · 2014: 83 · 2013: 51 · 2012: 40
FWCI: 15.03
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: Journal of Nursing Scholarship (publishedVersion)
PubMed (publishedVersion)
ePublications at Regis University (Regis University) (submittedVersion)
Topics: Health Sciences › Nursing › Research and Theory › Health Education and Validation
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: psychometric properties, reliability statistics, validity, content validity, criterion validity, construct validity, internal consistency, test-retest reliability, measurement error, nursing equipment, nursing research
MeSH terms: Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Mathematics, Periodicals as Topic, Planning Techniques, Predictive Value of Tests, Psychometrics, Research Design, Time Factors, Reproducibility of Results, Nursing Research, Bias, Discriminant Analysis, Guidelines as Topic, Peer Review, Research, Statistics, Nonparametric, Editorial Policies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A Psychometric Toolbox for Testing Validity and Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Metadata

Record

About these checks