The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Evaluation of methods used for estimating content validity
Abstract
&NA; The assessment of content validity is a critical and complex step in the development process of instruments which are frequently used to measure complex constructs in social and administrative pharmacy research. The aims of this study were to investigate the elements of content validity; to describe a practical approach for assessing content validity; and to discuss existing content validity indices. This is a narrative review of the assessment and quantification of content validity. It describes the key stages of conducting the content validation study and discusses the quantification and evaluation of the content validity estimates. Content validity provides evidence about the degree to which elements of an assessment instrument are relevant to and representative of the targeted construct for a particular assessment purpose. The assessment of content validity relies on using a panel of experts to evaluate instrument elements and rate them based on their relevance and representativeness to the content domain. It is a three‐stage process that includes; the development stage, judgment and quantifying stage, and revising and reconstruction stage. To quantify the expert judgments, several indices have been discussed in this paper such as the content validity ratio (CVR), content validity index (CVI), modified–Kappa, and some agreement indices. A practical guide describes the process of content validity evaluation is provided. In summary, content validation processes and content validity indices are essential factors in the instrument development process, should be treated and reported as important as other types of construct validation. Determining item CVI and reporting an overall CVI are important components necessary to instruments especially when the instrument is used to measure health outcomes or to guide a clinical decision making. Content validity deserves a rigorous assessment process as the obtained information from this process are invaluable for the quality of the newly developed instrument.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Determination and Quantification Of Content Validity
LYNN, M. R. (1986) · Nursing Research · doi:10.1097/00006199-198611000-00017 · Cited by 6,775
Is the CVI an acceptable indicator of content validity? Appraisal and recommendations
Polit, D. F., Beck, C. T., & Owen, S. V. (2007) · Research in Nursing & Health · doi:10.1002/nur.20199 · Cited by 5,273
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,883
Health Measurement Scales: A practical guide to their development and use
Streiner, D. L., Norman, G. R., & Cairney, J. (2014) · doi:10.1093/med/9780199685219.001.0001 · Cited by 2,564
Content validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387
Instrument review: Getting the most from a panel of experts
Davis, L. L. (1992) · Applied Nursing Research · doi:10.1016/s0897-1897(05)80008-4 · Cited by 2,364
Health Measurement Scales: A Practical Guide to Their Development and Use
Vogelzang, J. L. (2015) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2015.03.007 · Cited by 2,337
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
A Psychometric Toolbox for Testing Validity and Reliability
DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas‐Polston, E. (2007) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2007.00161.x · Cited by 1,889
Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application
Cook, D. A., & Beckman, T. J. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.10.036 · Cited by 1,745
Validity and reliability of measurement instruments used in research
Kimberlin, C. L., & Winterstein, A. G. (2008) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp070364 · Cited by 1,717
Objectifying content validity: Conducting a content validity study in social work research
Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003) · Social Work Research · doi:10.1093/swr/27.2.94 · Cited by 1,591
Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation
Ayre, C., & Scally, A. J. (2014) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175613513808 · Cited by 1,502
Selection and use of content experts for instrument development
Grant, J. S., & Davis, L. L. (1997) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199706)20:3<269::aid-nur9>3.0.co;2-g · Cited by 1,167
Measurement in Nursing and Health Research
Waltz, C. F., Strickland, O. L., & Lenz, E. R. (2016) · Springer Publishing Company eBooks · doi:10.1891/9780826170620 · Cited by 1,156
Meaning and Values in Test Validation: The Science and Ethics of Assessment
Messick, S. (1989) · Educational Researcher · doi:10.3102/0013189x018002005 · Cited by 948
Two Quantitative Approaches for Estimating Content Validity
Wynd, C. A., Schmidt, B., & Schaefer, M. A. (2003) · Western Journal of Nursing Research · doi:10.1177/0193945903252998 · Cited by 794
Measurement in Nursing and Health Research
Albert, N. M., & Ludwick, R. (2011) · Clinical Nurse Specialist · doi:10.1097/nur.0b013e318233ead4 · Cited by 767
The Development of an Instrument to Measure Social Support
NORBECK, J. S., LINDSEY, A. M., & CARRIERI, V. L. (1981) · Nursing Research · doi:10.1097/00006199-198109000-00003 · Cited by 735
Recalculation of the Critical Values for Lawshe’s Content Validity Ratio
Wilson, F. R., Pan, W., & Schumsky, D. A. (2012) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175612440286 · Cited by 701
Standards for validating health measures: Definition and content
E. Ware, J. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90003-8 · Cited by 636
Content validity and its estimation
Yaghmaie, F. (2003) · Academic Medicine · doi:10.22037/jme.v3i1.870 · Cited by 593
Measurement in nursing research
Waltz, C. F., Strickland, O. L., & Lenz, E. R. (1984) · Medical Entomology and Zoology · Cited by 465
Measurement in Nursing Research
Marrone, S. R. (1992) · AORN Journal · doi:10.1016/s0001-2092(07)69465-4 · Cited by 457
Downing, S. M. (2006) · Cited by 435
The Construct of Content Validity
Sireci, S. G. (1998) · Social Indicators Research · doi:10.1023/a:1006985528729 · Cited by 430
Drug-Related Problem Classification Systems
van Mil, J. W. F., Westerlund, T., Hersberger, K. E., & Schaefer, M. A. (2004) · Annals of Pharmacotherapy · doi:10.1345/aph.1d182 · Cited by 356
Validity evidence based on test content
Sireci, S., & Faulkner-Bond, M. (2014) · Psicothema · doi:10.7334/psicothema2013.256 · Cited by 256
On Validity Theory and Test Validation
Sireci, S. G. (2007) · Educational Researcher · doi:10.3102/0013189x07311609 · Cited by 195
Measurement of Health Outcomes: Reliability, Validity and Responsiveness
Roach, K. E. (2006) · JPO Journal of Prosthetics and Orthotics · doi:10.1097/00008526-200601001-00003 · Cited by 179
Assumptions Underlying the Use of Content Validity
Lennon, R. T. (1956) · Educational and Psychological Measurement · doi:10.1177/001316445601600303 · Cited by 135
Hanskamp‐Sebregts, M., Zegers, M., Vincent, C. A., van Gurp, P. J. M., de Vet, H. C. W., & Wollersheim, H. C. H. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011078 · Cited by 118
The Meaning of Content Validity
Fitzpatrick, A. R. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700102 · Cited by 115
Conceptualizing and measuring generic health outcomes
Ware, J. E. (1991) · Cancer · doi:10.1002/1097-0142(19910201)67:3+<774::aid-cncr2820671404>3.0.co;2-i · Cited by 105
Miller, V. A., Reynolds, W. W., Ittenbach, R. F., Luce, M. F., Beauchamp, T. L., & Nelson, R. M. (2009) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2009.4.3.21 · Cited by 85
Pérez-Escamilla, B., Franco-Trigo, L., Moullin, J. C., Martínez, F. M., & Corpas, J. P. G. (2015) · Patient Preference and Adherence · doi:10.2147/ppa.s76139 · Cited by 80
A practical approach to content validation
Slocumb, E. M., & Cole, F. L. (1991) · Applied Nursing Research · doi:10.1016/s0897-1897(05)80097-7 · Cited by 58
Content Validity Exercises for Nursing Students
Beck, C. T. (1999) · Journal of Nursing Education · doi:10.3928/0148-4834-19990301-08 · Cited by 20
Cited by
Cruchinho, P., López-Franco, M. D., Capelas, M. L., Almeida, S., Bennett, P. M., Miranda da Silva, M., Teixeira, G., Nunes, E., Lucas, P., & Gaspar, F. (2024) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s419714 · Cited by 469
“176 CVR values range from −1 (perfect disagreement) to 5 (perfect agreement).”
Stefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar‐Poli, P. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1494261 · Cited by 252
Promoting critical thinking in an online, project-based course
Cortázar, C., Nussbaum, M., Harcha, J., Alvares, D., López, F., Goñi, J., & Cabezas, V. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106705 · Cited by 208
Katebi, A., Homami, P., & Najmeddin, M. (2021) · Journal of Building Engineering · doi:10.1016/j.jobe.2021.103518 · Cited by 203
Martínez-Alcalá, C. I., Rosales-Lagarde, A., Alonso-Lavernia, M. D. L. Á., Ramírez-Salvador, J. Á., Jiménez-Rodríguez, B., Cepeda-Rebollar, R. M., López‐Noguerola, J. S., Díaz, M. L. B., & Agis-Juárez, R. A. (2018) · Frontiers in ICT · doi:10.3389/fict.2018.00021 · Cited by 166
Metadata
- Authors
- Almanasreh, E., Moles, R., & Chen, T. F.
- Venue
- Research in Social and Administrative Pharmacy
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 15
- Issue
- 2
- Pages
- 214-221
- ISSN
- 1551-7411 (ISSN-L)
- OpenAlex
- W2794918504
- Cited by
- 1,374
- References
- 41
- FWCI
- 122.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.