Cited by 1,095Health Systems, Economic Evaluations, Quality of LifeHealth Education and ValidationDelphi Technique in Research

The DOI matches its Crossref record; 45 of the 47 references it cites were found in a registry or an index.

Content validity–establishing and reporting the evidence in newly developed patient‐reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1 – eliciting concepts for a new PRO instrument

Open access

Patrick, Donald L., Burke, Laurie B., Gwaltney, Chad J., Leidy, Nancy Kline, Martin, Mona L., Molsen, Elizabeth, Ring, Lena·2011·Value in Health

DOI 10.1016/j.jval.2011.06.014

Open this paper in CoChat — free account Open PDF

Abstract

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.jval.2011.06.014

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
THE DISCOVERY OF GROUNDED THEORY: STRATEGIES FOR QUALITATIVE RESEARCH. By Barney G. Glaser and Anselm L. Strauss. Chicago: Aldine Publishing Company, 1967. 271 pp. $6.75
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,525
Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups.
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
Untitled work
(1998) · Sage eBooks · Cited by 38,631
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Basics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. M. (1992) · Journal of Marketing Research · doi:10.2307/3172751 · Cited by 17,852
The Brief Psychiatric Rating Scale.
Overall, J. E., & Gorham, D. R. (1962) · Psychological Reports · doi:10.2466/pr0.1962.10.3.799 · Cited by 11,090

Show all 47 references

Research works printed but not linked: 1

Clark, 2003, How to peer review a qualitative manuscript

Sorted by citations

COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study
Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Mokkink, L. B. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1829-0 · Cited by 2,348
Self-citation
Content Validity—Establishing and Reporting the Evidence in Newly Developed Patient-Reported Outcomes (PRO) Instruments for Medical Product Evaluation: ISPOR PRO Good Research Practices Task Force Report: Part 2—Assessing Respondent Understanding
Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011) · Value in Health · doi:10.1016/j.jval.2011.06.013 · Cited by 1,135
Self-citation
Measuring financial toxicity as a clinically relevant patient‐reported outcome: The validation of the COmprehensive Score for financial Toxicity (COST)
de Souza, J. A., Yap, B. J., Wroblewski, K., Blinder, V. S., Araújo, F. S., Hlubocky, F. J., Nicholas, L. H., O’Connor, J. M., Brockstein, B., Ratain, M. J., et al. (2016) · Cancer · doi:10.1002/cncr.30369 · Cited by 932
The development of a financial toxicity patient‐reported outcome in cancer: The COST measure
de Souza, J. A., Yap, B. J., Hlubocky, F. J., Wroblewski, K., Ratain, M. J., Cella, D. F., & Daugherty, C. K. (2014) · Cancer · doi:10.1002/cncr.28814 · Cited by 695
Overview of Classical Test Theory and Item Response Theory for the Quantitative Assessment of Items in Developing Patient-Reported Outcomes Measures
Cappelleri, J. C., Lundy, J. J., & Hays, R. D. (2014) · Clinical Therapeutics · doi:10.1016/j.clinthera.2014.04.006 · Cited by 605
Biomarkers and surrogate endpoints in clinical trials
Fleming, T. R., & Powers, J. H. (2012) · Statistics in Medicine · doi:10.1002/sim.5403 · Cited by 559
Development of the Flu-PRO: a patient-reported outcome (PRO) instrument to evaluate symptoms of influenza
Powers, J. H., Guerrero, M. L., Leidy, N. K., Fairchok, M. P., Rosenberg, A., Hernández, A., Stringer, S. M., Schofield, C. M., Rodríguez‐Zulueta, P., Kim, K. K., et al. (2015) · BMC Infectious Diseases · doi:10.1186/s12879-015-1330-0 · Cited by 504
Self-citation
Pediatric Patient-Reported Outcome Instruments for Research to Support Medical Product Labeling: Report of the ISPOR PRO Good Research Practices for the Assessment of Children and Adolescents Task Force
Matza, L. S., Patrick, D. L., Riley, A. W., Alexander, J. J., Rajmil, L., Pleil, A. M., & Bullinger, M. (2013) · Value in Health · doi:10.1016/j.jval.2013.04.004 · Cited by 493
Self-citation
Practitioner Review: Emotional Dysregulation in Attention-deficit/Hyperactivity Disorder—Implications for Clinical Recognition and Intervention
Faraone, S. V., Rostain, A. L., Blader, J., Busch, B., Childress, A. C., Connor, D. F., & Newcorn, J. H. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12899 · Cited by 400
Patient involvement in the development of patient‐reported outcome measures: a scoping review
Wiering, B., de Boer, D., & Delnoij, D. (2017) · Health Expectations · doi:10.1111/hex.12442 · Cited by 371
Electronic patient‐reported outcome systems in oncology clinical practice
Bennett, A. V., Jensen, R. E., & Basch, E. (2012) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21150 · Cited by 356
Clinical Outcome Assessments: Conceptual Foundation—Report of the ISPOR Clinical Outcomes Assessment – Emerging Good Practices for Outcomes Research Task Force
Walton, M. K., Powers, J. H., Hobart, J. C., Patrick, D. L., Marquis, P., Vamvakas, S., Isaac, M., Molsen, E., Cano, S., & Burke, L. B. (2015) · Value in Health · doi:10.1016/j.jval.2015.08.006 · Cited by 310
Self-citation
Roland-Morris disability questionnaire and Oswestry Disability Index: which has better measurement properties for measuring physical functioning in nonspecific low back pain? Systematic review and meta-analysis
Chiarotto, A., Maxwell, L. J., Terwee, C. B., Wells, G. A., Tugwell, P., & Ostelo, R. W. (2016) · Physical Therapy · doi:10.2522/ptj.20150420 · Cited by 290
FACE-Q Scales for Health-Related Quality of Life, Early Life Impact, Satisfaction with Outcomes, and Decision to Have Treatment
Klassen, A. F., Cano, S., Schwitzer, J. A., Scott, A., & Pusic, A. L. (2014) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000000895 · Cited by 287
Informing a priori sample size estimation in qualitative concept elicitation interview studies for clinical outcome assessment instrument development
Turner-Bowker, D. M., Lamoureux, R. E., Stokes, J., Litcher-Kelly, L., Galipeau, N., Yaworsky, A., Solomon, J., & Shields, A. L. (2018) · Value in Health · doi:10.1016/j.jval.2017.11.014 · Cited by 233
A retrospective analysis: the development of patient reported outcome measures for the assessment of Crohn's disease activity
Khanna, R., Zou, G., D’Haens, G., Feagan, B. G., Sandborn, W. J., Vandervoort, M. K., Rolleri, R. L., Bortey, E. B., Paterson, C. A., Forbes, W. P., et al. (2014) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13001 · Cited by 243
Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care
Greenhalgh, J., Dalkin, S. M., Gooding, K., Gibbons, E. J., Wright, J. M., Meads, D. M., Black, N. A., Valderas, J. M., & Pawson, R. (2017) · Health Services and Delivery Research · doi:10.3310/hsdr05020 · Cited by 253
Clinical outcome endpoints in heart failure trials: a European Society of Cardiology Heart Failure Association consensus document
Zannad, F., Garcia, A. A., Anker, S. D., Armstrong, P. W., Calvo, G., Cleland, J. G. F., Cohn, J. N., Dickstein, K., Domanski, M. J., Ekman, I., et al. (2013) · European Journal of Heart Failure · doi:10.1093/eurjhf/hft095 · Cited by 231
The BODY-Q: A Patient-Reported Outcome Instrument for Weight Loss and Body Contouring Treatments
Klassen, A. F., Cano, S., Alderman, A. K., Soldin, M. G., Thoma, A., Robson, S., Kaur, M. N., Papas, A., Laeken, N. V., Taylor, V. H., et al. (2016) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000000665 · Cited by 221
Assessment of physical function and participation in chronic pain clinical trials: IMMPACT/OMERACT recommendations
Taylor, A. M., Phillips, K., Patel, K. V., Turk, D. C., Dworkin, R. H., Beaton, D., Clauw, D. J., Gignac, M. A. M., Markman, J. D., Williams, D. A., et al. (2016) · Pain · doi:10.1097/j.pain.0000000000000577 · Cited by 208
Self-citation
Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience
Brédart, A., Marrel, A., Abetz-Webb, L., Lasch, K., & Acquadro, C. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-15 · Cited by 195
Systematic review of measurement properties of patient-reported outcome measures used in patients undergoing hip and knee arthroplasty
Harris, K. K., Dawson, J., Gibbons, E. J., Lim, C., Beard, D. J., Fitzpatrick, R. M., & Price, A. D. F. (2016) · Patient Related Outcome Measures · doi:10.2147/prom.s97774 · Cited by 194
Clinician-Reported Outcome Assessments of Treatment Benefit: Report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force
Powers, J. H., Patrick, D. L., Walton, M. K., Marquis, P., Cano, S., Hobart, J., Isaac, M., Vamvakas, S., Slagle, A., Molsen, E., et al. (2017) · Value in Health · doi:10.1016/j.jval.2016.11.005 · Cited by 191
Self-citation
Response scale selection in adult pain measures: results from a literature review
Safikhani, S., Gries, K. S., Trudeau, J., Reasner, D. S., Rüdell, K., Coons, S. J., Bush, E. N., Hanlon, J. T., Abraham, L., & Vernon, M. (2018) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-018-0053-6 · Cited by 168
A systematic review of patient reported outcomes and patient experience in enhanced recovery after orthopaedic surgery
Jones, E., Wainwright, T. W., Foster, J., Smith, J., Middleton, R., & Francis, N. K. (2014) · Annals of The Royal College of Surgeons of England · doi:10.1308/003588414x13824511649571 · Cited by 160
Development and Psychometric Evaluation of the FACE-Q Scales for Patients Undergoing Rhinoplasty
Klassen, A. F., Cano, S., East, C. A., Baker, S. B., Badia, L., Schwitzer, J. A., & Pusic, A. L. (2015) · JAMA Facial Plastic Surgery · doi:10.1001/jamafacial.2015.1445 · Cited by 164
Estimating Health-State Utility for Economic Models in Clinical Studies: An ISPOR Good Research Practices Task Force Report
Wolowacz, S. E., Briggs, A. H., Belozeroff, V., Clarke, P., Doward, L. C., Goeree, R. A., Lloyd, A. J., & Norman, R. (2016) · Value in Health · doi:10.1016/j.jval.2016.06.001 · Cited by 167
AmbuFlex: tele-patient-reported outcomes (telePRO) as the basis for follow-up in chronic and malignant diseases
Schougaard, L. M. V., Larsen, L. P., Jessen, A., Sidenius, P., Dørflinger, L., de Thurah, A. L., & Hjøllund, N. H. (2016) · Quality of Life Research · doi:10.1007/s11136-015-1207-0 · Cited by 158
Truthfulness in patient-reported outcomes: factors affecting patients’ responses and impact on data quality
Chang, E. M., Gillespie, E. F., & Shaverdian, N. (2019) · Patient Related Outcome Measures · doi:10.2147/prom.s178344 · Cited by 155
Patient‐reported outcomes
Johnston, B. C., Patrick, D. L., Devji, T., Maxwell, L. J., Bingham, C. O., Beaton, D., Boers, M., Briel, M., Busse, J. W., Carrasco‐Labra, A., et al. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch18 · Cited by 151
Self-citation
International phase I study protocol to develop a patient-reported outcome measure for adolescents and adults receiving gender-affirming treatments (the GENDER-Q)
Klassen, A. F., Kaur, M. N., Johnson, N., Kreukels, B. P. C., McEvenue, G., Morrison, S. D., Mullender, M. G., Poulsen, L., Özer, M., Rowe, W., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-025435 · Cited by 139
A systematic review highlights the need to investigate the content validity of patient-reported outcome measures for physical functioning in patients with low back pain
Chiarotto, A., Ostelo, R., Boers, M., & Terwee, C. B. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.005 · Cited by 141
SPIRIT-PRO Extension explanation and elaboration: guidelines for inclusion of patient-reported outcomes in protocols of clinical trials
Calvert, M., King, M., Mercieca-Bebber, R., Aiyegbusi, O., Kyte, D., Slade, A., Chan, A.-W., Basch, E., Bell, J., Bennett, A., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-045105 · Cited by 144
Self-citation
New Trial Designs and Potential Therapies for Pulmonary Artery Hypertension
Gomberg‐Maitland, M., Bull, T. M., Saggar, R., Barst, R. J., Elgazayerly, A., Fleming, T. R., Grimminger, F., Rainisio, M., Stewart, D. J., Stockbridge, N., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.10.026 · Cited by 134
Measuring respiratory symptoms of COPD: performance of the EXACT- Respiratory Symptoms Tool (E-RS) in three clinical trials
Leidy, N. K., Murray, L. T., Monz, B. U., Nelsen, L. M., Goldman, M. A., Jones, P., Dansie, E. J., & Sethi, S. (2014) · Respiratory Research · doi:10.1186/s12931-014-0124-z · Cited by 129
Self-citation
What Aspects of Quality of Life Are Important From Palliative Care Patients' Perspectives? A Systematic Review of Qualitative Research
McCaffrey, N., Bradley, S. L., Ratcliffe, J., & Currow, D. C. (2016) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2016.02.012 · Cited by 131
Development and validation of a generic scale for use in transition programmes to measure self‐management skills in adolescents with chronic health conditions: the TRANSITION ‐ Q
Klassen, A. F., Grant, C., Barr, R. D., Brill, H., de Camargo, O. K., Ronen, G. M., Samaan, M. C., Mondal, T. K., Cano, S., Schlatman, A., et al. (2014) · Child Care Health and Development · doi:10.1111/cch.12207 · Cited by 141
EQ-5D-Y-5L: developing a revised EQ-5D-Y with increased response categories
Kreimeier, S., Åström, M., Burström, K., Egmar, A., Gusi, N., Herdman, M., Kind, P., Pérez-Sousa, M. Á., & Greiner, W. (2019) · Quality of Life Research · doi:10.1007/s11136-019-02115-x · Cited by 130
Assessing the impact of headaches and the outcomes of treatment: a systematic review of patient-reported outcome measures (PROMs)
Haywood, K. L., Mars, T. S., Potter, R., Patel, S., Matharu, M., & Underwood, M. (2018) · Cephalalgia · doi:10.1177/0333102417731348 · Cited by 113
International multiphase mixed methods study protocol to develop a cross-cultural patient-reported outcome instrument for children and young adults with cleft lip and/or palate (CLEFT-Q)
Riff, K. W. Y. W., Tsangaris, E., Goodacre, T., Forrest, C. R., Pusic, A. L., Cano, S., & Klassen, A. F. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015467 · Cited by 115
Patient-reported Symptoms of Tenosynovial Giant Cell Tumors
Gelhorn, H. L., Tong-Starksen, S., McQuarrie, K., Vernon, C., Hanlon, J. T., Maclaine, G. D. H., Lenderking, W. R., Ye, X., Speck, R. M., Lackman, R. D., et al. (2016) · Clinical Therapeutics · doi:10.1016/j.clinthera.2016.03.008 · Cited by 121
Qualitative Methods Used to Generate Questionnaire Items: A Systematic Review
Ricci, L., Lanfranchi, J., Lemétayer, F., Rotonda, C., Guillemin, F., Coste, J., & Spitz, É. (2018) · Qualitative Health Research · doi:10.1177/1049732318783186 · Cited by 113
Development and initial testing of a new instrument to measure the experience of eczema control in adults and children: Recap of atopic eczema ( RECAP )
Howells, L., Chalmers, J. R., Gran, S., Ahmed, A. I., Apfelbacher, C., Burton, T., Howie, L., Lawton, S., Ridd, M. J., Rogers, N. K., et al. (2019) · British Journal of Dermatology · doi:10.1111/bjd.18780 · Cited by 106
Measurement Properties of the EQ VAS Around the Globe: A Systematic Review and Meta-Regression Analysis
Cheng, L. J., Tan, R. L.-Y., & Luo, N. (2021) · Value in Health · doi:10.1016/j.jval.2021.02.003 · Cited by 115
Development and Psychometric Validation of the FACE-Q Skin, Lips, and Facial Rhytids Appearance Scales and Adverse Effects Checklists for Cosmetic Procedures
Klassen, A. F., Cano, S., Schwitzer, J. A., Baker, S. B., CARRUTHERS, A. J., Carruthers, J., Chapas, A. M., & Pusic, A. L. (2016) · JAMA Dermatology · doi:10.1001/jamadermatol.2016.0018 · Cited by 107
Checklist to operationalize measurement characteristics of patient-reported outcome measures
Francis, D. O., McPheeters, M. L., Noud, M., Penson, D. F., & Feurer, I. D. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0307-4 · Cited by 114
“‘You lose your hair, what’s the big deal?’ I was so embarrassed, I was so self-conscious, I was so depressed:” a qualitative interview study to understand the psychosocial burden of alopecia areata
Aldhouse, N. V. J., Kitchen, H., Knight, S. L., Macey, J., Nunes, F. P., Dutronc, Y., Mesinkovska, N. A., Ko, J., King, B., & Wyrwich, K. W. (2020) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-020-00240-7 · Cited by 105
The impact of hyperhidrosis on patients' daily life and quality of life: a qualitative investigation
Kamudoni, P., Mueller, B., Halford, J. C. G., Schouveller, A., Stacey, B., & Salek, S. (2017) · Health and Quality of Life Outcomes · doi:10.1186/s12955-017-0693-x · Cited by 103
What Matters to Patients With Cleft Lip and/or Palate
Riff, K. W. Y. W., Tsangaris, E., Goodacre, T., Forrest, C. R., Lawson, J. L., Pusic, A. L., & Klassen, A. F. (2017) · The Cleft Palate-Craniofacial Journal · doi:10.1177/1055665617732854 · Cited by 105
“Sometimes It’s Difficult to Have a Normal Life”: Results from a Qualitative Study Exploring Caregiver Burden in Schizophrenia
Gater, A., Rofail, D., Tolley, C., Marshall, C., Abetz‐Webb, L., Zarit, S. H., & Berardo, C. G. (2014) · Schizophrenia Research and Treatment · doi:10.1155/2014/368215 · Cited by 121
Development of a New Patient-reported Outcome Instrument to Evaluate Treatments for Scars: The SCAR-Q
Klassen, A. F., Ziolkowski, N. I., Mundy, L. R., Miller, H. C., McIlvride, A., DiLaura, A., Fish, J. S., & Pusic, A. L. (2018) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000001672 · Cited by 96
Clinical outcome assessment in clinical trials of chronic pain treatments
Patel, K. V., Amtmann, D., Jensen, M. P., Smith, S. M., Veasley, C., & Turk, D. C. (2021) · PAIN Reports · doi:10.1097/pr9.0000000000000784 · Cited by 100
Patient Reported Outcomes in Rheumatoid Arthritis Clinical Trials
Orbai, A., & Bingham, C. O. (2015) · Current Rheumatology Reports · doi:10.1007/s11926-015-0501-8 · Cited by 95
Patient-reported outcomes in meta-analyses – Part 1: assessing risk of bias and combining outcomes
Johnston, B. C., Patrick, D. L., Busse, J. W., Schünemann, H. J., Agarwal, A., & Guyatt, G. H. (2013) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-11-109 · Cited by 100
Self-citation
Meaningful Endpoints for Idiopathic Pulmonary Fibrosis (IPF) Clinical Trials: Emphasis on ‘Feels, Functions, Survives’. Report of a Collaborative Discussion in a Symposium with Direct Engagement from Representatives of Patients, Investigators, the National Institutes of Health, a Patient Advocacy Organization, and a Regulatory Agency
Raghu, G., Ghazipura, M., Fleming, T. R., Aronson, K. I., Behr, J., Brown, K. M., Flaherty, K. R., Kazerooni, E. A., Maher, T. M., Richeldi, L., et al. (2024) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.202312-2213so · Cited by 108
Advancing Clinical Trials for Inherited Retinal Diseases: Recommendations from the Second Monaciano Symposium
Thompson, D. A., Iannaccone, A., Ali, R. R., Arshavsky, V. Y., Audo, I. S., Bainbridge, J. W., Besirli, C. G., Birch, D. G., Branham, K. E. H., Cideciyan, A. V., et al. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.7.2 · Cited by 96
FACE-Q Skin Cancer Module for measuring patient-reported outcomes following facial skin cancer surgery
Lee, E. H., Klassen, A. F., Cano, S., Nehal, K. S., & Pusic, A. L. (2018) · British Journal of Dermatology · doi:10.1111/bjd.16671 · Cited by 94
Measuring the impact of migraine for evaluating outcomes of preventive treatments for migraine headaches
Mannix, S., Skalicky, A. M., Buse, D. C., Desai, P., Sapra, S. J., Ortmeier, B. G., Widnell, K. L., & Hareendran, A. (2016) · Health and Quality of Life Outcomes · doi:10.1186/s12955-016-0542-3 · Cited by 88
Patient involvement in the development of patient-reported outcome measures: The developers’ perspective
Wiering, B., de Boer, D., & Delnoij, D. M. J. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2582-8 · Cited by 89
Development of the Patient Scale of the Patient and Observer Scar Assessment Scale (POSAS) 3.0: a qualitative study
Carrière, M. E., Mokkink, L. B., Tyack, Z. F., Westerman, M. J., Pijpe, A., Pleat, J., van de Kar, A. L., Brown, J. N., de Vet, H. C. W., & van Zuijlen, P. P. M. (2022) · Quality of Life Research · doi:10.1007/s11136-022-03244-6 · Cited by 91
What is important for you? A qualitative interview study of living with diabetes and experiences of diabetes care to establish a basis for a tailored Patient-Reported Outcome Measure for the Swedish National Diabetes Register
Engström, M. S., Leksell, J. K., Johansson, U., & Guðbjörnsdóttir, S. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010249 · Cited by 87
Establishing Content Validity of the CLEFT-Q: A New Patient-reported Outcome Instrument for Cleft Lip/Palate
Tsangaris, E., Riff, K. W. Y. W., Goodacre, T., Forrest, C. R., Dreise, M. M., Sykes, J. M., de Chalain, T., Harman, K., O'Mahony, A. M., Pusic, A. L., et al. (2017) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000001305 · Cited by 87
Tutorial on how to calculating content validity of scales in medical research
Madadizadeh, F., & Bahariniya, S. (2023) · Perioperative Care and Operating Room Management · doi:10.1016/j.pcorm.2023.100315 · Cited by 97
Value to Whom? The Patient Voice in the Value Discussion
Perfetto, E. M., Oehrlein, E. M., Boutin, M., Reid, S. M., & Gascho, E. (2017) · Value in Health · doi:10.1016/j.jval.2016.11.014 · Cited by 87
An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments
Staunton, H., Willgoss, T., Nelsen, L. M., Burbridge, C., Sully, K., Rofail, D., & Arbuckle, R. (2019) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-019-0100-y · Cited by 89
Development of the Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT®) questionnaire: a new patient-reported outcome instrument for PAH
McCollister, D. H., Shaffer, S., Badesch, D. B., Filusch, A., Hunsche, E., Schüler, R., Wiklund, I. E., & Peacock, A. J. (2016) · Respiratory Research · doi:10.1186/s12931-016-0388-6 · Cited by 80
A call to action to inform patient‐centred approaches to obesity management: Development of a disease‐illness model
Fastenau, J. M., Kolotkin, R. L., Fujioka, K., Alba, M., Canovatchel, W. J., & Traina, S. (2019) · Clinical Obesity · doi:10.1111/cob.12309 · Cited by 78
Qualitative validation of the FACIT-Fatigue scale in systemic lupus erythematosus
Kosinski, M. R., Gajria, K., Fernandes, A., & Cella, D. F. (2013) · Lupus · doi:10.1177/0961203313476360 · Cited by 79
Measurement challenges in shared decision making: putting the ‘patient’ in patient‐reported measures
Barr, P. J., & Elwyn, G. J. (2015) · Health Expectations · doi:10.1111/hex.12380 · Cited by 78
Evidence-Based Interventions for Adult Aural Rehabilitation: That Was Then, This Is Now
Maidment, D. W., Henshaw, H., Heffernan, E., & Ferguson, M. (2019) · Seminars in Hearing · doi:10.1055/s-0038-1676784 · Cited by 76
Patient-Reported Outcome Instruments for Physical Symptoms Among Patients Receiving Maintenance Dialysis: A Systematic Review
Flythe, J. E., Powell, J. D., Poulton, C. J., Westreich, K. D., Handler, L., Reeve, B. B., & Carey, T. S. (2015) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2015.05.020 · Cited by 75
Measuring respiratory symptoms in clinical trials of COPD: reliability and validity of a daily diary
Leidy, N. K., Sexton, C., Jones, P., Notte, S. M., Monz, B. U., Nelsen, L. M., Goldman, M. H., Murray, L. T., & Sethi, S. (2014) · Thorax · doi:10.1136/thoraxjnl-2013-204428 · Cited by 73
Self-citation
International guidance on the selection of patient-reported outcome measures in clinical trials: a review
Crossnohere, N. L., Brundage, M., Calvert, M., King, M. T., Reeve, B. B., Thorner, E. D., Wu, A. W., & Snyder, C. F. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02625-z · Cited by 77
FACE-Q Eye Module for Measuring Patient-Reported Outcomes Following Cosmetic Eye Treatments
Klassen, A. F., Cano, S., Grotting, J. C., Baker, S. B., Carruthers, J., CARRUTHERS, A. J., Laeken, N. V., Sykes, J. M., Schwitzer, J. A., & Pusic, A. L. (2016) · JAMA Facial Plastic Surgery · doi:10.1001/jamafacial.2016.1018 · Cited by 70
The PROactive innovative conceptual framework on physical activity
Dobbels, F., de Jong, C., Drost, E., Elberse, J., Feridou, C., Jacobs, L., Rabinovich, R., Frei, A., Puhan, M. A., de Boer, W. I., et al. (2014) · European Respiratory Journal · doi:10.1183/09031936.00004814 · Cited by 67
A specific method for qualitative medical research: the IPSE (Inductive Process to analyze the Structure of lived Experience) approach
Sibéoni, J., Verneuil, L., Manolios, É., & Révah‐Levy, A. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01099-4 · Cited by 87
Patient-Reported Outcome Measures in Lymphedema: A Systematic Review and COSMIN Analysis
Beelen, L. M., van Dishoeck, A., Tsangaris, E., Coriddi, M. R., Dayan, J. H., Pusic, A. L., Klassen, A. F., & Vasilic, D. (2020) · Annals of Surgical Oncology · doi:10.1245/s10434-020-09346-0 · Cited by 74
Tools for assessing the scalability of innovations in health: a systematic review
Charif, A. B., Zomahoun, H. T. V., Gogovor, A., Samri, M. A., Massougbodji, J., Wolfenden, L., Ploeg, J., Zwarenstein, M., Milat, A., Rhéault, N., et al. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00830-5 · Cited by 76
A randomized crossover trial of elamipretide in adults with primary mitochondrial myopathy
Karaa, A., Haas, R., Goldstein, A. C., Vockley, J. E., & Cohen, B. H. (2020) · Journal of Cachexia Sarcopenia and Muscle · doi:10.1002/jcsm.12559 · Cited by 68
Content validity: judging the relevance, comprehensiveness, and comprehensibility of an outcome measurement instrument – a COSMIN perspective
Mokkink, L. B., Herbelet, S., Tuinman, P. R., & Terwee, C. B. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111879 · Cited by 96
Characterizing mobility from the prosthetic limb user’s perspective
Hafner, B. J., Morgan, S. J., Abrahamson, D. C., & Amtmann, D. (2015) · Prosthetics and Orthotics International · doi:10.1177/0309364615579315 · Cited by 66
Patients’ appropriateness, acceptability, usability and preferences for pharmaceutical preparations: Results from a literature review on clinical evidence
Drumond, N., van Riet‐Nales, D. A., Karapinar‐Çarkit, F., & Stegemann, S. (2017) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2017.02.029 · Cited by 65
Patients’ Perspectives on Outcomes of Care After Discharge From the Emergency Department: A Qualitative Study
Vaillancourt, S., Seaton, M. B., Schull, M. J., Cheng, A. H. Y., Beaton, D., Laupacis, A., & Dainty, K. N. (2017) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2017.05.034 · Cited by 65
Development of the BODY-Q Chest Module Evaluating Outcomes following Chest Contouring Surgery
Klassen, A. F., Kaur, M. N., Poulsen, L., Fielding, C., Geerards, D., van de Grift, T. C., Hoogbergen, M. M., Juhl, C. B., Lorenzen, M. M., McEvenue, G., et al. (2018) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000004978 · Cited by 66
Understanding the Symptom Burden and Impact of Myasthenia Gravis from the Patient’s Perspective: A Qualitative Study
Jackson, K., Parthan, A., Lauher-Charest, M., Broderick, L. E., Law, N., & Barnett, C. (2022) · Neurology and Therapy · doi:10.1007/s40120-022-00408-x · Cited by 64
The Use of Qualitative Methods in Developing the Descriptive Systems of Preference-Based Measures of Health-Related Quality of Life for Use in Economic Evaluation
Stevens, K. J., & Palfreyman, S. J. (2012) · Value in Health · doi:10.1016/j.jval.2012.08.2204 · Cited by 67
Nurse perceptions of organizational culture and its association with the culture of error reporting: a case of public sector hospitals in Pakistan
Jafree, S. R., Zakar, R., Zakar, M. Z., & Fischer, F. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-1252-y · Cited by 62
Patient-Reported Outcome Measures
Poulsen, L., McEvenue, G., Klassen, A. F., Hoogbergen, M. M., Sørensen, J. A., & Pusic, A. L. (2018) · Clinics in Plastic Surgery · doi:10.1016/j.cps.2018.08.003 · Cited by 61
Patient Reported Outcome Measures (PROMs) in Inflammatory Bowel Disease: New Data
Bojic, D., Bodger, K., & Travis, S. P. L. (2016) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjw187 · Cited by 60
Patient-reported outcome measures for acute and chronic pain
Pogatzki-Zahn, E. M., Schnabel, K., & Kaiser, U. (2019) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000000780 · Cited by 62
A Systematic Review of Patient-Reported Outcome Measures Used in Adult Burn Research
Griffiths, C., Guest, E., White, P., Gaskin, E., Rumsey, N., Pleat, J., & Harcourt, D. M. (2016) · Journal of Burn Care & Research · doi:10.1097/bcr.0000000000000474 · Cited by 60
Patient-reported fatigue and its impact on patients with systemic lupus erythematosus
Sterling, K., Gallop, K., Swinburn, P., Flood, E. M., French, A., Sawah, S. A., Iikuni, N., Naegeli, A. N., & Nixon, A. (2013) · Lupus · doi:10.1177/0961203313511554 · Cited by 58
A Qualitative Research for Defining Meaningful Attributes for the Treatment of Inflammatory Bowel Disease from the Patient Perspective
Louis, E. J., Ramos-Goñi, J. M., Cuervo, J., Kopylov, U., Acosta, M. B., McCartney, S. A., Rosenfeld, G. A., Bettenworth, D., Hart, A., Novak, K. L., et al. (2020) · Patient · doi:10.1007/s40271-019-00407-5 · Cited by 58
Qualitative Methods and Patient-Reported Outcomes
Cheng, K. K. F., & Clark, A. M. (2017) · International Journal of Qualitative Methods · doi:10.1177/1609406917702983 · Cited by 57
Performance of the EXAcerbations of Chronic Pulmonary Disease Tool Patient-reported Outcome Measure in Three Clinical Trials of Chronic Obstructive Pulmonary Disease
Leidy, N. K., Murray, L. T., Jones, P., & Sethi, S. (2014) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201309-305oc · Cited by 57
Self-citation
Assessing Outcomes in Body Contouring
Klassen, A. F., Cano, S., Scott, A., Tsangaris, E., & Pusic, A. L. (2014) · Clinics in Plastic Surgery · doi:10.1016/j.cps.2014.06.004 · Cited by 57
Validation and reliability of a disease‐specific quality of life measure (the T ran Q ol) in adults and children with thalassaemia major
Klaassen, R. J., Barrowman, N. J., Merelles‐Pulcini, M., Vichinsky, E. P., Sweeters, N., Kirby-Allen, M. A., Neufeld, E. J., Kwiatkowski, J. L., Wu, J. K., Vickars, L. M., et al. (2013) · British Journal of Haematology · doi:10.1111/bjh.12631 · Cited by 56
Development and validation of the Cholinergic Urticaria Quality‐of‐Life Questionnaire (CholU‐QoL)
Ruft, J., Asady, A., Staubach, P., Casale, T. B., Sussmann, G., Zuberbier, T., Maurer, M., Weller, K., & Altrichter, S. (2018) · Clinical and Experimental Allergy · doi:10.1111/cea.13102 · Cited by 45
Prospective development of a patient‐reported outcomes instrument for desmoid tumors or aggressive fibromatosis
Gounder, M. M., Maddux, L., Paty, J. A., & Atkinson, T. M. (2019) · Cancer · doi:10.1002/cncr.32555 · Cited by 56
Development of the symptoms and impacts questionnaire for Crohn's disease and ulcerative colitis
Dulai, P. S., Jairath, V., Khanna, R., Ma, C., McCarrier, K. P., Martin, M. L., Parker, C. E., Morris, J. C., Feagan, B. G., & Sandborn, W. J. (2020) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.15726 · Cited by 56
Self-citation

Authors: Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L.
Affiliations: University of Washington (US)
United States Food and Drug Administration (US)
Brown University (US)
Uppsala University (SE)
Corresponding author: Patrick, Donald L.
ORCID: Patrick, Donald L.
Burke, Laurie B.
Gwaltney, Chad J.
Venue: Value in Health
Publisher: Elsevier BV
Published: 2011-12
Volume: 14
Issue: 8
Pages: 967-977
ISSN: 1098-3015 (ISSN-L)
DOI: 10.1016/j.jval.2011.06.014
OpenAlex: W2128536774
Cited by: 1,095
References: 47
Citations by year: 2026: 87 · 2025: 96 · 2024: 113 · 2023: 89 · 2022: 91 · 2021: 119 · 2020: 98 · 2019: 78 · 2018: 74 · 2017: 63 · 2016: 59 · 2015: 43 · 2014: 37 · 2013: 32 · 2012: 13
FWCI: 67.99
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/open-access/userlicense/1.0/ (vor, 593 d)
Locations: Value in Health (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
Health Sciences › Nursing › Research and Theory › Health Education and Validation
Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords: content validity, patient-reported outcomes, item generation, cognitive interviewing, regulatory submissions, patient understanding, good scientific practice
MeSH terms: Documentation, European Union, Humans, Interviews as Topic, Surveys and Questionnaires, Research Design, United States, United States Food and Drug Administration, Outcome Assessment, Health Care, Focus Groups, Qualitative Research, Validation Studies as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content validity–establishing and reporting the evidence in newly developed patient‐reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1 – eliciting concepts for a new PRO instrument

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks