The DOI matches its Crossref record; 59 of the 61 references it cites were found in a registry or an index; 1 of the 53 sources its claims cite were checked for support.
PRO development: rigorous qualitative research as the crucial foundation
Open accessAbstract
Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity.
Overview
CoChat Summary
## TL;DR
This paper argues that rigorous qualitative research is the foundation of patient-reported outcome (PRO) development because it is what establishes content validity, meaning, and relevance from subjects’ perspectives. It proposes combining a phenomenological theoretical framework with grounded theory methods and illustrates the approach using irritable bowel syndrome (IBS) focus groups and interviews.
## Key findings
- The authors state that PRO development should use an overarching phenomenological framework with grounded theory data collection and analysis to produce items and scales with content validity.
- They report that, in their IBS example, four concept elicitation gender-specific focus groups were conducted for IBS-C, and findings were triangulated with cognitive interviews in IBS-C and another set of focus group data in IBS-D.
- The paper says the IBS-C/IBS-D analysis used constant comparison and iterative coding to develop a conceptual framework; for example, “abdominal discomfort” was found to be multidimensional, meaning mild pain, fullness, and bloating for IBS-C, while for IBS-D it was described as an affective state tied to feeling embarrassed.
- The authors describe saturation as essential for adequacy of sample size and note that in the IBS study saturation was documented to show that important concepts were considered for inclusion in the conceptual framework.
## Methods
- Methodological paper describing qualitative methods for PRO development, with an applied example from a 2008 focus group study to develop a PRO instrument for IBS-C and IBS-D.
- The example used four focus groups, described as gender-specific and conducted with a semi-structured interview guide using open-ended questions and sensitizing concepts from literature and clinician input.
- Analysis combined grounded theory, constant comparison, iterative coding, memoing, and qualitative software (ATLAS.ti) to build concepts, sub-concepts, domains, and a conceptual framework; the authors also used triangulation with cognitive interviews and additional focus groups.
## Limitations
- The paper explicitly notes that qualitative research in the PRO field often lacks transparent documentation of how subjects’ words are linked to concepts and items, making results hard to evaluate; this is presented as a field-level limitation rather than a limitation of the authors’ own study.
- The text makes evident that the IBS example is methodological and illustrative, not a fully reported empirical study with outcome estimates; many procedural claims are described without full sample details or participant numbers beyond the four focus groups and the mention of 15 interviews as an example for saturation analysis (not stated as the study’s actual interview count).
- The passage about reliability is cut off in the provided text, so any specific reliability results or full validation outcomes for the IBS example are not fully stated in the paper text provided.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 0 Not valid · 35 Not checked · 39 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“There is no consistent approach or theoretical framework, however, in this broad-based research that one might use as a guideline to apply qualitative inquiry to the development of PROs [30–33].”
§ PRO development: rigorous qualitative research as the crucial foundation > Brief background: psychology of survey research and qualitative health research
What the sources say
- Not checked yetcites [30] Armes, J., Krishnasamy, M., & Higginson, I. (2004). Fatigue in cancer. Oxford, UK: Oxford University Press. source
- Partly supportedcites [31] Dixon-Woods, M., Shaw, R. L., Agarwal, S., & Smith, J. A. (2004). The problem of appraising qualitative research. Quality & Safety in Health Care, 13(3), 223–225. sourceExperimental — accuracy not yet measured
Our copy strongly supports the general half of the claim: the Abstract states that 'currently there are many different proposals with few signs of an emerging consensus', the QUALITY CRITERIA FOR QUALITATIVE RESEARCH section reports 'over 100 sets of proposals on quality in qualitative research, some adopting non-reconcilable positions', and the UNIVERSAL AND SPECIFIC section describes 'the diversity—indeed, near anarchy—in qualitative methodology' with the field's execution tied to whichever theoretical perspective the researchers adopt (QUALITATIVE RESEARCH IS NOT A UNIFIED FIELD). However, the claim's specific application—using qualitative inquiry as a guideline for the development of patient-reported outcomes (PROs)—is absent: searched 'patient reported outcome', 'questionnaire/instrument development', 'measurement'; the paper is about appraising qualitative studies in quality and safety in health care and never discusses PRO construction. Note also that the citation sits in a cluster [30-33], so this source supplies only the methodological-diversity point, not the PRO-specific literature base. (LLM, conf=0.72)
- Not checked yetcites [32] Wu, H. S., & McSweeney, M. (2004). Assessing fatigue in persons with cancer: An instrument development and testing study. Cancer, 101(7), 1685–1695. source
- Not checked yetcites [33] Liamputtong, P., & Ezzy, D. (2005). Qualitative research methods (2nd ed. ed.). Melbourne, Australia: Oxford University Press.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For subjects with IBS-D, abdominal discomfort appears to be an affective state (i.e., relates to an emotional response of feeling embarrassed) rather than a symptom itself that results from various symptoms and associated sensations (e.g., mild pain, bloating, and the immediate need to go).”
§ PRO development: rigorous qualitative research as the crucial foundation > Data analysis
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For subjects with IBS-C, discomfort meant a mild pain, fullness, and bloating.”
§ PRO development: rigorous qualitative research as the crucial foundation > Data analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Through such comparisons, it became clear that that abdominal discomfort, part of the clinical diagnostic criteria of both IBS-C and IBS-D, was a multidimensional concept.”
§ PRO development: rigorous qualitative research as the crucial foundation > Data analysis
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In IBS-C on the other hand, urgency was in effect feeling afraid of missing the opportunity to have a BM, a positive event for patients with IBS-C.”
§ PRO development: rigorous qualitative research as the crucial foundation > Questions of reliability and validity of results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
23 more claims
Create a free account to see all 75 claims and to verify the 52 references still open.
- It may state two separate claims as one. 13
- Probably not a substantial claim. 41
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Focusing on subjectivity and experiential data, i.e., how individuals perceive and understand their feelings, sensations or actions, the in-depth interview is particularly appropriate to identify issues of interest for developing questionnaires [8].”
From Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience (2014) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The discussion guide determines a focus for the inquiry [18], establishes boundaries, although flexible, for the study, and provides inclusion/exclusion criteria for new information. It also determines the successive phases of the inquiry with less and more focus [8].”
From Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience (2014) · cites this paper as [8]
Experimental — accuracy not yet measuredIn the citing paper
“several researchers stressed the importance of this approach as the necessary starting point for developing measurement tools to be used in quantitative research in order to ensure content validity [8-12].”
From Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience (2014) · cites this paper as [8]
In the citing paper
“an over-arching phenomenological approach with grounded data collection and analysis methods has been suggested to most accurately include the patient’s voice in PRO development [8].”
From Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience (2014) · cites this paper as [8]
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194 · cited 1×
“including comprehension, retrieval, judgment, response selection, and response reporting [25].”
BackgroundThe Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509 · cited 1×
“Researchers have published or presented criteria on how to evaluate qualitative research in health literature in general and in the development of PROs in particular [12–16].”
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
(1998) · Sage eBooks · Cited by 38,631
Qualitative research & evaluation methods
Patton, M. Q. (2002) · Sage eBooks · Cited by 29,633
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
(2008) · Biostatistics and Microbiology: A Survival Manual · doi:10.1007/978-0-387-77282-0_6 · Cited by 17,371
Qualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131
Qualitative research. Introducing focus groups.
Kitzinger, J. (1995) · BMJ · doi:10.1136/bmj.311.7000.299 · Cited by 6,939 · cited 2×
“... guide as to which concepts and which relationships between those concepts should be the focus of a research study), if any, would best serve PRO development? A conceptual framework as defined by the Food and Drug Administration (FDA), one of the major constituents for PROs, represents the demonstrated relationship…”
Background
Research works printed but not linked: 4
- Willis, G. (2005). Cognitive interviewing in practice. In Cognitive. Interviewing (Ed.), A tool for improving questionnaire design (pp. 42–62). Thousand Oaks, CA: Sage Publishers.
- Crabtree, B. F., & Miller, W. L. (1992). Doing qualitative research: Research methods for primary care. London: Sage Publications.
- Banister, P., Burman, E., Parker, I., Taylor, M., & Tindall, C. (2006). Qualiative methods in psychology: A research guide. Berkshire, UK: Open University Press.
- Tourangeau, R. (1984). Cognitive science and survey methods. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey design: Building a bridge between disciplines (pp. 73–100). Washington, D.C.: National Academy Press.
Cited by
Are We There Yet? Data Saturation in Qualitative Research
Fusch, P., & Ness, L. (2015) · The Qualitative Report · doi:10.46743/2160-3715/2015.2281 · Cited by 4,460
Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011) · Value in Health · doi:10.1016/j.jval.2011.06.014 · Cited by 1,095
Klassen, A. F., Cano, S. J., Schwitzer, J. A., Scott, A. M., & Pusic, A. L. (2015) · Plastic and Reconstructive Surgery · doi:10.1097/prs.0000000000000895 · Cited by 280
Development and Psychometric Evaluation of the FACE-Q Satisfaction with Appearance Scale
Pusic, A. L., Klassen, A. F., Scott, A. M., & Cano, S. J. (2013) · Clinics in Plastic Surgery · doi:10.1016/j.cps.2012.12.001 · Cited by 253
Brédart, A., Marrel, A., Abetz-Webb, L., Lasch, K., & Acquadro, C. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-15 · Cited by 195
“Content validity, measuring what one intends to measure, is the measurement property in this context that assesses whether items are comprehensive, well understood and adequately reflect the patient perspective from the population of interest [8-14].”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Lasch, K. E., Marquis, P., Vigneux, M., Abetz, L., Arnould, B., Bayliss, M., Crawford, B., & Rosa, K.
- Corresponding author
- Lasch, Kathryn Eilene
- Venue
- Quality of Life Research
- Published
- 2010-05-30
- Volume
- 19
- Issue
- 8
- Pages
- 1087-1096
- ISSN
- 0962-9343 (ISSN-L)
- 1573-2649
- PMC
- PMC2940042
- OpenAlex
- W2070613259
- Cited by
- 461
- References
- 61
- Citations by year
- 2026: 13 · 2025: 23 · 2024: 35 · 2023: 22 · 2022: 50 · 2021: 47 · 2020: 48 · 2019: 32 · 2018: 38 · 2017: 30 · 2016: 30 · 2015: 18 · 2014: 23 · 2013: 25 · 2012: 14
- FWCI
- 78.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- creativecommons.org/licenses/by-nc/2.0 (tdm)
- Locations
- Quality of Life Research (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- patient-reported outcomes, content validity, qualitative research, phenomenological framework, grounded theory, focus groups, patient input, scale development, psychometric properties
- MeSH terms
- Data Collection, Patients, Psychometrics, Outcome Assessment, Health Care, Validation Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: PRO development: rigorous qualitative research as the crucial foundation. https://app.cochat.ai/papers/10.1007/s11136-010-9677-6
- The paper
- Lasch, K. E., Marquis, P., Vigneux, M., Abetz, L., Arnould, B., Bayliss, M., Crawford, B., & Rosa, K. (2010). PRO development: rigorous qualitative research as the crucial foundation. Quality of Life Research. https://doi.org/10.1007/s11136-010-9677-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.