Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience
Open accessThe DOI matches its Crossref record; 62 of the 63 references it cites were found in a registry or an index; 2 of the 47 sources its claims cite were checked for support.
Abstract
Patient-reported outcome (PRO) measures must provide evidence that their development followed a rigorous process for ensuring their content validity. To this end, the collection of data is performed through qualitative interviews that allow for the elicitation of in-depth spontaneous reports of the patients' experiences with their condition and/or its treatment. This paper provides a review of qualitative research applied to PRO measure development. A clear definition of what is a qualitative research interview is given as well as information about the form and content of qualitative interviews required for developing PRO measures. Particular attention is paid to the description of interviewing approaches (e.g., semi-structured and in-depth interviews, individual vs. focus group interviews). Information about how to get prepared for a qualitative interview is provided with the description of how to develop discussion guides for exploratory or cognitive interviews. Interviewing patients to obtain knowledge regarding their illness experience requires interpersonal and communication skills to facilitate patients' expression. Those skills are described in details, as well as the skills needed to facilitate focus groups and to interview children, adolescents and the elderly. Special attention is also given to quality assurance and interview training. The paper ends on ethical considerations since interviewing for the development of PROs is performed in a context of illness and vulnerability. Therefore, it is all the more important that, in addition to soliciting informed consent, respectful interactions be ensured throughout the interview process.
Overview
CoChat Summary
TL;DR
This is a methodological review on how to conduct qualitative interviews for developing patient-reported outcome (PRO) measures, with a focus on content validity. It argues that careful interview design, interviewer skills, quality assurance, and ethical safeguards are essential when eliciting patients’ experiences of illness and treatment.
Key findings
- PRO development should start with qualitative research because content validity requires that items are “comprehensive, well understood and adequately reflect the patient perspective from the population of interest.”
- The paper distinguishes exploratory interviews from cognitive interviews: exploratory interviews identify domains/sub-domains and build a conceptual model, while cognitive interviews test whether patients understand items, instructions, recall periods, and response options as intended.
- Individual interviews are described as better for privacy and in-depth disclosure, while focus groups can reveal shared perspectives but may produce socially desirable responses and make it difficult to go in depth.
- The paper reports that, in a cited study, “open questions located later on in the interview” and framed in the present or past tense produced “more richness” than closed questions or future-tense questions.
Methods
- Narrative review of qualitative interviewing methods as applied to PRO measure development; the paper synthesizes prior literature rather than reporting a new empirical study.
- Focuses on interview forms and procedures relevant to PRO development, including in-depth and semi-structured interviews, individual interviews, focus groups, exploratory interviews, and cognitive interviews.
- Main analysis is conceptual and practice-oriented: it reviews guidance on discussion-guide design, interviewer communication skills, quality assurance, training, and ethical considerations.
Limitations
- The paper does not report original empirical data, so its conclusions are based on a review and synthesis of existing guidance rather than a primary study.
- It states that “few articles offer guidance for obtaining rich interview data,” which limits the evidence base for some recommendations.
- Evident from the text: many recommendations are general best practices drawn from prior work, and the paper does not quantify their effects across settings or populations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 1 Not valid · 33 Not checked · 24 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Focusing on subjectivity and experiential data, i.e., how individuals perceive and understand their feelings, sensations or actions, the in-depth interview is particularly appropriate to identify issues of interest for developing questionnaires [8].”
§ Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience > Review > Forms of qualitative research interviews
What the sources say
- Partly supportedcites [8] Lasch K, Marquis P, Vigneux M, Abetz L, Arnould B, Bayliss M, Crawford B, Rosa K: PRO development: rigorous qualitative research as the crucial foundation. Qual Life Res 2010, 19(8):1087–1096. 10.1007/s11136-010-9677-6 sourceExperimental — accuracy not yet measured
Our copy supports the general thrust: the phenomenological framework section states qualitative research accesses the phenomenon 'through the eyes of the person(s) having the experience' and the Data analysis section (p. ~6) calls interpretation 'essential to capturing subjects' meaning of feelings and impacts of a condition and its treatment', while the Overview of approaches and Conclusion sections endorse qualitative interviewing for identifying concepts/items for a PRO questionnaire ('The ability to develop items for a PRO measure...'; 'to develop a conceptual framework; to use appropriate, meaningful, subject-friendly wording when developing the items'). What the paper does not support is the singling-out of the in-depth interview as 'particularly appropriate': the Qualitative interviewing section treats focus groups and in-depth individual interviews interchangeably ('Whether the researcher uses focus group methods or in-depth individual interviews, the development of a truly open-ended discussion guide is essential...'), and the paper's own concept-elicitation example used four focus groups rather than individual interviews. The unsupported part is the claimed comparative preference for the in-depth interview format. (LLM, conf=0.72)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“What has not been addressed sufficiently in this literature is how best practices in interviewing methods can contribute to the quality and usefulness of the data collected.”
§ Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience > Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The semi-structured interview is also useful at a later stage of the questionnaire development, namely to address patients’ understanding of questionnaire items and check for content validity [24].”
§ Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience > Review > Forms of qualitative research interviews
What the sources say
- Not checked yetcites [24] Willis GB: Cognitive Interviewing: A Tool for Improving Questionnaire Design. London: Sage; 2005. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Hence, the qualitative research interview follows primarily an inductive approach; data-gathering is subject to ongoing revision; interview questions are flexible and individualised, and the emphasis is placed on depth of information [26].”
§ Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience > Review > Forms of qualitative research interviews
What the sources say
- Not checked yetcites [26] Mathieson CM: Interviewing the Ill and the Healthy: Paradigm or Process? In Qualitative Health Psychology: Theories and methods. Edited by: Murray M, Chamberlain K. London: Sage; 1999:117–132. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“They found that open questions located later on in the interview and framed in the present or past tense rather than closed questions, located at the beginning or middle in the interview or framed in the future tense, provided more richness in interviewees’ answers.”
§ Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience > Review > Quality assurance and interview training
What the sources say
- Not checked yetcites [50] Ogden J, Cornwell D: The role of topic, interviewee and question in predicting rich interview data in the field of health research. Sociol Health Illn 2010, 32(7):1059–1071. 10.1111/j.1467-9566.2010.01272.x source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
7 more claims
Create a free account to see all 60 claims and to verify the 45 references still open.
- Probably not a substantial claim. 44
- It may state two separate claims as one. 21
Citations
Cites
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
(2006) · Cited by 18,730
Constructing Grounded Theory. A Practical Guide Through Qualitative Analysis
(2006) · QMiP Bulletin · doi:10.53841/bpsqmip.2006.1.2.36 · Cited by 11,828
The SAGE handbook of qualitative research
(2005) · Choice Reviews Online · doi:10.5860/choice.43-1330 · Cited by 10,183
An Introduction to Qualitative Research
Flick, U. (2023) · SAGE Publications Ltd eBooks · doi:10.4135/9781036231712 · Cited by 8,198
Qualitative research. Introducing focus groups.
Kitzinger, J. (1995) · BMJ · doi:10.1136/bmj.311.7000.299 · Cited by 6,939 · cited 1×
“However, he/ she may adopt an interventionist style [46], encouraging people to talk to one another.”
Background(2008) · Cited by 6,727
The qualitative research interview
DiCicco‐Bloom, B., & Crabtree, B. F. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02418.x · Cited by 4,995 · cited 4×
“The researcher must develop a positive relationship with the interviewee [20,21], allowing for equality, trust and involvement [38].”
BackgroundInfluentialInterviews – Learning the Craft of Qualitative Research Interviewing
Vaivio, J. (2012) · European Accounting Review · doi:10.1080/09638180.2012.675165 · Cited by 4,535
Qualitative Psychology: A Practical Guide to Research Methods
(2008) · QMiP Bulletin · doi:10.53841/bpsqmip.2008.1.6.47 · Cited by 4,351
Research works printed but not linked: 4
- U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health: Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. Fed Regist 2009, 74(35):65132–65133. [http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdf]
- Boutin G: L’entretien De Recherche Qualitatif. Quebec: Presses de l’Université du Québec; 1997.
- Hughes KA: Comparing Pretesting Methods: Cognitive Interviews, Respondents Debriefing, and Behaviour Coding (U. S, Bureau of the Census Research Report Series #2004–02). Washington DC: Statistical Research Division; 2004.
- Morgan DL, Krueger RA: Focus Group Kit. Volume 1–6. London: Sage; 1997.
Cited by
Patient involvement in the development of patient‐reported outcome measures: a scoping review
Wiering, B., de Boer, D., & Delnoij, D. (2017) · Health Expectations · doi:10.1111/hex.12442 · Cited by 371
European Society of ColoProctology: guideline for haemorrhoidal disease
van Tol, R. R., Kleijnen, J., Watson, A. J. M., Jongen, J., Altomare, D. F., Qvist, N., Higuero, T., Muris, J. W. M., & Breukink, S. O. (2020) · Colorectal Disease · doi:10.1111/codi.14975 · Cited by 206
“All rights reserved clinicians and researchers to embrace patient-reported outcome measures (PROMs) in clinical care (86-88).”
BackgroundImplementing Patient-Reported Outcome Measures in Clinical Breast Cancer Care: A Systematic Review
van Egdom, L. S. E., Oemrawsingh, A., Verweij, L. M., Lingsma, H. F., Koppert, L. B., Verhoef, C. K., Klazinga, N., & Hazelzet, J. A. (2019) · Value in Health · doi:10.1016/j.jval.2019.04.1927 · Cited by 172
Adegbola, S. O., Dibley, L. B., Sahnan, K., Wade, T., Verjee, A., Sawyer, R., Mannick, S., McCluskey, D., Yassin, N., Phillips, R. K. S., et al. (2020) · Health and Quality of Life Outcomes · doi:10.1186/s12955-020-01622-7 · Cited by 132
Qualitative Methods Used to Generate Questionnaire Items: A Systematic Review
Ricci, L., Lanfranchi, J., Lemétayer, F., Rotonda, C., Guillemin, F., Coste, J., & Spitz, É. (2018) · Qualitative Health Research · doi:10.1177/1049732318783186 · Cited by 141
Metadata
- Authors
- Brédart, A., Marrel, A., Abetz-Webb, L., Lasch, K., & Acquadro, C.
- Affiliations
- Université Paris Descartes (FR)
- Mapi Research Trust (FR)
- Pharmerit (United States) (US)
- Corresponding author
- Acquadro, Catherine
- Venue
- Health and Quality of Life Outcomes
- Published
- 2014-02-05
- Volume
- 12
- Issue
- 1
- Pages
- 15-15
- ISSN
- 1477-7525 (ISSN-L)
- PMC
- PMC3933509
- OpenAlex
- W2160447026
- Cited by
- 195
- References
- 63
- Citations by year
- 2026: 9 · 2025: 20 · 2024: 14 · 2023: 16 · 2022: 19 · 2021: 30 · 2020: 21 · 2019: 16 · 2018: 10 · 2017: 11 · 2016: 17 · 2015: 8 · 2014: 4
- FWCI
- 4.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Health and Quality of Life Outcomes (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- patient-reported outcome measures, qualitative interviews, content validity, patient experience, illness experience, cognitive interviewing, exploratory interviews, focus groups, interview training, interview skills, research ethics, informed consent, quality assurance
- MeSH terms
- Age Factors, Communication, Health Services Research, Humans, Interviews as Topic, Patients, Professional-Patient Relations, Surveys and Questionnaires, Sex Factors, Outcome Assessment, Health Care, Focus Groups, Guidelines as Topic, Qualitative Research, Patient Preference, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience. https://app.cochat.ai/papers/10.1186/1477-7525-12-15
- The paper
- Brédart, A., Marrel, A., Abetz-Webb, L., Lasch, K., & Acquadro, C. (2014). Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience. Health and Quality of Life Outcomes. https://doi.org/10.1186/1477-7525-12-15
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.