The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index; 1 of the 11 sources its claims cite were checked for support.
Towards the use of mixed methods inquiry as best practice in health outcomes research
Open accessAbstract
Mixed methods research (MMR) has found an increased interest in the field of health outcomes research. Consideration for both qualitative and quantitative perspectives has become key to contextualising patient experiences in a clinically meaningful measurement framework. The purpose of this paper is to outline a process for incorporating MMR in health outcomes research to guide stakeholders in their understanding of the essence of mixed methods inquiry. In addition, this paper will outline the benefits and challenges of MMR and describe the types of support needed for designing and conducting robust MMR measurement studies. MMR involves the application of a well-defined and pre-specified research design that articulates purposely and prospectively, qualitative and quantitative components to generate an integrated set of evidence addressing a single research question. Various methodological design options are possible depending on the research question. MMR designs allow a research question to be studied thoroughly from different perspectives. When applied, it allows the strengths of one approach to complement the restrictions of another. Among other applications, MMR can be used to enhance the creation of conceptual models and development of new instruments, to interpret the meaningfulness of outcomes in a clinical study from the patient perspective, and inform health care policy. Robust MMR requires research teams with experience in both qualitative and quantitative research. Moreover, a thorough understanding of the underlying principles of MMR is recommended at the point of study conception all the way through to implementation and knowledge dissemination. The framework outlined in this paper is designed to encourage health outcomes researchers to apply MMR to their research and to facilitate innovative, patient-centred methodological solutions to address the complex challenges of the field.
Overview
CoChat Summary
## TL;DR
This paper is a position piece from the ISOQOL Mixed Methods SIG arguing that mixed methods research (MMR) should be used as best practice in health outcomes research, especially for patient-reported outcomes. It outlines what MMR is, why it is useful, and what researchers need to do to apply it rigorously.
## Key findings
- The paper cites a review showing that only 11% of patient-reported outcomes (PROs) had been developed by actually asking patients which outcomes are important to them.
- MMR is presented as a way to combine qualitative and quantitative approaches so that research can better reflect patient-identified priorities, scientific rigor, and patient outcomes.
- The authors argue that MMR is especially useful for developing conceptual models and instruments, interpreting PRO results from the patient perspective, and informing health care policy.
- The paper emphasizes that MMR can be helpful for small samples, rare disease populations, and other groups that are difficult to recruit, and that it can support hypothesis generation in phase II trials.
## Methods
- This is a position paper/framework article, not an empirical study.
- It synthesizes the authors’ and ISOQOL Mixed Methods SIG’s discussion of MMR, drawing on prior methodological literature and examples cited in the paper.
- The paper’s main analysis is conceptual and descriptive: it defines MMR, outlines its benefits and challenges, and proposes guiding principles for use in health outcomes research.
## Limitations
- The paper states that MMR is demanding in terms of methodological skillsets and requires teams experienced in both qualitative and quantitative research, as well as in MMR designs.
- It notes that integrating qualitative and quantitative strands can require additional resources and time.
- Evident from the text: the paper is not a primary study and does not test its claims with new data; it provides recommendations and examples rather than empirical evaluation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 0 Not valid · 8 Not checked · 18 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“a recent review of studies documenting the development of patient-reported outcomes (PRO) measures highlights that only 11% of PROs have been developed by actually asking patients which outcomes are important to them [5].”
§ Towards the use of mixed methods inquiry as best practice in health outcomes research > Background
What the sources say
- Supportedcites [5] Wiering, B., de Boer, D., & Delnoij, D. (2017). Patient involvement in the development of patient-reported outcome measures: A scoping review. Health Expect, 20(1), 11–23. source
The Abstract (Main results) and Results ('Patient involvement', p. corresponding section) of Wiering et al. (2017) report that patient involvement in determining which outcome to measure was minimal/limited at 10.9% (composed of 1.0% where all patient suggestions were included and 9.8% where patients helped develop domains or a framework), across 189 studies describing 193 PROMs. That is the figure the citing sentence rounds to 11%, and the citing description ('a recent review of studies documenting the development of PRO measures') matches this scoping review. No qualifier of the source (population of PROM development studies, 1980-2014) is contradicted. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, a critical strength of MMR approaches is that they typically capitalize on data reflecting individual lived experiences (in the qualitative strand).”
§ Towards the use of mixed methods inquiry as best practice in health outcomes research > Benefits and challenges of mixed methods research > Benefits
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“MMR enables a pragmatic path forward to conduct health outcomes measurement research in rare disease populations [20] or populations that are often difficult to recruit for research purposes (e.g., paediatrics, acute mental health, palliative).”
§ Towards the use of mixed methods inquiry as best practice in health outcomes research > Benefits and challenges of mixed methods research > Benefits
What the sources say
- Not checked yetcites [20] Patient-Centered Outcome Measures Initiatives in the Field of Rare Diseases. International Rare Diseases Research Consortium; 2016.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Incorporating the patient voice in MMR helps ensure that the research is focused on the needs and priorities of patients.”
§ Towards the use of mixed methods inquiry as best practice in health outcomes research > Benefits and challenges of mixed methods research > Benefits
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These examples show that MMR can help us to address common questions in the health outcomes field.”
§ Towards the use of mixed methods inquiry as best practice in health outcomes research > Benefits and challenges of mixed methods research > Benefits
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
1 more claim
Create a free account to see all 27 claims and to verify the 10 references still open.
- Probably not a substantial claim. 19
- It may state two separate claims as one. 8
Citations
Cites
1 retracted
WITHDRAWN - Mixed Methods Sampling: A Typology With Examples
Teddlie, C., & Yu, F. (2007) · Journal of Mixed Methods Research · doi:10.1177/2345678906292430 · Cited by 2,250
RetractedSAGE Handbook of Mixed Methods in Social & Behavioral Research
Tashakkori, A., & Teddlie, C. (2010) · doi:10.4135/9781506335193 · Cited by 6,215
Foundations of mixed methods research
Tashakkori, A., & Newman, I. (2023) · International Encyclopedia of Education(Fourth Edition) · doi:10.1016/b978-0-12-818630-5.11036-x · Cited by 857
Moments, Mixed Methods, and Paradigm Dialogs
Denzin, N. K. (2010) · Qualitative Inquiry · doi:10.1177/1077800410364608 · Cited by 456
Patient involvement in the development of patient‐reported outcome measures: a scoping review
Wiering, B., de Boer, D., & Delnoij, D. (2017) · Health Expectations · doi:10.1111/hex.12442 · Cited by 371
Mixed Research as a Tool for Developing Quantitative Instruments
Onwuegbuzie, A. J., Bustamante, R. M., & Nelson, J. A. (2010) · Journal of Mixed Methods Research · doi:10.1177/1558689809355805 · Cited by 366
Emerging Guidelines for Patient Engagement in Research
Kirwan, J. R., de Wit, M., Frank, L., Haywood, K. L., Salek, S., Brace-McDonnell, S., Lyddiatt, A., Barbic, S. P., Alonso, J., Guillemin, F., et al. (2017) · Value in Health · doi:10.1016/j.jval.2016.10.003 · Cited by 219
Self-citationRosas, S. R., & Ridings, J. W. (2016) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2016.08.016 · Cited by 120
Gelhorn, H. L., Kulke, M. H., O’Dorisio, T. M., Yang, Q., Jackson, J., Jackson, S., Boehm, K. A., Law, L., Kostelec, J., Auguste, P., et al. (2016) · Clinical Therapeutics · doi:10.1016/j.clinthera.2016.03.002 · Cited by 48
Conducting mixed methods research
Paul, S. (2014) · doi:10.4324/9781315858555-16 · Cited by 8
Research works printed but not linked: 9
- Tashakkori A, Teddlie C. Handbook of mixed Methods in social behavioral research. Thousand Oakc,CA: Sage Publications; 2003.*.
- Special Section on Mixed Methods Research. (2012). Qual Life Research, 21(3), 1573–2649.
- Busija L, Nicholson G, Toombs M, Cinelli R, Easton C, Sanders K, et al. Developing Conceptual Model of the Role of Elders in the Wellbeing of Australian Indigenous Communities: Group Concept Mapping Study 23rd ISOQOL Annual conference; Copenhagen, Denmark2016.
- Willgoss T. A Novel, Patient-Centered, Mixed Methods Approach to Identifying Relevant Concepts for Patient-Reported Outcome Measures and Facilitating Participant Engagement. 21st ISOQOL Annual Conference; Berlin, Germany2014.
- Barbic S. Development and testing of the Personal Recovery Outcome Measure (PROM) for people with mental illness: Application of Mixed methods. 23rd ISOQOL Annual conference; Copenhagen, Denmark2016.
- Blum SI, Bushnell DM, McCarrier KP, Martin ML, Cano S, Liedgens H, et al. The Pain Assessment for Lower Back Symptoms (PAL-S) and Impacts (PAL-I): A Case Example of the Application of Mixed-Methods in PRO Instrument Development. 23rd ISOQOL Annual Conference; Copenhagen, Denmark2016.
- Cleanthous S. Why we should move Mixed Methods in Psychometric Research from a three-step to a “two-step”. 23rd ISOQOL Annual Conference; Copenhagen, Denmark2016.
- Hudgens S. Application of mixed models for clinician reported outcome development 23rd ISOQOL annual conference; Copenhagen, Denmark2016.
- Fofana F, Bonnaud-Antignac A, Regnault A. A mixed method approach to help demonstrate saturation in qualitative research: applying Partial Least Square regression to qualitative data. 1st Mixed Methods International Research Association (MMIRA) Annual Conference; Boston, MA2014.
Cited by
Morel, T., & Cano, S. J. (2017) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-017-0718-x · Cited by 194
“tive and quantitative research methods in tandem with the explicit aim to efficiently utilise data from small samples [42].”
BackgroundEjaz, H., McGrath, H., Wong, B. L., Guise, A., Vercauteren, T., & Shapey, J. (2022) · DIGITAL HEALTH · doi:10.1177/20552076221089099 · Cited by 105
Agbo, F. J., Sanusi, I. T., Oyelere, S. S., & Suhonen, J. T. (2021) · Education Sciences · doi:10.3390/educsci11030142 · Cited by 138
Kobayashi, L. C., O’Shea, B. Q., Kler, J. S., Nishimura, R., Palavicino‐Maggio, C. B., Eastman, M. R., Vinson, Y. R., & Finlay, J. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-044965 · Cited by 92
Skamagki, G., King, A., Carpenter, C., & Wåhlin, C. (2022) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2022.2120375 · Cited by 84
“It can support the development of new measurement instruments and health-care policy, and the interpretation of clinical outcomes (Regnault, Willgoss, and Barbic, 2018).”
Background
Metadata
- Authors
- On behalf of the International Society for Quality of Life Research (ISOQOL) Mixed Methods Special Interest Group (SIG), Regnault, A., Willgoss, T., & Barbic, S.
- Affiliations
- Roche (United Kingdom) (GB)
- University of British Columbia (CA)
- Corresponding author
- Regnault, Antoine
- Venue
- Journal of Patient-Reported Outcomes
- Published
- 2018-04-11
- Volume
- 2
- Issue
- 1
- Pages
- 19-19
- ISSN
- 2509-8020 (ISSN-L)
- PMC
- PMC5934918
- OpenAlex
- W2797256474
- Semantic Scholar
- 8d88847cc2d5765293fe713d9e25fd3e14e27d4c
- Cited by
- 266
- References
- 11
- Citations by year
- 2026: 15 · 2025: 28 · 2024: 74 · 2023: 51 · 2022: 45 · 2021: 33 · 2020: 16 · 2019: 2 · 2018: 1
- FWCI
- 19.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Journal of Patient-Reported Outcomes (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- cIRcle (University of British Columbia) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Open Collections
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- mixed methods, health outcomes research, patient-reported outcomes, patient experience, research design, conceptual model, instrument development, patient-oriented research, health policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards the use of mixed methods inquiry as best practice in health outcomes research. https://app.cochat.ai/papers/10.1186/s41687-018-0043-8
- The paper
- On behalf of the International Society for Quality of Life Research (ISOQOL) Mixed Methods Special Interest Group (SIG), Regnault, A., Willgoss, T., & Barbic, S. (2018). Towards the use of mixed methods inquiry as best practice in health outcomes research. Journal of Patient-Reported Outcomes. https://doi.org/10.1186/s41687-018-0043-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.