Co-production of the quality of patient-centered outcomes research partnerships instrument for people with mental health conditions
Open accessAbstract
Mounting scientific evidence over the past decades in the field of psychiatry has shown community engagement in research produces more relevant research, increased uptake of research findings, and better clinical outcomes. Despite the need for the integration of community engagement methodologies into the scientific method, doctoral and master's level competencies in the field of psychiatry commonly do not include dedicated training or coursework on community engagement methodologies. Without appropriate training or research experience, attempts to facilitate community engagement are often ineffective and burdensome and leave stakeholders feeling disenfranchised. The goal of this study was to co-produce an instrument designed to improve the quality of community engagement research practices by measuring the degree to which researchers have partnered with psychiatric patient stakeholders. The development of the Quality of Patient-Centered Outcomes Research Partnerships Instrument included an iterative co-production process with psychiatric patient stakeholders and scientists, including item formulation, followed by two phases of cognitive interviews with psychiatric patient stakeholders to assess and refine instrument items. A pilot study was conducted to assess acceptability and feasibility. The pilot study of the Patient-Centered Outcomes Research Partnerships Instrument suggested feasibility and acceptability among psychiatric patient stakeholders. The Quality of Patient-Centered Outcomes Research Partnerships Instrument may be a valuable tool to enhance the quality of community engagement research practices within the field of psychiatry. Experience Framework This article is associated with the Innovation & Technology lens of The Beryl Institute Experience Framework (https://www.theberylinstitute.org/ExperienceFramework). Access other PXJ articles related to this lens. Access other resources related to this lens
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is not much training of researchers in how to effectively engage with people with lived experience.
“Also, there is not much training of researchers in how to effectively engage with PWLE 339 .”
From Ethical challenges in contemporary psychiatry: an overview and an appraisal of possible strategies and research needs (2024) · cites this paper as [339]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study
Vaismoradi, M., Turunen, H., & Bondas, T. (2013) · Nursing & Health Sciences · doi:10.1111/nhs.12048 · Cited by 8,327 · see citing works
Peer Support/Peer Provided Services Underlying Processes, Benefits, and Critical Ingredients.
Solomon, P. (2004) · Psychiatric Rehabilitation Journal · doi:10.2975/27.2004.392.401 · Cited by 1,060 · see citing works
Identifying and Defining the Dimensions of Community Capacity to Provide a Basis for Measurement
Goodman, R. M., Speers, M. A., McLeroy, K. R., Fawcett, S. B., Kegler, M. C., Parker, E. A., Smith, S. R., Sterling, T. D., & Wallerstein, N. B. (1998) · Health Education & Behavior · doi:10.1177/109019819802500303 · Cited by 1,007 · see citing works
Peer support among persons with severe mental illnesses: a review of evidence and experience
DAVIDSON, L., BELLAMY, C., GUY, K., & MILLER, R. (2012) · World Psychiatry · doi:10.1016/j.wpsyc.2012.05.009 · Cited by 913 · see citing works
Willis, G., & Artino, A. R. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-13-00154.1 · Cited by 691 · see citing works
Community-Based Participatory Research From the Margin to the Mainstream
Horowitz, C. R., Robinson, M., & Seifer, S. D. (2009) · Circulation · doi:10.1161/circulationaha.107.729863 · Cited by 556 · see citing works
Cyril, S., Smith, B. J., Possamai‐Inesedy, A., & Renzaho, A. M. N. (2015) · Global Health Action · doi:10.3402/gha.v8.29842 · Cited by 529 · see citing works
Community engagement in research: Frameworks for education and peer review
Ahmed, S. M., & Palermo, A.-G. S. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.178137 · Cited by 509 · see citing works
Evaluating patient and stakeholder engagement in research: moving from theory to practice
Esmail, L., Moore, E., & Rein, A. (2015) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.14.79 · Cited by 502 · see citing works
Elwyn, G. J., Barr, P. J., Grande, S. W., Thompson, R., Walsh, T., & Ozanne, E. M. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.009 · Cited by 427 · see citing works
Flicker, S., Travers, R., Guţă, A., McDonald, S., & Meagher, A. (2007) · Journal of Urban Health · doi:10.1007/s11524-007-9165-7 · Cited by 419 · see citing works
Why We Need Community Engagement in Medical Research
Holzer, J., Ellis, L. E., & Merritt, M. W. (2014) · Journal of Investigative Medicine · doi:10.1097/jim.0000000000000097 · Cited by 223 · see citing works
Sandoval, J. A., Lucero, J. E., OETZEL, J. G., Avila, M., Belone, L., Mau, M. L. M., Pearson, C. R., Tafoya, G., Duran, B., Rios, L. I., et al. (2011) · Health Education Research · doi:10.1093/her/cyr087 · Cited by 214 · see citing works
Evaluating community engagement in global health research: the need for metrics
the Ethics Working Group of the HIV Prevention Trials Network, MacQueen, K. M., Bhan, A., Frohlich, J., Holzer, J., & Sugarman, J. (2015) · BMC Medical Ethics · doi:10.1186/s12910-015-0033-9 · Cited by 157 · see citing works
Kwon, S. C., Tandon, S. D., Islam, N. S., Riley, L., & Trinh‐Shevrin, C. (2017) · Translational Behavioral Medicine · doi:10.1093/tbm/ibx026 · Cited by 141 · see citing works
Translational Behavioral Medicine
Spring, B. J., Pfammatter, A. F., Hoffman, S. A., & Warnick, J. L. (2017) · Springer eBooks · doi:10.1007/978-1-4614-6439-6_221-2 · Cited by 134 · see citing works
Correlates of cognitive impairment in first episode schizophrenia: The EUFEST study
Galderisi, S., Davidson, M., Kahn, R. S., Mucci, A., Boter, H., Gheorghe, M., RYBAKOWSKI, J. K., Libiger, J., Dollfus, S., López-Ibor, J. J., et al. (2009) · Schizophrenia Research · doi:10.1016/j.schres.2009.09.022 · Cited by 126 · see citing works
Translating Evidence into Population Health Improvement: Strategies and Barriers
Woolf, S. H., Purnell, J. Q., Simon, S., Zimmerman, E. B., Camberos, G. J., Haley, A. S., & Fields, R. P. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-082214-110901 · Cited by 115 · see citing works
On Measuring Community Participation in Research
Khodyakov, D., Stockdale, S. E., Jones, A., Mango, J. D., Jones, F., & Lizaola, E. (2012) · Health Education & Behavior · doi:10.1177/1090198112459050 · Cited by 92 · see citing works
Priede, C., & Farrall, S. (2011) · International Journal of Social Research Methodology · doi:10.1080/13645579.2010.523187 · Cited by 88 · see citing works
Translational research : the journal of laboratory and clinical medicine.
ScienceDirect (2006) · Cited by 78 · see citing works
Eder, M., Evans, E., Funes, M., Hong, H., Reuter, K., Ahmed, S. M., Calhoun, K. S., Corbie-Smith, G. M., Dave, G., DeFino, M. C., et al. (2018) · Progress in community health partnerships · doi:10.1353/cpr.2018.0034 · Cited by 68 · see citing works
Progress in Community Health Partnerships: Research, Education, and Action
Bass, E. B. (2011) · Cited by 57 · see citing works
On using ethical principles of community-engaged research in translational science
Khodyakov, D., Mikesell, L., Schraiber, R., Booth, M. S., & Bromley, E. (2015) · Translational research · doi:10.1016/j.trsl.2015.12.008 · Cited by 55 · see citing works
Fortuna, K. L., Barr, P. J., Goldstein, C. M., Walker, R., Brewer, L. C., Zagaria, A. B., & Bartels, S. J. (2019) · Journal of Participatory Medicine · doi:10.2196/12380 · Cited by 53 · see citing works
Self-citationInstrument Development: Getting Started
Davis, A. E. (1996) · Journal of Neuroscience Nursing · doi:10.1097/01376517-199606000-00009 · Cited by 48 · see citing works
Ethical issues in mental health research: the case for community engagement
DuBois, J. M., Bailey-Burch, B., Bustillos, D., Campbell, J., Cottler, L. B., Fisher, C. B., Hadley, W. B., Hoop, J. G., Roberts, L. W., Salter, E. K., et al. (2011) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e3283459422 · Cited by 45 · see citing works
Community engagement in patient-centered outcomes research: Benefits, barriers, and measurement
Martinez, L. S. S., Carolan, K., O’Donnell, A. E., Diaz, Y., & Freeman, E. (2018) · Journal of Clinical and Translational Science · doi:10.1017/cts.2018.341 · Cited by 44 · see citing works
Rotondi, A. J., Spring, M. B., Hanusa, B. H., Eack, S. M., & Haas, G. L. (2017) · JMIR Human Factors · doi:10.2196/humanfactors.6221 · Cited by 36 · see citing works
From the Ground Up: Building a Participatory Evaluation Model
Sánchez, V., Carrillo, C., & Wallerstein, N. B. (2011) · Progress in community health partnerships · doi:10.1353/cpr.2011.0007 · Cited by 16 · see citing works
Salihu, H. M., Salinas‐Miranda, A., Wang, W., Turner, D. E., Berry, E., & Zoorob, R. (2015) · Journal of Public Health Research · doi:10.4081/jphr.2015.443 · Cited by 15 · see citing works
Lincoln, A. K., Wallace, L. R., Kaminski, M. S., Lindeman, K., Aulier, L., & Delman, J. (2016) · Community Mental Health Journal · doi:10.1007/s10597-016-9989-2 · Cited by 13 · see citing works
Eder, M., Evans, E., Funes, M., Hong, H., Reuter, K., Ahmed, S. F., Calhoun, K. S., Corbie-Smith, G. M., Dave, G., DeFino, M. C., et al. (2018) · Progress in community health partnerships · doi:10.1353/cpr.2018.0044 · Cited by 5 · see citing works
Flagged first, then by citations
1 of the 34 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [26]Fortuna K, Barr P, Goldstein C, Application of Community-Engaged Research to Inform the Development and Implementation of a Peer-Delivered Mobile Health Intervention for Adults With Serious Mental Illness. J Participat Med 2019; 11(1): e12380. PMC7039401 32095314
Cited by
Sorted by citations
Galderisi, S., Appelbaum, P. S., Gill, N., Gooding, P., Herrman, H., Melillo, A., Myrick, K., Pathare, S., Savage, M., Szmukler, G., et al. (2024) · World Psychiatry · doi:10.1002/wps.21230 · Cited by 76 · see citing works
Beyond the methodological binary: coproduction as the third pillar of mental health science
Downs, J. L. (2025) · BMJ Mental Health · doi:10.1136/bmjment-2025-301807 · Cited by 25 · see citing works
Guidelines to Establish an Equitable Mobile Health Ecosystem
Fortuna, K. L., Kadakia, A., Cosco, T. D., Rotondi, A. J., Nicholson, J., Mois, G., Myers, A. L., Hamilton, J., Brewer, L. C., Collins-Pisano, C., et al. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202200011 · Cited by 14 · see citing works
Self-citationNicholson, J., Mazel, S. B., Faughnan, K., & Silverman, A. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20105876 · Cited by 6 · see citing works
A call to action for human experience
Wolf, J. A. (2021) · Patient Experience Journal · doi:10.35680/2372-0247.1597 · Cited by 6 · see citing works
Satcher, M. F., Dees, A. L., Johnston, J. M., Farid, A. M., & Khayal, I. S. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13588-7 · Cited by 7 · see citing works
Wood, L., Rowe, A., Persaud, K., Nyikavaranda, P., Malde‐Shah, N., Guerin, E., Dare, C. R. J., Constant, C., & Birken, M. (2023) · Psychosis · doi:10.1080/17522439.2023.2220373 · Cited by 5 · see citing works
Fortuna, K. L., Bohm, A., Lebby, S. R., Holden, K. B., Agic, B., Cosco, T. D., & Walker, R. (2023) · Journal of Participatory Medicine · doi:10.2196/48707 · Cited by 4 · see citing works
Self-citationFortuna, K. L., Marceau, S. R., Kadakia, A., Pratt, S. I., Varney, J., Walker, R., Myers, A. L., Thompson, S., Carter, K., Greene, K., et al. (2021) · JMIR Formative Research · doi:10.2196/29073 · Cited by 4 · see citing works
Self-citationFortuna, K. L., Mbao, M., Kadakia, A., Myers, A., Fischer, D., MacDonald, S., Brunchet, S., Hintz, I., Rossom, R. C., Brooks, J., et al. (2021) · IEEE Global Humanitarian Technology Conference (GHTC) · doi:10.1109/ghtc53159.2021.9612411 · Cited by 4 · see citing works
Self-citationBardach, S. H., Perry, A., Sturke, T., Stevens, R., & Satcher, M. F. (2025) · Health Expectations · doi:10.1111/hex.70194 · Cited by 2 · see citing works
Barriers and Facilitators to Timely Adjuvant Therapy for Head and Neck Cancer in Rural Care
Wasp, G. T., Khudaier, S., Siroonian, O., Coogan, M., Anton, C. P., Fortuna, K. L., Papas, S., Skrypeck, R., Wing, L., O’Farrell, J., et al. (2026) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2026.0369
Self-citationGollust, S. E., Graff, Y., Hassan, M., Franco, M., Vickery, K. D., Pratt, R. J., & Allen, M. (2026) · Journal of Participatory Research Methods · doi:10.35844/001c.161357
Gonsamo, D. D., Lo, H. H. M., Chui, W. H., & Zhang, Z. J. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119474
Validation of the Quality of Patient-Centered Outcomes Research Instrument (Preprint)Preprint
Fortuna, K. L., Goodman, M. S., Bather, J. R., Elwyn, G. J., Joyner, D. M., Tapiavala, V. N., & Rogers, T. (2026) · doi:10.2196/preprints.110688
Self-citation
- Authors
- Fortuna, K. L., Myers, A., Brooks, J., Collins-Pisano, C., Marceau, S., Pratt, S., Lyons, K., Walker, R., Thompson, S., Greene, K., Pringle, W., & Carter, K.
- Affiliations
- Dartmouth College (US)
- ORCID
- Venue
- Patient Experience Journal
- Publisher
- The Beryl Institute
- Published
- 2021-04-28
- Volume
- 8
- Issue
- 1
- Pages
- 148-156
- ISSN
- 2372-0247 (ISSN-L)
- PMC
- PMC8942114
- OpenAlex
- W3159609575
- Cited by
- 15
- References
- 34
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 3
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Patient Experience Journal (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute of Mental Health (K01MH117496)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- community participation, patient-centered outcomes research, co-production, research collaboration, mental health, research quality assessment, instrument development, cognitive interviewing, stakeholder engagement, research training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
