Ethnographic process evaluation in primary care: explaining the complexity of implementation
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The recent growth of implementation research in care delivery systems has led to a renewed interest in methodological approaches that deliver not only intervention outcome data but also deep understanding of the complex dynamics underlying the implementation process. We suggest that an ethnographic approach to process evaluation, when informed by and integrated with quantitative data, can provide this nuanced insight into intervention outcomes. The specific methods used in such ethnographic process evaluations are rarely presented in detail; our objective is to stimulate a conversation around the successes and challenges of specific data collection methods in health care settings. We use the example of a translational clinical trial among 11 community clinics in Portland, OR that are implementing an evidence-based, health-information technology (HIT)-based intervention focused on patients with diabetes. DISCUSSION: Our ethnographic process evaluation employed weekly diaries by clinic-based study employees, observation, informal and formal interviews, document review, surveys, and group discussions to identify barriers and facilitators to implementation success, provide insight into the quantitative study outcomes, and uncover lessons potentially transferable to other implementation projects. These methods captured the depth and breadth of factors contributing to intervention uptake, while minimizing disruption to clinic work and supporting mid-stream shifts in implementation strategies. A major challenge is the amount of dedicated researcher time required. The deep understanding of the 'how' and 'why' behind intervention outcomes that can be gained through an ethnographic approach improves the credibility and transferability of study findings. We encourage others to share their own experiences with ethnography in implementation evaluation and health services research, and to consider adapting the methods and tools described here for their own research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
Achieving integration in mixed methods designs-principles and practices
Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013) · Health Services Research · doi:10.1111/1475-6773.12117 · Cited by 7,219 · cited 1×
“context of a mixed methods convergent design within an intervention framework [9].”
BackgroundQualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory
Bradley, E. H., Curry, L. A., & Devers, K. J. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00684.x · Cited by 3,437 · cited 2×
“As is standard in qualitative research, data analysis is an ongoing, recursive process of reading, discussing and reflecting on the data as it is collected [35,36].”
BackgroundMethodBellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 1×
“Process evaluations typically focus on fidelity – the extent to which a program was implemented as intended in a new setting [15-17].”
BackgroundSittig, D. F., & Singh, H. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2010.042085 · Cited by 897 · cited 1×
“These considerations certainly apply to HIT-based interventions, which are embedded in complex sociotechnical interactions that form the daily work of health care [12,23,29-31].”
BackgroundWhy Do Evaluations of eHealth Programs Fail? An Alternative Set of Guiding Principles
Greenhalgh, T., & Russell, J. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000360 · Cited by 273 · cited 3×
“This emphasis can lead researchers to overlook the myriad, seemingly mundane details that may affect an intervention’s ultimate success, such as: who did what when; how people felt and talked about the intervention; how relationships, hierarchies, and workflows changed; and the resistance, compromises, and workarounds…”
BackgroundGREENHALGH, T., RUSSELL, J., ASHCROFT, R. E., & PARSONS, W. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00642.x · Cited by 119 · cited 1×
“The success of any intervention depends on variables involving power structures, social control, meaning, values, emotions, and relationships, all of which exist in the context of specific historical, social, and cultural settings [12,13,25,27,28].”
BackgroundPowell, B. J., Proctor, E. K., Glisson, C. A., Kohl, P. L., Raghavan, R., Brownson, R. C., Stoner, B. P., Carpenter, C. R., & Palinkas, L. A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-92 · Cited by 71
Cited by
Qualitative methods in implementation research: An introduction
Hamilton, A. B., & Finley, E. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112516 · Cited by 1,315
Beyond exploratory: a tailored framework for designing and assessing qualitative health research
Rendle, K. A., Abramson, C. M., Garrett, S. B., Halley, M. C., & Dohan, D. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-030123 · Cited by 195
“Contemporary researchers may use qualitative data and methods to improve the descriptive accuracy of health-related phenomena that have already been characterised by exploratory work or are difficult to capture using other approaches.(23) Researchers also use larger scale, comparative qualitative studies in ways that…”
MethodOlivier de Sardan, J.-P., Diarra, A., & Moha, M. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0213-9 · Cited by 167
Ethnographic methods for process evaluations of complex health behaviour interventions
Morgan-Trimmer, S., & Wood, F. (2016) · Trials · doi:10.1186/s13063-016-1340-2 · Cited by 167
“[31], in an ethnographic process evaluation of a technology-based diabetes intervention in health clinics, used diaries, document analysis, interviews, group interviews, and a survey in their data collection.”
BackgroundMethodMobilising context as complex and dynamic in evaluations of complex health interventions
Murdoch, J., Paparini, S., Papoutsi, C., James, H., Greenhalgh, T., & Shaw, S. E. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10354-5 · Cited by 23
“…approaches are well-known and widely used in health research, including ethnographic observations of socially structured actions involved in implementation [41], or conversation analysis [42], which reveal participants’ orientation and negotiation of relevant meaning through ongoing interaction.”
Background
Metadata
- Authors
- Bunce, A. E., Gold, R., Davis, J. V., McMullen, C. K., Jaworski, V., Mercer, M., & Nelson, C.
- Venue
- BMC Health Services Research
- Published
- 2014-12
- Volume
- 14
- Issue
- 1
- Pages
- 607-607
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W2164618974
- Cited by
- 49
- References
- 8
- FWCI
- 6.97
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ethnographic process evaluation in primary care: explaining the complexity of implementation. https://app.cochat.ai/papers/10.1186/s12913-014-0607-0
- The paper
- Bunce, A. E., Gold, R., Davis, J. V., McMullen, C. K., Jaworski, V., Mercer, M., & Nelson, C. (2014). Ethnographic process evaluation in primary care: explaining the complexity of implementation. BMC Health Services Research. https://doi.org/10.1186/s12913-014-0607-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.