Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 177

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Periodic reflections: a method of guided discussions for documenting implementation phenomena

Open access
Finley, Erin P., Huynh, Alexis K., Farmer, Melissa M., Bean-Mayberry, Bevanne, Moin, Tannaz, Oishi, Sabine M., Moreau, Jessica L., Dyer, Karen E., Lanham, Holly Jordan, Leykum, Luci, Hamilton, Alison B. · 2018 · BMC Medical Research Methodology

Abstract

BACKGROUND: Ethnography has been proposed as a valuable method for understanding how implementation occurs within dynamic healthcare contexts, yet this method can be time-intensive and challenging to operationalize in pragmatic implementation. The current study describes an ethnographically-informed method of guided discussions developed for use by a multi-project national implementation program. METHODS: The EMPOWER QUERI is conducting three projects to implement innovative care models in VA women's health for high-priority health concerns - prediabetes, cardiovascular risk, and mental health - utilizing the Replicating Effective Programs (REP) implementation strategy enhanced with stakeholder engagement and complexity science. Drawing on tenets of ethnographic research, we developed a lightly-structured method of guided "periodic reflections" to aid in documenting implementation phenomena over time. Reflections are completed as 30-60 min telephone discussions with implementation team members at monthly or bi-monthly intervals, led by a member of the implementation core. Discussion notes are coded to reflect key domains of interest and emergent themes, and can be analyzed singly or in triangulation with other qualitative and quantitative assessments to inform evaluation and implementation activities. RESULTS: Thirty structured reflections were completed across the three projects during a 15-month period spanning pre-implementation, implementation, and sustainment activities. Reflections provide detailed, near-real-time information on projects' dynamic implementation context, including characteristics of implementation settings and changes in the local or national environment, adaptations to the intervention and implementation plan, and implementation team sensemaking and learning. Reflections also provide an opportunity for implementation teams to engage in recurring reflection and problem-solving. CONCLUSIONS: To implement new, complex interventions into dynamic organizations, we must better understand the implementation process as it unfolds in real time. Ethnography is well suited to this task, but few approaches exist to aid in integrating ethnographic insights into implementation research. Periodic reflections show potential as a straightforward and low-burden method for documenting events across the life cycle of an implementation effort. They offer an effective means for capturing information on context, unfolding process and sensemaking, unexpected events, and diverse viewpoints, illustrating their value for use as part of an ethnographically-minded implementation approach. TRIAL REGISTRATION: The two implementation research studies described in this article have been registered as required: Facilitating Cardiovascular Risk Screening and Risk Reduction in Women Veterans (NCT02991534); and Implementation of Tailored Collaborative Care for Women Veterans (NCT02950961).

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12874-018-0610-y

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 19 references

Research works printed but not linked: 54

  1. Schensul JJ. Community, culture and sustainability in multilevel dynamic systems intervention science. Am J Community Psychol. 2009;43:241–56. · DOI · Paper page
  2. Green AE, Aarons GA. A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci [Internet]. 2011 [cited 2017 Sep 15];6. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-6-104 . · DOI
  3. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. · DOI · Paper page
  4. Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci [Internet]. 2015 [cited 2017 Sep 5];10. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-015-0295-0 . · DOI · Paper page
  5. Brewer J. Ethnography. Essent Guide Qual Methods Organ Res. SAGE Publications; 2004. p. 312–322. · doi:10.4135/9781446280119.n25
  6. Bunce AE, Gold R, Davis JV, McMullen CK, Jaworski V, Mercer M, et al. Ethnographic process evaluation in primary care: explaining the complexity of implementation. BMC Health Serv Res [Internet]. 2014 [cited 2017 Sep 15];14. Available from: http://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-014-0607-0 · DOI
  7. Greenhalgh T, Swinglehurst D. Studying technology use as social practice: the untapped potential of ethnography. BMC Med [Internet]. 2011 [cited 2017 Sep 5];9. Available from: http://bmcmedicine.biomedcentral.com/articles/10.1186/1741-7015-9-45 . · DOI · Paper page
  8. Morgan-Trimmer S, Wood F. Ethnographic methods for process evaluations of complex health behaviour interventions. Trials [Internet]. 2016 [cited 2017 Sep 15];17. Available from: http://trialsjournal.biomedcentral.com/articles/10.1186/s13063-016-1340-2 . · DOI · Paper page
  9. Thirsk LM, Clark AM. Using qualitative research for complex interventions: the contributions of hermeneutics. Int J Qual Methods. 2017;16:160940691772106. · DOI
  10. McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Park AM, et al. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15:62. · DOI
  11. Lanham HJ, Leykum LK, Taylor BS, McCannon CJ, Lindberg C, Lester RT. How complexity science can inform scale-up and spread in health care: understanding the role of self-organization in variation across local contexts. Soc Sci Med. 2013;93:194–202. · DOI · Paper page
  12. Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC. How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005;31:438–46. · DOI · Paper page
  13. Lanham HJ, Palmer RF, Leykum LK, McDaniel RR, Nutting PA, Stange KC, et al. Trust and reflection in primary care practice redesign. Health Serv Res. 2016;51:1489–514. · DOI
  14. Stensaker I, Falkenberg J, Grønhaug K. Implementation activities and organizational Sensemaking. J Appl Behav Sci. 2008;44:162–85. · DOI
  15. Weick KE. Sensemaking in organizations. Thou: Sage Publications; 1995.
  16. Simpson KM, Porter K, McConnell ES, Colón-Emeric C, Daily KA, Stalzer A, et al. Tool for evaluating research implementation challenges: A sense-making protocol for addressing implementation challenges in complex research settings. Implement Sci [Internet]. 2013 [cited 2017 May 11];8. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-8-2 . · DOI
  17. Leykum LK, Lanham HJ, Provost SM, McDaniel RR, Pugh J. Improving outcomes of hospitalized patients: the Physician Relationships, Improvising, and Sensemaking intervention protocol. Implement Sci [Internet]. 2014 [cited 2017 Sep 15];9. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-014-0171-3 . · DOI
  18. Hamilton A, Farmer M, Moin T, Finley E, Haskell S, Lang A, et al. Enhancing mental and physical health of women through engagement and retention (EMPOWER): a protocol for a program of research. Implement Sci. In press.
  19. Kilbourne AM, Abraham KM, Goodrich DE, Bowersox NW, Almirall D, Lai Z, et al. Cluster randomized adaptive implementation trial comparing a standard versus enhanced implementation intervention to improve uptake of an effective re-engagement program for patients with serious mental illness. Implement Sci [Internet]. 2013 [cited 2017 May 11];8. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-8-136 . · DOI
  20. Sogolow ED, Kay LS, Doll LS, Neumann MS, Mezoff JS, Eke AN, et al. Strengthening HIV prevention: application of a research-to-practice framework. AIDS Educ Prev Off Publ Int Soc AIDS Educ. 2000;12:21–32.
  21. Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood). 2013;32:223–31. · DOI · Paper page
  22. McDaniel RR, Lanham HJ, Anderson RA. Implications of complex adaptive systems theory for the design of research on health care organizations. Health Care Manage Rev. 2009;34:191–9. · DOI
  23. Gates EF. Making sense of the emerging conversation in evaluation about systems thinking and complexity science. Eval Program Plann. 2016;59:62–73. · DOI
  24. Ali MK, Echouffo-Tcheugui JB, Williamson DF. How Effective Were Lifestyle Interventions In Real-World Settings That Were Modeled On The Diabetes Prevention Program, Health Aff (Millwood). 2012;31:67–75. · DOI · Paper page
  25. Lawlor MS, Blackwell CS, Isom SP, Katula JA, Vitolins MZ, Morgan TM, et al. Cost of a group translation of the diabetes prevention program. Am J Prev Med. 2013;44:S381–9. · DOI
  26. Moin T, Ertl K, Schneider J, Vasti E, Makki F, Richardson C, et al. Women veterans’ experience with a web-based diabetes prevention program: a qualitative study to inform future practice. J Med Internet Res. 2015, e127;17. · DOI · Paper page
  27. Goldstein KM, Melnyk SD, Zullig LL, Stechuchak KM, Oddone E, Bastian LA, et al. Heart matters: gender and racial differences cardiovascular disease risk factor control among veterans. Womens Health Issues. 2014;24:477–83. · DOI
  28. Vimalananda VG, Biggs ML, Rosenzweig JL, Carnethon MR, Meigs JB, Thacker EL, et al. The influence of sex on cardiovascular outcomes associated with diabetes among older black and white adults. J Diabetes Complicat. 2014;28:316–22. · DOI
  29. Runnals JJ, Garovoy N, McCutcheon SJ, Robbins AT, Mann-Wrobel MC, Elliott A, et al. Systematic review of women veterans’ mental health. Womens Health Issues. 2014;24:485–502. · DOI
  30. Washington DL, Bean-Mayberry B, Riopelle D, Yano EM. Access to Care for Women Veterans: delayed healthcare and unmet need. J Gen Intern Med. 2011;26:655–61. · DOI · Paper page
  31. Vogt DS, Bergeron A, Salgado D, Daley J, Ouimette P, Wolfe J. Barriers to veterans health administration care in a nationally representative sample of women veterans. J Gen Intern Med. 2006;21. · DOI
  32. Report of the Under Secretary for Health Workgroup. Provision of Primary Care to Women Veterans. In: US Department of Veterans Affairs, Office of Public Health and Environmental Hazards. Washington DC: Women Veterans Health Strategic Health Care Group; 2008.
  33. Hamilton AB, Poza I, Washington DL. “Homelessness and trauma go hand-in-hand”: pathways to homeless among women veterans. Womens Health Issues. 2011;21:s203–9. · DOI · Paper page
  34. Hamilton AB, Frayne SM, Cordasco KM, Washington DL. Factors related to Attrition from VA healthcare use: findings from the National Survey of women veterans. J Gen Intern Med. 2013;28:510–6. · DOI
  35. Jordon M, Lanham HJ, Anderson RA, McDaniel RR Jr. Implications of complex adaptive systems theory for interpreting research about health care organizations. J Eval Clin Pract. 2010;16:228–31. · DOI
  36. Murdoch J. Process evaluation for complex interventions in health services research: analysing context, text trajectories and disruptions. BMC Health Serv Res [Internet]. 2016 [cited 2017 Sep 15];16. Available from: http://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-016-1651-8 . · DOI
  37. Balasubramanian BA, Cohen DJ, Davis MM, Gunn R, Dickinson LM, Miller WL, et al. Learning Evaluation: blending quality improvement and implementation research methods to study healthcare innovations. Implement Sci [Internet]. 2015 [cited 2017 Sep 26];10. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-015-0219-z . · DOI
  38. Bernard HR. Research methods in anthropology, second edition: qualitative and quantitative approaches. Walnut Creek: AltaMira Press; 1995.
  39. Hall TL, Holtrop JS, Dickinson LM, Glasgow RE. Understanding adaptations to patient-centered medical home activities: The PCMH adaptations model. Transl Behav Med [Internet]. 2017 [cited 2017 Sep 15]; Available from: http://link.springer.com/10.1007/s13142-017-0511-3 . · DOI
  40. Sharp A, Nguyen H, Hahn E, et al. The just do it playbook for implementation science. Arizona: Phoenix; 2014. · doi:10.3121/cmr.2014.1250.a3-1
  41. Averill JB. Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res. 2002;12:855–66. · doi:10.1177/104973230201200611 · Paper page
  42. Kedward J, Dakin L. A qualitative study of barriers to the use of statins and the implementation of coronary heart disease prevention in primary care. Br J Gen Pract. 2003;53:684–9.
  43. Stewart RE, Stirman SW, Chambliss DL. A qualitative investigation of practicing psychologists’ attitudes toward research-informed practice: implications for dissemination strategies. Prof Psychol Res Pract. 2012;43:100–9. · DOI
  44. Raphael K. Recall bias: a proposal for assessment and control. Int J Epidemiol. 1987;16:167–70. · DOI · Paper page
  45. Li J, Hinami K, Hansen LO, Maynard G, Budnitz T, Williams MV. The physician mentored implementation model: a promising quality improvement framework for health care change. Acad Med. 2015;90:303–10. · DOI
  46. Balasubramanian BA, Chase SM, Nutting PA, Cohen DJ, Strickland PAO, Crosson JC, et al. Using learning teams for reflective adaptation (ULTRA): insights from a team-based change management strategy in primary care. Ann Fam Med. 2010;8:425–32. · DOI
  47. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care QHC. 1998;7:149–58. · DOI · Paper page
  48. Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci [Internet]. 2006 [cited 2017 Sep 15];1. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-1-23 . · DOI · Paper page
  49. Seidel S, Chandra Kruse L, Székely N, Gau M, Stieger D. Design principles for sensemaking support systems in environmental sustainability transformations. Eur J Inf Syst [Internet]. 2017; Available from: https://doi.org/10.1057/s41303-017-0039-0 . Accessed 5 Sept 2017. · DOI · Paper page
  50. Weick K. Managing the unexpected: complexity as distributed sensemaking. Uncertain Surprise Complex Syst Quest Work Unexpected. Springer-Verlag; 2005.
  51. Baum F. Participatory action research. J Epidemiol Community Health. 2006;60:854–7. · DOI · Paper page
  52. Skolarus TA, Lehmann T, Tabak RG, Harris J, Lecy J, Sales AE. Assessing citation networks for dissemination and implementation research frameworks. Implement Sci [Internet]. 2017 [cited 2017 Sep 15];12. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-017-0628-2 . · DOI · Paper page
  53. Hamilton AB, Farmer MM, Moin T, Finley EP, Lang AJ, Oishi SM, et al. Enhancing Mental and Physical Health of Women through Engagement and Retention (EMPOWER): a protocol for a program of research. Implement Sci [Internet]. 2017:12. Available from: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-017-0658-9 . · DOI
  54. Huynh AK, Hamilton AB, Farmer MM, Bean-Mayberry B, Stirman SW, Moin T, et al. A Pragmatic Approach to Guide Implementation Evaluation Research: Strategy Mapping for Complex Interventions. Front Public Health [Internet]. 2018 [cited 2018 May 30];6. Available from: https://www.frontiersin.org/article/10.3389/fpubh.2018.00134/full . · DOI

Cited by

See all 177

Metadata

Authors
Finley, E. P., Huynh, A. K., Farmer, M. M., Bean-Mayberry, B., Moin, T., Oishi, S. M., Moreau, J. L., Dyer, K. E., Lanham, H. J., Leykum, L., & Hamilton, A. B.
Venue
BMC Medical Research Methodology
Published
2018-11-27
Volume
18
Issue
1
Pages
153-153
ISSN
1471-2288 (ISSN-L)
OpenAlex
W2902650223
Cited by
177
References
19
FWCI
11.43
Type
journal article
Language
en
Open access
gold
Licence
Funders
Quality Enhancement Research Initiative (QUE 15-272)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Periodic reflections: a method of guided discussions for documenting implementation phenomena. https://app.cochat.ai/papers/10.1186/s12874-018-0610-y
The paper
Finley, E. P., Huynh, A. K., Farmer, M. M., Bean-Mayberry, B., Moin, T., Oishi, S. M., Moreau, J. L., Dyer, K. E., Lanham, H. J., Leykum, L., & Hamilton, A. B. (2018). Periodic reflections: a method of guided discussions for documenting implementation phenomena. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-018-0610-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.