The impact of Stress Management and Resilience Training (SMART) on academic physicians during the implementation of a new Health Information System: An exploratory randomized controlled trial
Open accessThe DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Abstract
Objective: The Stress Management and Resilience Training (SMART) program is an evidence-based intervention designed to build resilience in physicians in clinical practice. The objective of the current study was to assess the impact of the SMART program on academic physicians’ levels of resilience, subjective happiness, stress, and anxiety, and specifically during the implementation of a new hospital-wide Health Information System (HIS). Methods: A total of 40 physicians in a tertiary care academic hospital were randomized (allocation ratio 1:1) to either the SMART intervention or the control condition. The SMART intervention consisted of one mandatory two-hour in-person workshop and an optional 24-week online program, designed to support the materials delivered in the workshop. Outcome measures were assessed using validated scales administered online at baseline and at 3-months and 6-months follow-up. Results: After adjusting for baseline levels of each outcome, no statistically significant intervention effect was observed for resilience, subjective happiness, stress or anxiety at 3-months or 6-months follow-up. However, physicians in the intervention group demonstrated improvements in resilience, stress and anxiety at follow-up that were within the range of clinically relevant differences. Conclusions: The findings of this exploratory study provide modest support that the SMART intervention may be beneficial for proactively addressing physician wellness during the implementation of a new HIS and that larger randomized trials are warranted. Trial registration: NCT04384861.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Two studies evaluated symptoms of depression and anxiety (71, 77). One study significantly reduced anxiety symptoms at postintervention and at follow-ups (71), while the other did not (77).”
From Digital resilience interventions for healthcare workers: a systematic review (2025) · cites this paper as [77]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Seven studies examined the outcome of stress (70–72, 74–77), with four achieving significant results (70, 71, 75, 76), and three not (72, 74, 77).”
From Digital resilience interventions for healthcare workers: a systematic review (2025) · cites this paper as [77]
The cited source says what the claim attributes to it.
In the citing paper
“Seven studies (68–71, 73, 76, 77) measured resilience, with four studies achieving statistical relevance (68, 70, 71, 76), three did not (69, 73, 77).”
From Digital resilience interventions for healthcare workers: a systematic review (2025) · cites this paper as [77]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807 · cited 3×
“To obtain a global level of perceived stress, the 4 positive items were reversed scored and all items were summed (range from 0 to 40, with higher scores indicative of higher levels of stress) [10].”
BackgroundInfluentialA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 4×
“The Generalized Anxiety Disorder-7 item (GAD-7) scale was utilized to assess the severity of physicians’ self-reported anxiety symptoms [18, 19].”
BackgroundMethodInfluentialDevelopment of a new resilience scale: The Connor-Davidson Resilience Scale (CD-RISC)
Connor, K. M., & Davidson, J. R. T. (2003) · Depression and Anxiety · doi:10.1002/da.10113 · Cited by 11,793 · cited 4×
“Higher scores are indicative of greater levels of resilience [9].”
BackgroundMethodInfluentialMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · cited 1×
“Furthermore, we did not employ stratified randomization to balance the groups on participant characteristics that may have influenced the outcomes, such as gender or years of work experience, therefore making it more difficult to generalize the findings [38].”
MethodNorman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700 · cited 1×
“5 standard deviation change from baseline in the Active group, which has been identified as the threshold for meaningful change in health-related quality of life measures [30], but is less than the 1 standard deviation change reported by physicians in a previous SMART study [11].”
ResultA Measure of Subjective Happiness: Preliminary Reliability and Construct Validation
Lyubomirsky, S., & Lepper, H. S. (1999) · Social Indicators Research · doi:10.1023/a:1006824100041 · Cited by 4,071 · cited 2×
“Scoring was reversed for the last item and a single composite score was obtained by averaging the scores on all 4 items, with higher scores reflecting greater happiness [14].”
MethodPhysician burnout: contributors, consequences and solutions
West, C. P., Dyrbye, L. N., & Shanafelt, T. D. (2018) · Journal of Internal Medicine · doi:10.1111/joim.12752 · Cited by 2,768 · cited 1×
“It has been noted previously that some of the metrics that predict a successful HIS implementation, including stakeholder engagement, commitment and involvement [32, 33], may be related to factors that contribute to stress, anxiety, and burnout in physicians, such as the lack of input or control regarding issues affec…”
BackgroundInterventions to prevent and reduce physician burnout: a systematic review and meta-analysis
West, C. P., Dyrbye, L. N., Erwin, P. J., & Shanafelt, T. D. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31279-x · Cited by 2,362
Refining the relationship between personality and subjective well-being.
Steel, P., Schmidt, J., & Shultz, J. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.1.138 · Cited by 1,794 · cited 1×
“It is also possible that subjective happiness is less amenable to the intervention due to the various contextual and personality factors underlying this construct [31].”
BackgroundAllocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494 · cited 1×
“The HIS is associated with less time spent face-to-face with patients [1] and increased time on patient-related administrative tasks often during personal time in the evenings [2].”
BackgroundBoonstra, A., & Broekhuis, M. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-231 · Cited by 851 · cited 1×
“Prior to implementation of HISs, physicians report a number of perceived barriers to acceptance, in particular relating to the organizational structures and change management processes [3].”
BackgroundToussaint, A., Hüsing, P., Gumz, A., Wingenfeld, K., Härter, M., Schramm, E., & Löwe, B. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.032 · Cited by 641
Sood, A., Prasad, K., Schroeder, D., & Varkey, P. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1640-x · Cited by 410 · cited 10×
“In previous pilot studies of brief SMART programs with physicians, Sood and colleagues reported a reduction of stress and anxiety at 8 weeks [11] and 12-weeks [12] followup, with large effect sizes.”
BackgroundMethodResultInfluentialSelf-citationTai-Seale, M., Olson, C. W., Li, J., Chan, A. S., Morikawa, C., Durbin, M., Wang, W., & Luft, H. S. (2017) · Health Affairs · doi:10.1377/hlthaff.2016.0811 · Cited by 379 · cited 1×
“The HIS is associated with less time spent face-to-face with patients [1] and increased time on patient-related administrative tasks often during personal time in the evenings [2].”
BackgroundAssociation of Electronic Health Record Design and Use Factors With Clinician Stress and Burnout
Kroth, P. J., Morioka-Douglas, N., Veres, S., Babbott, S., Poplau, S., Qeadan, F., Parshall, C., Corrigan, K., & Linzer, M. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.9609 · Cited by 333 · cited 1×
“Following implementation, HIS design and use have both been associated with clinician stress and burnout [4].”
MethodInfluentialCooke, G. P., Doust, J. A., & Steele, M. C. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-2 · Cited by 301 · cited 1×
“Indeed, studies have found that greater intolerance of ambiguity and uncertainly is predictive of higher levels of perceived work-related stress and burnout in physicians [36, 37].”
BackgroundLoprinzi, C. E., Prasad, K., Schroeder, D. R., & Sood, A. (2011) · Clinical Breast Cancer · doi:10.1016/j.clbc.2011.06.008 · Cited by 283 · cited 6×
“, follow-up phone calls, refresher sessions) may be required for the intervention to be effective [13].”
BackgroundMethodInfluentialSelf-citationJordan, P., Shedden-Mora, M. C., & Löwe, B. (2017) · PLOS ONE · doi:10.1371/journal.pone.0182162 · Cited by 225 · cited 1×
“The Generalized Anxiety Disorder-7 item (GAD-7) scale was utilized to assess the severity of physicians’ self-reported anxiety symptoms [18, 19].”
MethodEskildsen, A., Dalgaard, V. L., Nielsen, K. J., Andersen, J. H., Zachariae, R., Olsen, L. R., Jørgensen, A., & Christiansen, D. H. (2015) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3510 · Cited by 195 · cited 1×
“19 and 11 [16, 28, 29] has been estimated in the literature.”
BackgroundEffect of Organization-Directed Workplace Interventions on Physician Burnout: A Systematic Review
DeChant, P. F., Acs, A., Rhee, K. B., Boulanger, T. S., Snowdon, J. L., Tutty, M. A., Sinsky, C. A., & Thomas Craig, K. J. (2019) · Mayo Clinic Proceedings: Innovations, Quality & Outcomes · doi:10.1016/j.mayocpiqo.2019.07.006 · Cited by 192
How much change is enough? Evidence from a longitudinal study on depression in UK primary care
Kounali, D., Button, K. S., Lewis, G., Gilbody, S., Kessler, D., Araya, R., Duffy, L., Lanham, P., Peters, T. J., Wiles, N., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291720003700 · Cited by 164 · cited 1×
“Moreover, the research collectively defines a MCID as an improvement of 20–30% in GAD-7 scores [26, 27].”
BackgroundSood, A., Sharma, V., Schroeder, D. R., & Gorman, B. (2014) · EXPLORE · doi:10.1016/j.explore.2014.08.002 · Cited by 162 · cited 10×
“In previous pilot studies of brief SMART programs with physicians, Sood and colleagues reported a reduction of stress and anxiety at 8 weeks [11] and 12-weeks [12] followup, with large effect sizes.”
BackgroundMethodResultInfluentialSelf-citationIannello, P., Mottini, A., Tirelli, S., Riva, S., & Antonietti, A. (2017) · Medical Education Online · doi:10.1080/10872981.2016.1270009 · Cited by 143 · cited 1×
“Indeed, studies have found that greater intolerance of ambiguity and uncertainly is predictive of higher levels of perceived work-related stress and burnout in physicians [36, 37].”
BackgroundCommentary: Ambiguity and Uncertainty: Neglected Elements of Medical Education Curricula?
Luther, V. P., & Crandall, S. J. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31821da915 · Cited by 137 · cited 1×
“Resilience reflects one’s capacity to respond and adapt to challenging situations [9] and may bear particular relevance for physicians undergoing organizational transitions, as personal competencies related to tolerance of stress and negative influences may not be emphasized in medical training [35].”
BackgroundImplementation of a nationwide electronic health record (EHR)
Fragidis, L. L., & Chatzoglou, P. (2018) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa-09-2016-0136 · Cited by 128 · cited 1×
“It has been noted previously that some of the metrics that predict a successful HIS implementation, including stakeholder engagement, commitment and involvement [32, 33], may be related to factors that contribute to stress, anxiety, and burnout in physicians, such as the lack of input or control regarding issues affec…”
BackgroundA systematic review of interventions to foster physician resilience
Fox, S., Lydon, S., Byrne, D., Madden, C., Connolly, F., & O’Connor, P. (2018) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2017-135212 · Cited by 105 · cited 2×
“The Stress Management and Resilience Training (SMART) program is one of the few evidence-based interventions designed to build resilience in physicians in clinical practice [7, 8].”
BackgroundInterventions to Prevent and Reduce Physician Burnout: A Systematic Review and Meta-analysis
West, C. P., Dyrbye, L. N., Erwin, P. J., & Shanafelt, T. D. (2017) · Obstetrical & Gynecological Survey · doi:10.1097/01.ogx.0000513222.66754.52 · Cited by 100 · cited 1×
“Evidence supports the use of interventions both at an organizational and individual level to decrease physician burnout [5].”
BackgroundWerdecker, L., & Esch, T. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253447 · Cited by 100
Bauer-Staeb, C., Kounali, D.-Z., Welton, N. J., Griffith, E., Wiles, N. J., Lewis, G., Faraway, J. J., & Button, K. S. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.04.002 · Cited by 99 · cited 2×
“5 and 4 [25–27], though for “mild” baseline levels, a MCID of 1 has been put forth [26].”
BackgroundInterventions to improve resilience in physicians who have completed training: A systematic review
Venegas, C. L., Nkangu, M. N., Duffy, M. C., Fergusson, D. A., & Spilg, E. G. (2019) · PLOS ONE · doi:10.1371/journal.pone.0210512 · Cited by 59 · cited 5×
“There is also evidence, albeit of lower strength, to support the use of resilience-building interventions to mitigate against the effects of burnout, stress and anxiety in physicians [7, 8].”
BackgroundMethodResultInfluentialSelf-citationRelation Between Physicians’ Work Lives and Happiness
Eckleberry-Hunt, J., Kirkpatrick, H. A., Taku, K., Hunt, R., & Vasappa, R. (2016) · Southern Medical Journal · doi:10.14423/smj.0000000000000437 · Cited by 37
Drachev, S. N., Stangvaltaite-Mouhat, L., Bolstad, N. L., Johnsen, J.-A. K., Yushmanova, T. N., & Trovik, T. A. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155390 · Cited by 37
Vilović, T., Božić, J., Vilović, M., Rušić, D., Furlan, S. Ž., Rađa, M., & Tomičić, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042093 · Cited by 27 · cited 1×
“The raw mean reported levels of the PSS at baseline met the classification criteria of “moderate stress” in both the Active and Control groups [16, 17].”
MethodApproaches and challenges to optimising primary care teams' electronic health record usage
Pandhi, N., Yang, W.-L., Karp, Z., Young, A. S., Beasley, J. W., Kraft, S. A., & Carayon, P. (2014) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v21i3.57 · Cited by 24 · cited 1×
“It has been noted previously that some of the metrics that predict a successful HIS implementation, including stakeholder engagement, commitment and involvement [32, 33], may be related to factors that contribute to stress, anxiety, and burnout in physicians, such as the lack of input or control regarding issues affec…”
BackgroundSpilg, E. G., McNeill, K., Sabri, E., Duffy, M. C., Ananny, L., Graham, I. D., LeBlanc, V. R., & Wells, P. S. (2021) · Psychology Health & Medicine · doi:10.1080/13548506.2021.1954670 · Cited by 24 · cited 5×
“PLoS ONE 17(4): e0267240. https://doi.org/ 10.1371/journal.pone.0267240 Editor: Ryouhei Ishii, Osaka University Graduate School of Medicine, JAPAN Received: November 25, 2020 Accepted: April 2, 2022 Published: April 22, 2022 Copyright: © 2022 Spilg et al. This is an open access article distributed under the terms of t…”
ResultInfluentialSelf-citationCarter, S., Greenberg, J., Funes, C. J., Macklin, E. A., & Vranceanu, A. (2020) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2020.102581 · Cited by 20 · cited 1×
“19 and 11 [16, 28, 29] has been estimated in the literature.”
BackgroundThe Text Effect: Stress Management and Resiliency Training Pilot for Resident Physicians
Nathan, J., McCray, L. W., & Feldman, N. (2021) · Family Medicine · doi:10.22454/fammed.2021.847102 · Cited by 12
Duffrin, C., & Larsen, L. C. (2014) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2012-131512 · Cited by 9
Cited by
Individual-level interventions for reducing occupational stress in healthcare workers
Tamminga, S. J., Emal, L. M., Boschman, J. S., Levasseur, A., Thota, A. B., Ruotsalainen, J. H., Schelvis, R. M. C., Nieuwenhuijsen, K., & van der Molen, H. F. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002892.pub6 · Cited by 189
Shiri, R., Nikunlaakso, R., & Laitinen, J. H. (2023) · Healthcare · doi:10.3390/healthcare11121792 · Cited by 124
“A 24-week stress management and resilience training [128], and a 6-month guided web-based resilience enhancement course [81] did not boost happiness among healthcare workers.”
BackgroundResilience-based interventions in the public sector workplace: a systematic review
Hollaar, M. H. L., Kemmere, B., Kocken, P., & Denktaş, S. (2025) · BMC Public Health · doi:10.1186/s12889-024-21177-2 · Cited by 55
Digital resilience interventions for healthcare workers: a systematic review
Larsson, M., Ho, D. M., Kirschner, M., Seifritz, E., & Manoliu, A. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1519670 · Cited by 14
Correlations to and potential implications of resilience among certified pharmacy technicians
Wasem, V., Woodyard, A., Desselle, S. P., Hosseini, S., Hohmeier, K. C., & McKeirnan, K. C. (2022) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2022.08.023 · Cited by 12
Metadata
- Authors
- Spilg, E. G., Kuk, H., Ananny, L., McNeill, K., LeBlanc, V., Bauer, B. A., Sood, A., & Wells, P. S.
- Affiliations
- University of Ottawa (CA)
- Mayo Clinic (US)
- Corresponding author
- Spilg, Edward G.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-04-22
- Volume
- 17
- Issue
- 4
- Pages
- e0267240
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC9032401
- OpenAlex
- W4224224249
- Cited by
- 21
- References
- 40
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 5 · 2023: 4 · 2022: 1
- FWCI
- 5.16
- Type
- journal article
- Language
- en
- Update notices
- correction (2024-04-11)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- AMS Healthcare (Phoenix Fellowship (no award number))
- Topics
- Health Sciences › Health Professions › General Health Professions › Healthcare professionals’ stress and burnout
- Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Keywords
- physician resilience, physician stress, anxiety, subjective happiness, health information system implementation, physician well-being, academic physicians, online intervention
- MeSH terms
- Anxiety, Happiness, Humans, Physicians, Resilience, Psychological, Health Information Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
