The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Systems science and systems thinking for public health: a systematic review of the field
Open accessAbstract
Objectives: This paper reports on findings from a systematic review designed to investigate the state of systems science research in public health. The objectives were to: (1) explore how systems methodologies are being applied within public health and (2) identify fruitful areas of activity. Design: A systematic review was conducted from existing literature that draws on or uses systems science (in its various forms) and relates to key public health areas of action and concern, including tobacco, alcohol, obesity and the social determinants of health. Data analysis: 117 articles were included in the review. An inductive qualitative content analysis was used for data extraction. The following were systematically extracted from the articles: approach, methodology, transparency, strengths and weaknesses. These were then organised according to theme (ie, commonalities between studies within each category), in order to provide an overview of the state of the field as a whole. The assessment of data quality was intrinsic to the goals of the review itself, and therefore, was carried out as part of the analysis. Results: 4 categories of research were identified from the review, ranging from editorial and commentary pieces to complex system dynamic modelling. Our analysis of each of these categories of research highlighted areas of potential for systems science to strengthen public health efforts, while also revealing a number of limitations in the dynamic systems modelling being carried out in public health. Conclusions: There is a great deal of interest in how the application of systems concepts and approach might aid public health. Our analysis suggests that soft systems modelling techniques are likely to be the most useful addition to public health, and align well with current debate around knowledge transfer and policy. However, the full range of systems methodologies is yet to be engaged with by public health researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
(2000) · University of Maribor digital library (University of Maribor) · Cited by 9,354
Powers, C. H., & Giddens, A. (1988) · Social Forces · doi:10.2307/2579442 · Cited by 8,828
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Methods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,042
Content Analysis: A Flexible Methodology
White, M. D., & Marsh, E. E. (2006) · Library Trends · doi:10.1353/lib.2006.0053 · Cited by 1,999
Evidence based medicine: a movement in crisis?
Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group (2014) · BMJ · doi:10.1136/bmj.g3725 · Cited by 1,766
Forrester, J. W. (1969) · Cited by 1,571
Complex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244
Theorising interventions as events in systems
Hawe, P., Shiell, A., & Riley, T. (2009) · American Journal of Community Psychology · doi:10.1007/s10464-009-9229-9 · Cited by 1,143
Systems thinking for health systems strengthening.
de Savigny, D., & Adam, T. (2009) · Cited by 1,060
Systems Thinking: Creative Holism for Managers
Jackson, M. C. (2003) · Cited by 930
Shaping cities for health: complexity and the planning of urban environments in the 21st century
Rydin, Y., Bleahu, A., Davies, M., Dávila, J. D., Friel, S., De Grandis, G., Groce, N., Hallal, P. C., Hamilton, I., Howden-Chapman, P., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60435-8 · Cited by 839
Public Management and Policy Networks: Foundations of a network approach to governance
Klijn, E. H., & Koppenjan, J. F. M. (2000) · Public Management: An International Journal of Research and Theory · doi:10.1080/14719030000000007 · Cited by 593
Systems thinking, knowledge and action: towards better models and methods
Best, A., & Holmes, B. (2010) · Evidence & Policy · doi:10.1332/174426410x502284 · Cited by 444
How small system dynamics models can help the public policy process
Ghaffarzadegan, N., Lyneis, J., & Richardson, G. P. (2011) · System Dynamics Review · doi:10.1002/sdr.442 · Cited by 418
Systems Thinking to Improve the Public's Health
Leischow, S. J., Best, A., Trochim, W. M., Clark, P. I., Gallagher, R. S., Marcus, S. E., & Matthews, E. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.05.014 · Cited by 410
Practical Challenges of Systems Thinking and Modeling in Public Health
Trochim, W. M., Cabrera, D. A., Milstein, B., Gallagher, R. S., & Leischow, S. J. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.066001 · Cited by 405
Advancing the Science of Community-Level Interventions
Trickett, E. J., Beehler, S., Deutsch, C., Green, L. W., Hawe, P., McLeroy, K., Miller, R. L., Rapkin, B. D., Schensul, J. J., Schulz, A. J., et al. (2011) · American Journal of Public Health · doi:10.2105/ajph.2010.300113 · Cited by 403
Sustainability science: an integrated approach for health-programme planning
Gruen, R. L., Elliott, J. H., Nolan, M. L., Lawton, P. D., Parkhill, A., McLaren, C. J., & Lavis, J. N. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61659-1 · Cited by 395
Executive Summary: FORESIGHT ‘Tackling Obesities: Future Choices’ project
Jebb, S. A., Kopelman, P., & Butland, B. (2007) · Obesity Reviews · doi:10.1111/j.1467-789x.2007.00344.x · Cited by 367
Policies, decisions and information sources for modeling
Forrester, J. W. (1992) · European Journal of Operational Research · doi:10.1016/0377-2217(92)90006-u · Cited by 348
Systems thinking for strengthening health systems in LMICs: need for a paradigm shift
Adam, T., & de Savigny, D. (2012) · Health Policy and Planning · doi:10.1093/heapol/czs084 · Cited by 330
Hannes, K., & Macaitis, K. (2012) · Qualitative Research · doi:10.1177/1468794111432992 · Cited by 320
Interdisciplinarity and Systems Science to Improve Population Health
Mabry, P. L., Olster, D. H., Morgan, G. D., & Abrams, D. B. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.05.018 · Cited by 292
Systems Concepts in Action: A Practitioner's Toolkit
Williams, B., & Hummelbrunner, R. (2010) · Stanford University Press eBooks · doi:10.1515/9780804776554 · Cited by 285
Beyond Evidence-Based Policy in Public Health
Smith, K. (2013) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137026583 · Cited by 268
Ulrich, W., & Reynolds, M. (2010) · Systems Approaches to Managing Change: A Practical Guide · doi:10.1007/978-1-84882-809-4_6 · Cited by 266
Evidence-Based Policymaking: A Critique
Greenhalgh, T., & Russell, J. (2009) · Perspectives in Biology and Medicine · doi:10.1353/pbm.0.0085 · Cited by 241
Systemic Intervention for Public Health
Midgley, G. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.067660 · Cited by 207
Formalizing the role of agent-based modeling in causal inference and epidemiology
Marshall, B. D. L., & Galea, S. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu274 · Cited by 192
Public Management and Network Management: An Overview
Kickert, W. J. M., & Koppenjan, J. F. M. (1997) · Managing Complex Networks: Strategies for the Public Sector · doi:10.4135/9781446217658.n3 · Cited by 187
Johnston, L. M., Matteson, C. L., & Finegood, D. T. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301884 · Cited by 169
Recognizing rhetoric in health care policy analysis
Russell, J., Greenhalgh, T., Byrne, E., & Mcdonnell, J. (2008) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2007.006029 · Cited by 164
Foresight: Tackling Obesities: Future Choices - Building the Obesity System Map
Vandenbroeck, P., Goossens, J., & Clemens, M. (2007) · PsycEXTRA Dataset · doi:10.1037/e602972011-001 · Cited by 158
Applying complexity theory: A review to inform evaluation design
Walton, M. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.04.002 · Cited by 151
A Call to Address Complexity in Prevention Science Research
Lich, K. H., Ginexi, E. M., Osgood, N. D., & Mabry, P. L. (2012) · Prevention Science · doi:10.1007/s11121-012-0285-2 · Cited by 143
Kwamie, A., van Dijk, H., & Agyepong, I. A. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-29 · Cited by 137
Galea, S., Hall, C., & Kaplan, G. A. (2009) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2008.08.005 · Cited by 124
Tengs, T. O., Osgood, N. D., & Chen, L. L. (2001) · Preventive Medicine · doi:10.1006/pmed.2001.0922 · Cited by 122
Model validation in soft systems practice
Checkland, P. B. (1995) · Systems Research · doi:10.1002/sres.3850120108 · Cited by 120
Johnston, L. M., & Finegood, D. T. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122802 · Cited by 113
Improving the Effectiveness of Health Care and Public Health: A Multiscale Complex Systems Analysis
Bar-Yam, Y. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.064444 · Cited by 112
Gilson, L., Elloker, S., Olckers, P., & Lehmann, U. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-30 · Cited by 104
Schaefer, D. R., adams, J., & Haas, S. A. (2013) · Health Education & Behavior · doi:10.1177/1090198113493091 · Cited by 102
Beyond ‘vulnerable groups’: contexts and dynamics of vulnerability
Zarowsky, C., Haddad, S. H. S., & Nguyen, V. (2013) · Global Health Promotion · doi:10.1177/1757975912470062 · Cited by 91
Mahamoud, A., Roche, B., & Homer, J. B. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.06.036 · Cited by 91
Silverman, B. G., Hanrahan, N. P., Bharathy, G. K., Gordon, K., & Johnson, D. (2014) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2014.08.006 · Cited by 89
Implications of Network Structure on Public Health Collaboratives
Retrum, J. H., Chapman, C. L., & Varda, D. (2013) · Health Education & Behavior · doi:10.1177/1090198113492759 · Cited by 87
Human Health and Climate Change: Leverage Points for Adaptation in Urban Environments
Proust, K., Newell, B., Brown, H., Capon, A. G., Browne, C., Burton, A., Dixon, J., Mu, L., & Zarafu, M. (2012) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph9062134 · Cited by 86
Prashanth, N. S., Marchal, B., Devadasan, N., Kegels, G., & Criel, B. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-42 · Cited by 81
Leading change: A guide to whole systems working
Attwood, M. M., Pedler, M., Pritchard, S., et al. (2003) · Cited by 79
Modeling US Adult Obesity Trends: A System Dynamics Model for Estimating Energy Imbalance Gap
Fallah‐Fini, S., Rahmandad, H., Huang, T. T. ‐., Bures, R. M., & Glass, T. A. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301882 · Cited by 77
Agent-Based Models and Systems Science Approaches to Public Health
Maglio, P. P., & Mabry, P. L. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.11.010 · Cited by 76
Reducing health inequities: the contribution of core public health services in BC
Pauly, B., MacDonald, M., Hancock, T., Martin, W., & Perkin, K. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-550 · Cited by 76
Tobias, M. I., Cavana, R. Y., & Bloomfield, A. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.171165 · Cited by 72
Systems Thinking Tools as Applied to Community-Based Participatory Research: A Case Study
BeLue, R., Carmack, C. C., Myers, K. R., Weinreb-Welch, L., & Lengerich, E. J. (2012) · Health Education & Behavior · doi:10.1177/1090198111430708 · Cited by 67
A Novel System Dynamics Model of Female Obesity and Fertility
Sabounchi, N. S., Hovmand, P. S., Osgood, N. D., Dyck, R. F., & Jungheim, E. S. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301898 · Cited by 54
Combating Obesity through Healthy Eating Behavior: A Call for System Dynamics Optimization
Abidin, N. Z., Mamat, M., Dangerfield, B. C., Zulkepli, J. H., Baten, M. A., & Wibowo, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114135 · Cited by 53
Advancing the application of systems thinking in health: why cure crowds out prevention
Bishai, D. M., Paina, L., Li, Q., Peters, D. H., & Hyder, A. A. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-28 · Cited by 50
Iwelunmor, J., Airhihenbuwa, C. O., Cooper, R., Tayo, B. O., Plange‐Rhule, J., Adanu, R., & Ogedegbe, G. G. (2014) · Globalization and Health · doi:10.1186/1744-8603-10-42 · Cited by 47
Integrative system dynamics: analysis of policy options for tobacco control in New Zealand
Cavana, R. Y., & Tobias, M. I. (2008) · Systems Research and Behavioral Science · doi:10.1002/sres.934 · Cited by 46
Wakeland, W. W., Nielsen, A. E., Schmidt, T. D., McCarty, D. W., Webster, L. R., FitzGerald, J., & Haddox, J. D. (2013) · Health Education & Behavior · doi:10.1177/1090198113492767 · Cited by 43
The Tobacco Use Management System: Analyzing Tobacco Control From a Systems Perspective
Borland, R., Young, D., Coghill, K., & Zhang, J. Y. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.165910 · Cited by 42
Network Influences on Dissemination of Evidence-Based Guidelines in State Tobacco Control Programs
Luke, D. A., Wald, L. M., Carothers, B. J., Bach, L., & Harris, J. K. (2013) · Health Education & Behavior · doi:10.1177/1090198113492760 · Cited by 40
Optimizing an HIV testing program using a system dynamics model of the continuum of care
on behalf of the Vancouver HIV Testing Program Modelling Group, Kok, S., Rutherford, A. R., Gustafson, R., Barrios, R., Montaner, J. S. G., & Vàsàrhelyi, K. (2015) · Health Care Management Science · doi:10.1007/s10729-014-9312-0 · Cited by 40
Сауткина, Е., Goodwin, D. M., Jones, A., Ogilvie, D., Petticrew, M. P., White, M. J., & Cummins, S. (2014) · Health & Place · doi:10.1016/j.healthplace.2014.05.006 · Cited by 40
Tubbing, L., Harting, J., & Stronks, K. (2015) · Health Policy · doi:10.1016/j.healthpol.2014.12.020 · Cited by 37
The genetics of alcohol dependence: Advancing towards systems-based approaches
Palmer, R. H. C., McGeary, J. E., Francazio, S. K., Raphael, B. J., Lander, A. D., Heath, A. C., & Knopik, V. S. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.07.005 · Cited by 35
MacLean, L. M., Clinton, K. M., Edwards, N. C., Garrard, M., Ashley, L. A., Hansen-Ketchum, P., & Walsh, A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-36 · Cited by 34
An evidence-based framework to measure quality of allied health care
Grimmer, K. A., Lizarondo, L. M., Kumar, S., Bell, E., Buist, M., & Weinstein, P. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-10 · Cited by 33
Capturing complexity: mixing methods in the analysis of a European tobacco control policy network
Weishaar, H. B., Amos, A., & Collin, J. (2014) · International Journal of Social Research Methodology · doi:10.1080/13645579.2014.897851 · Cited by 30
Norman, C. D., Charnaw-Burger, J., Yip, A. L., Saad, S., & Lombardo, C. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01534.x · Cited by 28
Bocoum, F. Y., Kouanda, S., Kouyaté, B. A., Hounton, S., & Adam, T. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-997 · Cited by 26
Social determinants in an Australian urban region: a ‘complexity’ lens
Fisher, M., Miloš, D., Baum, F. E., et al. (2014) · Health Promotion International · doi:10.1093/heapro/dau071 · Cited by 23
Lich, K. H., Osgood, N. D., & Mahamoud, A. (2010) · Global Health Promotion · doi:10.1177/1757975909358255 · Cited by 18
A Complex Systems Approach to Understanding and Combating the Obesity Epidemic
Hammond, R. A. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-374387-9.00061-1 · Cited by 17
Rehfuess, E. A., Best, N., Briggs, D., & Joffe, M. (2013) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-10-13 · Cited by 13
Prevention of Methamphetamine Abuse: Can Existing Evidence Inform Community Prevention?
Birckmayer, J. D., Fisher, D. A., Holder, H. D., & Yacoubian, G. S. (2008) · Journal of Drug Education · doi:10.2190/de.38.2.d · Cited by 12
Delgado, J., Pollard, S., Snary, E., Black, E., Prpich, G. P., & Longhurst, P. (2012) · Risk Analysis · doi:10.1111/j.1539-6924.2012.01934.x · Cited by 10
Social Network Analysis of Peer Effects on Binge Drinking among U.S. Adolescents
Mundt, M. P. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37210-0_14 · Cited by 9
Use of complex systems modelling to strengthen public health’s role in preventing war
Wiist, W. H. (2014) · Medicine Conflict & Survival · doi:10.1080/13623699.2014.922374 · Cited by 3
Cited by
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260
“Statistical methods, such as interrupted time-series analysis, can be used effectively to evaluate the impacts of such interventions over time,(28) and simulation approaches, such as agent-based modelling, can integrate diverse evidence sources, allow for non-independence and feedback, and simulate emergence.(19,29) T…”
Moore, G. F., Evans, R. E., Hawkins, J., Littlecott, H., Melendez-Torres, G. J., Bonell, C., & Murphy, S. (2019) · Evaluation · doi:10.1177/1356389018803219 · Cited by 471
“However, this advocacy, has been accompanied by fewer efforts to articulate what this might look like in practice (Carey et al., 2015; Greenwood-Lee et al., 2016; Luke and Stamatakis, 2012).”
BackgroundUnderstanding the rise of cardiometabolic diseases in low- and middle-income countries
Miranda, J. J., Barrientos-Gutiérrez, T., Corvalan, C., Hyder, A. A., Lazo-Porras, M., Oni, T., & Wells, J. C. K. (2019) · Nature Medicine · doi:10.1038/s41591-019-0644-7 · Cited by 365
Wicked Problems in Public Policy: Understanding and Responding to Complex Challenges
Head, B. W. (2022) · Springer eBooks · doi:10.1007/978-3-030-94580-0 · Cited by 351
Whole systems approaches to obesity and other complex public health challenges: a systematic review
Bagnall, A.-M., Radley, D., Jones, R., Gately, P., Nobles, J., Van Dijk, M., Blackshaw, J., Montel, S., & Sahota, P. (2019) · BMC Public Health · doi:10.1186/s12889-018-6274-z · Cited by 322
Metadata
- Authors
- Carey, G., Malbon, E., Carey, N., Joyce, A., Crammond, B., & Carey, A.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2015-12
- Volume
- 5
- Issue
- 12
- Pages
- e009002
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W2232278549
- Cited by
- 432
- References
- 83
- FWCI
- 6.26
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.