The DOI matches its Crossref record; 107 of the 107 references it cites were found in a registry or an index.
Evaluation of public health interventions from a complex systems perspective: A research methods review
Open accessAbstract
INTRODUCTION: Applying a complex systems perspective to public health evaluation may increase the relevance and strength of evidence to improve health and reduce health inequalities. In this review of methods, we aimed to: (i) classify and describe different complex systems methods in evaluation applied to public health; and (ii) examine the kinds of evaluative evidence generated by these different methods. METHODS: We adapted critical review methods to identify evaluations of public health interventions that used systems methods. We conducted expert consultation, searched electronic databases (Scopus, MEDLINE, Web of Science), and followed citations of relevant systematic reviews. Evaluations were included if they self-identified as using systems- or complexity-informed methods and if they evaluated existing or hypothetical public health interventions. Case studies were selected to illustrate different types of complex systems evaluation. FINDINGS: Seventy-four unique studies met our inclusion criteria. A framework was developed to map the included studies onto different stages of the evaluation process, which parallels the planning, delivery, assessment, and further delivery phases of the interventions they seek to inform; these stages include: 1) theorising; 2) prediction (simulation); 3) process evaluation; 4) impact evaluation; and 5) further prediction (simulation). Within this framework, we broadly categorised methodological approaches as mapping, modelling, network analysis and 'system framing' (the application of a complex systems perspective to a range of study designs). Studies frequently applied more than one type of systems method. CONCLUSIONS: A range of complex systems methods can be utilised, adapted, or combined to produce different types of evaluative evidence. Further methodological innovation in systems evaluation may generate stronger evidence to improve health and reduce health inequalities in our complex world.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Self-citationProcess evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204 · cited 2×
“Process evaluations are a common feature of public health intervention evaluation (Moore et al., 2014), but they do not typically include system maps, modelling or the explicit application of systems theories and concepts.”
BackgroundDixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,289
Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use
Patton, M. Q. (2010) · Cited by 1,740
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260
Self-citationAgent-Based and Individual-Based Modeling: A Practical Introduction
Railsback, S. F., & Grimm, V. (2011) · Cited by 1,203
Theorising interventions as events in systems
Hawe, P., Shiell, A., & Riley, T. (2009) · American Journal of Community Psychology · doi:10.1007/s10464-009-9229-9 · Cited by 1,143
Checkland, P. B., & Poulter, J. (2007) · Lancaster EPrints (Lancaster University) · Cited by 731
Complex interventions or complex systems? Implications for health economic evaluation
Shiell, A., Hawe, P., & Gold, L. (2008) · BMJ · doi:10.1136/bmj.39569.510521.ad · Cited by 629
The application of systems thinking in health: why use systems thinking?
Peters, D. H. (2014) · Health Research Policy and Systems · doi:10.1186/1478-4505-12-51 · Cited by 577
Moore, G. F., Evans, R. E., Hawkins, J., Littlecott, H., Melendez-Torres, G. J., Bonell, C., & Murphy, S. (2019) · Evaluation · doi:10.1177/1356389018803219 · Cited by 471 · cited 1×
“The task of identifying public health evaluations that take a systems perspective involves a number of challenges and decision-points: notably, deciding (i) whether or not some studies that explicitly reported taking a complex systems perspective were justified in doing so (Moore et al., 2019); and (ii) whether the in…”
BackgroundRihoux, B. (2006) · International Sociology · doi:10.1177/0268580906067836 · Cited by 461
Business Dynamics—Systems Thinking and Modeling for a Complex World
Swanson, J. (2002) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601336 · Cited by 442
Complex Systems Thinking and Current Impasses in Health Disparities Research
Diez Roux, A. V. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300149 · Cited by 436
Systems science and systems thinking for public health: a systematic review of the field
Carey, G., Malbon, E., Carey, N., Joyce, A., Crammond, B., & Carey, A. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009002 · Cited by 432
System dynamics—a personal view of the first fifty years
Forrester, J. W. (2007) · System Dynamics Review · doi:10.1002/sdr.382 · Cited by 346
Whole systems approaches to obesity and other complex public health challenges: a systematic review
Bagnall, A.-M., Radley, D., Jones, R., Gately, P., Nobles, J., Van Dijk, M., Blackshaw, J., Montel, S., & Sahota, P. (2019) · BMC Public Health · doi:10.1186/s12889-018-6274-z · Cited by 322
Systems Concepts in Action: A Practitioner's Toolkit
Williams, B., & Hummelbrunner, R. (2010) · Stanford University Press eBooks · doi:10.1515/9780804776554 · Cited by 285
Scarborough, P., Adhikari, V., Harrington, R. A., Elhussein, A., Briggs, A., Rayner, M., Adams, J., Cummins, S., Penney, T., & White, M. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003025 · Cited by 277
Self-citationImplications of the Foresight Obesity System Map for Solutions to Childhood Obesity
Finegood, D. T., Merth, T. D. N., & Rutter, H. (2010) · Obesity · doi:10.1038/oby.2009.426 · Cited by 275
Self-citationA Community Based Systems Diagram of Obesity Causes
Allender, S., Owen, B., Kuhlberg, J., Lowe, J., Nagorcka-Smith, P., Whelan, J., & Bell, C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0129683 · Cited by 274
Petticrew, M., Knai, C., Thomas, J., Rehfuess, E. A., Noyes, J., Gerhardus, A., Grimshaw, J. M., Rutter, H., & McGill, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000899 · Cited by 204
Self-citationPowell, R., Moreno, J. L., Jennings, H. H., Criswell, J. H., Katz, L., Blake, R. R., Mouton, J. S., Bonney, M. E., Northway, M. L., Loomis, C. P., et al. (1961) · American Sociological Review · doi:10.2307/2090590 · Cited by 196
Practice-Based Evidence in Public Health: Improving Reach, Relevance, and Results
Ammerman, A., Smith, T. W., & Calancie, L. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182458 · Cited by 181
Haghshenas, H., Vaziri, M., & Gholamialam, A. (2014) · Cities · doi:10.1016/j.cities.2014.11.003 · Cited by 157
Applying complexity theory: A review to inform evaluation design
Walton, M. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.04.002 · Cited by 151
Evans, R., Murphy, S., & Scourfield, J. (2015) · Prevention Science · doi:10.1007/s11121-015-0552-0 · Cited by 136
Prevention of childhood obesity and food policies in Latin America: from research to practice
Pérez‐Escamilla, R., Lutter, C. K., Rabadan‐Diehl, C., Rubinstein, A., Calvillo, A., Corvalán, C., Batis, C., Jacoby, E., Vorkoper, S., Kline, L., et al. (2017) · Obesity Reviews · doi:10.1111/obr.12574 · Cited by 133
Translating systems thinking into practice for community action on childhood obesity
Allender, S. E., Brown, A. D., Bolton, K. A., Fraser, P., Lowe, J., & Hovmand, P. S. (2019) · Obesity Reviews · doi:10.1111/obr.12865 · Cited by 126
The implementation of Health in All Policies initiatives: a systems framework for government action
Shankardass, K., Muntaner, C., Kokkinen, L., Shahidi, F. V., Freiler, A., Oneka, G., Bayoumi, A. M., & O'Campo, P. J. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0295-z · Cited by 125
Complex, but not quite complex enough: The turn to the complexity sciences in evaluation scholarship
Mowles, C. (2014) · Evaluation · doi:10.1177/1356389014527885 · Cited by 123
Theorizing healthy settings: a critical discussion with reference to Healthy Universities
Dooris, M., Wills, J., & Newton, J. (2014) · Scandinavian Journal of Public Health · doi:10.1177/1403494814544495 · Cited by 123
Tengs, T. O., Osgood, N. D., & Chen, L. L. (2001) · Preventive Medicine · doi:10.1006/pmed.2001.0922 · Cited by 122
Systems thinking in public health: a bibliographic contribution to a meta-narrative review
Chughtai, S., & Blanchet, K. (2016) · Health Policy and Planning · doi:10.1093/heapol/czw159 · Cited by 119
Participatory system dynamics modelling for housing, energy and wellbeing interactions
Eker, S., Zimmermann, N., Carnohan, S., & Davies, M. (2017) · Building Research & Information · doi:10.1080/09613218.2017.1362919 · Cited by 116
Zhang, D. “., Giabbanelli, P. J., Arah, O. A., & Zimmerman, F. J. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301934 · Cited by 108
Systems Thinking in 49 Communities Related to Healthy Eating, Active Living, and Childhood Obesity
Brennan, L. K., Sabounchi, N. S., Kemner, A. L., & Hovmand, P. S. (2015) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000248 · Cited by 107
Tobacco Town: Computational Modeling of Policy Options to Reduce Tobacco Retailer Density
Luke, D. A., Hammond, R. A., Combs, T., Sorg, A., Kasman, M., Mack‐Crane, A., Ribisl, K. M., & Henriksen, L. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303685 · Cited by 107
Gates, E. F. (2016) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2016.08.004 · Cited by 106
Knai, C., Petticrew, M. P., Douglas, N., Durand, M. A., Eastmure, E., Nolte, E., & Mays, N. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15122895 · Cited by 93
Self-citationLich, K. H., Urban, J. B., Frerichs, L., & Dave, G. (2016) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2016.10.008 · Cited by 91
Process evaluation of the Healthy Primary School of the Future: the key learning points
Bartelink, N. H. M., van Assema, P., Jansen, M. W. J., Savelberg, H. H. C. M., Moore, G. F., Hawkins, J. L., & Kremers, S. (2019) · BMC Public Health · doi:10.1186/s12889-019-6947-2 · Cited by 81
Loyo, H. K., Batcher, C., Wile, K., Huang, P. P., Orenstein, D., & Milstein, B. (2012) · Health Promotion Practice · doi:10.1177/1524839910390305 · Cited by 79
Pearson‐Stuttard, J., Kypridemos, C., Collins, B., Mozaffarian, D., Huang, Y., Bandosz, P., Capewell, S., Whitsel, L. P., Wilde, P., O’Flaherty, M., et al. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002551 · Cited by 78
Egan, M., McGill, E., Penney, T. L., de Cuevas, R. A., Er, V., Orton, L., Lock, K., Popay, J., Savona, N., Cummins, S., et al. (2019) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · Cited by 76
Self-citationUsing Qualitative Comparative Analysis to understand complex policy problems
Blackman, T., Wistow, J., & Byrne, D. (2013) · Evaluation · doi:10.1177/1356389013484203 · Cited by 73
Tobias, M. I., Cavana, R. Y., & Bloomfield, A. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.171165 · Cited by 72
Knowledge theories can inform evaluation practice: What can a complexity lens add?
Hawe, P., Bond, L. M., & Butler, H. (2009) · New Directions for Evaluation · doi:10.1002/ev.316 · Cited by 71
Durie, R., & Wyatt, K. M. (2013) · Critical Public Health · doi:10.1080/09581596.2013.781266 · Cited by 71
Blackman, T., Wistow, J., & Byrne, D. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.04.003 · Cited by 70
Systems Science and Childhood Obesity: A Systematic Review and New Directions
Skinner, A. C., & Foster, E. M. (2013) · Journal of Obesity · doi:10.1155/2013/129193 · Cited by 67
European Healthy City Network Phase V: patterns emerging for healthy urban planning
Grant, M. (2015) · Health Promotion International · doi:10.1093/heapro/dav033 · Cited by 62
Pell, D., Penney, T. L., Hammond, D. G., Vanderlee, L., White, M. J., & Adams, J. M. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026698 · Cited by 62
Self-citationJalali, M. S., Rahmandad, H., Bullock, S. L., Lee, S. H., Gittelsohn, J., & Ammerman, A. S. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.12.021 · Cited by 59
Orton, L., Halliday, E. C., Collins, M., Egan, M., Lewis, S., Ponsford, R., Powell, K., Salway, S., Townsend, A. F., Whitehead, M. M., et al. (2016) · Critical Public Health · doi:10.1080/09581596.2016.1250868 · Cited by 56
Self-citationMoving alcohol prevention research forward—Part I: introducing a complex systems paradigm
Apostolopoulos, Y., Lemke, M. K., Barry, A. E., & Lich, K. H. (2017) · Addiction · doi:10.1111/add.13955 · Cited by 56
Crane, M. A., Bauman, A. E., Lloyd, B., McGill, B., Rissel, C. E., & Grunseit, A. C. (2019) · Health Promotion Journal of Australia · doi:10.1002/hpja.239 · Cited by 56
Health Behavior Change in Populations
Kahan, S. I. (2014) · Johns Hopkins University Press eBooks · doi:10.56021/9781421414553 · Cited by 55
Examining the Impact of the Walking School Bus With an Agent-Based Model
Yang, Y., Roux, A. V. D., Evenson, K. R., & Colabianchi, N. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301896 · Cited by 52
Figueiró, A. C., Oliveira, S. R. D. A., Hartz, Z., Couturier, Y., Bernier, J., Freire, M. D. S. M., Samico, I., Medina, M. G., de, R. F., & Potvin, L. (2016) · International Journal of Public Health · doi:10.1007/s00038-016-0861-5 · Cited by 49
adams, J., & Schaefer, D. R. (2016) · Journal of Health and Social Behavior · doi:10.1177/0022146515627848 · Cited by 46
Scaling up Integrated Early Childhood Development programs: lessons from four countries
Pérez‐Escamilla, R., Cavallera, V., Tomlinson, M., & Dua, T. (2017) · Child Care Health and Development · doi:10.1111/cch.12480 · Cited by 44
Wakeland, W. W., Nielsen, A. E., Schmidt, T. D., McCarty, D. W., Webster, L. R., FitzGerald, J., & Haddox, J. D. (2013) · Health Education & Behavior · doi:10.1177/1090198113492767 · Cited by 43
An analysis of the stock market reaction to the announcements of the UK Soft Drinks Industry Levy
Law, C., Cornelsen, L., Adams, J. M., Penney, T. L., Rutter, H., White, M. J., & Smith, R. (2020) · Economics & Human Biology · doi:10.1016/j.ehb.2019.100834 · Cited by 43
Self-citationSoler, R. E., Orenstein, D., Honeycutt, A., Bradley, C., Trogdon, J. G., Kent, C. K., Wile, K., Haddix, A. C., O’Neil, D., Bunnell, R. E., et al. (2016) · Preventing Chronic Disease · doi:10.5888/pcd13.150272 · Cited by 42
Lyon, A. R., Maras, M. A., Pate, C. M., Igusa, T., & Stoep, A. V. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0628-y · Cited by 41
Li, Y., Zhang, D. “., Rajbhandari‐Thapa, J., Madondo, K., Yi, S. S., Fisher, E. M., Griffin, K., Liu, B., Wang, Y., & Pagán, J. A. (2017) · Preventive Medicine · doi:10.1016/j.ypmed.2017.10.014 · Cited by 41
Kasman, M., Hammond, R. A., Heuberger, B., Mack‐Crane, A., Purcell, R., Economos, C. D., Swinburn, B. A., Allender, S. E., & Nichols, M. S. (2019) · Obesity · doi:10.1002/oby.22553 · Cited by 41
Guzmán, L. A., de la Hoz, D., & de Cáceres, A. M. (2012) · International Journal of Sustainable Transportation · doi:10.1080/15568318.2012.696772 · Cited by 40
Hoang, V. P., Shanahan, M., Shukla, N., Perez, P., Farrell, M., & Ritter, A. J. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1368-8 · Cited by 40
Guo, H., Hobbs, B. F., Lasater, M. E., Parker, C. L., & WINCH, P. J. (2016) · Waste Management · doi:10.1016/j.wasman.2016.05.019 · Cited by 40
Comparing methods of targeting obesity interventions in populations: An agent-based simulation
Beheshti, R., Jalalpour, M., & Glass, T. A. (2017) · SSM - Population Health · doi:10.1016/j.ssmph.2017.01.006 · Cited by 40
The impact of UK soft drinks industry levy on manufacturers’ domestic turnover
Law, C., Cornelsen, L., Adams, J. M., Pell, D., Rutter, H., White, M. J., & Smith, R. (2020) · Economics & Human Biology · doi:10.1016/j.ehb.2020.100866 · Cited by 40
Self-citationThe Healthy Primary School of the Future: A Contextual Action-Oriented Research Approach
Bartelink, N. H. M., Van Assema, P., Jansen, M. W. J., Savelberg, H. H. C. M., Willeboordse, M., & Kremers, S. P. J. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15102243 · Cited by 39
Applying Systems Science to Evaluate a Community-Based Social Marketing Innovation
Biroscak, B. J., Schneider, T., Panzera, A. D., Bryant, C. A., McDermott, R. J., Mayer, A. B., Khaliq, M., Lindenberger, J. H., Courtney, A. H., Swanson, M. A., et al. (2014) · Social Marketing Quarterly · doi:10.1177/1524500414556649 · Cited by 39
Chen, H., Xue, H., Liu, S., Huang, T. T. ‐., Wang, Y., & Wang, Y. (2018) · Public Health · doi:10.1016/j.puhe.2018.01.013 · Cited by 36
Evaluation of Get Healthy at Work, a state-wide workplace health promotion program in Australia
Crane, M. A., Bohn-Goldbaum, E. E., Lloyd, B., Rissel, C. E., Bauman, A. E., Indig, D., Khanal, S., & Grunseit, A. C. (2019) · BMC Public Health · doi:10.1186/s12889-019-6493-y · Cited by 33
Keyes, K. M., Shev, A. B., Tracy, M., & Cerdá, M. (2018) · Addiction · doi:10.1111/add.14470 · Cited by 32
Navigating the Turbulent Waters of School Reform Guided by Complexity Theory
White, D. G., & Levin, J. A. (2016) · Complicity An International Journal of Complexity and Education · doi:10.29173/cmplct24566 · Cited by 31
Learning from seasoned evaluators: Implications of systems approaches for evaluation practice
Gates, E. (2017) · Evaluation · doi:10.1177/1356389017697613 · Cited by 31
Keyes, K. M., Hamilton, A. D., Swanson, J. W., Tracy, M., & Cerdá, M. (2019) · American Journal of Public Health · doi:10.2105/ajph.2019.305041 · Cited by 31
Walton, M. (2015) · Evidence & Policy · doi:10.1332/174426415x14298726247211 · Cited by 29
Capturing the Complexity of Evaluations of Health Promotion Interventions: A Scoping Review
Kania, A., Patel, A. B., Roy, A., Yelland, G. S., Nguyêñ, D. T. K., & Verhoef, M. J. (2012) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.027.003 · Cited by 28
Evaluating a complex health promotion intervention: case application of three systems methods
Rosas, S. R., & Knight, E. K. (2018) · Critical Public Health · doi:10.1080/09581596.2018.1455966 · Cited by 27
Urwannachotima, N., Hanvoravongchai, P., & Ansah, J. P. (2018) · Systems Research and Behavioral Science · doi:10.1002/sres.2546 · Cited by 25
Lapalme, J., Bisset, S. L., & Potvin, L. (2013) · International Journal of Public Health · doi:10.1007/s00038-013-0449-2 · Cited by 24
An agent-based model of the influence of neighbourhood design on daily trip patterns
Jin, X., & White, R. W. (2012) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2012.03.006 · Cited by 24
Kuo, T., Robles, B., Trogdon, J. G., Ferencik, R., Simon, P. A., & Fielding, J. E. (2015) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000334 · Cited by 24
Social determinants in an Australian urban region: a ‘complexity’ lens
Fisher, M., Miloš, D., Baum, F. E., et al. (2014) · Health Promotion International · doi:10.1093/heapro/dau071 · Cited by 23
Impacts of licensed premises trading hour policies on alcohol‐related harms
Occhipinti, J., Prodan, A., Livingston, M., Knowles, D. L., O’Donnell, E. M., Room, R., Indig, D., Page, A., McDonnell, G., & Wiggers, J. H. (2018) · Addiction · doi:10.1111/add.14178 · Cited by 23
Implementing a social‐ecological model of health in Wales
Rothwell, H., Shepherd, M., Murphy, S., Burgess, S., Townsend, N. P., & Pimm, C. (2010) · Health Education · doi:10.1108/09654281011087279 · Cited by 21
Systemic barriers to effective utilization of decision making tools in child protection practice
Alfandari, R. (2017) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2017.02.030 · Cited by 20
Igras, S. M., Sinaï, I., Mukabatsinda, M., Ngabo, F., Jennings, V. H., & Lundgren, R. (2014) · Global Health Science and Practice · doi:10.9745/ghsp-d-13-00165 · Cited by 19
Bars on blocks: A cellular automata model of crime and liquor licensed establishment density
Spicer, V., Reid, A. A., Ginther, J., Seifi, H., & Dabbaghian, V. (2012) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2012.02.004 · Cited by 18
McGill, E., Marks, D., Sumpter, C., & Egan, M. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010759 · Cited by 18
Self-citationSchelbe, L. A., Randolph, K. A., Yelick, A., Cheatham, L. P., & Groton, D. B. (2018) · Journal of Evidence-Informed Social Work · doi:10.1080/23761407.2018.1436110 · Cited by 18
Czaja, S. J., Valente, T. W., Nair, S. N., Villamar, J. A., & Brown, C. H. (2015) · Implementation Science · doi:10.1186/s13012-016-0433-3 · Cited by 15
Burman, C. J., & Aphane, M. (2016) · African Journal of AIDS Research · doi:10.2989/16085906.2016.1198821 · Cited by 15
Sumpter, C., McGill, E., Dickie, E., Champo, E., Romeri, E., & Egan, M. (2016) · BMC Public Health · doi:10.1186/s12889-016-3117-7 · Cited by 13
Self-citationvan Twist, M. J. W., Kort, M., & van der Steen, M. (2015) · International Journal of Public Administration · doi:10.1080/01900692.2014.952821 · Cited by 12
Dynamic Simulation of Crime Perpetration and Reporting to Examine Community Intervention Strategies
Yonas, M., Burke, J. G., Brown, S. T., Borrebach, J. D., Garland, R., Burke, D. S., & Grefenstette, J. J. (2013) · Health Education & Behavior · doi:10.1177/1090198113493090 · Cited by 12
Dickson‐Gómez, J., Glasman, L. R., Bodnar, G., & Murphy, M. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3667-8 · Cited by 11
Araz, Ö. M., Wilson, F. A., & Stimpson, J. P. (2018) · Annals of Operations Research · doi:10.1007/s10479-018-2961-5 · Cited by 10
Haggård, U., Trolldal, B., Kvillemo, P., & Guldbrandsson, K. (2014) · Nordic Studies on Alcohol and Drugs · doi:10.1515/nsad-2015-0009 · Cited by 9
Modeling the Diet Dynamics of Children: The Roles of Socialization and the School Environment
Safan, M., Murillo, A. L., Wadhera, D., & Castillo‐Chávez, C. (2018) · Letters in Biomathematics · doi:10.30707/lib5.1safan · Cited by 9
Development and Complex Dynamics at School Environment
Fuentes, M., Cárdenas, J. P., Carro, N., & Lozada, M. (2018) · Complexity · doi:10.1155/2018/3963061 · Cited by 8
Cited by
Evans, R., MacDonald, S., Trubey, R., Noyes, J., Robling, M., Willis, S., Boffey, M., Wooders, C., Vinnicombe, S., & Melendez-Torres, G. J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02260-y · Cited by 29
Metadata
- Authors
- McGill, E., Er, V., Penney, T., Egan, M., White, M., Meier, P., Whitehead, M., Lock, K., Anderson de Cuevas, R., Smith, R., Savona, N., Rutter, H., Marks, D., de Vocht, F., Cummins, S., Popay, J., & Petticrew, M.
- Venue
- Social Science & Medicine
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 272
- Pages
- 113697
- ISSN
- 0277-9536 (ISSN-L)
- OpenAlex
- W3119019580
- Cited by
- 257
- References
- 107
- FWCI
- 25.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.