The effect of changing the built environment on physical activity: a quantitative review of the risk of bias in natural experiments
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Evidence regarding the association of the built environment with physical activity is influencing policy recommendations that advocate changing the built environment to increase population-level physical activity. However, to date there has been no rigorous appraisal of the quality of the evidence on the effects of changing the built environment. The aim of this review was to conduct a thorough quantitative appraisal of the risk of bias present in those natural experiments with the strongest experimental designs for assessing the causal effects of the built environment on physical activity. METHODS: Eligible studies had to evaluate the effects of changing the built environment on physical activity, include at least one measurement before and one measurement of physical activity after changes in the environment, and have at least one intervention site and non-intervention comparison site. Given the large number of systematic reviews in this area, studies were identified from three exemplar systematic reviews; these were published in the past five years and were selected to provide a range of different built environment interventions. The risk of bias in these studies was analysed using the Cochrane Risk of Bias Assessment Tool: for Non-Randomized Studies of Interventions (ACROBAT-NRSI). RESULTS: Twelve eligible natural experiments were identified. Risk of bias assessments were conducted for each physical activity outcome from all studies, resulting in a total of fifteen outcomes being analysed. Intervention sites included parks, urban greenways/trails, bicycle lanes, paths, vacant lots, and a senior citizen's centre. All outcomes had an overall critical (n = 12) or serious (n = 3) risk of bias. Domains with the highest risk of bias were confounding (due to inadequate control sites and poor control of confounding variables), measurement of outcomes, and selection of the reported result. CONCLUSIONS: The present review focused on the strongest natural experiments conducted to date. Given this, the failure of existing studies to adequately control for potential sources of bias highlights the need for more rigorous research to underpin policy recommendations for changing the built environment to increase physical activity. Suggestions are proposed for how future natural experiments in this area can be improved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Lee, I.-M., Shiroma, E. J., Lobelo, F., Puska, P., Blair, S. N., & Katzmarzyk, P. T. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61031-9 · Cited by 8,215
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
Correlates of physical activity: why are some people physically active and others not?
Bauman, A. E., Reis, R. S., Sallis, J. F., Wells, J. C., Loos, R. J., & Martin, B. W. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60735-1 · Cited by 4,151
An ecological approach to creating active living communities
Sallis, J. F., Cervero, R. B., Ascher, W., Henderson, K. A., Kraft, M. K., & Kerr, J. (2006) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.27.021405.102100 · Cited by 3,296
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907 · cited 2×
“This tool was chosen because it is specifically designed for non-randomised studies [32].”
Methodvon Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Built Environment Correlates of Walking: A Review
SAELENS, B. E., & HANDY, S. L. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31817c67a4 · Cited by 1,912
Sanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531 · cited 1×
“Given that there has been little consistency in previous risk of bias tools that have weighted bias or quality domains [56], adjusting the principles of an established risk of bias tool by creating weighted bias domains would have been difficult to justify.”
BackgroundKwasnicka, D., Dombrowski, S. U., White, M., & Sniehotta, F. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1151372 · Cited by 1,476
Cited by
Social determinants of health and diabetes: A scientific review
Hill-Briggs, F., Adler, N. E., Berkowitz, S. A., Chin, M. H., Gary-Webb, T. L., Navas-Acien, A., Thornton, P. L., & Haire-Joshu, D. (2021) · Diabetes Care · doi:10.2337/dci20-0053 · Cited by 1,732
“Several review articles of natural experiments summarize the benefits of policy andbuilt environment changes on obesity-related outcomes(112)anddietandPAoutcomes (120,121).”
BackgroundSmith, M., Hosking, J., Woodward, A., Witten, K., MacMillan, A., Field, A., Baas, P., & Mackie, H. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0613-9 · Cited by 888
Hunter, R. F., Cleland, C., Cleary, A., Droomers, M., Wheeler, B. W., Sinnett, D., Nieuwenhuijsen, M. J., & Braubach, M. (2019) · Environment International · doi:10.1016/j.envint.2019.104923 · Cited by 544
Self-citationKärmeniemi, M., Lankila, T., Ikäheimo, T., Koivumaa-Honkanen, H., & Korpelainen, R. (2018) · Annals of Behavioral Medicine · doi:10.1093/abm/kax043 · Cited by 446
Moore, T. H. M., Kesten, J. M., López-López, J. A., Ijaz, S., McAleenan, A., Richards, A., Gray, S., Savović, J., & Audrey, S. (2018) · Health & Place · doi:10.1016/j.healthplace.2018.07.012 · Cited by 269
Metadata
- Authors
- Benton, J. S., Anderson, J., Hunter, R. F., & French, D. P.
- Venue
- International Journal of Behavioral Nutrition and Physical Activity
- Published
- 2016-10-07
- Volume
- 13
- Issue
- 1
- Pages
- 107-107
- ISSN
- 1479-5868 (ISSN-L)
- OpenAlex
- W2529266118
- Cited by
- 120
- References
- 21
- FWCI
- 17.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effect of changing the built environment on physical activity: a quantitative review of the risk of bias in natural experiments. https://app.cochat.ai/papers/10.1186/s12966-016-0433-3
- The paper
- Benton, J. S., Anderson, J., Hunter, R. F., & French, D. P. (2016). The effect of changing the built environment on physical activity: a quantitative review of the risk of bias in natural experiments. International Journal of Behavioral Nutrition and Physical Activity. https://doi.org/10.1186/s12966-016-0433-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.