Analysis of longitudinal data to evaluate a policy change
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Longitudinal data analysis methods are powerful tools for exploring scientific questions regarding change and are well suited to evaluate the impact of a new policy. However, there are challenging aspects of policy change data that require consideration, such as defining comparison groups, separating the effect of time from that of the policy, and accounting for heterogeneity in the policy effect. We compare currently available methods to evaluate a policy change and illustrate issues specific to a policy change analysis via a case study of laws that eliminate gun‐use restrictions (shall‐issue laws) and firearm‐related homicide. We obtain homicide rate ratios estimating the effect of enacting a shall‐issue law, which vary between 0.903 and 1.101. We conclude that in a policy change analysis it is essential to select a mean model that most accurately characterizes the anticipated effect of the policy intervention, thoroughly model temporal trends, and select methods that accommodate unit‐specific policy effects. We also conclude that several longitudinal data analysis methods are useful to evaluate a policy change, but not all may be appropriate in certain contexts. Analysts must carefully decide which methods are appropriate for their application and must be aware of the differences between methods to select a procedure that generates valid inference. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Segmented regression analysis of interrupted time series studies in medication use research
Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross-Degnan, D. (2002) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.1365-2710.2002.00430.x · Cited by 3,279 · cited 3×
““Segmented regression” relies on the rigid assumption of linearity and does not allow adjustment for covariates [4].”
BackgroundMethodInfluentialA Covariance Estimator for GEE with Improved Small‐Sample Properties
Mancl, L. A., & DeRouen, T. A. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00126.x · Cited by 656
Research works printed but not linked: 24
- 10.1097/00007632-200003010-00005 · DOI · Paper page
- 10.1016/j.aap.2004.03.002 · DOI
- 10.1111/j.1475-6773.2005.00501.x · doi:10.1111/j.1475-6773.2005.00501.x
- 10.1162/qjec.122.1.159 · DOI · Paper page
- 10.1086/467988 · DOI · Paper page
- 10.1136/ip.2004.007062 · DOI · Paper page
- 10.1177/1088767905279972 · DOI
- 10.2105/AJPH.87.6.918 · doi:10.2105/ajph.87.6.918
- 10.1093/biomet/73.1.13 · DOI · Paper page
- Diggle PJ, 2002, Analysis of Longitudinal Data, 10.1093/oso/9780198524847.001.0001 · DOI · Paper page
- Carriere KC, 2000, Across time and space: variations in hospital use during Canadian health reform, Health Services Research, 35, 467
- 10.2307/2290687 · DOI
- 10.1080/01621459.1999.10473816 · DOI
- 10.1191/0962280202sm291ra · DOI · Paper page
- 10.1002/(SICI)1097-0258(19990215)18:3<321::AID-SIM28>3.0.CO;2-P · DOI · Paper page
- 10.1016/0197-2456(86)90046-2 · DOI · Paper page
- 10.2307/2682801 · DOI
- 10.2307/2531734 · DOI · Paper page
- 10.1093/oxfordjournals.aje.a114892 · DOI · Paper page
- Heagerty PJ, 2000, Window subsampling of estimating functions with application to regression models, Journal of the American Statistical Association, 95, 197, 10.1080/01621459.2000.10473914 · DOI
- Verbeke G, 2000, Linear Mixed Models for Longitudinal Data
- 10.1007/978-1-4899-4541-9 · DOI · Paper page
- R Development Core Team, 2007, R: A Language and Environment for Statistical Computing
- StataCorp, 2007, Stata Statistical Software: Release 10
Cited by
Raifman, J., Moscoe, E., Austin, S. B., & McConnell, M. (2017) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2016.4529 · Cited by 426
Dowell, D., Zhang, K., Noonan, R. K., & Hockenberry, J. M. (2016) · Health Affairs · doi:10.1377/hlthaff.2016.0448 · Cited by 264
Goldberg, D., French, B., Thomasson, A., Reddy, R. K., & Halpern, S. D. (2011) · Liver Transplantation · doi:10.1002/lt.22396 · Cited by 66
“We stratified the baseline hazard function by the transplant center to accommodate heterogeneity in the hazard of death or removal from the transplant list across centers.(24) We used the sandwich variance estimator to properly account for the correlation due to the clustering of patients with centers.”
MethodSelf-citationRisk of waitlist mortality in patients with primary sclerosing cholangitis and bacterial cholangitis
Goldberg, D. S., Camp, A., Martinez-Camacho, A., Forman, L., Fortune, B., & Reddy, R. K. (2013) · Liver Transplantation · doi:10.1002/lt.23587 · Cited by 58
“We used robust standard errors to account for correlations due to patient clustering by transplant center.(12) Covariates were reported as subhazard ratios because of the use of competing-risk models.”
MethodArno, P. S., House, J. S., Viola, D., & Schechter, C. (2011) · Journal of Public Health Policy · doi:10.1057/jphp.2011.2 · Cited by 40
Bachhuber, M. A., Maughan, B. C., Mitra, N., Feingold, J., & Starrels, J. L. (2016) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2015.08.005 · Cited by 35
Metadata
- Authors
- French, B., & Heagerty, P. J.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2008-07-10
- Volume
- 27
- Issue
- 24
- Pages
- 5005-5025
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2047851597
- Cited by
- 88
- References
- 3
- FWCI
- 2.17
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.