The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
A basic study design for expedited safety signal evaluation based on electronic healthcare data
Open accessAbstract
Active drug safety monitoring based on longitudinal electronic healthcare databases (a Sentinel System), as outlined in recent FDA-commissioned reports, consists of several interlocked processes, including signal generation, signal strengthening, and signal evaluation. Once a signal of a potential drug safety issue is generated, signal strengthening and signal evaluation have to follow in short sequence in order to quickly provide as much information about the triggering drug-event association as possible. This paper proposes a basic study design based on the incident user cohort design for expedited signal evaluation in longitudinal healthcare databases. It will not resolve all methodological issues nor will it fit all study questions arising within the framework of a Sentinel System. It should rather be seen as a guidance that will fit the majority of situations and serve as a starting point for adaptations to specific studies. Such an approach will expedite and structure the process of study development and highlight specific assumptions, which is particularly valuable in a Sentinel System where signals are by definition preliminary and evaluation of signals is time critical.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adjusting for time varying confounders is difficult in a matched case-control study.
“Adjusting for time varying confounders is difficult in a matched case-control study.31 46”
From Anticholinergic drugs and risk of dementia: case-control study (2018) · cites this paper as [31]
The Incident user design section says case-control studies are prone to errors in confounder adjustment. It does not specify matched case-control studies or say that adjusting for time-varying confounders is difficult in that design. The Sources of exposure variation section discusses confounding as health status changes over time, but in a case-crossover design. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
The Case-Crossover Design: A Method for Studying Transient Effects on the Risk of Acute Events
Maclure, M. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115853 · Cited by 2,327
Overadjustment bias and unnecessary adjustment in epidemiologic studies.
Schisterman, E. F., Cole, S. R., & Platt, R. W. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a819a1 · Cited by 2,096 · cited 1×
“The clear temporal sequence of confounder adjustment before treatment initiation in an incident user design avoids mistakenly adjusting for consequences of treatment (intermediates) rather than predictors for treatment, a possible reason for overadjustment.(12) Identifying two active treatment groups further reduces t…”
BackgroundSchneeweiss, S., Rassen, J. A., Glynn, R. J., Avorn, J., Mogun, H., & Brookhart, M. A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a663cc · Cited by 1,128
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721 · cited 1×
“7 Since this experiment is impossible, the next logical expansion of the exper-iment is to generate or observe exposure variation within the same patient but over time.”
BackgroundThe Challenge of Subgroup Analyses — Reporting without Distorting
Lagakos, S. W. (2006) · New England Journal of Medicine · doi:10.1056/nejmp068070 · Cited by 504
Flagged first, then by citations
Research works printed but not linked: 30
- Platt, 2009, The new Sentinel Network-improving the evidence of medical-product safety, N Engl J Med, 361, 645, 10.1056/NEJMp0905338 · DOI
- Avorn, 2009, Managing drug-risk information-what to do with all those new numbers, N Engl J Med, 361, 647, 10.1056/NEJMp0905466 · DOI
- Walker AM Orthogonal predictions: follow-up questions for suggestive data 2010 · DOI
- Schneeweiss, 2005, Adjusting for unmeasured confounders in pharmacoepidemiologic claims data using external information: the example of COX2 inhibitors and myocardial infarction, Epidemiology, 16, 17, 10.1097/01.ede.0000147164.11879.b5 · DOI
- Seeger, 2003, A propensity score-matched cohort study of the effect of statins, mainly fluvastatin, on the occurrence of acute myocardial infarction, Am J Cardiol, 92, 1447, 10.1016/j.amjcard.2003.08.057 · DOI
- Schneeweiss, 2005, A review of uses of health care utilization databases for epidemiologic research on therapeutics, J Clin Epidemiol, 58, 323, 10.1016/j.jclinepi.2004.10.012 · DOI
- Ray, 2003, Evaluating medication effects outside of clinical trials: new-user designs, Am J Epidemiol, 158, 915, 10.1093/aje/kwg231 · DOI · Paper page
- Schneeweiss, 2007, Increasing levels of restriction in pharmacoepidemiologic database studies of elderly and comparison with randomized trial results, Med care, 45, S131, 10.1097/MLR.0b013e318070c08e · DOI
- Suissa, 2008, Immortal time bias in pharmaco-epidemiology, Am J Epidemiol, 167, 492, 10.1093/aje/kwm324 · DOI
- Moride, 1994, Evidence of the depletion of susceptibles effect in non-experimental pharmacoepidemiologic research, J Clin Epidemiol, 47, 731, 10.1016/0895-4356(94)90170-8 · DOI
- Solomon, 2008, The risk of infection associated with tumor necrosis factor α antagonists: making sense of epidemiologic evidence, Arthritis Rheum, 58, 919, 10.1002/art.23396 · DOI
- Wacholder, 1991, Practical considerations in choosing between the case-cohort and nested case-control designs, Epidemiology, 2, 155, 10.1097/00001648-199103000-00013 · DOI
- McMahon, 1998, Drug exposure risk windows and unexposed comparator groups for cohort studies in pharmacoepidemiology, Pharmacoepidemiol Drug Saf, 7, 275, 10.1002/(SICI)1099-1557(199807/08)7:4<275::AID-PDS363>3.0.CO;2-N · DOI
- Kiyota, 2004, Accuracy of Medicare claims-based diagnosis of acute myocardial infarction: estimating positive predictive value on the basis of review of hospital records, Am Heart J, 148, 99, 10.1016/j.ahj.2004.02.013 · DOI
- McMahon, 2003, Approaches to combat with confounding by indication in observational studies of intended drug effects, Pharmacoepidemiol Drug Saf, 12, 551, 10.1002/pds.883 · DOI
- Schneeweiss, 2006, Sensitivity analysis and external adjustment for unmeasured confounders in epidemiologic database studies of therapeutics, Pharmacoepidemiol Drug Saf, 15, 291, 10.1002/pds.1200 · DOI
- Brookhart, 2006, Variable selection for propensity score models, Am J Epidemiol, 163, 1149, 10.1093/aje/kwj149 · DOI · Paper page
- Austin, 2008, A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003, Stat Med, 27, 2037, 10.1002/sim.3150 · DOI
- Kurth, 2006, Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect, Am J Epidemiol, 163, 262, 10.1093/aje/kwj047 · DOI
- Lunt, 2009, Different methods of balancing covariates leading to different effect estimates in the presence of effect modification, Am J Epidemiol, 169, 909, 10.1093/aje/kwn391 · DOI
- Sekula, 2010, An application of propensity score methods to estimate the treatment effect of corticosteroids in patients with severe cutaneous adverse reactions, Pharmacoepidemiol Drug Saf, 19, 10, 10.1002/pds.1863 · DOI
- Piantadosi, 1997, Clinical Trials-A Methodologic Perspective
- Hernan, 2008, Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease, Epidemiology, 19, 766, 10.1097/EDE.0b013e3181875e61 · DOI
- Brookhart, 2006, Evaluating short-term drug effects using a physician-specific prescribing preference as an instrumental variable, Epidemiology, 17, 268, 10.1097/01.ede.0000193606.58671.c5 · DOI
- Schneeweiss, 2007, Risk of death associated with the use of conventional versus atypical antipsychotic drugs among elderly patients.[see comment][erratum appears in CMAJ. 2007 May 22;176(11):1613], CMAJ, 176, 627, 10.1503/cmaj.061250 · DOI · Paper page
- Miettinen, 1976, Estimability and estimation in case-referent studies, Am J Epidemiol, 103, 226, 10.1093/oxfordjournals.aje.a112220 · DOI
- Wacholder, 1996, The case-control study as data missing by design: estimating risk differences, Epidemiology, 7, 144, 10.1097/00001648-199603000-00007 · DOI
- Rothman, 2008, Modern Epidemiology
- Roumie, 2009, Non-aspirin NSAIDs, cyclooxygenase-2 inhibitors and risk for cardiovascular events-stroke, acute myocardial infarction, and death from coronary heart disease, Pharmacoepidemiol Drug Saf, 18, 1053, 10.1002/pds.1820 · DOI
- Robins, 1994, Correcting for non-compliance in randomized trials using structural nested mean models, Commun Stat Theory Methods, 23, 2379, 10.1080/03610929408831393 · DOI
Cited by
Sorted by citations
Network-based approach to prediction and population-based validation of in silico drug repurposing
Cheng, F., Desai, R. J., Handy, D. E., Wang, R., Schneeweiss, S., Barabási, A.-L., & Loscalzo, J. (2018) · Nature Communications · doi:10.1038/s41467-018-05116-5 · Cited by 552
Anticholinergic drugs and risk of dementia: case-control study
Richardson, K., Fox, C., Maidment, I., Steel, N., Loke, Y. K., Arthur, A., Myint, P. K., Grossi, C. M., Mattishent, K., Bennett, K., et al. (2018) · BMJ · doi:10.1136/bmj.k1315 · Cited by 520
When and how can real world data analyses substitute for randomized controlled trials?
Franklin, J. M., & Schneeweiss, S. (2017) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.857 · Cited by 316
Patorno, E., Pawar, A., Franklin, J. M., Najafzadeh, M., Déruaz-Luyet, A., Brodovicz, K. G., Sambevski, S., Bessette, L. G., Santiago Ortiz, A. J., Kulldorff, M., et al. (2019) · Circulation · doi:10.1161/circulationaha.118.039177 · Cited by 215
Self-citationPatorno, E., Htoo, P. T., Glynn, R. J., Schneeweiss, S., Wexler, D. J., Pawar, A., Bessette, L. G., Chin, K., Everett, B. M., & Kim, S. C. (2021) · Annals of Internal Medicine · doi:10.7326/m21-0893 · Cited by 103
Simon, T. G., Patorno, E., & Schneeweiss, S. (2022) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2021.07.010 · Cited by 98
Vandenbroucke, J., & Pearce, N. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv225 · Cited by 67
Design considerations in an active medical product safety monitoring system.
Gagne, J. J., Fireman, B., Ryan, P. B., Maclure, M., Gerhard, T., Toh, S., Rassen, J. A., Nelson, J. C., & Schneeweiss, S. (2012) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2316 · Cited by 49
Self-citationQuinn, P. D., Fine, K. L., Rickert, M. E., Sujan, A. C., Boersma, K., Chang, Z., Franck, J., Lichtenstein, P., Larsson, H., & D’Onofrio, B. M. (2020) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2020.2539 · Cited by 38
Metadata
- Authors
- Schneeweiss, S.
- Affiliations
- Brigham and Women's Hospital (US)
- Corresponding author
- Schneeweiss, Sebastian
- Venue
- Pharmacoepidemiology and Drug Safety
- Publisher
- Wiley
- Published
- 2010-05-17
- Volume
- 19
- Issue
- 8
- Pages
- 858-868
- ISSN
- 1053-8569 (ISSN-L)
- PMC
- PMC2917262
- OpenAlex
- W2001727746
- Cited by
- 255
- References
- 6
- Citations by year
- 2026: 8 · 2025: 5 · 2024: 10 · 2023: 6 · 2022: 18 · 2021: 19 · 2020: 17 · 2019: 29 · 2018: 22 · 2017: 14 · 2016: 10 · 2015: 13 · 2014: 16 · 2013: 17 · 2012: 35
- FWCI
- 25.65
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Pharmacoepidemiology and Drug Safety (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Library of Medicine (RO1-LM010213, RC1-LM010351)
- National Center for Research Resources (RC1-RR028231)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Keywords
- drug safety signals, signal evaluation, Sentinel System, research design
- MeSH terms
- Delivery of Health Care, Female, Humans, Male, Primary Health Care, Cohort Studies, Databases, Factual, Drug Monitoring, Adverse Drug Reaction Reporting Systems, Prescription Drugs, Propensity Score, Drug-Related Side Effects and Adverse Reactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review