The DOI matches its Crossref record, with a small difference in title or year; 26 of the 26 references it cites were found in a registry or an index.
Shrinkage observed-to-expected ratios for robust and transparent large-scale pattern discovery
Open accessAbstract
Large observational data sets are a great asset to better understand the effects of medicines in clinical practice and, ultimately, improve patient care. For an empirical pattern in observational data to be of practical relevance, it should represent a substantial deviation from the null model. For the purpose of identifying such deviations, statistical significance tests are inadequate, as they do not on their own distinguish the magnitude of an effect from its data support. The observed-to-expected (OE) ratio on the other hand directly measures strength of association and is an intuitive basis to identify a range of patterns related to event rates, including pairwise associations, higher order interactions and temporal associations between events over time. It is sensitive to random fluctuations for rare events with low expected counts but statistical shrinkage can protect against spurious associations. Shrinkage OE ratios provide a simple but powerful framework for large-scale pattern discovery. In this article, we outline a range of patterns that are naturally viewed in terms of OE ratios and propose a straightforward and effective statistical shrinkage transformation that can be applied to any such ratio. The proposed approach retains emphasis on the practical relevance and transparency of highlighted patterns, while protecting against spurious associations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2. Visualisation of OE ratios over time, for the association in a collection of electronic patient records between first prescriptions of an antihypertensive medicine and diagnoses of swelling. The top panel displays the logarithm of the OE ratio (with shrinkage) over time. The bottom panel displays the underlying observed and expected numbers of events. Reproduced from Norén et al. [9] with permission from Springer.](/paper-figures/82c46f49c4f14c65b0205987ddb93d88/shrinkage-observed-to-expected-ratios-for-robust-and-transparent-large-scale-figure-2.jpg)

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimation with Quadratic Loss
James, W., & Stein, C. M. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-0919-5_30 · Cited by 2,319
Evans, S., WALLER, P. C., & Davis, S. (2001) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.677 · Cited by 1,808
A Bayesian neural network method for adverse drug reaction signal generation
Bate, A., Lindquist, M., Edwards, I. R., Olsson, S., Orre, R., Lansner, A., & Freitas, R. M. D. (1998) · European Journal of Clinical Pharmacology · doi:10.1007/s002280050466 · Cited by 1,492
Self-citationDuMouchel, W. (1999) · The American Statistician · doi:10.1080/00031305.1999.10474456 · Cited by 883
Selecting the right interestingness measure for association patterns
Tan, P., Kumar, V., & Srivastava, J. (2002) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775053 · Cited by 868
ROTHMAN, K. J., GREENLAND, S., & WALKER, A. M. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113015 · Cited by 859 · cited 1×
“The additive baseline model has clear advantages as a basis for both individual decision-making and public policy-making.(13) Moreover, empirical results suggest that it is better suited to detect some patterns indicative of adverse drug interactions, at least in individual case safety reports.”
BackgroundLarge-Scale Bayesian Logistic Regression for Text Categorization
Genkin, A., Lewis, D. D., & Madigan, D. (2007) · Technometrics · doi:10.1198/004017007000000245 · Cited by 812
VigiBase, the WHO Global ICSR Database System: Basic Facts
Lindquist, M. (2008) · Drug Information Journal · doi:10.1177/009286150804200501 · Cited by 599
Sanz, E. J., Cuevas, C. D. L., Kiuru, A., Bate, A., & Edwards, R. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17865-9 · Cited by 379
Self-citationProceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability:
F., D. D., & Neyman, J. (1957) · Journal of the American Statistical Association · doi:10.2307/2280857 · Cited by 351
Statistical significance tests.
Cox, D. (1982) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.1982.tb01987.x · Cited by 335
Empirical bayes screening for multi-item associations
DuMouchel, W., & Pregibon, D. (2001) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/502512.502526 · Cited by 268
Discovering significant patterns
Webb, G. I. (2008) · Machine Learning · doi:10.1007/s10994-008-5045-y · Cited by 209
Norén, G. N., Bate, A., Orre, R., & Edwards, I. R. (2005) · Statistics in Medicine · doi:10.1002/sim.2473 · Cited by 208
Self-citationDiscovering Significant Patterns
Webb, G. I. (2007) · Machine Learning · doi:10.1007/s10994-007-5006-x · Cited by 204
A statistical methodology for drug–drug interaction surveillance
Norén, G. N., Sundberg, R., Bate, A., & Edwards, I. R. (2008) · Statistics in Medicine · doi:10.1002/sim.3247 · Cited by 202
Self-citationTemporal pattern discovery in longitudinal electronic patient records
Norén, G. N., Hopstadius, J., Bate, A., Star, K., & Edwards, I. R. (2009) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-009-0152-3 · Cited by 170
Self-citationDuplicate detection in adverse drug reaction surveillance
Norén, G. N., Orre, R., Bate, A., & Edwards, I. R. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-006-0052-8 · Cited by 144
Self-citationSanz, E. J., DELASCUEVAS, C., KIURU, A., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)70271-3 · Cited by 81
Caster, O., Norén, G. N., Madigan, D., & Bate, A. (2010) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.10078 · Cited by 67
Self-citationImpact of Stratification on Adverse Drug Reaction Surveillance
Hopstadius, J., Norén, G. N., Bate, A., & Edwards, I. R. (2008) · Drug Safety · doi:10.2165/00002018-200831110-00008 · Cited by 59
Self-citationAhmed, I., Thiessard, F., Miremont‐Salamé, G., Bégaud, B., & Tubert‐Bitter, P. (2010) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2010.111 · Cited by 46
Pattern Discovery and Detection: A Unified Statistical Methodology
Hand, D. J., & Bolton, R. J. (2004) · Journal of Applied Statistics · doi:10.1080/0266476042000270518 · Cited by 24
Gould, A. L. (2006) · Biometrical Journal · doi:10.1002/bimj.200610296 · Cited by 21
Data Mining in Pharmacovigilance
Hauben, M., Madigan, D., Hochberg, A. M., Reisinger, S. J., & O’Hara, D. J. (2007) · International Journal of Pharmaceutical Medicine · doi:10.2165/00124363-200721050-00001 · Cited by 5
Abacavir and increased risk of myocardial infarction
Edwards, R., Bate, A., & Lindquist, M. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61333-1 · Cited by 3
Self-citation
Cited by
Sorted by citations
Salem, J.-E., Manouchehri, A., Moey, M., Lebrun-Vignes, B., Bastarache, L., Pariente, A., Gobert, A., Spano, J.-P., Balko, J. M., Bonaca, M. P., et al. (2018) · The Lancet Oncology · doi:10.1016/s1470-2045(18)30608-9 · Cited by 1,271
Cohen, M. E., Ko, C. Y., Bilimoria, K. Y., Zhou, L., Huffman, K., Wang, X., Liu, Y., Kraemer, K., Meng, X., Merkow, R., et al. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.02.027 · Cited by 583
Neurologic toxicity associated with immune checkpoint inhibitors: a pharmacovigilance study
Johnson, D. B., Manouchehri, A., Haugh, A. M., Quach, H. T., Balko, J. M., Lebrun‐Vignes, B., Mammen, A. L., Moslehi, J. J., & Salem, J. (2019) · Journal for ImmunoTherapy of Cancer · doi:10.1186/s40425-019-0617-x · Cited by 382
Cardiovascular Toxicities Associated With Ibrutinib
Salem, J., Manouchehri, A., Bretagne, M., Lebrun‐Vignes, B., Groarke, J. D., Johnson, D. B., Yang, T., Reddy, N. M., Funck‐Brentano, C., Brown, J. R., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.07.056 · Cited by 276
Ibrutinib-Mediated Atrial Fibrillation Attributable to Inhibition of C-Terminal Src Kinase
Xiao, L., Salem, J., Clauß, S., Hanley, A., Bapat, A. C., Hulsmans, M., Iwamoto, Y., Wojtkiewicz, G. R., Çetinbaş, M., Schloss, M. J., et al. (2020) · Circulation · doi:10.1161/circulationaha.120.049210 · Cited by 254
Metadata
- Authors
- Norén, G. N., Hopstadius, J., & Bate, A.
- Affiliations
- Uppsala Monitoring Centre (SE)
- Corresponding author
- Norén, G Niklas
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2011-06-24
- Volume
- 22
- Issue
- 1
- Pages
- 57-69
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- PMC
- PMC6331976
- OpenAlex
- W2005366883
- Cited by
- 336
- References
- 26
- Citations by year
- 2026: 45 · 2025: 45 · 2024: 48 · 2023: 46 · 2022: 53 · 2021: 21 · 2020: 17 · 2019: 9 · 2018: 11 · 2017: 5 · 2016: 5 · 2015: 8 · 2014: 10 · 2013: 7 · 2012: 6
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Statistical Methods in Medical Research (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- observed-to-expected ratio, pattern discovery, observational data, spurious association, rare events, higher-order interactions, temporal association, associative strength, clinical practice
- MeSH terms
- Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review