The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports
Abstract
Background: The process of generating ‘signals’ of possible unrecognized hazards from spontaneous adverse drug reaction reporting data has been likened to looking for a needle in a haystack. However, statistical approaches to the data have been underutilised. Methods: Using the UK Yellow Card database, we have developed and evaluated a statistical aid to signal generation called a Proportional Reporting Ratio (PRR). The proportion of all reactions to a drug which are for a particular medical condition of interest is compared to the same proportion for all drugs in the database, in a 2 × 2 table. We investigated a group of newly‐marketed drugs using as minimum criteria for a signal, 3 or more cases, PRR at least 2, chi‐squared of at least 4. Findings: The database was used to examine retrospectively 15 drugs newly‐marketed in the UK, with the highest levels of ADR reporting. The method identified 481 signals meeting the minimum criteria during the period 1996–8. Further evaluation of these showed that 70% were known adverse reactions, 13% were events which were likely to be related to the underlying disease and 17% were signals requiring further evaluation. Implications: Proportional reporting ratios are a valuable aid to signal generation from spontaneous reporting data which are easy to calculate and interpret, and various refinements are possible. © Crown copyright 2001. Reproduced with the permission of Her Majesty's Stationary Office. Published by John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
False‐positives in spontaneous reporting: should we worry about them?
Bégaud, B., Moride, Y., Tubert‐Bitter, P., Chaslerie, A., & Haramburu, F. (1994) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.1994.tb04373.x · Cited by 89
Regulatory Pharmacovigilance in theUnitedKingdom: Current Principles and Practice
WALLER, P. C., Coulson, R., & Wood, S. M. (1996) · Pharmacoepidemiology and Drug Safety · doi:10.1002/(sici)1099-1557(199611)5:6<363::aid-pds249>3.0.co;2-7 · Cited by 45
Self-citationAdverse drug reactions: finding the needle in the haystack
Edwards, I. R. (1997) · BMJ · doi:10.1136/bmj.315.7107.500 · Cited by 36
Differences between males and females in risk of NSAID-related severe gastrointestinal events
Neutel, C. I., Maxwell, C. J., & Appel, W. C. (1999) · Pharmacoepidemiology and Drug Safety · doi:10.1002/(sici)1099-1557(199912)8:7<535::aid-pds456>3.0.co;2-d · Cited by 12
Research works printed but not linked: 4
- Wood SM, 1993, Adverse Drug Reactions On‐line Information Tracking (ADROIT), Pharmaceutical Medicine, 7, 203
- Speirs CJ, 1986, Iatrogenic Diseases, 93
- Grant EM, 1998, Electronic Communication Technologies‐Techniques and Technologies for the 21st Century, 551
- Finney DJ, 1974, Systematic signalling of adverse reactions to drugs, Meth Inf Med, 13, 1, 10.1055/s-0038-1636131 · doi:10.1055/s-0038-1636131
Cited by
The reporting odds ratio and its advantages over the proportional reporting ratio
Rothman, K. J., Lanes, S., & Sacks, S. T. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1001 · Cited by 1,111
Data Mining of the Public Version of the FDA Adverse Event Reporting System
Sakaeda, T., Tamon, A., Kadoyama, K., & Okuno, Y. (2013) · International Journal of Medical Sciences · doi:10.7150/ijms.6048 · Cited by 1,048
Quantitative signal detection using spontaneous ADR reporting
Bate, A., & Evans, S. J. W. (2009) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1742 · Cited by 912
Self-citationSafety monitoring in the Vaccine Adverse Event Reporting System (VAERS)
Shimabukuro, T. T., Nguyen, M., Martin, D., & DeStefano, F. (2015) · Vaccine · doi:10.1016/j.vaccine.2015.07.035 · Cited by 608
Postlicensure Safety Surveillance for Quadrivalent Human Papillomavirus Recombinant Vaccine
Slade, B. A. (2009) · JAMA · doi:10.1001/jama.2009.1201 · Cited by 470
Understanding vaccine safety information from the Vaccine Adverse Event Reporting System
VARRICCHIO, F., ISKANDER, J., DESTEFANO, F., BALL, R., PLESS, R., BRAUN, M. M., & CHEN, R. T. (2004) · The Pediatric Infectious Disease Journal · doi:10.1097/00006454-200404000-00002 · Cited by 380
Fusaroli, M., Salvo, F., Begaud, B., AlShammari, T. M., Bate, A., Battini, V., Brueckner, A., Candore, G., Carnovale, C., Crisafulli, S., et al. (2024) · Drug Safety · doi:10.1007/s40264-024-01423-7 · Cited by 351
Real-world Data for Clinical Evidence Generation in Oncology
Khozin, S., Blumenthal, G. M., & Pazdur, R. (2017) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djx187 · Cited by 346
Shrinkage observed-to-expected ratios for robust and transparent large-scale pattern discovery
Norén, G. N., Hopstadius, J., & Bate, A. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280211403604 · Cited by 336
Harpaz, R., DuMouchel, W., LePendu, P., Bauer-Mehren, A., Ryan, P., & Shah, N. H. (2013) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2013.24 · Cited by 333
The General Practice Research Database: Role in Pharmacovigilance
Wood, L., & Martinez, C. (2004) · Drug Safety · doi:10.2165/00002018-200427120-00004 · Cited by 331
Avery, A., Anderson, C., Bond, C., Fortnum, H., Gifford, A., Hannaford, P., Hazell, L., Krska, J., Lee, A., McLernon, D., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15200 · Cited by 331
Moore, T. J., Glenmullen, J., & Mattison, D. R. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.5262 · Cited by 324
Liu, M., Wu, Y., Chen, Y., Sun, J., Zhao, Z., Chen, X.-W., Matheny, M. E., & Xu, H. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000699 · Cited by 289
Wang, X., Hripcsak, G., Markatou, M., & Friedman, C. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3028 · Cited by 288
Noguchi, Y., Tachi, T., & Teramachi, H. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab347 · Cited by 285
The role of data mining in pharmacovigilance
Hauben, M., Madigan, D., Gerrits, C. M., Walsh, L., & Van Puijenbroek, E. P. (2005) · Expert Opinion on Drug Safety · doi:10.1517/14740338.4.5.929 · Cited by 276
Pariente, A., Gregoire, F., Fourrier-Reglat, A., Haramburu, F., & Moore, N. (2007) · Drug Safety · doi:10.2165/00002018-200730100-00007 · Cited by 268
Novel Statistical Tools for Monitoring the Safety of Marketed Drugs
Almenoff, J. S., Pattishall, E. N., Gibbs, T. G., DuMouchel, W., Evans, S. J. W., & Yuen, N. (2007) · Clinical Pharmacology & Therapeutics · doi:10.1038/sj.clpt.6100258 · Cited by 266
Self-citationLogan, R. F., & van Staa, T. P. (2003) · Gut · doi:10.1136/gut.52.10.1530 · Cited by 262
A curated and standardized adverse drug event resource to accelerate drug safety research
Banda, J. M., Evans, L., Vanguri, R. S., Tatonetti, N. P., Ryan, P. B., & Shah, N. H. (2016) · Scientific Data · doi:10.1038/sdata.2016.26 · Cited by 246
Böhm, R., von Hehn, L., Herdegen, T., Klein, H.-J., Bruhn, O., Petri, H., & Höcker, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157753 · Cited by 256
Liu, L., Chen, J., Wang, L., Chen, C., & Chen, L. (2022) · Frontiers in Endocrinology · doi:10.3389/fendo.2022.1043789 · Cited by 258
Conducting and interpreting disproportionality analyses derived from spontaneous reporting systems
Cutroneo, P. M., Sartori, D., Tuccori, M., Crisafulli, S., Battini, V., Carnovale, C., Rafaniello, C., Capuano, A., Poluzzi, E., Moretti, U., et al. (2024) · Frontiers in Drug Safety and Regulation · doi:10.3389/fdsfr.2023.1323057 · Cited by 224
Vellozzi, C., Burwen, D. R., Dobardzic, A., Ball, R., Walton, K., & Haber, P. (2009) · Vaccine · doi:10.1016/j.vaccine.2009.01.125 · Cited by 188
Decision support methods for the detection of adverse events in post-marketing data
Hauben, M., & Bate, A. (2009) · Drug Discovery Today · doi:10.1016/j.drudis.2008.12.012 · Cited by 163
Gastaldon, C., Raschi, E., Kane, J. M., Barbui, C., & Schoretsanitis, G. (2021) · Psychotherapy and Psychosomatics · doi:10.1159/000510703 · Cited by 134
Raschi, E., Poluzzi, E., Salvo, F., Pariente, A., De Ponti, F., Marchesini, G., & Moretti, U. (2018) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2018.02.014 · Cited by 119
Yang, Z., Lv, Y., Yu, M., Mei, M., Xiang, L., Zhao, S., & Li, R. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2022.925377 · Cited by 120
Chiappini, S., Vickers-Smith, R., Harris, D., Papanti Pelletier, G. D., Corkery, J. M., Guirguis, A., Martinotti, G., Sensi, S. L., & Schifano, F. (2023) · Pharmaceuticals · doi:10.3390/ph16070994 · Cited by 78
Lakhani, M., Kwan, A. T. H., Mihalache, A., Popovic, M. M., Nanji, K., Xie, J. S., Feo, A., Rabinovitch, D., Shor, R., Sadda, S., et al. (2025) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2025.05.007 · Cited by 70
Mele, A., Calzolaro, S., Cannone, G., Cetrone, M., Conte, D., & Tricarico, D. (2014) · Pharmacology Research & Perspectives · doi:10.1002/prp2.28 · Cited by 58
Caruso, I., Di Gioia, L., Di Molfetta, S., Caporusso, M., Cignarelli, A., Sorice, G. P., Laviola, L., & Giorgino, F. (2024) · Journal of Endocrinological Investigation · doi:10.1007/s40618-024-02441-z · Cited by 49
Mali, G., Ahuja, V., & Dubey, K. (2021) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/jcpt.13259 · Cited by 44
Yang, Z., Yu, M., Mei, M., Chen, C., Lv, Y., Xiang, L., & Li, R. (2022) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2021.10.003 · Cited by 37
Pharmacovigilance study of GLP-1 receptor agonists for metabolic and nutritional adverse events
He, L., Li, Q., Yang, Y., Li, J., Luo, W., Huang, Y., & Zhong, X. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1416985 · Cited by 40
Azab, M., & Pasina, L. (2025) · Obesity Research & Clinical Practice · doi:10.1016/j.orcp.2025.01.011 · Cited by 33
Singh, H., Natt, N. K., & Nim, D. K. (2025) · Expert Review of Endocrinology & Metabolism · doi:10.1080/17446651.2025.2459720 · Cited by 10
Safety assessment of disulfiram: real-world adverse event analysis based on FAERS database
Luo, J., Zeng, Y., Chen, Z., Luo, Y., Shi, L., & Zhou, X. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1498204 · Cited by 9
Zou, D., Hu, Q., Liu, Y., & Yu, L. (2024) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-024-01784-0 · Cited by 5
Metadata
- Authors
- Evans, S. J. W., Waller, P. C., & Davis, S.
- Venue
- Pharmacoepidemiology and Drug Safety
- Publisher
- Wiley
- Published
- 2001-10
- Volume
- 10
- Issue
- 6
- Pages
- 483-486
- ISSN
- 1053-8569 (ISSN-L)
- 1099-1557
- OpenAlex
- W1988100739
- Cited by
- 1,802
- References
- 4
- FWCI
- 19.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.