Significance of data mining in routine signal detection: analysis based on the safety signals identified by the FDA
Abstract
Purpose: Data mining has been introduced as one of the most useful methods for signal detection by spontaneous reports, but data mining is not always effective in detecting all safety issues. To investigate appropriate situations in which data mining is effective in routine signal detection activities, we analyzed the characteristics of signals that the US Food and Drug Administration (FDA) identified from the FDA Adverse Event Reporting System (FAERS). Methods: Among the signals that the FDA identified from the FAERS between 2008 1Q and 2014 4Q, we selected 233 signals to evaluate in this study. We conducted a disproportionality analysis and classified these signals into two groups according to the presence or absence of statistical significance in the reporting odds ratio (ROR). Then, we compared the two groups based on the characteristics of the suspected drugs and adverse events (AEs). Results: Safety signals were most frequently identified for new drugs that had been on the market for less than 5 years, but some signals were still identified for old drugs (≥20 years), and most of them were statistically significant. The proportion of the signals for “serious” events was significantly higher in the group of nonsignals by ROR (Fisher's exact test, P = 0.032). Conclusions: Data mining was shown to be effective in the following situations: (1) early detection of safety issues for newly marketed drugs, (2) continuous monitoring of safety issues for old drugs, and (3) signal detection of nonserious AEs, to which little attention is usually given.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
FAERS is one of the largest publicly available repositories of unsolicited reports, gathering more than 15 million reports worldwide since 2004.
“FAERS is one of the largest publicly available repositories of unsolicited reports, gathering more than 15 million reports worldwide since 2004; it was already used to early identify and characterize AEs for recently marketed drugs as well as for continuous monitoring of safety issues for old drugs (5).”
From The Changing Face of Drug-induced Adrenal Insufficiency in the Food and Drug Administration Adverse Event Reporting System (2022) · cites this paper as [5]
Cites
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,302 · see citing works
The reporting odds ratio and its advantages over the proportional reporting ratio
Rothman, K. J., Lanes, S., & Sacks, S. T. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1001 · Cited by 1,112 · see citing works
Coloma, P. M., Schuemie, M. J., Trifirò, G., Gini, R., Herings, R. M. C., Hippisley‐Cox, J., Mazzaglia, G., Giaquinto, C., Corrao, G., Pedersen, L. H., et al. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2053 · Cited by 259 · see citing works
Principles of Signal Detection in Pharmacovigilance
Meyboom, R. H. B., Egberts, T. C. G., Edwards, I. R., Hekster, Y. A., Koning, F. H. P. D., & Gribnau, F. W. J. (1997) · Drug Safety · doi:10.2165/00002018-199716060-00002 · Cited by 241 · see citing works
Poluzzi, E., Raschi, E., Piccinni, C. P., & De, F. (2012) · InTech eBooks · doi:10.5772/50095 · Cited by 227 · see citing works
Belton, K. J., Lewis, S. C., Payne, S., Rawlins, M., & Wood, S. (1995) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.1995.tb04440.x · Cited by 187 · see citing works
Comparison of Statistical Signal Detection Methods Within and Across Spontaneous Reporting Databases
Candore, G., Juhlin, K., Manlik, K., Thakrar, B. T., Quarcoo, N., Seabroke, S., Wisniewski, A. F. Z., & Slattery, J. (2015) · Drug Safety · doi:10.1007/s40264-015-0289-5 · Cited by 149 · see citing works
Evaluation of FDA safety‐related drug label changes in 2010
Lester, J., Neyarapally, G. A., Lipowski, E. E., Graham, C. F., Hall, M., & Pan, G. J. D. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3395 · Cited by 113 · see citing works
Comparative Performance of Two Quantitative Safety Signalling Methods
Almenoff, J. S., LaCroix, K., Yuen, N., Fram, D. M., & DuMouchel, W. (2006) · Drug Safety · doi:10.2165/00002018-200629100-00005 · Cited by 110 · see citing works
Signal Selection and Follow-Up in Pharmacovigilance
Meyboom, R. H. B., Lindquist, M., Egberts, T. C. G., & Edwards, I. R. (2002) · Drug Safety · doi:10.2165/00002018-200225060-00011 · Cited by 105 · see citing works
Monitoring product safety in the postmarketing environment
Sharrar, R. G., & Dieck, G. S. (2013) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098613490780 · Cited by 78 · see citing works
Determinants of signal selection in a spontaneous reporting system for adverse drug reactions
van Puijenbroek, E., van Grootheest, K., Diemont, W. L., Leufkens, H. G. M., & Egberts, T. C. G. (2001) · British Journal of Clinical Pharmacology · doi:10.1046/j.0306-5251.2001.01501.x · Cited by 68 · see citing works
Pacurariu, A. C., Coloma, P. M., van Haren, A., Genov, G., Sturkenboom, M., & Straus, S. M. J. M. (2014) · Drug Safety · doi:10.1007/s40264-014-0240-1 · Cited by 58 · see citing works
The FDA and New Safety Warnings
Moore, T. J., Singh, S., & Furberg, C. D. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.618 · Cited by 43 · see citing works
Impact Analysis of Signals Detected from Spontaneous Adverse Drug Reaction Reporting Data
WALLER, P. C., Heeley, E. L., & Moseley, J. (2005) · Drug Safety · doi:10.2165/00002018-200528100-00002 · Cited by 43 · see citing works
Moro, P. L., Baumblatt, J. A. G., Lewis, P., Cragan, J. D., Tepper, N. K., & Cano, M. V. (2016) · Drug Safety · doi:10.1007/s40264-016-0482-1 · Cited by 42 · see citing works
Montastruc, F., Salvo, F., Arnaud, M., Bégaud, B., & Pariente, A. (2016) · Drug Safety · doi:10.1007/s40264-016-0413-1 · Cited by 41 · see citing works
Use of Triage Strategies in the WHO Signal-Detection Process
Lindquist, M. (2007) · Drug Safety · doi:10.2165/00002018-200730070-00014 · Cited by 40 · see citing works
Plessis, L., Gómez-Lumbreras, A., García, N., Cereza, G., & Figueras, A. (2017) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-017-2223-5 · Cited by 33 · see citing works
Osokogu, O. U., Fregonese, F., Ferrajolo, C., Verhamme, K., de Bie, S., Jong, G. ’., Catapano, M., Weibel, D., Kaguelidou, F., Bramer, W. M., et al. (2015) · Drug Safety · doi:10.1007/s40264-015-0265-0 · Cited by 31 · see citing works
Osokogu, O. U., Dodd, C. N., Pacurariu, A. C., Kaguelidou, F., Weibel, D. M., & Sturkenboom, M. (2016) · Drug Safety · doi:10.1007/s40264-016-0433-x · Cited by 18 · see citing works
Donegan, K. L., Owen, R., Bird, H., Burch, B., Smith, A., & Tregunno, P. (2018) · Drug Safety · doi:10.1007/s40264-018-0675-x · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Fusaroli, M., Salvo, F., Bégaud, B., Alshammari, T. M., Bate, A., Battini, V., Brueckner, A., Candore, G., Carnovale, C., Crisafulli, S., et al. (2024) · Drug Safety · doi:10.1007/s40264-024-01423-7 · Cited by 366 · see citing works
Conducting and interpreting disproportionality analyses derived from spontaneous reporting systems
Cutroneo, P. M., Sartori, D., Tuccori, M., Crisafulli, S., Battini, V., Carnovale, C., Rafaniello, C., Capuano, A., Poluzzi, E., Moretti, U., et al. (2024) · Frontiers in Drug Safety and Regulation · doi:10.3389/fdsfr.2023.1323057 · Cited by 224 · see citing works
Raschi, E., Mazzarella, A., Antonazzo, I. C., Bendinelli, N., Forcesi, E., Tuccori, M., Moretti, U., Poluzzi, E., & De Ponti, F. (2019) · Targeted Oncology · doi:10.1007/s11523-019-00632-w · Cited by 101 · see citing works
Gastaldon, C., Schoretsanitis, G., Arzenton, E., Raschi, E., Papola, D., Ostuzzi, G., Moretti, U., Seifritz, E., Kane, J. M., Trifirò, G., et al. (2022) · Drug Safety · doi:10.1007/s40264-022-01246-4 · Cited by 66 · see citing works
Analyzing adverse drug reaction using statistical and machine learning methods
Kim, H. R., Sung, M., Park, J. A., Jeong, K., Kim, H. H., Lee, S., & Park, Y. R. (2022) · Medicine · doi:10.1097/md.0000000000029387 · Cited by 43 · see citing works
Sartori, D., Aronson, J. K., Norén, G. N., & Onakpoya, I. (2022) · Drug Safety · doi:10.1007/s40264-022-01258-0 · Cited by 41 · see citing works
Hypothesis-free signal detection in healthcare databases: finding its value for pharmacovigilance
Bate, A., Hornbuckle, K., Juhaeri, J., Motsko, S. P., & Reynolds, R. F. (2019) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098619864744 · Cited by 39 · see citing works
Wu, B., Hu, Q., Tian, F., Wu, F., Li, Y., & Xu, T. (2021) · Scientific Reports · doi:10.1038/s41598-021-90108-7 · Cited by 35 · see citing works
Cabrera‐Perez, J. S., Carey, V. J., Odejide, O. O., Singh, S., Kupper, T. S., Pillai, S. S., Weiss, S. T., & Akenroye, A. T. (2024) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2024.10.028 · Cited by 36 · see citing works
Guillain–Barré syndrome in patients treated with immune checkpoint inhibitors
Fan, Q., Hu, Y., Wang, X., & Zhao, B. (2021) · Journal of Neurology · doi:10.1007/s00415-021-10404-0 · Cited by 35 · see citing works
Antonazzo, I. C., Poluzzi, E., Forcesi, E., Salvo, F., Pariente, A., Marchesini, G., Ponti, F. D., & Raschi, E. (2019) · Acta Diabetologica · doi:10.1007/s00592-019-01378-7 · Cited by 27 · see citing works
Asano, H., Tian, Y., Hatabu, A., Takagi, T., Ueda, M., & Ikeda, K. (2023) · Scientific Reports · doi:10.1038/s41598-023-44142-2 · Cited by 26 · see citing works
Mytheen, S., Varghese, A., Joy, J., Shaji, A., & Tom, A. A. (2023) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2023.2223955 · Cited by 23 · see citing works
Wei, W., Chen, L., Zhou, H., Liu, J., Zhang, Y., Feng, S., Bai, Y., Leng, Y.-E., Chang, E., & Huang, L. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1208456 · Cited by 27 · see citing works
Zhai, Y., Ye, X., Hu, F., Xu, J., Guo, X., Lin, Z., Zhou, X., Guo, Z., Cao, Y., & He, J. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.767987 · Cited by 21 · see citing works
Nawa, H., Niimura, T., Hamano, H., Yagi, K., Goda, M., Zamami, Y., & Ishizawa, K. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.655605 · Cited by 19 · see citing works
Raschi, E., Fusaroli, M., Massari, F., Mollica, V., Repaci, A., Ardizzoni, A., Poluzzi, E., Pagotto, U., & Di Dalmazi, G. (2022) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgac359 · Cited by 17 · see citing works
Yu, Z., Zhu, H., Chen, H., Zhu, L., & Liao, X. (2023) · Journal of Pharmacy & Pharmaceutical Sciences · doi:10.3389/jpps.2023.11235 · Cited by 15 · see citing works
Zhang, M., Xie, W., Li, J., Zheng, J., & Zhou, Y. (2023) · Archives of Women s Mental Health · doi:10.1007/s00737-023-01378-1 · Cited by 15 · see citing works
Liu, T., Gao, R., Li, L., Wu, B., & Wu, F. (2023) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-023-01634-5 · Cited by 12 · see citing works
Le, H., Chen, R., Harris, S., Fang, H., Lyn‐Cook, B. D., Hong, H., Ge, W., Rogers, P., Tong, W., & Zou, W. (2024) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1328613 · Cited by 12 · see citing works
Zhang, S., Yan, M., Zhao, H., Qiu, X., & Zhu, D. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1445324 · Cited by 10 · see citing works
Fan, Q., Ma, J., Zhang, B., Li, Q., Liu, F., & Zhao, B. (2020) · Cancer Chemotherapy and Pharmacology · doi:10.1007/s00280-020-04151-8 · Cited by 9 · see citing works
Liu, C., Wang, X., & Cao, X. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1502047 · Cited by 9 · see citing works
Pharmacovigilance analysis of cardiac risks associated with Bruton tyrosine kinase inhibitors
Zhai, Y., Hu, F., Shi, W., Ye, X., Xu, J., Guo, X., Cao, Y., He, J., & Xu, F. (2023) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2023.2204226 · Cited by 9 · see citing works
Le, H., Hong, H., Ge, W., Francis, H., Lyn‐Cook, B. D., Hwang, Y., Rogers, P., Tong, W., & Zou, W. (2023) · Experimental Biology and Medicine · doi:10.1177/15353702231211860 · Cited by 9 · see citing works
Guan, Y., Qi, Y.-M., Zheng, L., Yang, J., Zhang, M., Zhang, Q., & Ji, L. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-068127 · Cited by 7 · see citing works
Zhou, R., Lu, P., He, M., Chen, J., Shi, Y., Han, F., & Cai, Y. (2023) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2023.2250717 · Cited by 7 · see citing works
Wei, W., Huang, L., Bai, Y., Chang, E., & Liu, J. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1391003 · Cited by 6 · see citing works
Fan, Q., Chen, H., Hu, Y., & Zhao, B. (2023) · Cutaneous and Ocular Toxicology · doi:10.1080/15569527.2023.2208661 · Cited by 6 · see citing works
Tang, R., Lopes, V., & Caffrey, A. R. (2022) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2022.2045945 · Cited by 5 · see citing works
Xu, Y.-X., Shen, Q., Lu, X.-F., Shen, X.-L., Zhang, L., Qiao, X.-W., & Zhang, X. (2026) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1714638 · Cited by 3 · see citing works
Crisafulli, S., Ciccimarra, F., Scapini, F., L’Abbate, L., Jannini, E. A., Martino, M. C. D., Giannetta, E., Mestres, J., Tuccori, M., & Trifirò, G. (2025) · Drug Safety · doi:10.1007/s40264-025-01626-6 · Cited by 3 · see citing works
Fukazawa, C., Hinomura, Y., Kaneko, M., & Narukawa, M. (2021) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-021-00265-0 · Cited by 3 · see citing works
Self-citationTEDAR: Temporal dynamic signal detection of adverse reactions
Aparo, A., Sala, P., Bonnici, V., & Giugno, R. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102212 · Cited by 3 · see citing works
Choi, M. J., Oh, S., Song, Y., & Ki, S. H. (2024) · Toxicological Research · doi:10.1007/s43188-024-00256-x · Cited by 3 · see citing works
Wang, Z., Wang, Y., Wu, T., Zhu, H., Zhang, L., & Liao, X. (2025) · Endocrine Connections · doi:10.1530/ec-25-0305 · Cited by 2 · see citing works
Design Principles for Interactive Dashboards in Drug Safety Surveillance: Design Science Research
Kotowicz, M., Ferati, M., Chowdhury, S., & Pires, C. M. (2026) · JMIR Medical Informatics · doi:10.2196/75936 · Cited by 2 · see citing works
Zhao, W., Le, H., Chen, J. J., Duggirala, H. J., Forshee, R. A., Botsis, T., Francis, H., Hong, H., Tong, W., Hwang, Y., et al. (2021) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm52615.2021.9669460 · Cited by 2 · see citing works
Jin, Y., Fan, M., Zheng, X., & Zhu, S. (2024) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2024.2392006 · Cited by 2 · see citing works
Zhai, Y., Yuan, L., Fang, S., Liu, S.-G., Ye, X., Shi, W., Cao, Y., He, J., Hu, F., & Feng, X. (2024) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2024.2416542 · Cited by 2 · see citing works
Zhai, Y., Hu, F., Zhu, B., Xu, J., Guo, X., Shi, W., Zhou, X., Zheng, Y., Xu, X., Ye, X., et al. (2023) · Immunotherapy · doi:10.2217/imt-2022-0145 · Cited by 2 · see citing works
Adusumilli, P. K., Begum, F., Sangnure, A. A., & George, J. (2024) · Perspectives in Clinical Research · doi:10.4103/picr.picr_10_24 · Cited by 1 · see citing works
Guan, Y., Yang, J., Qi, Y.-M., Song, C., & Zheng, L. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1529923 · Cited by 1 · see citing works
Liang, J., Hu, F., Li, J., Zhai, Y., Guo, X., Xu, J., Ye, X., & He, J. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1786129 · Cited by 1 · see citing works
Hyeon, S., Im, J. H., & Song, Y. (2022) · Korean Journal of Clinical Pharmacy · doi:10.24304/kjcp.2022.32.4.352 · Cited by 1 · see citing works
Qian, J., Truong, B., & Tanni, K. A. (2021) · BioDrugs · doi:10.1007/s40259-021-00474-x · Cited by 1 · see citing works
The Applications And Impact Of DBMS In Various Aspects Of Modern World
(2022) · The American Journal of Physical Sciences and Applications · doi:10.15864/ajps.2205
Signal detection of COVID ‐19 vaccines adverse events using spontaneous reports from South Korea
Jeong, H. S., & Chun, B. C. (2023) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5629
Assessment of pharmacovigilance system of new drugs in Thailand
Polkot, N., Anantachoti, P., & Nerapusee, O. (2021) · doi:10.58837/chula.the.2021.358
Adverse events associated with tirzepatide: a focus on subgroup-specific differences
Yu, Z., Qi, Y., Gan, Q., Wu, G., Zhang, X., Jiang, C., & Li, J. (2026) · BMC Pharmacology and Toxicology · doi:10.1186/s40360-026-01105-3 · Cited by 1 · see citing works
Asano, H., Tian, Y., Hatabu, A., Fukuzawa, K., Takaya, D., & Ikeda, K. (2026) · Research Square · doi:10.21203/rs.3.rs-8923363/v1
Yin, M., Tan, H., Xie, S., Kuang, Y., Wu, Q., Ma, J., & Guo, C. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1799557
Lu, M., Yuan, L., Liu, J., Dou, Y., & Cui, J. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1876415
Kwan, A. T. H., Lakhani, M., & McIntyre, R. S. (2026) · Clinical Nutrition · doi:10.1016/j.clnu.2026.106809
- Authors
- Fukazawa, C., Hinomura, Y., Kaneko, M., & Narukawa, M.
- Affiliations
- Japan Pharmaceutical Information Center (JP)
- Kitasato University (JP)
- Corresponding author
- Fukazawa, Chisato
- Venue
- Pharmacoepidemiology and Drug Safety
- Publisher
- Wiley
- Published
- 2018-10-15
- Volume
- 27
- Issue
- 12
- Pages
- 1402-1408
- ISSN
- 1053-8569 (ISSN-L)
- 1099-1557
- OpenAlex
- W2896939971
- Cited by
- 57
- References
- 22
- Citations by year
- 2026: 8 · 2025: 4 · 2024: 11 · 2023: 13 · 2022: 8 · 2021: 9 · 2020: 1 · 2019: 3
- FWCI
- 2.72
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Pharmacoepidemiology and Drug Safety (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Foundation for Anesthesia Education and Research
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Keywords
- data mining, safety signal detection, FDA Adverse Event Reporting System, spontaneous adverse event reporting, disproportionality analysis, reporting odds ratio, pharmacovigilance, newly marketed drugs, serious adverse events
- MeSH terms
- Data Interpretation, Statistical, Humans, United States, United States Food and Drug Administration, Odds Ratio, Databases, Factual, Adverse Drug Reaction Reporting Systems, Pharmacoepidemiology, Data Mining, Drug-Related Side Effects and Adverse Reactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review