The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Digital Drug Safety Surveillance: Monitoring Pharmaceutical Products in Twitter
Open accessAbstract
BACKGROUND: Traditional adverse event (AE) reporting systems have been slow in adapting to online AE reporting from patients, relying instead on gatekeepers, such as clinicians and drug safety groups, to verify each potential event. In the meantime, increasing numbers of patients have turned to social media to share their experiences with drugs, medical devices, and vaccines. OBJECTIVE: The aim of the study was to evaluate the level of concordance between Twitter posts mentioning AE-like reactions and spontaneous reports received by a regulatory agency. METHODS: We collected public English-language Twitter posts mentioning 23 medical products from 1 November 2012 through 31 May 2013. Data were filtered using a semi-automated process to identify posts with resemblance to AEs (Proto-AEs). A dictionary was developed to translate Internet vernacular to a standardized regulatory ontology for analysis (MedDRA(®)). Aggregated frequency of identified product-event pairs was then compared with data from the public FDA Adverse Event Reporting System (FAERS) by System Organ Class (SOC). RESULTS: Of the 6.9 million Twitter posts collected, 4,401 Proto-AEs were identified out of 60,000 examined. Automated, dictionary-based symptom classification had 86 % recall and 72 % precision [corrected]. Similar overall distribution profiles were observed, with Spearman rank correlation rho of 0.75 (p < 0.0001) between Proto-AEs reported in Twitter and FAERS by SOC. CONCLUSION: Patients reporting AEs on Twitter showed a range of sophistication when describing their experience. Despite the public availability of these data, their appropriate role in pharmacovigilance has not been established. Additional work is needed to improve data acquisition and automation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Freifeld, C. C., Mandl, K. D., Reis, B. Y., & Brownstein, J. S. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2544 · Cited by 499
Self-citationSerious Adverse Drug Events Reported to the Food and Drug Administration, 1998-2005
Moore, T. J. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.16.1752 · Cited by 462
Web-scale pharmacovigilance: listening to signals from the crowd
White, R. W., Tatonetti, N. P., Shah, N. H., Altman, R. B., & Horvitz, E. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001482 · Cited by 199
Complication Rates After Hip or Knee Arthroplasty in Morbidly Obese Patients
Friedman, R. J., Hess, S., Berkowitz, S. D., & Homering, M. (2013) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-013-3049-9 · Cited by 194
Kass‐Hout, T., & Alhinnawi, H. (2013) · British Medical Bulletin · doi:10.1093/bmb/ldt028 · Cited by 148
Self-citationUsing Facebook to Increase Spontaneous Reporting of Adverse Drug Reactions
Knezevic, M. Z., Bivolarevic, I. C., Peric, T. S., & Јаnkovic, S. (2011) · Drug Safety · doi:10.2165/11590110-000000000-00000 · Cited by 43
Duke, J. D., & Friedlin, J. (2010) · PubMed · Cited by 36
Duggirala, H. J., Herz, N. D., Caños, D., Sullivan, R. A., Schaaf, R., Pinnow, E. E., & Marinac‐Dabic, D. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2261 · Cited by 20
Haber, P., Iskander, J., Walton, K., Campbell, S. R., & Kohl, K. S. (2011) · PEDIATRICS · doi:10.1542/peds.2010-1722g · Cited by 20
Research works printed but not linked: 6
- Center for Drug Evaluation, Research. FDA adverse events reporting system (FAERS)—FDA adverse event reporting system (FAERS): latest quarterly data files. fda.gov. Center for drug evaluation and research.
- European Medicines Agency. Guideline on good pharmacovigilance practices (GVP). EMA; London; 2012:1–84.
- US Food and Drug Administration. Guidance for industry. Patient-reported outcome measures: use in medical product development to support labeling claims. US FDA; Silver Spring (MD); 2009:1–43.
- Association of the British Pharmaceutical Industry. Pharmacovigilance Expert Network. Guidance notes on the management of adverse events and product complaints from digital media. 2nd ed. London; ABPI; 2013:1–14.
- 52 Cool Facts About Social Media—2012 Edition #socialmedia—Danny Brown [Internet]. dannybrown.me. Cited 25 Nov 2013. http://dannybrown.me/2012/06/06/52-cool-facts-social-media-2012/ .
- Edwards IR, Lindquist M. Social media and networks in pharmacovigilance: boon or bane? Drug Saf. 2011;34:267–71. · doi:10.2165/11590720-000000000-00000
Cited by
Point-of-Care Diagnostics: Recent Developments in a Connected Age
Nayak, S., Blumenfeld, N. R., Laksanasopin, T., & Sia, S. K. (2017) · Analytical Chemistry · doi:10.1021/acs.analchem.6b04630 · Cited by 508
Utilizing social media data for pharmacovigilance: A review
Sarker, A., Ginn, R., Nikfarjam, A., O’Connor, K., Smith, K., Jayaraman, S., Upadhaya, T., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.02.004 · Cited by 497
A review of existing and emerging digital technologies to combat the global trade in fake medicines
Mackey, T. K., & Nayyar, G. (2017) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2017.1313227 · Cited by 361
Portable automatic text classification for adverse drug reaction detection via multi-corpus training
Sarker, A., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.002 · Cited by 356
Using Digital Health Technology to Better Generate Evidence and Deliver Evidence-Based Care
Sharma, A., Harrington, R. A., McClellan, M. B., Turakhia, M. P., Eapen, Z. J., Steinhubl, S., Mault, J. R., Majmudar, M. D., Roessig, L., Chandross, K. J., et al. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.03.523 · Cited by 332
Metadata
- Authors
- Freifeld, C. C., Brownstein, J. S., Menone, C. M., Bao, W., Filice, R., Kass-Hout, T., & Dasgupta, N.
- Venue
- Drug Safety
- Published
- 2014-04-29
- Volume
- 37
- Issue
- 5
- Pages
- 343-350
- ISSN
- 0114-5916 (ISSN-L)
- 1179-1942
- OpenAlex
- W2165530491
- Cited by
- 267
- References
- 9
- FWCI
- 55.65
- Type
- journal article
- Language
- en
- Update notices
- correction (2014-05-24)
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital Drug Safety Surveillance: Monitoring Pharmaceutical Products in Twitter. https://app.cochat.ai/papers/10.1007/s40264-014-0155-x
- The paper
- Freifeld, C. C., Brownstein, J. S., Menone, C. M., Bao, W., Filice, R., Kass-Hout, T., & Dasgupta, N. (2014). Digital Drug Safety Surveillance: Monitoring Pharmaceutical Products in Twitter. Drug Safety. https://doi.org/10.1007/s40264-014-0155-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.