Inter‐expert agreement of seven criteria in causality assessment of adverse drug reactions
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
What is already known about this subject • In pharmacovigilance, many methods have been proposed for causality assessment of adverse drug reactions. • Expert judgement is commonly used to evaluate the causal relationship between a drug treatment and the occurrence of an adverse event. This form of judgement relies either explicitly or implicitly on causality criteria. What this study adds • Our study compares the judgements of five senior experts using global introspection about drug causation and seven causality criteria on a random set of putative adverse drug reactions. • Even if previous publications have shown poor agreement between experts using global introspection, few have compared judgements of well trained pharmacologists, familiar with using a standardized causality assessment method. Aims: To evaluate agreement between five senior experts when assessing seven causality criteria and the probability of drug causation. Methods: A sample of 31 adverse event‐drug pairs was constituted. For each pair, five experts separately assessed (i) the probability of drug causation, which was secondarily divided into seven causality levels: ruled out (0–0.05), unlikely (0.06–0.25), doubtful (0.26–0.45), indeterminate (0.46–0.55), plausible (0.56–0.75), likely (0.76–0.95), and certain (0.96–1); and (ii) seven causality criteria. To test discrepancies between experts, the kappa index was used. Results: The agreement of the five experts was very poor (kappa = 0.05) for the probability of drug causation. Among the seven levels of causality, only ‘doubtful’ showed a significant rate of agreement (kappa = 0.32, P < 0.001). For all criteria, the kappa index was significant except for the item ‘risk(s) factor(s)’ (kappa = 0.09). Agreement between experts was good (0.64, P < 0.001) only for the criterion ‘reaction at site of application or toxic plasma concentration of the drug or validated test’. However, the rate of agreement with kappa indices of the causality criteria ranged from 0.12 to 0.38. Conclusions: This study confirms that in the absence of an operational procedure, agreement between experts is low. This should be considered when designing a causality assessment method. In particular, criteria inducing a low level of agreement should have their weight reduced.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for estimating the probability of adverse drug reactions
Naranjo, C. A., Busto, U., Sellers, E. M., Sandor, P., Ruiz, I., Roberts, E. A., Janecek, E., Domecq, C., & Greenblatt, D. J. (1981) · Clinical Pharmacology and Therapeutics · doi:10.1038/clpt.1981.154 · Cited by 11,914
Cited by
Interrater agreement and interrater reliability: Key concepts, approaches, and applications
Gisev, N., Bell, J. S., & Chen, T. F. (2013) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2012.04.004 · Cited by 924
Jordan, S. A., Cunningham, D. G., & Marles, R. J. (2010) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2009.12.005 · Cited by 415
“…role of coexistent disease and medication as alternative etiologic possibilities, and the examination of a plausible pathophysiologic mechanism of injury which includes the history and pharmacology of the suspect ingredient (Edwards and Aronson, 2000, Arimone et al., 2007, Agbabiaka et al., 2008).”
BackgroundRockey, D. C., Seeff, L. B., Rochon, J., Freston, J., Chalasani, N., Bonacini, M., Fontana, R. J., & Hayashi, P. H. (2010) · Hepatology · doi:10.1002/hep.23577 · Cited by 313
Lamba, C. D., Gupta, V. K., van Haselen, R., Rutten, L., Mahajan, N., Molla, A. M., & Singhal, R. (2020) · Homeopathy · doi:10.1055/s-0040-1701251 · Cited by 257
Hakim, J. B., Painter, J. L., Ramcharran, D., Kara, V., Powell, G., Sobczak, P., Sato, C., Bate, A., & Beam, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-09138-0 · Cited by 32
Metadata
- Authors
- Arimone, Y., Miremont‐Salamé, G., Haramburu, F., Molimard, M., Moore, N., Fourrier‐Réglat, A., & Bégaud, B.
- Venue
- British Journal of Clinical Pharmacology
- Publisher
- Wiley
- Published
- 2007-08-15
- Volume
- 64
- Issue
- 4
- Pages
- 482-488
- ISSN
- 0306-5251 (ISSN-L)
- 1365-2125
- OpenAlex
- W2030084116
- Cited by
- 77
- References
- 1
- FWCI
- 5.60
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Inter‐expert agreement of seven criteria in causality assessment of adverse drug reactions. https://app.cochat.ai/papers/10.1111/j.1365-2125.2007.02937.x
- The paper
- Arimone, Y., Miremont‐Salamé, G., Haramburu, F., Molimard, M., Moore, N., Fourrier‐Réglat, A., & Bégaud, B. (2007). Inter‐expert agreement of seven criteria in causality assessment of adverse drug reactions. British Journal of Clinical Pharmacology. https://doi.org/10.1111/j.1365-2125.2007.02937.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.