The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
A framework for establishing scientific confidence in new approach methodologies
Open accessAbstract
Robust and efficient processes are needed to establish scientific confidence in new approach methodologies (NAMs) if they are to be considered for regulatory applications. NAMs need to be fit for purpose, reliable and, for the assessment of human health effects, provide information relevant to human biology. They must also be independently reviewed and transparently communicated. Ideally, NAM developers should communicate with stakeholders such as regulators and industry to identify the question(s), and specified purpose that the NAM is intended to address, and the context in which it will be used. Assessment of the biological relevance of the NAM should focus on its alignment with human biology, mechanistic understanding, and ability to provide information that leads to health protective decisions, rather than solely comparing NAM-based chemical testing results with those from traditional animal test methods. However, when NAM results are compared to historical animal test results, the variability observed within animal test method results should be used to inform performance benchmarks. Building on previous efforts, this paper proposes a framework comprising five essential elements to establish scientific confidence in NAMs for regulatory use: fitness for purpose, human biological relevance, technical characterization, data integrity and transparency, and independent review. Universal uptake of this framework would facilitate the timely development and use of NAMs by the international community. While this paper focuses on NAMs for assessing human health effects of pesticides and industrial chemicals, many of the suggested elements are expected to apply to other types of chemicals and to ecotoxicological effect assessments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Toxicity Testing in the 21st Century: A Vision and a Strategy
Krewski, D., Acosta, D., Andersen, M., Anderson, H., Bailar, J. C., Boekelheide, K., Brent, R., Charnley, G., Cheung, V. G., Green, S., et al. (2010) · Journal of Toxicology and Environmental Health, Part B · doi:10.1080/10937404.2010.483176 · Cited by 1,688
Limitations of Animal Studies for Predicting Toxicity in Clinical Trials
Van Norman, G. A. (2019) · JACC: Basic to Translational Science · doi:10.1016/j.jacbts.2019.10.008 · Cited by 732
The Flaws and Human Harms of Animal Experimentation
AKHTAR, A. (2015) · Cambridge Quarterly of Healthcare Ethics · doi:10.1017/s0963180115000079 · Cited by 527 · cited 1×
“2010; Leist and Hartung 2013; Hoffmann 2015; Akhtar 2015; Cohen 2017; Paparella et al.”
BackgroundGuidance on Uncertainty Analysis in Scientific Assessments
EFSA Scientific Committee, Benford, D., Halldorsson, T., Jeger, M. J., Knutsen, H. K., More, S., Naegeli, H., Noteborn, H., Ockleford, C., Ricci, A., et al. (2018) · EFSA Journal · doi:10.2903/j.efsa.2018.5123 · Cited by 404
Weil, C. S., & Scala, R. A. (1971) · Toxicology and Applied Pharmacology · doi:10.1016/0041-008x(71)90112-8 · Cited by 389
CERAPP: Collaborative Estrogen Receptor Activity Prediction Project
Mansouri, K., Abdelaziz, A., Rybacka, A., Roncaglioni, A., Tropsha, A., Varnek, A., Zakharov, A., Worth, A., Richard, A. M., Grulke, C. M., et al. (2016) · Environmental Health Perspectives · doi:10.1289/ehp.1510267 · Cited by 375
Why animal studies are often poor predictors of human reactions to exposure
Bracken, M. B. (2009) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.08k033 · Cited by 362
A Modular Approach to the ECVAM Principles on Test Validity
Hartung, T., Bremer, S., Casati, S., Coecke, S., Corvi, R., Fortaner, S., Gribaldo, L., Halder, M., Hoffmann, S., Roi, A. J., et al. (2004) · Alternatives to Laboratory Animals · doi:10.1177/026119290403200503 · Cited by 341 · cited 2×
“For NAMs that will be performed in more than one location, properly designed training and transfer studies in a second independent and competent laboratory using a small number of coded chemicals, should be conducted to show that the NAM can be repeated in a naïve laboratory (Hartung et al. 2004).”
BackgroundMethodAnimal to human translation: a systematic scoping review of reported concordance rates
Leenaars, C. H. C., Kouwenaar, C., Stafleu, F. R., Bleich, A., Ritskes-Hoitinga, M., De Vries, R. B. M., & Meijboom, F. L. B. (2019) · Journal of Translational Medicine · doi:10.1186/s12967-019-1976-2 · Cited by 314
Judson, R. S., Magpantay, F. M., Chickarmane, V., Haskell, C., Tania, N., Taylor, J., Xia, M., Huang, R., Rotroff, D. M., Filer, D. L., et al. (2015) · Toxicological Sciences · doi:10.1093/toxsci/kfv168 · Cited by 309
Screening Chemicals for Estrogen Receptor Bioactivity Using a Computational Model
Browne, P., Judson, R. S., Casey, W. M., Kleinstreuer, N. C., & Thomas, R. S. (2015) · Environmental Science & Technology · doi:10.1021/acs.est.5b02641 · Cited by 276
Self-citationDevelopment and Validation of a Computational Model for Androgen Receptor Activity
Kleinstreuer, N. C., Ceger, P., Watt, E. D., Martin, M., Houck, K., Browne, P., Thomas, R. S., Casey, W. M., Dix, D. J., Allen, D., et al. (2017) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.6b00347 · Cited by 214
Self-citationAn evaluation framework for new approach methodologies (NAMs) for human health safety assessment
Parish, S. T., Aschner, M., Casey, W., Corvaro, M., Embry, M. R., Fitzpatrick, S., Kidd, D., Kleinstreuer, N. C., Lima, B. S., Settivari, R. S., et al. (2020) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2020.104592 · Cited by 211
Self-citationNon-animal methods to predict skin sensitization (II): an assessment of defined approaches
Kleinstreuer, N. C., Hoffmann, S., Alépée, N., Allen, D., Ashikaga, T., Casey, W., Clouet, E., Cluzel, M., Desprez, B., Gellatly, N., et al. (2018) · Critical Reviews in Toxicology · doi:10.1080/10408444.2018.1429386 · Cited by 207
Self-citationBal-Price, A. (2018) · ALTEX · doi:10.14573/altex.1712081 · Cited by 207
CoMPARA: Collaborative Modeling Project for Androgen Receptor Activity
Mansouri, K., Kleinstreuer, N., Abdelaziz, A. M., Alberga, D., Alves, V. M., Andersson, P. L., Andrade, C. H., Bai, F., Balabin, I., Ballabio, D., et al. (2020) · Environmental Health Perspectives · doi:10.1289/ehp5580 · Cited by 207
Self-citationNon-animal methods to predict skin sensitization (I): the Cosmetics Europe database
Hoffmann, S., Kleinstreuer, N., Alépée, N., Allen, D., Api, A. M., Ashikaga, T., Clouet, E., Cluzel, M., Desprez, B., Gellatly, N., et al. (2018) · Critical Reviews in Toxicology · doi:10.1080/10408444.2018.1429385 · Cited by 188
Self-citationDevelopmental neurotoxicity – Challenges in the 21st Century and In Vitro Opportunities
Smirnova, L., Hogberg, H. T., Leist, M., & Hartung, T. (2014) · ALTEX · doi:10.14573/altex.1403271 · Cited by 183
Inflammatory findings on species extrapolations: humans are definitely no 70-kg mice
Leist, M., & Hartung, T. (2013) · Archives of Toxicology · doi:10.1007/s00204-013-1038-0 · Cited by 164
Bal‐Price, A., Pistollato, F., Sachana, M., Bopp, S. K., Munn, S., & Worth, A. P. (2018) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2018.02.008 · Cited by 160
Luechtefeld, T., Maertens, A., Russo, D. P., Rovida, C., Zhu, H., & Hartung, T. (2016) · ALTEX · doi:10.14573/altex.1510053 · Cited by 132
Development of a Roadmap for Action on New Approach Methodologies in Risk Assessment
Escher, S. E., Partosch, F., Konzok, S., Jennings, P., Luijten, M., Kienhuis, A. S., de Leeuw, V. C., Reuss, R., Lindemann, K.-M., & Bennekou, S. H. (2022) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2022.en-7341 · Cited by 119
A Curated Database of Rodent Uterotrophic Bioactivity
Kleinstreuer, N., Ceger, P. C., Allen, D., Strickland, J. A., Chang, X., Hamm, J. T., & Casey, W. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.1510183 · Cited by 118
Self-citationAdriaens, E., Barroso, J., Eskes, C., Hoffmann, S., McNamee, P. M., Alépée, N., Bessou‐Touya, S., Smedt, A. D., Wever, B. D., Pfannenbecker, U., et al. (2013) · Archives of Toxicology · doi:10.1007/s00204-013-1156-8 · Cited by 117
Self-citationBarroso, J., Pfannenbecker, U., Adriaens, E., Alépée, N., Cluzel, M., Smedt, A. D., Hibatallah, J., Klarić, M., Mewes, K. R., Millet, M., et al. (2016) · Archives of Toxicology · doi:10.1007/s00204-016-1679-x · Cited by 115
Self-citationClippinger, A. J., Allen, D., Jarabek, A. M., Corvaro, M., Gaça, M., Gehen, S. C., Hotchkiss, J. A., Patlewicz, G. Y., Melbourne, J., Hinderliter, P. M., et al. (2017) · Toxicology in Vitro · doi:10.1016/j.tiv.2017.12.011 · Cited by 106
Self-citationDevelopmental neurotoxicity guideline study: Issues with methodology, evaluation and regulation*
Tsuji, R., & Crofton, K. M. (2012) · Congenital Anomalies · doi:10.1111/j.1741-4520.2012.00374.x · Cited by 103
Food for Thought … Mechanistic Validation
Hartung, T. (2013) · ALTEX · doi:10.14573/altex.2013.2.119 · Cited by 93 · cited 2×
“2010; Leist and Hartung 2013; Hoffmann 2015; Akhtar 2015; Cohen 2017; Paparella et al.”
BackgroundHoffmann, S. (2015) · ALTEX · doi:10.14573/altex.1505051 · Cited by 80
The Frank R. Lautenberg Chemical Safety for the 21st Century Act
Ocspp, & Oppt (2016) · Cited by 79
Casati, S., Aschberger, K., Barroso, J., Casey, W., Delgado, I. F., Kim, T. S., Kleinstreuer, N., Kojima, H., Lee, J. K., Lowit, A., et al. (2017) · Archives of Toxicology · doi:10.1007/s00204-017-2097-4 · Cited by 79
Self-citationPham, L., Watford, S., Pradeep, P., Martin, M. T., Thomas, R. S., Judson, R., Setzer, R. W., & Friedman, K. P. (2020) · Computational Toxicology · doi:10.1016/j.comtox.2020.100126 · Cited by 76
Evaluation of Variability Across Rat Acute Oral Systemic Toxicity Studies
Karmaus, A. L., Mansouri, K., To, K. T., Blake, B. E., Fitzpatrick, J. M., Strickland, J. A., Patlewicz, G. Y., Allen, D., Casey, W., & Kleinstreuer, N. (2022) · Toxicological Sciences · doi:10.1093/toxsci/kfac042 · Cited by 64
Self-citationCoralie, D., Barroso, J., Matys, I., Worth, A. P., & Casati, S. (2016) · Toxicology in Vitro · doi:10.1016/j.tiv.2016.04.008 · Cited by 62
Self-citationHärtung, T., León, B. O.-D., Rodger, C., Eskes, C., GOLDBERG, A., McNamee, P., Scott, L., & Zuang, V. (2010) · ALTEX · doi:10.14573/altex.2010.1.43 · Cited by 57
Mice-to-men comparison of inhaled drug-aerosol deposition and clearance
Kolanjiyil, A. V., Kleinstreuer, C., Kleinstreuer, N., Pham, W. N., & Sadikot, R. T. (2018) · Respiratory Physiology & Neurobiology · doi:10.1016/j.resp.2018.11.003 · Cited by 56
Self-citationHigh-Throughput Screening to Identify Chemical Cardiotoxic Potential
Krishna, S., Berridge, B., & Kleinstreuer, N. (2021) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.0c00382 · Cited by 52
Self-citationHuman-relevant approaches to assess eye corrosion/irritation potential of agrochemical formulations
Clippinger, A. J., Raabe, H., Allen, D., Choksi, N. Y., van der Zalm, A. J., Kleinstreuer, N., Barroso, J., & Lowit, A. (2021) · Cutaneous and Ocular Toxicology · doi:10.1080/15569527.2021.1910291 · Cited by 52
Self-citationUncertainties of testing methods: What do we (want to) know about carcinogenicity?
Paparella, M., Colacci, A., & Jacobs, M. N. (2016) · ALTEX · doi:10.14573/altex.1608281 · Cited by 50
Patterson, E. A., Whelan, M. P., & Worth, A. P. (2021) · Computational Toxicology · doi:10.1016/j.comtox.2020.100144 · Cited by 47
Piersma, A. H., Burgdorf, T., Louekari, K., Desprez, B., Taalman, R. D. F. M., Landsiedel, R., Barroso, J., Rogiers, V., Eskes, C., Oelgeschläger, M., et al. (2018) · Toxicology in Vitro · doi:10.1016/j.tiv.2018.02.018 · Cited by 45
Self-citationPoints of Reference in the Validation Process: The Report and Recommendations of ECVAM Workshop 66
Hoffmann, S., Edler, L., Gardner, I. A., Gribaldo, L., Härtung, T., Klein, C. L., Liebsch, M., Sauerland, S., Schechtman, L. M., Stammati, A. P., et al. (2008) · Alternatives to Laboratory Animals · doi:10.1177/026119290803600311 · Cited by 43
Reflections on the progress towards non-animal methods for acute toxicity testing of chemicals
Prior, H. M., Casey, W., Kimber, I., Whelan, M., & Sewell, F. R. (2018) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2018.12.008 · Cited by 41
Self-citationDevelopment of a curated Hershberger database
Browne, P., Kleinstreuer, N., Ceger, P. C., Deisenroth, C., Baker, N., Markey, K. J., Thomas, R. S., Judson, R., & Casey, W. (2018) · Reproductive Toxicology · doi:10.1016/j.reprotox.2018.08.016 · Cited by 34
Self-citationCharacteristics to consider when selecting a positive control material for an in vitro assay
Petersen, E. J., Nguyen, A., Brown, J., Elliott, J. T., Clippinger, A., Gordon, J., Kleinstreuer, N., & Roesslein, M. (2021) · ALTEX · doi:10.14573/altex.2102111 · Cited by 34
Self-citationDobreniecki, S., Méndez, E., Lowit, A., Freudenrich, T. M., Wallace, K., Carpenter, A., Wetmore, B. A., Kreutz, A., Korol-Bexell, E., Friedman, K. P., et al. (2022) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2022.105167 · Cited by 34
Self-citationSteps towards the international regulatory acceptance of non-animal methodology in safety assessment
Sewell, F. R., Doe, J. E., Gellatly, N. L., Ragan, I., & Burden, N. (2017) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2017.07.001 · Cited by 32
Madia, F., Pillo, G., Worth, A. P., Corvi, R., & Prieto, P. (2021) · Archives of Toxicology · doi:10.1007/s00204-021-03035-x · Cited by 32
Workflow for Defining Reference Chemicals for Assessing Performance of In Vitro Assays
Judson, R., Thomas, R. S., Baker, N., Simha, A., Howey, X. M., Marable, C., Kleinstreuer, N. C., & Houck, K. A. (2018) · ALTEX · doi:10.14573/altex.1809281 · Cited by 26
Self-citationPetersen, E. J., Sharma, M., Clippinger, A. J., Gordon, J., Katz, A., Laux, P., Leibrock, L., Luch, A., Matheson, J. M., Stucki, A., et al. (2021) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.1c00080 · Cited by 25
Self-citationTechnical framework for enabling high-quality measurements in new approach methodologies (NAMs)
Petersen, E. J., Elliott, J. T., Gordon, J., Kleinstreuer, N. C., Reinke, E., Roesslein, M., & Toman, B. (2022) · ALTEX · doi:10.14573/altex.2205081 · Cited by 24
Self-citationNew approach methods for testing chemicals for endocrine disruption potential
Judson, R., Friedman, K. P., Houck, K. A., Mansouri, K., Browne, P., & Kleinstreuer, N. (2018) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2018.10.002 · Cited by 21
Self-citationRegulatory use and acceptance of alternative methods for chemical hazard identification
Browne, P., Delrue, N., & Gourmelon, A. (2019) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2019.02.003 · Cited by 12
Self-citationThe relevance of experimental reproductive studies in safety assessment
Stewart, J. (2017) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2017.05.002 · Cited by 4
Cited by
Carratt, S. A., Zuch de Zafra, C. L., Oziolor, E., Rana, P., Vansell, N. R., Mangipudy, R., & Vaidya, V. S. (2025) · Toxicological Sciences · doi:10.1093/toxsci/kfae122 · Cited by 59
Metadata
- Authors
- van der Zalm, A. J., Barroso, J., Browne, P., Casey, W., Gordon, J., Henry, T. R., Kleinstreuer, N. C., Lowit, A. B., Perron, M., & Clippinger, A. J.
- Venue
- Archives of Toxicology
- Published
- 2022-08-20
- Volume
- 96
- Issue
- 11
- Pages
- 2865-2879
- ISSN
- 0340-5761 (ISSN-L)
- 1432-0738
- OpenAlex
- W4292461632
- Cited by
- 257
- References
- 55
- FWCI
- 46.98
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.