Cited by 331Computational Drug Discovery Methodsvaccines and immunoinformatics approachesAdvanced Chemical Physics Studies

Empirical scoring functions for structure-based virtual screening: applications, critical aspects, and challenges

Open access
Guedes, Isabella A., Pereira, Felipe S. S., Dardenne, Laurent E.·2018·Frontiers in Pharmacology

Abstract

Structure-based virtual screening (VS) is a widely used approach that employs the knowledge of the three-dimensional structure of the target of interest in the design of new lead compounds from large-scale molecular docking experiments. Through the prediction of the binding mode and affinity of a small molecule within the binding site of the target of interest, it is possible to understand important properties related to the binding process. Empirical scoring functions are widely used for pose and affinity prediction. Although pose prediction is performed with satisfactory accuracy, the correct prediction of binding affinity is still a challenging task and crucial for the success of structure-based VS experiments. There are several efforts in distinct fronts to develop even more sophisticated and accurate models for filtering and ranking large libraries of compounds. This paper will cover some recent successful applications and methodological advances, including strategies to explore the ligand entropy and solvent effects, training with sophisticated machine-learning techniques, and the use of quantum mechanics. Particular emphasis will be given to the discussion of critical aspects and further directions for the development of more accurate empirical scoring functions.

AI snapshot

Written from the paper’s full text.

TL;DR

This review surveys empirical scoring functions for structure-based virtual screening, covering descriptors, training/test datasets, machine learning, and emerging strategies. It concludes that pose prediction is often satisfactory, but accurate binding-affinity prediction and ranking remain major challenges.

Key findings

  • Pose prediction is generally satisfactory under adequate system preparation and when target flexibility is not significant, but active/inactive discrimination and absolute affinity prediction remain challenging; in D3R Grand Challenge 2, even with crystal structures of 36 complexes at Stage 2, the maximum Kendall’s tau achieved was 0.46.
  • Linear scoring functions show moderate correlations (RP ∼ 0.6), whereas nonlinear machine-learning models achieve better correlations (RP > 0.7) on benchmarking studies; for example, SFCscoreRF reached R = 0.779, higher than linear SFCscore models.
  • Key datasets include PDBbind-CN version 2017 with 17,900 structures (14,761 protein–ligand complexes) and affinities ranging from 1.2 pM to 10 mM; DUD-E has 102 targets with 50 decoys per ligand; DEKOIS 2.0 has 81 benchmarking sets for 80 targets with 30 decoys per active.
  • Target-specific scoring functions can improve accuracy, but Wójcikowski et al. found RF target-specific models only slightly better than generic models, with two-thirds increasing EF1% by less than 10%.

Methods

  • Design: narrative review of empirical scoring functions for structure-based virtual screening, including applications, critical aspects, and challenges.
  • Data/sample: no primary experimental sample; synthesizes published literature, scoring functions, benchmarks (PDBbind-CN, DUD-E, DEKOIS 2.0, D3R Grand Challenges), and methodological studies.
  • Analysis: qualitative synthesis of scoring-function components (descriptors, training/test sets, regression/classification, linear vs nonlinear machine learning) and evaluation metrics (docking, screening, ranking, and scoring power).

Limitations

  • Paper states: there is no universal scoring function; affinity prediction remains challenging; nonlinear models act as “black boxes” and risk overfitting or bias; decoys are presumed rather than experimentally confirmed inactive; small benchmark performance differences (e.g., Spearman correlation differences of 0.05–0.15) lack statistical significance.
  • Paper states remaining challenges in protein flexibility, solvation/water treatment, covalent docking, and QM/MM approaches; QM-based methods do not guarantee outperformance and still face solvent and entropic estimation problems.
  • Evident from the text: as a narrative review, it does not conduct a systematic search or quantitative meta-analysis and reports no new primary data.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fphar.2018.01089

Cites

239 of 239 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 150 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    Empirical scoring functions are developed to reproduce experimental affinity data based on the idea that it is possible to correlate the free energy of binding to a set of non-related variables.

    “Empirical scoring functions are developed to reproduce experimental affinity data (Pason and Sotriffer, 2016) based on the idea that it is possible to correlate the free energy of binding to a set of non-related variables.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Pason and Sotriffer, 2016

      Not checked in the free run.

    • Rests on an assumption: Empirical scoring functions are widely used for pose and affinity prediction.
  • Premisecitation

    Empirical scoring functions have implemented specific terms accounting for intermolecular interactions, such as van der Waals and electrostatic potentials.

    “Empirical scoring functions have implemented specific terms accounting for intermolecular interactions, such as van der Waals and electrostatic potentials.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Empirical scoring functions are widely used for pose and affinity prediction.
  • Premisecitation

    Current docking methods and associated scoring functions exhibit good pose prediction power if the system is adequately prepared and target flexibility does not play a significant role.

    “Current docking methods and the associated scoring functions exhibit good pose prediction power if one assumes an adequate preparation of the system and if the target flexibility does not play a significant role (Corbeil et al., 2012; Chaput and Mouawad, 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Corbeil et al., 2012 source

      Not checked in the free run.

    • cites Chaput and Mouawad, 2017

      Not checked in the free run.

  • Interpretationreasoning

    The inclusion of a polar desolvation might be crucial to avoid overestimation of hydrogen bonds, since H-bond formation is directly related with the desolvation of polar atoms.

    “Besides the improvement in affinity predictions, the inclusion of a polar desolvation might be crucial to avoid overestimation of hydrogen bonds, since the H-bond formation is directly related with the desolvation of polar atoms.”
    Quote in the paperNot a substantial claim
  • Interpretationreasoning

    Metal ions can be a source of inaccuracy when using non-specific scoring functions, since the real contribution of metal-ion interactions can be underestimated or overestimated.

    “Despite the importance in considering metal ions, it can be also a source of inaccuracy when using non-specific scoring functions, since the real contribution of interaction metal ions can be underestimated – in the case of simple counting of metal-atom interacting pairs – or overestimated – when using Coulomb potential with formal charges.”
    Quote in the paperNot a substantial claim
  • May combine two claims. 42
  • Classified as probably not a substantial claim. 37
  • May combine two claims.

    Premisecitation

    The nonpolar desolvation is favorable to binding and is related to the hydrophobic effect when transferring nonpolar molecular surface from bulk water to a nonpolar medium.

    “The nonpolar desolvation, favorable to binding, is related to the hydrophobic effect when transferring nonpolar molecular surface from the bulk water to a medium that is nonpolar, as is the case of many protein binding cavities (Tanford, 1980; Williams and Bardsley, 1999; Freire, 2008).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Tanford, 1980

      Not checked in the free run.

    • cites Williams and Bardsley, 1999

      Not checked in the free run.

    • cites Freire, 2008 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Scoring functions are typically divided into three main classes: force field-based, knowledge-based, and empirical.

    “Scoring functions are typically divided into three main classes (Wang et al., 2003): force field-based, knowledge-based, and empirical.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wang et al., 2003 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Many studies have highlighted the influence of halogen bonds on enhancing binding affinity against several targets.

    “Many studies have highlighted the influence of halogen bonds (X-bonds) on enhancing binding affinity against several targets and the computational methods developed so far (Desiraju et al., 2013; Ford and Ho, 2016).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Desiraju et al., 2013 source

      Not checked in the free run.

    • cites Ford and Ho, 2016 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Scoring functions are a straightforward and fast strategy despite limited accuracy, remaining the main alternative to be applied in VS experiments.

    “In this context, scoring functions emerge as a straightforward and fast strategy despite limited accuracy, remaining as the main alternative to be applied in VS experiments (Huang et al., 2010).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Huang et al., 2010 source

      Not checked in the free run.

    • Rests on an assumption: Empirical scoring functions are widely used for pose and affinity prediction.
  • May combine two claims.

    Premisecitation

    Detection of active compounds among decoys and accurate prediction of binding affinity remain challenging tasks, even when induced fit and entropy effects are not important for binding.

    “However, the detection of active compounds among a set of decoy compounds and the accurate prediction of binding affinity remain challenging tasks, even when induced fit and entropy effects are not important for binding (Gohlke and Klebe, 2002; Damm-Ganamet et al., 2013; Yuriev and Ramsland, 2013; Grinter and Zou, 2014; Smith et al., 2016).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Gohlke and Klebe, 2002

      Not checked in the free run.

    • cites Damm-Ganamet et al., 2013 source

      Not checked in the free run.

    • cites Yuriev and Ramsland, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The development of more accurate scoring functions is strategic in the field of SBDD and remains a challenging task, especially in hit-to-lead optimization and de novo design.

    “Moreover, the development of more accurate scoring functions is strategic in the field of SBDD and remains a challenging task, especially in the hit-to-lead optimization (Enyedy and Egan, 2008) and de novo design (Liu et al., 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Enyedy and Egan, 2008

      Not checked in the free run.

    • cites Liu et al., 2017 source

      Not checked in the free run.

    • Rests on an assumption: There is no universal scoring function with significant reliability for all molecular systems.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    DUD-E keeps a proportion of 50 decoys per ligand for all 102 macromolecules.

    “Although the number of ligands (i.e., active compounds) significantly varies for each target, a proportion of 50 decoys per ligand is kept for all 102 macromolecules.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    MM-GBSA is less sensitive to the investigated systems and is more suitable to be used in general cases than MM-PBSA.

    “They concluded that although similar results were observed, MM-GBSA is less sensitive to the investigated systems and is more suitable to be used in general cases (e.g., reverse docking, which is widely used to predict the receptor target(s) of a compound).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sun et al., 2014 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    DUD-E is an enhanced version of the original DUD set and has been widely used to train and validate scoring functions.

    “The DUD-E dataset is an enhanced version of the original DUD set and has been widely used to train and validate scoring functions (Huang et al., 2006; Mysinger et al., 2012).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Huang et al., 2006 source

      Not checked in the free run.

    • cites Mysinger et al., 2012 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    A significant drawback of PDBbind-CN datasets is the insufficient information regarding negative data.

    “A significant drawback of PDBbind-CN datasets is the insufficient information regarding negative data (i.e., experimentally confirmed inactive compounds).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premiseown data

    PDBbind-CN collected affinities range from 1.2 pM to 10 mM.

    “Collected affinities comprise a large interval of values, ranging from 1.2 pM (1.2 × 10−12 M) to 10 mM (1.0 × 10−3 M).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    DUD-E is composed of 102 targets with corresponding active, inactive, marginal, and decoy compounds.

    “It is composed of 102 targets with corresponding active, inactive, marginal, and decoy compounds.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mysinger et al., 2012 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    The PDBbind-CN refined set is considered one of the largest datasets of structures available for the development and validation of docking methodologies and scoring functions.

    “The “refined set” is a subset composed of high-quality datasets constructed according to several criteria concerning the quality of the structures, the affinity data, and the nature of the complex, being considered one of the largest datasets of structures available for the development and validation of docking methodologies and scoring functions.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The unfavorable desolvation effect from burying polar groups after ligand binding plays an important role in the binding event, but it is commonly neglected by most scoring functions.

    “The unfavorable desolvation effect from burying polar groups after ligand binding also plays an important role in the binding event, but it is commonly neglected by most scoring functions (Kar et al., 2013; Li et al., 2014c; Cramer et al., 2017).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Kar et al., 2013 source

      Not checked in the free run.

    • cites Li et al., 2014c

      Not checked in the free run.

    • cites Cramer et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The PDBbind-CN core set is widely used for comparative assessment of scoring functions in predicting affinities.

    “Also, PDBbind-CN provides a benchmarking named “core set” widely used for comparative assessment of scoring functions in predicting affinities (Li Y. et al., 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Li Y. et al., 2018

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Scoring functions generally neglect entropic contributions or adopt simplified algorithms to approximate entropies.

    “Given the difficulty in modeling entropic effects for ΔGbind, scoring functions generally neglect their contributions or adopt simplified algorithms to approximate entropies in a straightforward manner (Jain, 2006).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, 2006 source

      Not checked in the free run.

    • Rests on an assumption: Empirical scoring functions are widely used for pose and affinity prediction.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    PDBbind-CN current release (version 2017) contains 17,900 structures, including 14,761 protein-ligand complexes.

    “The current release (version 2017) contains 17,900 structures (14,761 protein–ligand complexes) and is annually updated to keep up with the growth of the Protein Data Bank (Berman et al., 2000).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Liu et al., 2015

      Not checked in the free run.

    • cites Berman et al., 2000 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given

    The test set must be composed of instances not used in the training process at any moment.

    “Furthermore, the test set must be composed of instances not used in the training process at any moment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In Wójcikowski et al. (2017), fivefold cross-validations using the DUD-E dataset considered horizontal, vertical, and per-target splitting strategies.

    “For example, in the recent work of Wójcikowski et al. (2017), they performed fivefold cross-validations using the DUD-E dataset. Three distinct splitting strategies were considered: horizontal, vertical, and per-target.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wójcikowski et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In the per-target split, training and test are performed for each protein target, simulating the construction and validation of target-specific scoring functions.

    “in the per-target split, the training and test are performed for each protein target (i.e., 102 unique machine-learning models relative to the 102 DUD-E targets), simulating the construction and validation of target-specific scoring functions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wójcikowski et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    PDBbind, DUD-E, and DEKOIS 2.0 are examples of widely used benchmarks for evaluating scoring functions.

    “PDBbind (Liu et al., 2015), DUD-E (Mysinger et al., 2012), and DEKOIS 2.0 (Bauer et al., 2013) are examples of widely used benchmarks for evaluating scoring functions.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Liu et al., 2015

      Not checked in the free run.

    • cites Mysinger et al., 2012 source

      Not checked in the free run.

    • cites Bauer et al., 2013 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Studies evaluating the influence of training size demonstrated that MLR becomes insensitive to the growth of the training size whereas larger training sets can lead to an overall better accuracy of nonlinear scoring functions.

    “Studies evaluating the influence of the training size for the performance of linear and nonlinear scoring functions for affinity prediction demonstrated that MLR becomes insensitive to the growth of the training size whereas larger training sets can lead to an overall better accuracy of nonlinear scoring functions (Ding et al., 2013; Ain et al., 2015; Li et al., 2015a,b; Li H. et al., 2018).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ding et al., 2013 source

      Not checked in the free run.

    • cites Ain et al., 2015 source

      Not checked in the free run.

    • cites Li et al., 2015a,b

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given

    Training, validation, and test sets must never have protein-ligand complexes in common at the same time.

    “It is important to keep in mind that training, validation, and test sets must never have protein–ligand complexes in common at the same time.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The test set must be used only for evaluating the predictive performance of different scoring functions, and no decision should be taken based on its performance to avoid artificially high correlations.

    “Thus, the test set must be used only for evaluating the predictive performance of different scoring functions, and no decision should be taken based on the performance for this dataset to avoid useless comparisons due to artificially high correlations.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Huang and Wong developed the screening performance index (SPI) to evaluate VS methods that correlate with BEDROC with less computational cost, discarding the necessity of docking decoy compounds.

    “Recently, Huang and Wong (2016) developed an inexpensive method – the screening performance index (SPI) – to evaluate VS methods that correlate with BEDROC with less computational cost, since it discards the necessity of docking decoy compounds (i.e., only considers the docking of active molecules).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Huang and Wong (2016)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    According to results from Grand Challenge 2, pose prediction is well performed for many methodologies, but scoring remains very challenging even when crystal structures are provided.

    “According to the results obtained in the Grand Challenge 2, it is clear that the pose prediction task is well performed for many methodologies, but scoring is still a very challenging task, even when the crystal structures are provided (Gaieb et al., 2018).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Gaieb et al., 2018 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    D3R periodically provides pharmaceutical-related benchmark datasets and a Grand Challenge as a blinded community challenge with unpublished data.

    “Drug Design Data Resource (D3R10) periodically provide pharmaceutical-related benchmark datasets and a Grand Challenge as a blinded community challenge with unpublished data (Gathiaka et al., 2016).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gathiaka et al., 2016 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Wrong orientation of hydrogen atoms can lead to high van der Waals energies, underestimation of hydrogen bond interactions, and incorrect electrostatic repulsions between charged/polar groups.

    “In such cases, the wrong orientation of hydrogen atoms can lead to high van der Waals energies, underestimation of hydrogen bond interactions, and incorrect electrostatic repulsions between charged/polar groups.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Reliable protein-ligand structures usually comply with criteria: good resolution (2.5 Å or better), fully resolved electron density for the entire ligand and surrounding binding-site residues, and no significant influences from crystal packing on the observed binding mode.

    “Reliable protein–ligand structures usually comply these criteria: good resolution (2.5 Å or better), fully resolved electron density for the entire ligand and the surrounding binding-site residues, and without significant influences from crystal packing on the observed binding mode (Cole et al., 2011).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Cole et al., 2011 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The broad profile of D3R Grand Challenges makes their datasets one of the more reliable sources to evaluate docking and scoring methods.

    “The broad profile of the D3R Grand Challenges, regarding chemical space diversity and affinity data carefully collected, makes their datasets one of the more reliable sources to evaluate docking and scoring methods, providing useful guidelines and best practices for further VS campaigns and methodological improvements.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Prospective evaluations are of substantial importance because blinded predictions simulate real experiments of VS campaigns.

    “In addition to the well-known benchmarking sets, prospective evaluations are of substantial importance since the blinded predictions simulate real experiments of VS campaigns.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Scoring functions mainly composed of simple contact-based descriptors (element-element pair counting) emerge to circumvent the complicated preparation required in large datasets for VS.

    “In this context, scoring functions mainly composed of simple contact-based descriptors (element–element pair counting) emerge to circumvent the complicated preparation required in large datasets for VS.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Zilian and Sotriffer trained a RF scoring function using the same SFCscore descriptors (SFCscoreRF) and found a much improved model, with R = 0.779 significantly higher than correlations obtained for SFScore linear models.

    “As an example, Zilian and Sotriffer (2013) trained a RF scoring function using the same SFCscore descriptors (named SFCscoreRF) and found a much improved model, with R = 0.779 significantly higher than those correlations obtained for the SFScore linear models (Pason and Sotriffer, 2016).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Zilian and Sotriffer (2013)

      Not checked in the free run.

    • cites Pason and Sotriffer, 2016

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Scoring functions can be developed using regression methods to reproduce continuous binding constants or classification methods to reproduce binary affinity data.

    “Scoring functions can be developed using regression methods to reproduce continuous (e.g., binding constants) or classification methods to reproduce binary affinity data (e.g., active/inactive).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Linear scoring functions developed to date have shown moderate correlations (RP ∼ 0.6), whereas nonlinear models achieved significantly better correlations (RP > 0.7) on benchmarking studies.

    “Linear scoring functions developed to date have shown moderate correlations (RP ∼ 0.6), whereas nonlinear models achieved significantly better correlations (RP > 0.7) on benchmarking studies (Ashtawy and Mahapatra, 2012; Khamis and Gomaa, 2015; Wang and Zhang, 2017; Wójcikowski et al., 2017).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ashtawy and Mahapatra, 2012

      Not checked in the free run.

    • cites Khamis and Gomaa, 2015

      Not checked in the free run.

    • cites Wang and Zhang, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Many sophisticated machine-learning techniques automatically generate local models for similar training points, being able to classify new instances automatically and use different regression models according to specific properties without explicitly defining classes based on such descriptors.

    “Many sophisticated machine-learning techniques automatically generate local models for similar training points (e.g., locally weighted regression), being able to classify the new instances automatically and use different regression models according to specific properties without explicitly defining classes based on such descriptors.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The PDBbind refined set follows criteria: only complexes with known Kd or Ki are allowed; no complexes with extremely low (Kd or Ki > 10 mM) or extremely high (Kd or Ki < 1 pM) affinities are accepted; estimated values are rejected.

    “the PDBbind refined set follows several criteria concerning the bioactivity manually collected from the original reference (Liu et al., 2015): (i) only complexes with known dissociation constants (Kd) or inhibition constants (Ki) are allowed, (ii) no complexes with extremely low (Kd or Ki > 10 mM) or extremely high (Kd or Ki < 1 pM) affinities are accepted, and (iii) estimated values are rejected”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Liu et al., 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    DL methods take advantage of the recent increase in computational power and the ever-expanding availability of structural and binding data.

    “Such methods take advantage of the recent increase in computational power and the ever-expanding availability of structural and binding data.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Larger training sets and describing complexes with more descriptors have a positive impact on the predictive performance of nonlinear models.

    “Furthermore, they also observed that larger training sets and describing the complexes with more descriptors have a positive impact in the predictive performance of the nonlinear models.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Li et al. (2014a)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Recently, DL has been applied for pose/affinity prediction and active/inactive detection, exhibiting outstanding performance compared with several well-performing scoring functions developed with both linear and nonlinear approaches.

    “Recently, DL has been applied for pose/affinity prediction and active/inactive detection, exhibiting an outstanding performance when compared with several well-performing scoring functions developed with both linear and nonlinear approaches (Wallach et al., 2015; Khamis et al., 2016; Pereira et al., 2016; Ragoza et al., 2017; Jiménez Luna et al., 2018; Nguyen et al., 2018).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Wallach et al., 2015

      Not checked in the free run.

    • cites Khamis et al., 2016

      Not checked in the free run.

    • cites Pereira et al., 2016 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Over the last decades, many strategies have been implemented in docking programs to consider some degree of flexibility, such as soft potentials and ensemble docking.

    “However, over the last decades, many strategies have been implemented in docking programs to consider some degree of flexibility in the targeted, such as soft potentials and ensemble docking.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    DL is considered a promising approach to diverse drug discovery projects guided by successes in image and speech recognition problems.

    “DL is considered as a promising approach to diverse drug discovery projects guided by the successes obtained in image and speech recognition problems (Zhang L. et al., 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zhang L. et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Bodnarchuk published an extensive review of water-placement methods helpful for locating conserved water molecules within the protein binding site to be considered explicitly during docking simulation.

    “Recently, Bodnarchuk (2016) published an extensive review of water-placement methods helpful for locating conserved water molecules within the protein binding site to be considered explicitly during the docking simulation.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bodnarchuk (2016) source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Solvent mapping approaches only calculate the solvent contribution to the free energy and must be combined with other methods to be used for lead optimization or VS.

    “However, these approaches only calculate the solvent contribution to the free energy and must be combined with other methods to be used for lead optimization or VS.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Covalent inhibitors can be divided into reversible and irreversible categories according to whether inhibition is reversible or irreversible.

    “Covalent inhibitors can further be divided into two different categories according to whether inhibition is reversible or irreversible (Tuley and Fast, 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tuley and Fast, 2018

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Many solvent mapping methods evaluated on real drug design studies showed that solvent mapping methods could be important to help ligand optimization and to correctly rank compounds to assist synthetic prioritization.

    “Many solvent mapping methods were evaluated on real drug design studies in a recent paper (Bucher et al., 2018), showing that solvent mapping methods could be important to help ligand optimization and to correctly rank compounds to assist synthetic prioritization.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bucher et al., 2018 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Whereas high computational cost related with sampling protein conformations and docking large compound libraries can be overcome with high-performance computing platforms, weighing such conformations and integrating them with scoring functions remains a hindrance for accurate estimation of binding affinities on flexible systems.

    “Whereas the high computational cost related with sampling protein conformations and docking large compound libraries can be overcome with the use of high-performance computing platforms, weighing such conformations and integrating them with the scoring functions remains a hindrance for accurate estimation of binding affinities on flexible systems.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In AutoDock4, explicit water molecules of the first hydration shell are represented as uncharged spheres directly attached to the ligand, whereas a hydration force field accounting for entropic and enthalpic contributions automatically predicts their potential in mediating protein-ligand interactions.

    “In AutoDock4, explicit water molecules of the first hydration shell as represented as uncharged spheres directly attached to the ligand, whereas a hydration force field accounting for the entropic and enthalpic contributions, automatically predicts their potential in mediating protein–ligand interactions (Forli and Olson, 2012).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Forli and Olson, 2012 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A water-mapping protocol based on post-trajectory analysis of explicit solvent MD uses inhomogeneous solvation theory and tries to predict the free energy cost of moving a water molecule from a protein hydration site into the bulk solvent.

    “An interesting approach is the use of a water-mapping protocol based on the post trajectory analysis of explicit solvent MD. This analysis is based on the inhomogeneous solvation theory and tries to predict the free energy cost of moving a water molecule from a protein hydration site into the bulk solvent (Yang et al., 2013).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Yang et al., 2013 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    These advances were essential to overcome the bottleneck of high computational cost and are allowing the increasing use of QM methods.

    “These advances were essential to overcome the bottleneck of the high computational cost and are allowing the increasing use of QM methods in the”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Development of covalent-docking methodologies is very important due to potential advantages of covalent inhibitors, including sustained duration of action, increased ligand efficiency, ability to inhibit shallow binding sites previously categorized as undruggable, and increased ability to overcome resistant mutations.

    “The development of covalent-docking methodologies capable of dealing with such type of inhibition is very important due to the potential advantages associated with covalent inhibitors (De Cesco et al., 2017), including (i) sustained duration of action leading to less frequent dosing, (ii) increased ligand efficiency, (iii) ability to inhibit targets with shallow binding sites previously”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Cesco et al., 2017 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In the last 10 years, important advances were made in computing hardware, quantum algorithms to compute molecular wave functions, more reliable semi-empirical quantum methods, and new hybrid QM/MM methods.

    “In the last 10 years, important advances were made in computing hardware (e.g., Graphics Processing Units – GPUs), in the development of quantum algorithms to compute molecular wave functions (Dixon and Merz, 1997; Birgin et al., 2013), the development of more reliable semi-empirical quantum methods (Christensen et al., 2016; Yilmazer and Korth, 2016), and development of new hybrid QM/MM methods (”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Dixon and Merz, 1997

      Not checked in the free run.

    • cites Birgin et al., 2013 source

      Not checked in the free run.

    • cites Christensen et al., 2016 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    These non-classical interactions/effects are beyond the limits of classical methods and represent a significant challenge to the development of scoring functions for computational drug design.

    “These non-classical interactions/effects are beyond the limits of classical methods and represent a significant challenge to the development of scoring functions to be used in computational drug design experiments.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The development of docking methodologies to predict poses and binding affinities of ligands that bind covalently to the receptor is a challenging task.

    “The development of docking methodologies to predict poses and binding affinities of ligands that bind covalently to the receptor is a challenging task.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Metal ion interactions are essential when dealing with metalloproteins and, due to large changes in electronic structure under ligand binding, are also a great challenge.

    “In particular, metal ions interactions are essential when dealing with metalloproteins and, due to the large changes in the electronic structure under ligand binding, are also a great challenge.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Due to increasing interest in covalent drugs, many non-covalent docking programs have developed covalent versions and some new docking programs focused on covalent ligands have been developed.

    “Due to the increasing interest in covalent drugs, many non-covalent docking programs have developed covalent versions and some new docking programs focused on covalent ligands have been developed (Kumalo et al., 2015; Awoonor-Williams et al., 2017; De Cesco et al., 2017).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Kumalo et al., 2015 source

      Not checked in the free run.

    • cites Awoonor-Williams et al., 2017 source

      Not checked in the free run.

    • cites De Cesco et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    Two critical aspects in the future development of covalent scoring functions are the capacity to predict the kinetics of ligand binding and the intrinsic reactivity of electrophilic and nucleophilic pairs of atoms.

    “Two critical aspects in the future development of covalent scoring functions are the capacity to predict the kinetics of ligand binding (e.g., residence times) and the intrinsic reactivity of electrophilic and nucleophilic pairs of atoms (De Cesco et al., 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Cesco et al., 2017 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Advances in QM methods were essential to overcome the bottleneck of high computational cost and are allowing increasing use of QM methods in the prediction of protein-ligand binding affinities.

    “These advances were essential to overcome the bottleneck of the high computational cost and are allowing the increasing use of QM methods in the prediction of protein–ligand binding affinities (Crespo et al., 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Crespo et al., 2017 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    The use of quantum mechanical methods can improve the description of protein-ligand interactions and, in principle, could provide a more accurate binding affinity.

    “The use of quantum mechanical methods can improve the description of protein–ligand interactions and, in principle, could provide a more accurate binding affinity (Raha and Merz, 2005; Chaskar et al., 2017; Crespo et al., 2017; Cavasotto et al., 2018).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Raha and Merz, 2005

      Not checked in the free run.

    • cites Chaskar et al., 2017 source

      Not checked in the free run.

    • cites Crespo et al., 2017 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The XBScoreQM scoring function achieved good performance on both pose and affinity prediction when compared against 12 diverse scoring functions and increased predictive capacity for protein-ligand complexes with X-bond interactions.

    “The new scoring function achieved good performances on both pose and affinity prediction when compared against 12 diverse scoring functions, and increase predictive capacity to deal with protein–ligand complexes with X-bond interactions.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Yang et al., 2015 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Consensus scoring excels over individual scoring functions in docking-based VS and is less sensitive to protein target variation.

    “In addition, they compared their machine-learning-based CS with individual scoring functions and traditional CS schemed, confirming that CS excel individual scoring functions performances in docking-based VS, being less sensitive to protein target variation.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Ericksen et al., 2017 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Ericksen et al. (2017) developed machine-learning consensus scoring using discrete mixture models and gradient boosting to combine scores from eight docking programs and obtained improved performance over individual scoring functions on 21 targets from the DUD-E dataset.

    “For example, Ericksen et al. (2017) developed machine-learning CS using discrete mixture models and gradient boosting to combine the scores from eight docking programs and obtained improved performances than individual scoring functions on 21 targets from DUD-E dataset.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Ericksen et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    In recent years, the increasing availability of protein-ligand structures with measured binding affinities and datasets containing active, decoy, and true inactive compounds are boosting the use of sophisticated machine-learning techniques to obtain better performing scoring functions.

    “In recent years, the increasing availability of protein–ligand structures with measured binding affinities and data sets containing active, decoy, and true inactive compounds are boosting the use of sophisticated machine-learning techniques to obtain better performing scoring functions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Methodological advances will be dependent on the size and quality of the available datasets for training and benchmarking.

    “Methodological advances will be dependent to the size and quality of the available datasets for training and benchmarking”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Target-specific scoring functions trained with RF only performed slightly better than generic models, with two-thirds of them increasing EF1% less than 10%.

    “Still, in the recent work of Wójcikowski et al. (2017), the target-specific scoring functions trained with RF only performed slightly better than generic models, with two-third of them increasing the EF1% less than 10%.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wójcikowski et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisereasoning

    To overcome the lack of a sufficient amount of experimental structures, protein-ligand conformations used for training target-specific scoring functions are commonly obtained from docking experiments.

    “To overcome the lack of a sufficient amount of experimental structures, protein–ligand conformations used for training target-specific scoring functions are commonly obtained from docking experiments.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Inhibitors of protein-protein interactions interact in uncommon binding cavities characterized by higher hydrophobicity, aromaticity, and molecular weight compared to enzyme inhibitors, and usually within flatter, larger, and more hydrophobic binding sites than enzyme catalytic sites.

    “which interact in uncommon binding cavities characterized by higher hydrophobicity, aromaticity, and molecular weight compared to enzyme inhibitors, as usually interacting within flatter, larger, and more hydrophobic binding sites than the enzyme catalytic sites (Morelli et al., 2011; Kuenemann et al., 2014).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Morelli et al., 2011 source

      Not checked in the free run.

    • cites Kuenemann et al., 2014 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Reliable predictions of ligand binding affinity remain a big challenge.

    “Reliable predictions of ligand binding affinity remain a big challenge”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The development of accurate empirical scoring functions to predict protein–ligand binding affinities is a key aspect in SBDD.
  • May combine two claims.

    Premisecitation

    Tailored scoring functions are more beneficial for protein targets with fewer active compounds than for those containing more actives, where target-specific scoring functions exhibit similar performance to the generic model.

    “As an intriguing result, they found that tailored scoring functions are more beneficial for the protein targets with less active compounds than the others containing more actives, where the target-specific scoring functions exhibit similar performances to the generic model.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wójcikowski et al., 2017 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The requirement of a large training set to derive a robust scoring function might become a significant hindrance and source of inaccuracy.

    “Despite encouraging results obtained for target-specific scoring functions, it is important to highlight that the requirement of a large training set to derive a robust scoring function might become a significant hindrance and source of inaccuracy.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Target-specific scoring functions yield significant improvements in docking and VS accuracies compared to non-specific models when trained on target-specific protein–ligand complexes.
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Great care will be necessary to avoid artificial performances due to the increased capacity of nonlinear methods to capture bias present in the training data.

    “great care will be necessary to avoid artificial performances due to the increased capacity of these nonlinear methods to capture bias present in the training data.”
    Quote in the paperNot a substantial claim
71 of 71
  • The paper relies on this without support.

    Empirical scoring functions are widely used for pose and affinity prediction.

    “Empirical scoring functions are widely used for pose and affinity prediction.”
  • The paper relies on this without support.

    There is no universal scoring function with significant reliability for all molecular systems.

    “Although there is no universal scoring function with significant reliability for all molecular systems, some important strategies were explored.”
  • The paper relies on this without support.

    The methodology behind empirical scoring functions is fast enough to be used in large-scale structure-based VS and de novo design studies.

    “First, the methodology behind this type of scoring function could be fast enough to be used in large-scale structure-based VS and de novo design studies.”
  • The paper relies on this without support.

    The use of modern sophisticated machine-learning techniques and the increasing availability of protein–ligand structures and measured binding affinity data will increase the accuracy of empirical scoring functions enough to be useful in computer-aided SBDD experiments.

    “Secondly, the use of modern sophisticated machine-learning techniques and the increasing availability of protein–ligand structures and measured binding affinity data could increase considerably the accuracy of empirical scoring functions to be useful in computer-aided SBDD experiments.”
  • The authors state this as an assumption.

    All discussion in this review assumes that the inhibitors being dealt with are non-covalent.

    “All the discussion made in this review assumes that we are dealing with non-covalent inhibitors.”
  • The paper relies on this without support.

    Target-specific scoring functions yield significant improvements in docking and VS accuracies compared to non-specific models when trained on target-specific protein–ligand complexes.

    “Significant improvements in docking and VS accuracies are reported when employing target-specific scoring functions rather than non-specific models, using as training datasets protein–ligand complexes comprising specific molecular targets instead of a general dataset.”
  • The paper relies on this without support.

    The development of accurate empirical scoring functions to predict protein–ligand binding affinities is a key aspect in SBDD.

    “The development of accurate empirical scoring functions to predict protein–ligand binding affinities is a key aspect in SBDD.”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Rosetta all-atom scoring function often has severe limitations.

    “However, there are many limitations to these techniques, as they are dependent on databases of known structure, are computationally intensive (such as involving significant sampling), as well as being dependent on classical scoring functions, such as the Rosetta all-atom scoring function, which often have severe limitations [95].”
  • Classical antibody design techniques are dependent on databases of known structure.

    “However, there are many limitations to these techniques, as they are dependent on databases of known structure, are computationally intensive (such as involving significant sampling), as well as being dependent on classical scoring functions, such as the Rosetta all-atom scoring function, which often have severe limitations [95].”
  • Classical antibody design techniques are dependent on classical scoring functions.

    “However, there are many limitations to these techniques, as they are dependent on databases of known structure, are computationally intensive (such as involving significant sampling), as well as being dependent on classical scoring functions, such as the Rosetta all-atom scoring function, which often have severe limitations [95].”
  • Classical antibody design techniques are computationally intensive, involving significant sampling.

    “However, there are many limitations to these techniques, as they are dependent on databases of known structure, are computationally intensive (such as involving significant sampling), as well as being dependent on classical scoring functions, such as the Rosetta all-atom scoring function, which often have severe limitations [95].”

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. Abu-Mostafa, 2012, Learning From Data.
  2. Friesner, Extra precision glide: docking and scoring incorporating a model of hydrophobic enclosure for protein-ligand complexes., J. Med. Chem., 49, 6177, 10.1021/jm051256o · DOI
  3. Guedes, 2016, Development of empirical scoring functions for predicting protein-ligand binding affinity., Soc. Bras. Bioquim. Biol. Mol., 1

Cited by

Sorted by citations

Authors
Guedes, I. A., Pereira, F. S. S., & Dardenne, L. E.
Affiliations
Laboratório Nacional de Computação Científica (BR)
Corresponding author
Dardenne, Laurent E.
Venue
Frontiers in Pharmacology
Published
2018-09-24
Volume
9
Pages
1089-1089
ISSN
1663-9812 (ISSN-L)
OpenAlex
W2893435209
Cited by
331
References
239
Citations by year
2026: 38 · 2025: 45 · 2024: 41 · 2023: 52 · 2022: 50 · 2021: 47 · 2020: 36 · 2019: 19 · 2018: 1 · 2012: 1
FWCI
2.07
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Pharmacology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Conselho Nacional de Desenvolvimento Científico e Tecnológico
  • Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro
Topics
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › vaccines and immunoinformatics approaches
  • Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
Keywords
empirical scoring function, structure-based virtual screening, molecular docking, binding affinity prediction, pose prediction, solvent effects, machine learning, quantum mechanics, lead compound design, compound ranking

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review