Cited by 9Lipid Membrane Structure and BehaviorProtein Structure and DynamicsCaveolin-1 and cellular processes

Free Energy of Membrane Pore Formation and Stability from Molecular Dynamics Simulations

Open access
Rivel, Timothée, Biriukov, Denys, Kabelka, Ivo, Vácha, Robert·2025·Journal of Chemical Information and Modeling

Abstract

High Resolution Image Download MS PowerPoint Slide Understanding the molecular mechanisms of pore formation is crucial for elucidating fundamental biological processes and developing therapeutic strategies, such as the design of drug delivery systems and antimicrobial agents. Although experimental methods can provide valuable information, they often lack the temporal and spatial resolution necessary to fully capture the dynamic stages of pore formation. In this study, we present two novel collective variables (CVs) designed to characterize membrane pore behavior, particularly its energetics, through molecular dynamics (MD) simulations. The first CV─termed Full-Path─effectively tracks both the nucleation and expansion phases of pore formation. The second CV─called Rapid─is tailored to accurately assess pore expansion in the limit of large pores, providing quick and reliable method for evaluating membrane line tension under various conditions. Our results clearly demonstrate that the line tension predictions from both our CVs are in excellent agreement. Moreover, these predictions align qualitatively with available experimental data. Specifically, they reflect higher line tension of 1-palmitoyl-2-oleoyl- sn -glycero-3-phosphocholine (POPC) membranes containing 1-palmitoyl-2-oleoyl- sn -glycero-3-phospho- l -serine (POPS) lipids compared to pure POPC, the decrease in line tension of POPC vesicles as the 1-palmitoyl-2-oleoyl- sn -glycero-3-phosphoglycerol (POPG) content increases, and higher line tension when ionic concentration is increased. Notably, these experimental trends are accurately captured only by the all-atom CHARMM36 and prosECCo75 force fields. In contrast, the all-atom Slipids force field, along with the coarse-grained Martini 2.2, Martini 2.2 polarizable, and Martini 3 models, show varying degrees of agreement with experiments. Our developed CVs can be adapted to various MD simulation engines for studying pore formation, with potential implications in membrane biophysics. They are also applicable to simulations involving external agents, offering an efficient alternative to existing methodologies.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1021/acs.jcim.4c01960

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Fusion is initiated by the formation of pores in the opposing membranes stimulated by the electric field.

    “Rather, fusion is initiated by the formation of pores 21 in the opposing membranes stimulated by the electric field.”

    From Fusion of lipid membranes: an alternative pathway (2026) · cites this paper as [21]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 69

  1. Kabelka I.; Vácha R. Advances in Molecular Understanding of α-Helical Membrane-Active Peptides. Acc. Chem. Res. 2021, 54, 2196– 2204. 10.1021/acs.accounts.1c00047. 33844916 · DOI
  2. Brogden K. A. Antimicrobial peptides: Pore formers or metabolic inhibitors in bacteria?. Nat. Rev. Microbiol. 2005, 3, 238– 250. 10.1038/nrmicro1098. 15703760 · DOI · Paper page
  3. Boukany P. E.; et al. Nanochannel electroporation delivers precise amounts of biomolecules into living cells. Nat. Nanotechnol. 2011, 6, 747– 754. 10.1038/nnano.2011.164. 22002097 · DOI
  4. Lee M. T.; Chen F. Y.; Huang H. W. Energetics of Pore Formation Induced by Membrane Active Peptides. Biochemistry 2004, 43, 3590– 3599. 10.1021/bi036153r. 15035629 · DOI
  5. Qian S.; Wang C.; Yang L.; Huang H. W. Structure of transmembrane pore induced by Bax-derived peptide: Evidence for lipidic pores. Proc. Natl. Acad. Sci. U. S. A. 2008, 105, 17379– 17383. 10.1073/pnas.0807764105. 18987313 PMC2582298 · DOI
  6. Qian S.; Wang C.; Yang L.; Huang H. W. Structure of the alamethicin pore reconstructed by x-ray diffraction analysis. Biophys. J. 2008, 94, 3512– 3522. 10.1529/biophysj.107.126474. 18199659 PMC2292392 · DOI
  7. Afonin S.; Dürr U. H.; Wadhwani P.; Salgado J.; Ulrich A. S. Solid state NMR structure analysis of the antimicrobial peptide gramicidin s in lipid membranes: Concentration-dependent re-alignment and self-assembly as a β-barrel. Top. Curr. Chem. 2008, 273, 139– 154. 10.1007/128_2007_20. 23605461 · DOI
  8. Esteban-Martín S.; Strandberg E.; Salgado J.; Ulrich A. S. Solid state NMR analysis of peptides in membranes: Influence of dynamics and labeling scheme. Biochim. Biophys. Acta - Biomembr. 2010, 1798, 252– 257. 10.1016/j.bbamem.2009.08.010. 19715662 · DOI
  9. Aisenbrey C.; Marquette A.; Bechinger B. Adv. Exp. Med. Biol. 2019, 1117, 33– 64. 10.1007/978-981-13-3588-4_4. 30980352 · DOI
  10. García-Sáez A. J.; Chiantia S.; Salgado J.; Schwille P. Pore formation by a bax-derived peptide: Effect on the line tension of the membrane probed by AFM. Biophys. J. 2007, 93, 103– 112. 10.1529/biophysj.106.100370. 17416629 PMC1914428 · DOI
  11. Henderson J. M.; Waring A. J.; Separovic F.; Lee K. Y. C. Antimicrobial Peptides Share a Common Interaction Driven by Membrane Line Tension Reduction. Biophys. J. 2016, 111, 2176– 2189. 10.1016/j.bpj.2016.10.003. 27851941 PMC5113125 · DOI
  12. Kakorin S.; Neumann E. Ionic conductivity of electroporated lipid bilayer membranes. Bioelectrochemistry 2002, 56, 163– 166. 10.1016/s1567-5394(02)00040-3. 12009466 · DOI
  13. Song C.; Weichbrodt C.; Salnikov E. S.; Dynowski M.; Forsberg B. O.; Bechinger B.; Steinem C.; De Groot B. L.; Zachariae U.; Zeth K. Crystal structure and functional mechanism of a human antimicrobial membrane channel. Proc. Natl. Acad. Sci. U. S. A. 2013, 110, 4586– 4591. 10.1073/pnas.1214739110. 23426625 PMC3607029 · DOI
  14. Kirsch S. A.; Böckmann R. A. Membrane pore formation in atomistic and coarse-grained simulations. Biochim. Biophys. Acta - Biomembr. 2016, 1858, 2266– 2277. 10.1016/j.bbamem.2015.12.031. 26748016 · DOI
  15. Dixit M.; Lazaridis T. Free energy of hydrophilic and hydrophobic pores in lipid bilayers by free energy perturbation of a restraint. J. Chem. Phys. 2020, 153, 054101 10.1063/5.0016682. 32770888 PMC7928062 · DOI
  16. Bubnis G.; Grubmüller H. Sequential Water and Headgroup Merger: Membrane Poration Paths and Energetics from MD Simulations. Biophys. J. 2020, 119, 2418– 2430. 10.1016/j.bpj.2020.10.037. 33189685 PMC7822740 · DOI
  17. Awasthi N.; Hub J. S. Simulations of pore formation in lipid membranes: Reaction coordinates, convergence, hysteresis, and finite-size effects. J. Chem. Theory Comput. 2016, 12, 3261– 3269. 10.1021/acs.jctc.6b00369. 27254744 · DOI
  18. Hub J. S.; Awasthi N. Probing a Continuous Polar Defect: A Reaction Coordinate for Pore Formation in Lipid Membranes. J. Chem. Theory Comput. 2017, 13, 2352– 2366. 10.1021/acs.jctc.7b00106. 28376619 · DOI
  19. Hub J. S. Joint Reaction Coordinate for Computing the Free-Energy Landscape of Pore Nucleation and Pore Expansion in Lipid Membranes. J. Chem. Theory Comput. 2021, 17, 1229– 1239. 10.1021/acs.jctc.0c01134. 33427469 · DOI
  20. Tribello G. A.; Bonomi M.; Branduardi D.; Camilloni C.; Bussi G. PLUMED 2: New feathers for an old bird. Comput. Phys. Commun. 2014, 185, 604– 613. 10.1016/j.cpc.2013.09.018. · DOI
  21. Abraham M. J.; Murtola T.; Schulz R.; Páll S.; Smith J. C.; Hess B.; Lindah E. Gromacs: High performance molecular simulations through multi-level parallelism from laptops to supercomputers. SoftwareX 2015, 1–2, 19– 25. 10.1016/j.softx.2015.06.001. · DOI · Paper page
  22. Jo S.; Lim J. B.; Klauda J. B.; Im W. CHARMM-GUI membrane builder for mixed bilayers and its application to yeast membranes. Biophys. J. 2009, 97, 50– 58. 10.1016/j.bpj.2009.04.013. 19580743 PMC2711372 · DOI
  23. Wu E. L.; Cheng X.; Jo S.; Rui H.; Song K. C.; Dávila-Contreras E. M.; Qi Y.; Lee J.; Monje-Galvan V.; Venable R. M.; Klauda J. B.; Im W. CHARMM-GUI membrane builder toward realistic biological membrane simulations. J. Comput. Chem. 2014, 35, 1997– 2004. 10.1002/jcc.23702. 25130509 PMC4165794 · DOI
  24. Lee J.; et al. CHARMM-GUI Input Generator for NAMD, GROMACS, AMBER, OpenMM, and CHARMM/OpenMM Simulations Using the CHARMM36 Additive Force Field. J. Chem. Theory Comput. 2016, 12, 405– 413. 10.1021/acs.jctc.5b00935. 26631602 PMC4712441 · DOI
  25. Klauda J. B.; Venable R. M.; Freites J. A.; O’Connor J. W.; Tobias D. J.; Mondragon-Ramirez C.; Vorobyov I.; MacKerell A. D.; Pastor R. W. Update of the CHARMM All-Atom Additive Force Field for Lipids: Validation on Six Lipid Types. J. Phys. Chem. B 2010, 114, 7830– 7843. 10.1021/jp101759q. 20496934 PMC2922408 · DOI
  26. Venable R. M.; Luo Y.; Gawrisch K.; Roux B.; Pastor R. W. Simulations of anionic lipid membranes: Development of interaction-specific ion parameters and validation using NMR data. J. Phys. Chem. B 2013, 117, 10183– 10192. 10.1021/jp401512z. 23924441 PMC3813009 · DOI
  27. Marrink S. J.; Risselada H. J.; Yefimov S.; Tieleman D. P.; De Vries A. H. The MARTINI force field: Coarse grained model for biomolecular simulations. J. Phys. Chem. B 2007, 111, 7812– 7824. 10.1021/jp071097f. 17569554 · DOI
  28. Yesylevskyy S. O.; Schäfer L. V.; Sengupta D.; Marrink S. J. Polarizable water model for the coarse-grained MARTINI force field. PLoS Comput. Biol. 2010, 6, e1000810 10.1371/journal.pcbi.1000810. 20548957 PMC2883601 · DOI
  29. Jorgensen W. L.; Chandrasekhar J.; Madura J. D.; Impey R. W.; Klein M. L. Comparison of simple potential functions for simulating liquid water. J. Chem. Phys. 1983, 79, 926– 935. 10.1063/1.445869. · DOI
  30. Durell S. R.; Brooks B. R.; Ben-Naim A. Solvent-induced forces between two hydrophilic groups. J. Phys. Chem. 1994, 98, 2198– 2202. 10.1021/j100059a038. · DOI
  31. Páll S.; Hess B. A flexible algorithm for calculating pair interactions on SIMD architectures. Comput. Phys. Commun. 2013, 184, 2641– 2650. 10.1016/j.cpc.2013.06.003. · DOI
  32. Darden T.; York D.; Pedersen L. Particle mesh Ewald: An N·log(N) method for Ewald sums in large systems. J. Chem. Phys. 1993, 98, 10089– 10092. 10.1063/1.464397. · DOI
  33. Essmann U.; Perera L.; Berkowitz M. L.; Darden T.; Lee H.; Pedersen L. G. A smooth particle mesh Ewald method. J. Chem. Phys. 1995, 103, 8577– 8593. 10.1063/1.470117. · DOI
  34. Shirts M. R.; Mobley D. L.; Chodera J. D.; Pande V. S. Accurate and efficient corrections for missing dispersion interactions in molecular simulations. J. Phys. Chem. B 2007, 111, 13052– 13063. 10.1021/jp0735987. 17949030 · DOI
  35. Nosé S. A molecular dynamics method for simulations in the canonical ensemble. Mol. Phys. 1984, 52, 255– 268. 10.1080/00268978400101201. · DOI
  36. Hoover W. G. Canonical dynamics: Equilibrium phase-space distributions. Phys. Rev. A 1985, 31, 1695– 1697. 10.1103/PhysRevA.31.1695. 9895674 · DOI
  37. Bussi G.; Donadio D.; Parrinello M. Canonical sampling through velocity rescaling. J. Chem. Phys. 2007, 126, 014101 10.1063/1.2408420. 17212484 · DOI
  38. Berendsen H. J.; Postma J. P.; Van Gunsteren W. F.; Dinola A.; Haak J. R. Molecular dynamics with coupling to an external bath. J. Chem. Phys. 1984, 81, 3684– 3690. 10.1063/1.448118. · DOI
  39. Parrinello M.; Rahman A. Polymorphic transitions in single crystals: A new molecular dynamics method. J. Appl. Phys. 1981, 52, 7182– 7190. 10.1063/1.328693. · DOI
  40. Berger O.; Edholm O.; Jähnig F. Molecular dynamics simulations of a fluid bilayer of dipalmitoylphosphatidylcholine at full hydration, constant pressure, and constant temperature. Biophys. J. 1997, 72, 2002– 2013. 10.1016/S0006-3495(97)78845-3. 9129804 PMC1184396 · DOI
  41. Dickson C. J.; Madej B. D.; Skjevik Å. A.; Betz R. M.; Teigen K.; Gould I. R.; Walker R. C. Lipid14: The amber lipid force field. J. Chem. Theory Comput. 2014, 10, 865– 879. 10.1021/ct4010307. 24803855 PMC3985482 · DOI
  42. Jämbeck J. P.; Lyubartsev A. P. An extension and further validation of an all-atomistic force field for biological membranes. J. Chem. Theory Comput. 2012, 8, 2938– 2948. 10.1021/ct300342n. 26592132 · DOI
  43. Jämbeck J. P.; Lyubartsev A. P. Derivation and systematic validation of a refined all-atom force field for phosphatidylcholine lipids. J. Phys. Chem. B 2012, 116, 3164– 3179. 10.1021/jp212503e. 22352995 PMC3320744 · DOI
  44. Jämbeck J. P.; Lyubartsev A. P. Another piece of the membrane puzzle: Extending slipids further. J. Chem. Theory Comput. 2013, 9, 774– 784. 10.1021/ct300777p. 26589070 · DOI
  45. Grote F.; Lyubartsev A. P. Optimization of Slipids Force Field Parameters Describing Headgroups of Phospholipids. J. Phys. Chem. B 2020, 124, 8784– 8793. 10.1021/acs.jpcb.0c06386. 32926619 PMC7584372 · DOI
  46. Michaud-Agrawal N.; Denning E. J.; Woolf T. B.; Beckstein O. MDAnalysis: A toolkit for the analysis of molecular dynamics simulations. J. Comput. Chem. 2011, 32, 2319– 2327. 10.1002/jcc.21787. 21500218 PMC3144279 · DOI
  47. Starke L. J.; Allolio C.; Hub J. S. Pore formation in complex biological membranes: torn between evolutionary needs. bioRxiv 2024, 10.1101/2024.05.06.592649. · DOI
  48. Hub J. S.; De Groot B. L.; Van Der Spoel D. G-whams-a free Weighted Histogram Analysis implementation including robust error and autocorrelation estimates. J. Chem. Theory Comput. 2010, 6, 3713– 3720. 10.1021/ct100494z. · DOI
  49. Nencini R.; Tempra C.; Biriukov D.; Riopedre-Fernandez M.; Chamorro V. C.; Polák J.; Mason P. E.; Ondo D.; Heyda J.; Ollila O. H. S.; Jungwirth P.; Javanainen M.; Martinez-Seara H. Effective Inclusion of Electronic Polarization Improves the Description of Electrostatic Interactions: The prosECCo75 Biomolecular Force Field. J. Chem. Theory Comput. 2024, 20, 7546– 7559. 10.1021/acs.jctc.4c00743. 39186899 PMC11391585 · DOI
  50. Lira R. B.; Leomil F. S.; Melo R. J.; Riske K. A.; Dimova R. To Close or to Collapse: The Role of Charges on Membrane Stability upon Pore Formation. Adv. Sci. 2021, 8, 2004068 10.1002/advs.202004068. PMC8188222 34105299 · DOI
  51. Åqvist J. Ion-water interaction potentials derived from free energy perturbation simulations. J. Phys. Chem. 1990, 94, 8021– 8024. 10.1021/j100384a009. · DOI
  52. Smith D. E.; Dang L. X. Computer simulations of NaCl association in polarizable water. J. Chem. Phys. 1994, 100, 3757– 3766. 10.1063/1.466363. · DOI
  53. Wang Z. J.; Frenkel D. Pore nucleation in mechanically stretched bilayer membranes. J. Chem. Phys. 2005, 123, 154701 10.1063/1.2060666. 16252963 · DOI
  54. Shinoda W.; Nakamura T.; Nielsen S. O. Free energy analysis of vesicle-to-bicelle transformation. Soft Matter 2011, 7, 9012– 9020. 10.1039/c1sm05404j. · DOI
  55. Kabelka I.; Vácha R. Optimal conditions for opening of membrane pore by amphiphilic peptides. J. Chem. Phys. 2015, 143, 243115 10.1063/1.4933229. 26723600 · DOI
  56. Bennett W. F.; Sapay N.; Tieleman D. P. Atomistic simulations of pore formation and closure in lipid bilayers. Biophys. J. 2014, 106, 210– 219. 10.1016/j.bpj.2013.11.4486. 24411253 PMC3907245 · DOI
  57. Akimov S. A.; Volynsky P. E.; Galimzyanov T. R.; Kuzmin P. I.; Pavlov K. V.; Batishchev O. V. Pore formation in lipid membrane I: Continuous reversible trajectory from intact bilayer through hydrophobic defect to transversal pore. Sci. Rep. 2017, 7, 12152 10.1038/s41598-017-12127-7. 28939906 PMC5610326 · DOI
  58. Srividya N.; Muralidharan S. Determination of the line tension of giant vesicles from pore-closing dynamics. J. Phys. Chem. B 2008, 112, 7147– 7152. 10.1021/jp7119203. 18503265 · DOI
  59. Antila H. S.; Ferreira T. M.; Ollila O. H.; Miettinen M. S. Using Open Data to Rapidly Benchmark Biomolecular Simulations: Phospholipid Conformational Dynamics. J. Chem. Inf. Model. 2021, 61, 938– 949. 10.1021/acs.jcim.0c01299. 33496579 PMC7903423 · DOI
  60. Kiirikki A. M.; et al. Overlay databank unlocks data-driven analyses of biomolecules for all. Nat. Commun. 2024, 15, 1136 10.1038/s41467-024-45189-z. 38326316 PMC10850068 · DOI · Paper page
  61. Richardson J. D.; Van Lehn R. C. Free Energy Analysis of Peptide-Induced Pore Formation in Lipid Membranes by Bridging Atomistic and Coarse-Grained Simulations. J. Phys. Chem. B 2024, 36, 8737– 8752. 10.1021/acs.jpcb.4c03276. 39207202 · DOI
  62. Levadny V.; Tsuboi T. A.; Belaya M.; Yamazaki M. Rate constant of tension-induced pore formation in lipid membranes. Langmuir 2013, 29, 3848– 3852. 10.1021/la304662p. 23472875 · DOI
  63. Karal M. A. S.; Billah M. M.; Ahamed M. K. Determination of pore edge tension from the kinetics of rupture of giant unilamellar vesicles using the Arrhenius equation: effects of sugar concentration, surface charge and cholesterol. Phys. Chem. Chem. Phys. 2024, 26, 6107– 6117. 10.1039/D3CP04451C. 38299672 · DOI
  64. Kramar P.; Miklavčič D.; Lebar A. M. A system for the determination of planar lipid bilayer breakdown voltage and its applications. IEEE Trans. Nanobioscience 2009, 8, 132– 138. 10.1109/TNB.2009.2022834. 19457754 · DOI
  65. Lebar A. M.; Miklavčič D.; Kotulska M.; Kramar P. Water pores in planar lipid bilayers at fast and slow rise of transmembrane voltage. Membranes 2021, 11, 263 10.3390/membranes11040263. 33916447 PMC8067013 · DOI
  66. Catte A.; Girych M.; Javanainen M.; Loison C.; Melcr J.; Miettinen M. S.; Monticelli L.; Määttä J.; Oganesyan V. S.; Ollila O. H.; Tynkkynen J.; Vilov S. Molecular electrometer and binding of cations to phospholipid bilayers. Phys. Chem. Chem. Phys. 2016, 18, 32560– 32569. 10.1039/C6CP04883H. 27874109 · DOI
  67. Pajtinka P.; Vácha R. Amphipathic Helices Can Sense Both Positive and Negative Curvatures of Lipid Membranes. J. Phys. Chem. Lett. 2024, 15, 175– 179. 10.1021/acs.jpclett.3c02785. 38153203 PMC10788957 · DOI
  68. Mou Q.; Xu M.; Deng J.; Hu N.; Yang J. Studying the roles of salt ions in the pore initiation and closure stages in the biomembrane electroporation. APL Bioeng. 2023, 7, 026103 10.1063/5.0147104. 37180734 PMC10168715 · DOI
  69. Karal M. A. S.; Orchi U. S.; Towhiduzzaman M.; Ahamed M. K.; Ahmed M.; Ahammed S.; Mokta N. A.; Sharmin S.; Sarkar M. K. Electrostatic effects on the electrical tension-induced irreversible pore formation in giant unilamellar vesicles. Chem. Phys. Lipids 2020, 231, 104935 10.1016/j.chemphyslip.2020.104935. 32569600 · DOI

Cited by

Sorted by citations

Authors
Rivel, T., Biriukov, D., Kabelka, I., & Vácha, R.
Affiliations
  • Central European Institute of Technology – Masaryk University (CZ)
  • Masaryk University (CZ)
Corresponding author
Vácha, Robert
Venue
Journal of Chemical Information and Modeling
Published
2025-01-10
Volume
65
Issue
2
Pages
908-920
ISSN
  • 1549-9596 (ISSN-L)
  • 1549-960X
OpenAlex
W4406235549
Cited by
9
References
1
Citations by year
2026: 7 · 2025: 2
FWCI
2.49
Type
journal article
Language
en
Open access
Locations
  • Journal of Chemical Information and Modeling (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Veřejné služby Informačního systému (Masarykiana Brunensis Universitas) (submittedVersion, cc-by)
Funders
  • Ministerstvo ?kolstv?, Ml?de?e a Telov?chovy (CZ.02.01.01/00/22_010/0003229, LX22NPO5103)
  • H2020 European Research Council (101001470)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Lipid Membrane Structure and Behavior
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Cell Biology › Caveolin-1 and cellular processes
Keywords
pore formation, collective variables, pore nucleation, pore expansion, POPC membrane, ionic concentration effects, force field comparison, CHARMM36, Martini coarse-grained model, lipid vesicles
MeSH terms
Cell Membrane, Lipid Bilayers, Phosphatidylcholines, Thermodynamics, Porosity, Molecular Dynamics Simulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review