Characterizing the chemical landscape in commercial e-cigarette liquids and aerosols by liquid chromatography–high-resolution mass spectrometry
Open accessAbstract
The surge in electronic cigarette (e-cig) use in recent years has raised questions on chemical exposures that may result from vaping. Previous studies have focused on measuring known toxicants, particularly those present in traditional cigarettes, while fewer have investigated unknown compounds and transformation products formed during the vaping process in these diverse and constantly evolving products. The primary aim of this work was to apply liquid chromatography-high-resolution mass spectrometry (LC-HRMS) and chemical fingerprinting techniques for the characterization of e-liquids and aerosols from a selection of popular e-cig products. We conducted nontarget and quantitative analyses of tobacco-flavored e-liquids and aerosols generated using four popular e-cig products: one disposable, two pod, and one tank/mod. Aerosols were collected using a condensation device and analyzed in solution alongside e-liquids by LC-HRMS. The number of compounds detected increased from e-liquids to aerosols in three of four commercial products, as did the proportion of condensed-hydrocarbon-like compounds, associated with combustion. Kendrick mass defect analysis suggested that some of the additional compounds detected in aerosols belonged to homologous series resulting from decomposition of high-molecular-weight compounds during vaping. Lipids in inhalable aerosols have been associated with severe respiratory effects, and lipid-like compounds were observed in aerosols as well as e-liquids analyzed. Six potentially hazardous additives and contaminants, including the industrial chemical tributylphosphine oxide and the stimulant caffeine, were identified and quantified in the e-cig liquids and aerosols analyzed. The obtained findings demonstrate the potential of nontarget LC-HRMS to identify previously unknown compounds and compound classes in e-cig liquids and aerosols, which is critical for the assessment of chemical exposures resulting from vaping.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A 2021 study by researchers at Johns Hopkins University revealed that vaping aerosols contain nearly 2000 distinct chemicals.
“Evidence-based international data, such as a 2021 study by researchers at Johns Hopkins University revealing that vaping aerosols contain nearly 2000 distinct chemicals”
From Mobilizing for Health: A Case Study of Kazakhstan’s Vaping Ban Advocacy Campaign (2025) · cites this paper as [17]
The Results and Discussion section reports compounds detected in e-cigarette aerosols and says the count increased after vaping for most products. The passages available from our copy do not give a count of nearly 2,000 distinct chemicals, so that numerical part of the claim is not supported. (LLM, conf=0.78)
Experimental — accuracy not yet measuredVaping is linked to serious health conditions such as EVALI, a severe respiratory illness responsible for multiple deaths globally.
“It was crucial to emphasize the link between vaping and serious health conditions, such as EVALI, a severe respiratory illness responsible for multiple deaths globally [17].”
From Mobilizing for Health: A Case Study of Kazakhstan’s Vaping Ban Advocacy Campaign (2025) · cites this paper as [17]
The Introduction identifies the 2019 EVALI outbreak as an example of health effects associated with vaping, and the Abstract links compounds in inhalable aerosols to severe respiratory effects. Neither passage reports deaths or establishes that EVALI caused multiple deaths globally. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 56
- [1]Schmidt S Vaper, Beware: The Unique Toxicological Profile of Electronic Cigarettes. EHP. 2020, pp 1– 10. PMC7263459 32363917
- [2]National Academies of Sciences Engineering and Medicine. Public Health Consequences of E-Cigarettes; Stratton K, Kwan LY, Eaton DL, Eds.; The National Academies Press: Washington, D.C., 2018. 10.17226/24737. 29894118 · DOI
- [3]Miech R; Johnston L; O’Malley PM; Bachman JG; Patrick ME Trends in Adolescent Vaping, 2017–2019. N. Engl. J. Med 2019, 381 (15), 1490– 1491. 10.1056/nejmc1910739. 31532955 PMC7310772 · DOI
- [4]Cheng T Chemical Evaluation of Electronic Cigarettes. Tob. Control 2014, 23 (SUPPL. 2). 10.1136/tobaccocontrol-2013-051482. PMC3995255 24732157 · DOI
- [5]Wei B; Goniewicz M; O’Connor RJ Concurrent Quantification of Emerging Chemicals of Health Concern in E-Cigarette Liquids by High-Performance Liquid Chromatography-Tandem Mass Spectrometry. ACS Omega 2019, 4 (13), 15364– 15372. 10.1021/acsomega.9b01255. 31572835 PMC6761617 · DOI
- [6]Jensen RP; Strongin RM; Peyton DH Solvent Chemistry in the Electronic Cigarette Reaction Vessel. Sci. Rep 2017, 7, 1– 11. 10.1038/srep42549. 28195231 PMC5307352 · DOI
- [7]Sassano MF; Davis ES; Keating JE; Zorn BT; Kochar TK; Wolfgang MC; Glish GL; Tarran R Evaluation of E-Liquid Toxicity Using an Open-Source High-Throughput Screening Assay. PLoS Biol. 2018, 16 (3), 1– 24. 10.1371/journal.pbio.2003904. PMC5870948 29584716 · DOI
- [8]Salam S; Saliba NA; Shihadeh A; Eissenberg T; El-hellani A Flavor-Toxicant Correlation in E-cigarettes: A Meta-Analysis. 2020. 10.1021/acs.chemrestox.0c00247. PMC7759004 33185445 · DOI
- [12]Jiang H; Ahmed CMS; Martin TJ; Canchola A; Oswald IWH; Garcia JA; Chen JY; Koby K; Zhao Z; Zhang H; Chen K; Lin Y Chemical and Toxicological Characterization of Vaping Emission Products from Commonly Used Vape Juice Diluents. Chem. Res. Toxicol 2020. 10.1021/acs.chemrestox.0c00174. 32618192 · DOI
- [13]Olmedo P; Goessler W; Tanda S; Grau-Perez M; Jarmul S; Aherrera A; Chen R; Hilpert M; Cohen JE; Navas-Acien A; Rule AM Metal Concentrations in E-Cigarette Liquid and Aerosol Samples: The Contribution of Metallic Coils. Environ. Health Perspect 2018, 126 (02). 10.1289/EHP2175. PMC6066345 29467105 · DOI
- [14]Wei B; Connor RJO; Goniewicz ML; Hyland A Emerging Chemicals of Health Concern in Electronic Nicotine Delivery Systems. Chem. Res. Toxicol 2020. 10.1021/acs.chemrestox.0c00281. PMC7582622 32880169 · DOI
- [15]Salamanca JC; Meehan-Atrash J; Vreeke S; Escobedo JO; Peyton DH; Strongin RM E-Cigarettes Can Emit Formaldehyde at High Levels under Conditions That Have Been Reported to Be Non-Averse to Users. Sci. Rep 2018, 8 (1), 6– 11. 10.1038/s41598-018-25907-6. 29765089 PMC5954153 · DOI
- [16]Uchiyama S; Noguchi M; Sato A; Ishitsuka M; Inaba Y; Kunugita N Determination of Thermal Decomposition Products Generated from E-Cigarettes. Chem. Res. Toxicol 2020. 10.1021/acs.chemrestox.9b00410. 31950825 · DOI
- [17]Tierney PA; Karpinski CD; Brown JE; Luo W; Pankow JF Flavour Chemicals in Electronic Cigarette Fluids. Tob. Control 2016, 25 (E1), e10– e15. 10.1136/tobaccocontrol-2014-052175. 25877377 PMC4853541 · DOI
- [18]Omaiye E; McWhirter K; Luo W; Pankow J; Talbot P Toxicity of JUUL Fluids and Aerosols Correlates Strongly with Nicotine and Some Flavor Chemical Concentrations. Chem. Res. Toxicol 2018, 1– 19. 10.1101/490607. PMC6579667 30896936 · DOI
- [19]Erythropel HC; Anastas PT; Krishnan-Sarin S; O’Malley SS; Jordt SE; Zimmerman JB Differences in Flavourant Levels and Synthetic Coolant Use between USA, EU and Canadian Juul Products. Tob. Control 2020, 1– 4. 10.1136/tobaccocontrol-2019-055500. 32341193 PMC7606218 · DOI
- [20]Rawlinson C; Martin S; Frosina J; Wright C Chemical Characterisation of Aerosols Emitted by Electronic Cigarettes Using Thermal Desorption–Gas Chromatography–Time of Flight Mass Spectrometry. J. Chromatogr. A 2017, 1497, 144– 154. 10.1016/j.chroma.2017.02.050. 28381359 · DOI
- [21]Herrington JS; Myers C Electronic Cigarette Solutions and Resultant Aerosol Profiles. J. Chromatogr. A 2015, 1418, 192– 199. 10.1016/j.chroma.2015.09.034. 26422308 · DOI
- [22]Wang J; Chow W; Chang J; Wong JW Ultrahigh-Performance Liquid Chromatography Electrospray Ionization Q-Orbitrap Mass Spectrometry for the Analysis of 451 Pesticide Residues in Fruits and Vegetables: Method Development and Validation. J. Agric. Food Chem 2014, 62 (42), 10375– 10391. 10.1021/jf503778c. 25265038 · DOI
- [23]Hollender J; Schymanski EL; Singer HP; Ferguson PL Nontarget Screening with High Resolution Mass Spectrometry in the Environment: Ready to Go? Environ. Sci. Technol 2017, 51 (20), 11505– 11512. 10.1021/acs.est.7b02184. 28877430 · DOI
- [24]Zubarev RA; Makarov A Orbitrap Mass Spectrometry. Anal. Chem 2013, 85 (11), 5288– 5296. 10.1021/ac4001223. 23590404 · DOI
- [25]Pan Q; Zhuo X; He C; Zhang Y; Shi Q Validation and Evaluation of High-Resolution Orbitrap Mass Spectrometry on Molecular Characterization of Dissolved Organic Matter. ACS Omega 2020, 5 (10), 5372– 5379. 10.1021/acsomega.9b04411. 32201827 PMC7081437 · DOI
- [26]Sanchís J; Jaén-Gil A; Gago-Ferrero P; Munthali E; Farré MJ Characterization of Organic Matter by HRMS in Surface Waters: Effects of Chlorination on Molecular Fingerprints and Correlation with DBP Formation Potential. Water Res. 2020, 176. 10.1016/j.watres.2020.115743. 32272321 · DOI
- [27]Knolhoff AM; Kneapler CN; Croley TR Optimized Chemical Coverage and Data Quality for Non-Targeted Screening Applications Using Liquid Chromatography/High-Resolution Mass Spectrometry. Anal. Chim. Acta 2019, 1066, 93– 101. 10.1016/j.aca.2019.03.032. 31027538 · DOI
- [28]Waldner BJ; Machalett R; Schönbichler S; Dittmer M; Rubner MM; Intelmann D Fast Evaluation of Herbal Substance Class Composition by Relative Mass Defect Plots. Anal. Chem 2020. 10.1021/acs.analchem.0c01447. 32902254 · DOI
- [29]Talih S; Salman R; El-Hage R; Karam E; Karaoghlanian N; El-Hellani A; Saliba N; Shihadeh A Characteristics and Toxicant Emissions of JUUL Electronic Cigarettes. Tob. Control 2019, 28 (6), 678– 680. 10.1136/tobaccocontrol-2018-054616. 30745326 PMC7341718 · DOI
- [30]El-Hellani A; Salman R; El-Hage R; Talih S; Malek N; Baalbaki R; Karaoghlanian N; Nakkash R; Shihadeh A; Saliba NA Nicotine and Carbonyl Emissions from Popular Electronic Cigarette Products: Correlation to Liquid Composition and Design Characteristics. Nicotine Tob. Res 2018, 20 (2), 215– 223. 10.1093/ntr/ntw280. 27798087 PMC5896517 · DOI
- [31]Wieczorek R; Phillips G; Czekala L; Trelles Sticken E; O’Connell G; Simms L; Rudd K; Stevenson M; Walele T A Comparative in Vitro Toxicity Assessment of Electronic Vaping Product E-Liquids and Aerosols with Tobacco Cigarette Smoke. Toxicol. Vitr 2020, 66 (April), 104866. 10.1016/j.tiv.2020.104866. 32353510 · DOI
- [32]Shao XM; Friedman TC Pod-Mod vs. Conventional e-Cigarettes: Nicotine Chemistry, PH, and Health Effects. J. Appl. Physiol 2020, 128 (4), 1056– 1058. 10.1152/japplphysiol.00717.2019. 31854246 PMC7191502 · DOI
- [33]Tayyarah R; Long GA Comparison of Select Analytes in Aerosol from E-Cigarettes with Smoke from Conventional Cigarettes and with Ambient Air. Regul. Toxicol. Pharmacol 2014, 70 (3), 704– 710. 10.1016/j.yrtph.2014.10.010. 25444997 · DOI
- [34]St. Helen G; Havel C; Dempsey DA; Jacob P; Benowitz NL Nicotine Delivery, Retention and Pharmacokinetics from Various Electronic Cigarettes. Addiction 2016, 111 (3), 535– 544. 10.1111/add.13183. 26430813 PMC4749433 · DOI
- [35]Pappas RS; Gray N; Halstead M; Valentin-Blasini L; Watson C Toxic Metal-Containing Particles in Aerosols from Pod-Type Electronic Cigarettes. J. Anal. Toxicol 2020. 10.1093/jat/bkaa088. PMC7839233 32672822 · DOI
- [36]Harvanko AM; Havel CM; Jacob P; Benowitz NL Characterization of Nicotine Salts in 23 Electronic Cigarette Refill Liquids. Nicotine Tob. Res 2020, 22 (7), 1239– 1243. 10.1093/ntr/ntz232. 31821492 PMC7291795 · DOI
- [38]Olmedo P; Navas-Acien A; Hess C; Jarmul S; Rule AM A Direct Method for E-Cigarette Aerosol Sample Collection. Environ. Res 2016, 149, 151– 156. 10.1016/j.envres.2016.05.008. 27200479 PMC4910690 · DOI
- [39]Hilpert M; Ilievski V; Hsu S; Rule AM; Olmedo P E-Cigarette Aerosol Collection Using Converging and Straight Tubing Sections: Physical Mechanisms. J. Colloid Interface Sci 2021, 584, 804– 815. 10.1016/j.jcis.2020.10.011. 33268068 PMC7736306 · DOI
- [40]Zhao D; Navas-Acien A; Ilievski V; Slavkovich V; Olmedo P; Adria-Mora B; Domingo-Relloso A; Aherrera A; Kleiman NJ; Rule AM; Hilpert M Metal Concentrations in Electronic Cigarette Aerosol: Effect of Open-System and Closed-System Devices and Power Settings. Environ. Res 2019, 174 (April), 125– 134. 10.1016/j.envres.2019.04.003. 31071493 PMC7079580 · DOI
- [41]ISO. ISO 20768: Vapour Products — Routine Analytical Vaping Machine — Definitions and Standard Conditions; 2018; Vol. 2018.
- [43]Rivas-Ubach A; Liu Y; Bianchi TS; Tolić N; Jansson C; Paša-Tolić L Moving beyond the van Krevelen Diagram: A New Stoichiometric Approach for Compound Classification in Organisms. Anal. Chem 2018, 90 (10), 6152– 6160. 10.1021/acs.analchem.8b00529. 29671593 · DOI
- [44]Fouquet TNJ The Kendrick Analysis for Polymer Mass Spectrometry. J. Mass Spectrom 2019, 54 (12), 933– 947. 10.1002/jms.4480. 31758605 · DOI
- [45]Sleiman M; Logue JM; Montesinos VN; Russell ML; Litter MI; Gundel LA; Destaillats H Emissions from Electronic Cigarettes: Key Parameters Affecting the Release of Harmful Chemicals. Environ. Sci. Technol 2016, 50 (17), 9644– 9651. 10.1021/acs.est.6b01741. 27461870 · DOI
- [46]Talih S; Salman R; Karaoghlanian N; El-Hellani A; Saliba N; Eissenberg T; Shihadeh A Juice Monsters: Sub-Ohm Vaping and Toxic Volatile Aldehyde Emissions. Chem. Res. Toxicol 2017, 30 (10), 1791– 1793. 10.1021/acs.chemrestox.7b00212. 28937746 · DOI
- [47]Baassiri M; Talih S; Salman R; Karaoghlanian N; Saleh R; El Hage R; Saliba N; Shihadeh A Clouds and “Throat Hit”: Effects of Liquid Composition on Nicotine Emissions and Physical Characteristics of Electronic Cigarette Aerosols. Aerosol Sci. Technol 2017, 51 (11), 1231– 1239. 10.1080/02786826.2017.1341040. 32863527 PMC7453347 · DOI
- [48]Podgorski DC; Hamdan R; McKenna AM; Nyadong L; Rodgers RP; Marshall AG; Cooper WT Characterization of Pyrogenic Black Carbon by Desorption Atmospheric Pressure Photoionization Fourier Transform Ion Cyclotron Resonance Mass Spectrometry. Anal. Chem 2012, 84 (3), 1281– 1287. 10.1021/ac202166x. 22242739 · DOI
- [49]Schramm S; Carré V; Scheffler JL; Aubriet F Analysis of Mainstream and Sidestream Cigarette Smoke Particulate Matter by Laser Desorption Mass Spectrometry. Anal. Chem 2011, 83 (1), 133– 142. 10.1021/ac1019842. 21126024 · DOI
- [50]Zhao J; Nelson J; Dada O; Pyrgiotakis G; Kavouras IG; Demokritou P Assessing Electronic Cigarette Emissions: Linking Physico-Chemical Properties to Product Brand, e-Liquid Flavoring Additives, Operational Voltage and User Puffing Patterns. Inhal. Toxicol 2018, 30 (2), 78– 88. 10.1080/08958378.2018.1450462. 29564955 PMC6459014 · DOI
- [51]McCauley L; Markin C; Hosmer D An Unexpected Consequence of Electronic Cigarette Use. Chest 2012, 141 (4), 1110– 1113. 10.1378/chest.11-1334. 22474155 · DOI
- [52]Eissenberg T; Maziak W Are Electronic Cigarette Users at Risk for Lipid-Mediated Lung Injury? Am. J. Respir. Crit. Care Med 2020, 201 (8), 1012– 1013. 10.1164/RCCM.201910-2082LE. PMC7159422 31917600 · DOI
- [53]Blount BC; Karwowski MP; Shields PG; Morel-Espinosa M; Valentin-Blasini L; Gardner M; Braselton M; Brosius CR; Caron KT; Chambers D; Corstvet J; Cowan E; de Jesús VR; Espinosa P; Fernandez C; Holder C; Kuklenyik Z; Kusovschi JD; Newman C; Reis GB; Rees J; Reese C; Silva L; Seyler T; Song MA; Sosnoff C; Spitzer CR; Tevis D; Wang L; Watson C; Wewers MD; Xia B; Heitkemper DT; Ghinai I; Layden J; Briss P; King BA; Delaney LJ; Jones CM; Baldwin GT; Patel A; Meaney-Delman D; Rose D; Krishnasamy V; Barr JR; Thomas J; Pirkle JL Vitamin E Acetate in Bronchoalveolar-Lavage Fluid Associated with EVALI. N. Engl. J. Med 2020, 382 (8), 697– 705. 10.1056/NEJMoa1916433. 31860793 PMC7032996 · DOI · Paper page
- [54]Fouquet TNJ; Cody RB; Ozeki Y; Kitagawa S; Ohtani H; Sato H On the Kendrick Mass Defect Plots of Multiply Charged Polymer Ions: Splits, Misalignments, and How to Correct Them. J. Am. Soc. Mass Spectrom 2018, 29 (8), 1611– 1626. 10.1007/s13361-018-1972-4. 29752598 · DOI
- [55]Erythropel HC; Jabba SV; DeWinter TM; Mendizabal M; Anastas PT; Jordt SE; Zimmerman JB Formation of Flavorant-Propylene Glycol Adducts With Novel Toxicological Properties in Chemically Unstable E-Cigarette Liquids. Nicotine Tob. Res 2019, 21 (9), 1248– 1258. 10.1093/ntr/nty192. 30335174 PMC6698951 · DOI
- [56]Escobar YNH; Nipp G; Cui T; Petters SS; Surratt JD; Jaspers I In Vitro Toxicity and Chemical Characterization of Aerosol Derived from Electronic Cigarette Humectants Using a Newly Developed Exposure System. Chem. Res. Toxicol 2020, 33 (7), 1677– 1688. 10.1021/acs.chemrestox.9b00490. 32223225 PMC11391858 · DOI
- [57]Lisko JG; Lee GE; Kimbrell JB; Rybak ME; Valentin-Blasini L; Watson CH Caffeine Concentrations in Coffee, Tea, Chocolate, and Energy Drink Flavored E-Liquids. Nicotine Tob. Res 2017, 19 (4), 484– 492. 10.1093/ntr/ntw192. 27613945 PMC5568045 · DOI
- [58]Salin AV; Il’in AV; Faskhutdinov RI; Galkin VI; Islamov DR; Kataeva ON Tributylphosphine Catalyzed Addition of Diphenylphosphine Oxide to Unsubstituted and Substituted Electron-Deficient Alkenes. Tetrahedron Lett. 2018, 59 (17), 1630– 1634. 10.1016/j.tetlet.2018.03.040. · DOI
- [59]Takeshita A; Igarashi-migitaka J; Nishiyama K; Takahashi H; Takeuchi Y; Koibuchi N Acetyl Tributyl Citrate, the Most Widely Used Phthalate Substitute Plasticizer, Induces Cytochrome P450 3A through Steroid and Xenobiotic Receptor. Toxicol. Sci 2011, 123 (2), 460– 470. 10.1093/toxsci/kfr178. 21742782 · DOI
- [60]Jing Y; Gong C; Xian K; Wang C; Lu P The Effects of Filter Ventilation on Flavor Constituents in Cigarette Smoke. Beiträge zur Tab. Int. to Tob. Res 2016, 21 (5), 280– 285. 10.2478/cttr-2013-0794. · DOI
- [62]Kivell BM; Danielson K Neurological Effects of Nicotine, Tobacco, and Particulate Matter; Elsevier Inc., 2016; Vol. 1. 10.1016/B978-0-12-800213-1.00011-0. · DOI
Cited by
Sorted by citations
Mobilizing for Health: A Case Study of Kazakhstan’s Vaping Ban Advocacy Campaign
Sadykova, J., Ayaganova, A., & Yergaliyev, K. A. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22071102 · Cited by 1 · see citing works
- Authors
- Tehrani, M. W., Newmeyer, M. N., Rule, A. M., & Prasse, C.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Prasse, Carsten
- Venue
- Chemical Research in Toxicology
- Publisher
- American Chemical Society (ACS)
- Published
- 2021-10-05
- Volume
- 34
- Issue
- 10
- Pages
- 2216-2226
- ISSN
- 0893-228X (ISSN-L)
- 1520-5010
- PMC
- PMC11317110
- OpenAlex
- W3202533999
- Cited by
- 84
- References
- 0
- Citations by year
- 2026: 8 · 2025: 20 · 2024: 26 · 2023: 13 · 2022: 14 · 2021: 3
- FWCI
- 8.80
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Chemical Research in Toxicology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Environmental Health Sciences (R01ES030025, T32ES007141)
- Topics
- Health Sciences › Medicine › Physiology › Smoking Behavior and Cessation
- Physical Sciences › Chemistry › Spectroscopy › Mass Spectrometry Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
- Keywords
- electronic cigarettes, e-liquids, chemical fingerprinting, non-targeted analysis, Kendrick mass defect analysis, homologous series, lipid-like compounds, tributylphosphine oxide, caffeine, chemical exposure assessment
- MeSH terms
- Aerosols, Chromatography, Liquid, Flavoring Agents, Mass Spectrometry, Electronic Nicotine Delivery Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review