The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Named Entity Recognition and Normalization Applied to Large-Scale Information Extraction from the Materials Science Literature
Open accessPublished version of a preprint
Abstract
The number of published materials science articles has increased manyfold over the past few decades. Now, a major bottleneck in the materials discovery pipeline arises in connecting new results with the previously established literature. A potential solution to this problem is to map the unstructured raw text of published articles onto structured database entries that allow for programmatic querying. To this end, we apply text mining with named entity recognition (NER) for large-scale information extraction from the published materials science literature. The NER model is trained to extract summary-level information from materials science documents, including inorganic material mentions, sample descriptors, phase labels, material properties and applications, as well as any synthesis and characterization methods used. Our classifier achieves an accuracy (f1) of 87%, and is applied to information extraction from 3.27 million materials science abstracts. We extract more than 80 million materials-science-related named entities, and the content of each abstract is represented as a database entry in a structured format. We demonstrate that simple database queries can be used to answer complex “meta-questions” of the published literature that would have previously required laborious, manual literature searches to answer. All of our data and functionality has been made freely available on our Github (https://github.com/materialsintelligence/matscholar) and website (http://matscholar.com), and we expect these results to accelerate the pace of future materials science discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
(2008) · Journal of Machine Learning Research · Cited by 33,051
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
(1996) · Cited by 20,179
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Epitaxial BiFeO 3 Multiferroic Thin Film Heterostructures
Wang, J., Neaton, J. B., Zheng, H., Nagarajan, V., Ogale, S. B., Liu, B., Viehland, D., Vaithyanathan, V., Schlom, D. G., Waghmare, U. V., et al. (2003) · Science · doi:10.1126/science.1080615 · Cited by 6,217
PubChem Substance and Compound databases
Kim, S., Thiessen, P. A., Bolton, E. E., Chen, J., Fu, G., Gindulyte, A., Han, L., He, J., He, S., Shoemaker, B. A., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv951 · Cited by 5,436
Python Materials Genomics (pymatgen): A robust, open-source python library for materials analysis
Ong, S. P., Richards, W. D., Jain, A., Hautier, G., Kocher, M., Cholia, S., Gunter, D., Chevrier, V. L., Persson, K. A., & Ceder, G. (2013) · Computational Materials Science · doi:10.1016/j.commatsci.2012.10.028 · Cited by 4,534
Self-citationNeural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507
Composition, structure, and stability ofRuO2(110)as a function of oxygen pressure
Reuter, K., & Scheffler, M. (2001) · Physical Review B · doi:10.1103/physrevb.65.035406 · Cited by 2,109
Text Chunking Using Transformation-Based Learning
Ramshaw, L. A., & Marcus, M. P. (1999) · Text, Speech and Language Technology · doi:10.1007/978-94-017-2390-9_10 · Cited by 1,460
Jolliffe, I. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_455 · Cited by 1,206
Unsupervised word embeddings capture latent knowledge from materials science literature
Tshitoyan, V., Dagdelen, J., Weston, L., Dunn, A., Rong, Z., Kononova, O., Persson, K. A., Ceder, G., & Jain, A. (2019) · Nature · doi:10.1038/s41586-019-1335-8 · Cited by 1,123
Self-citationHigh thermoelectric figure of merit in heavy hole dominated PbTe
Pei, Y., LaLonde, A., Iwanaga, S., & Snyder, G. J. (2011) · Energy & Environmental Science · doi:10.1039/c0ee00456a · Cited by 784
Combinatorial screening for new materials in unconstrained composition space with machine learning
Meredig, B., Agrawal, A., Kirklin, S., Saal, J. E., Doak, J. W., Thompson, A., Zhang, K., Choudhary, A., & Wolverton, C. (2014) · Physical Review B · doi:10.1103/physrevb.89.094104 · Cited by 730
Textpresso: An Ontology-Based Information Retrieval and Extraction System for Biological Literature
Müller, H.-M., Kenny, E. E., & Sternberg, P. W. (2004) · PLoS Biology · doi:10.1371/journal.pbio.0020309 · Cited by 653
Swain, M. C., & Cole, J. M. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00207 · Cited by 598
Materials Synthesis Insights from Scientific Literature via Text Extraction and Machine Learning
Kim, E., Huang, K., Saunders, A., McCallum, A., Ceder, G., & Olivetti, E. (2017) · Chemistry of Materials · doi:10.1021/acs.chemmater.7b03500 · Cited by 473
Self-citationBiomedical Ontologies in Action: Role in Knowledge Management, Data Integration and Decision Support
Bodenreider, O. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638585 · Cited by 368
Segura-Bédmar, I., Martínez, P., & Herrero-Zazo, M. (2013) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 297
Information retrieval and text mining technologies for chemistry
Krallinger, M., Rabal, O., Lourenço, A., Oyarzabal, J., & Valencia, A. (2017) · Chemical Reviews · doi:10.1021/acs.chemrev.6b00851 · Cited by 281
ChemSpot: a hybrid system for chemical named entity recognition
Rocktäschel, T., Weidlich, M., & Leser, U. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts183 · Cited by 269
tmChem: a high performance approach for chemical named entity recognition and normalization
Leaman, R., Wei, C.-H., & Lu, Z. (2015) · Journal of Cheminformatics · doi:10.1186/1758-2946-7-s1-s3 · Cited by 268
Progress and prospects for accelerating materials science with automated and autonomous workflows
Stein, H. S., & Gregoire, J. M. (2019) · Chemical Science · doi:10.1039/c9sc03766g · Cited by 228
Virtual screening of inorganic materials synthesis parameters with deep learning
Kim, E., Huang, K., Jegelka, S., & Olivetti, E. (2017) · npj Computational Materials · doi:10.1038/s41524-017-0055-6 · Cited by 190
Machine-learned and codified synthesis parameters of oxide materials
Kim, E., Huang, K., Tomala, A., Matthews, S., Strubell, E., Saunders, A., McCallum, A., & Olivetti, E. (2017) · Scientific Data · doi:10.1038/sdata.2017.127 · Cited by 164
Court, C. J., & Cole, J. M. (2018) · Scientific Data · doi:10.1038/sdata.2018.111 · Cited by 148
Chemical named entities recognition: a review on approaches and applications
Eltahier, S., & Salim, N. B. (2014) · Journal of Cheminformatics · doi:10.1186/1758-2946-6-17 · Cited by 128
Natural Language Processing Using Very Large Corpora
Armstrong, S., Church, K., Isabelle, P., Manzi, S., Tzoukermann, E., & Yarowsky, D. (2000) · Computational Linguistics · doi:10.1162/coli.2000.26.2.294a · Cited by 111
Legrain, F., Carrete, J., van Roekeghem, A., Madsen, G. K. H., & Mingo, N. (2017) · The Journal of Physical Chemistry B · doi:10.1021/acs.jpcb.7b05296 · Cited by 109
Rabe, K. M., & Joannopoulos, J. D. (1985) · Physical review. B, Condensed matter · doi:10.1103/physrevb.32.2302 · Cited by 105
Zhang, X., Zhao, C., & Wang, X. (2015) · Computers in Industry · doi:10.1016/j.compind.2015.07.005 · Cited by 57
Automatically Extracting Action Graphs from Materials Science Synthesis ProceduresPreprint
Mysore, S., Kim, E., Strubell, E., Liu, A., Chang, H.-S., Kompella, S., Huang, K., McCallum, A., & Olivetti, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.06872 · Cited by 50
Automated cognome construction and semi-automated hypothesis generation
Voytek, J. B., & Voytek, B. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.04.019 · Cited by 40
An Information Retrieval and Recommendation System for Astronomical Observatories
Mukund, N., Thakur, S., Abraham, S., Aniyan, A. K., Mitra, S., Philip, N. S., Vaghmare, K., & Acharjya, D. P. (2018) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/aaadb2 · Cited by 15
A Relation Aware Search Engine for Materials Science
Shah, S., Vora, D., Gautham, B. P., & Reddy, S. (2018) · Integrating materials and manufacturing innovation · doi:10.1007/s40192-017-0105-4 · Cited by 11
(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1
CORD-19: The COVID-19 Open Research Dataset
Wang, L. L., Lo, K., Chandrasekhar, Y., Reas, R., Yang, J., Burdick, D., Eide, D., Funk, K., Katsis, Y., Kinney, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.10706
Research works printed but not linked: 8
- Fang, 2006, Human Gene Name Normalization using Text Matching with Automatically Extracted Synonym Dictionaries, Proceedings of the Workshop on Linking Natural Language Processing and Biology: Towards Deeper Biological Literature Analysis., 41, 10.3115/1567619.1567627 · doi:10.3115/1567619.1567627
- Chollet, 2015, Keras
- https://dev.elsevier.com/.
- http://www.rsc.org/.
- Wang, 2007, Enhanced Thermoelectric Performance of PbTe Within the Orthorhombic Pnma Phase, Phys. Rev. B: Condens. Matter Mater. Phys., 76, 155127, 10.1103/PhysRevB.76.155127 · doi:10.1103/physrevb.76.155127
- Arnold, 2009, Ferroelectric-paraelectric Transition in BiFeO3: Crystal Structure of the Orthorhombic β Phase, Phys. Rev. Lett., 102, 10.1103/PhysRevLett.102.027602 · doi:10.1103/physrevlett.102.027602
- Fu, 2014, Tetragonal-tetragonal-monoclinic-rhombohedral Transition: Strain Relaxation of Heavily Compressed BiFeO3 Epitaxial Thin Films, Appl. Phys. Lett., 104, 10.1063/1.4864077 · doi:10.1063/1.4864077
- Weston, 2014, Hybrid Functional Calculations of Point Defects and Hydrogen in SrZrO3, Phys. Rev. B: Condens. Matter Mater. Phys., 89, 184109, 10.1103/PhysRevB.89.184109 · doi:10.1103/physrevb.89.184109
Cited by
Recent advances and applications of deep learning methods in materials science
Choudhary, K., DeCost, B., Chen, C., Jain, A., Tavazza, F., Cohn, R., Park, C. W., Choudhary, A., Agrawal, A., Billinge, S. J. L., et al. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00734-6 · Cited by 1,172
Self-citationStructured information extraction from scientific text with large language models
Dagdelen, J., Dunn, A., Lee, S., Walker, N., Rosen, A. S., Ceder, G., Persson, K. A., & Jain, A. (2024) · Nature Communications · doi:10.1038/s41467-024-45563-x · Cited by 771
Self-citationMatSciBERT: A materials domain language model for text mining and information extraction
Gupta, T., Zaki, M., Krishnan, N. M. A., & Mausam (2022) · npj Computational Materials · doi:10.1038/s41524-022-00784-w · Cited by 342
Data-driven materials research enabled by natural language processing and information extraction
Olivetti, E. A., Cole, J. M., Kim, E., Kononova, O., Ceder, G., Han, T. Y.-J., & Hiszpanski, A. M. (2020) · Applied Physics Reviews · doi:10.1063/5.0021106 · Cited by 302
Self-citationLiu, Y., Yang, Z., Yu, Z., Liu, Z., Liu, D., Lin, H., Li, M., Ma, S., Avdeev, M., & Shi, S. (2023) · Journal of Materiomics · doi:10.1016/j.jmat.2023.05.001 · Cited by 294
Metadata
- Authors
- Weston, L., Tshitoyan, V., Dagdelen, J., Kononova, O., Trewartha, A., Persson, K. A., Ceder, G., & Jain, A.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2019-07-31
- Volume
- 59
- Issue
- 9
- Pages
- 3692-3702
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W2964864162
- Cited by
- 307
- References
- 43
- FWCI
- 8.25
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Toyota Research Institute
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.