The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Big data techniques in auditing research and practice: Current trends and future opportunities
Open accessAbstract
This paper analyses the use of big data techniques in auditing, and finds that the practice is not as widespread as it is in other related fields. We first introduce contemporary big data techniques to promote understanding of their potential application. Next, we review existing research on big data in accounting and finance. In addition to auditing, our analysis shows that existing research extends across three other genealogies: financial distress modelling, financial fraud modelling, and stock market prediction and quantitative modelling. Auditing is lagging behind the other research streams in the use of valuable big data techniques. A possible explanation is that auditors are reluctant to use techniques that are far ahead of those adopted by their clients, but we refute this argument. We call for more research and a greater alignment to practice. We also outline future opportunities for auditing in the context of real-time information and in collaborative platforms and peer-to-peer marketplaces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks
LOUGHRAN, T., & MCDONALD, B. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01625.x · Cited by 6,015
Giving content to investor sentiment: The role of media in the stock market
TETLOCK, P. C. (2007) · The Journal of Finance · doi:10.1111/j.1540-6261.2007.01232.x · Cited by 4,827
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
An Introduction to Statistical Learning: with Applications in R
James, G. M., Witten, D., Hastie, T. J., & Tibshirani, R. J. (2018) · doi:10.25334/q4ht55 · Cited by 2,912
Predicting Material Accounting Misstatements*
DECHOW, P. M., GE, W., LARSON, C. R., & SLOAN, R. G. (2011) · Contemporary Accounting Research · doi:10.1111/j.1911-3846.2010.01041.x · Cited by 1,818
Sohil, F., Sohali, M. U., & Shabbir, J. (2022) · Statistical Theory and Related Fields · doi:10.1080/24754269.2021.1980261 · Cited by 1,624
Ngai, E. W. T., Hu, Y., Wong, Y. H., Chen, Y., & Sun, X. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.006 · Cited by 1,361
A survey on opinion mining and sentiment analysis: Tasks, approaches and applications
Ravi, K., & Ravi, V. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.06.015 · Cited by 1,306
Quantifying Trading Behavior in Financial Markets Using Google Trends
Preis, T., Moat, H. S., & Stanley, H. E. (2013) · Scientific Reports · doi:10.1038/srep01684 · Cited by 948
Consumer credit-risk models via machine-learning algorithms
Khandani, A. E., Kim, A. J., & Lo, A. W. (2010) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2010.06.001 · Cited by 864
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
Data Mining techniques for the detection of fraudulent financial statements
KIRKOS, E., SPATHIS, C., & MANOLOPOULOS, Y. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.02.016 · Cited by 722
Big data in accounting: an overview
Vasarhelyi, M. A., Kogan, A., & Tuttle, B. M. (2015) · Accounting Horizons · doi:10.2308/acch-51071 · Cited by 641
How Big Data Will Change Accounting
Warren, J. D., Moffitt, K. C., & Byrnes, P. (2015) · Accounting Horizons · doi:10.2308/acch-51069 · Cited by 615
Intelligent financial fraud detection: A comprehensive review
West, J., & Bhattacharya, M. (2016) · Computers & Security · doi:10.1016/j.cose.2015.09.005 · Cited by 592
Classification and Regression Trees, Bagging, and Boosting
Sutton, C. D. (2005) · Handbook of Statistics · doi:10.1016/s0169-7161(04)24011-1 · Cited by 587
Detection of financial statement fraud and feature selection using data mining techniques
Ravisankar, P., Ravi, V., Raghava Rao, G., & Bose, I. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.11.006 · Cited by 582
Big data and analytics in the modern audit engagement: Research needs
Appelbaum, D., Kogan, A., & Vasarhelyi, M. A. (2017) · Auditing: A Journal of Practice & Theory · doi:10.2308/ajpt-51684 · Cited by 515
Prediction of financial distress: An empirical study of listed Chinese companies using data mining
Geng, R., Bose, I., & Chen, X. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.08.016 · Cited by 479
Data Mining with Decision Trees: Theory and Applications
(2015) · Online Information Review · doi:10.1108/oir-04-2015-0121 · Cited by 447
A Decision Aid for Assessing the Likelihood of Fraudulent Financial Reporting
Bell, T. B., & Carcello, J. V. (2000) · AUDITING: A Journal of Practice & Theory · doi:10.2308/aud.2000.19.1.169 · Cited by 437
Big Data Analytics in Financial Statement Audits
Cao, M., Chychyla, R., & Stewart, T. (2015) · Accounting Horizons · doi:10.2308/acch-51068 · Cited by 434
Brown-Liburd, H., Issa, H., & Lombardi, D. (2015) · Accounting Horizons · doi:10.2308/acch-51023 · Cited by 434
Financial Statement Fraud: Insights from the Academic Literature
Hogan, C. E., Rezaee, Z., Riley, R. A., & Velury, U. K. (2008) · AUDITING: A Journal of Practice & Theory · doi:10.2308/aud.2008.27.2.231 · Cited by 402
Financial Statement Fraud Detection: An Analysis of Statistical and Machine Learning Algorithms
Perols, J. (2011) · AUDITING: A Journal of Practice & Theory · doi:10.2308/ajpt-50009 · Cited by 391
Lam, M. (2004) · Decision Support Systems · doi:10.1016/s0167-9236(03)00088-5 · Cited by 380
Data Derivatives: On the Emergence of a Security Risk Calculus for Our Times
Amoore, L. (2011) · Theory, Culture & Society · doi:10.1177/0263276411417430 · Cited by 374
Understanding the paradigm shift to computational social science in the presence of big data
Chang, R. M., Kauffman, R. J., & Kwon, Y. (2014) · Decision Support Systems · doi:10.1016/j.dss.2013.08.008 · Cited by 369
Identification of fraudulent financial statements using linguistic credibility analysis
Humpherys, S. L., Moffitt, K. C., Burns, M. B., Burgoon, J. K., & Felix, W. F. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.009 · Cited by 342
Big Data as Complementary Audit Evidence
Yoon, K., Hoogduin, L., & Zhang, L. (2015) · Accounting Horizons · doi:10.2308/acch-51076 · Cited by 330
Alles, M. G. (2015) · Accounting Horizons · doi:10.2308/acch-51067 · Cited by 325
Data Mining with Decision Trees: Theory and Applications
Rokach, L., & Maimon, O. (2007) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/6604 · Cited by 324
MetaFraud: A Meta-Learning Framework for Detecting Financial Fraud1
Abbasi, A., Albrecht, C., Vance, A., & Hansen, J. (2012) · MIS Quarterly · doi:10.2307/41703508 · Cited by 298
Data analytics in auditing: Opportunities and challenges
Earley, C. E. (2015) · Business Horizons · doi:10.1016/j.bushor.2015.05.002 · Cited by 287
Using neural networks and data mining techniques for the financial distress prediction model
Chen, W.-S., & Du, Y.-K. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.03.020 · Cited by 283
Assessing the Risk of Management Fraud Through Neural Network Technology.
Green, B. P., & Choi, J. H. (1997) · Auditing: A Journal of Practice & Theory · doi:10.2308/ajpt-9708303198 · Cited by 244
Detecting evolutionary financial statement fraud
Zhou, W., & Kapoor, G. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.007 · Cited by 243
Consequences of Big Data and Formalization on Accounting and Auditing Standards
Krahel, J. P., & Titera, W. R. (2015) · Accounting Horizons · doi:10.2308/acch-51065 · Cited by 242
Accounting Variables, Deception, and a Bag of Words: Assessing the Tools of Fraud Detection
Purda, L., & Skillicorn, D. (2015) · Contemporary Accounting Research · doi:10.1111/1911-3846.12089 · Cited by 242
Discovering Golden Nuggets: Data Mining in Financial Application
Zhang, D., & Zhou, L. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2004.829279 · Cited by 228
Predicting restaurant financial distress using decision tree and AdaBoosted decision tree models
Kim, S. Y., & Upneja, A. (2014) · Economic Modelling · doi:10.1016/j.econmod.2013.10.005 · Cited by 215
Toward Effective Big Data Analysis in Continuous Auditing
Zhang, J., Yang, X., & Appelbaum, D. (2015) · Accounting Horizons · doi:10.2308/acch-51070 · Cited by 205
A Field Study on the Use of Process Mining of Event Logs as an Analytical Procedure in Auditing
Jans, M., Alles, M. G., & Vasarhelyi, M. A. (2014) · The Accounting Review · doi:10.2308/accr-50807 · Cited by 201
Reliance on Decision Aids: An Examination of Auditors' Assessment of Management Fraud.
Eining, M. M., & Jones, D. R. (1997) · Auditing A Journal of Practice & Theory · doi:10.2308/ajpt-1302504 · Cited by 195
Lin, C.-C., Chiu, A.-A., Huang, S. Y., & Yen, D. C. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.08.011 · Cited by 188
The discovery of experts' decision rules from qualitative bankruptcy data using genetic algorithms
Kim, M.-J., & Han, I. (2003) · Expert Systems with Applications · doi:10.1016/s0957-4174(03)00102-7 · Cited by 180
Latent Variable Modeling with R
Finch, W. H., & French, B. F. (2015) · Routledge eBooks · doi:10.4324/9781315869797 · Cited by 177
Quantifying the semantics of search behavior before stock market moves
Curme, C., Preis, T., Stanley, H. E., & Moat, H. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1324054111 · Cited by 174
Moffitt, K. C., & Vasarhelyi, M. A. (2013) · Journal of Information Systems · doi:10.2308/isys-10372 · Cited by 173
Infer, Predict, and Assure: Accounting Opportunities in Data Analytics
Schneider, G. P., Dai, J., Janvrin, D. J., Ajayi, K., & Raschke, R. L. (2015) · Accounting Horizons · doi:10.2308/acch-51140 · Cited by 172
Quantifying the Relationship Between Financial News and the Stock Market
Alanyali, M., Moat, H. S., & Preis, T. (2013) · Scientific Reports · doi:10.1038/srep03578 · Cited by 170
The Ties that Bind: The Decision to Co‐Offend in Fraud
Free, C., & Murphy, P. R. (2015) · Contemporary Accounting Research · doi:10.1111/1911-3846.12063 · Cited by 169
News sentiment in the gold futures market
Smales, L. A. (2014) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2014.09.006 · Cited by 163
From once upon a time to happily ever after: Tracking emotions in mail and books
Mohammad, S. M. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.05.030 · Cited by 159
Financial early warning system model and data mining application for risk detection
Koyuncugil, A. S., & Özgülbaş, N. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.12.021 · Cited by 156
Business failure prediction using decision trees
Gepp, A., Kumar, K., & Bhattacharya, S. (2009) · Journal of Forecasting · doi:10.1002/for.1153 · Cited by 154
Self-citationCommentaries on Big Data's Importance for Accounting and Auditing
Griffin, P. A., & Wright, A. M. (2015) · Accounting Horizons · doi:10.2308/acch-51066 · Cited by 154
Business analytics: Why now and what next?
Acito, F., & Khatri, V. (2014) · Business Horizons · doi:10.1016/j.bushor.2014.06.001 · Cited by 152
Li, H., Sun, J., & Wu, J. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.02.016 · Cited by 149
When Can Social Media Lead Financial Markets?
Zheludev, I., Smith, R. E., & Aste, T. (2014) · Scientific Reports · doi:10.1038/srep04213 · Cited by 144
A data mining approach to the prediction of corporate failure
Lin, F. Y., & McClean, S. I. (2001) · Knowledge-Based Systems · doi:10.1016/s0950-7051(01)00096-x · Cited by 140
Gray, G. L., & Debreceny, R. S. (2014) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2014.05.006 · Cited by 137
How does Google search affect trader positions and crude oil prices?
Li, X., Ma, J., Wang, S., & Zhang, X. (2015) · Economic Modelling · doi:10.1016/j.econmod.2015.04.005 · Cited by 133
Can Google Trends search queries contribute to risk diversification?
Krištoufek, L. (2013) · Scientific Reports · doi:10.1038/srep02713 · Cited by 132
Bankruptcy prediction: the case of Japanese listed companies
Xu, M., & Zhang, C. (2008) · Review of Accounting Studies · doi:10.1007/s11142-008-9080-5 · Cited by 116
Detection of fraudulent financial statements using the hybrid data mining approach
Chen, S. (2016) · SpringerPlus · doi:10.1186/s40064-016-1707-6 · Cited by 115
The impact of multinationality on firm value: A comparative analysis of machine learning techniques
Kuzey, C., Uyar, A., & Delen, D. (2013) · Decision Support Systems · doi:10.1016/j.dss.2013.11.001 · Cited by 98
WALKING DOWN WALL STREET WITH A TABLET: A SURVEY OF STOCK MARKET PREDICTIONS USING THE WEB
Nardo, M., Giudici, M. P., & Naltsidis, M. (2015) · Journal of Economic Surveys · doi:10.1111/joes.12102 · Cited by 91
Fundamentals of association rules in data mining and knowledge discovery
Zhang, S., & Wu, X. (2011) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.10 · Cited by 78
The development and intellectual structure of continuous auditing research✩
Chiu, V., Liu, Q., & Vasarhelyi, M. A. (2014) · Journal of Accounting Literature · doi:10.1016/j.acclit.2014.08.001 · Cited by 76
Topological pattern discovery and feature extraction for fraudulent financial reporting
Huang, S., Tsaih, R., & Yu, F. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.01.012 · Cited by 74
Money Walks: Implicit Mobility Behavior and Financial Well-Being
Singh, V. K., Bozkaya, B., & Pentland, A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0136628 · Cited by 71
Generalized optimal wavelet decomposing algorithm for big financial data
Sun, E. W., Chen, Y., & Yu, M. (2015) · International Journal of Production Economics · doi:10.1016/j.ijpe.2014.12.033 · Cited by 70
Using Benford’s law and neural networks as a review procedure
Busta, B., & Weinberg, R. S. (1998) · Managerial Auditing Journal · doi:10.1108/02686909810222375 · Cited by 65
Improving customer retention in financial services using kinship network information
Benoit, D. F., & den Poel, D. V. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.04.016 · Cited by 64
Efficient global portfolios: Big data and investment universes
Guerard, J. B., Rachev, S. T., & Shao, B. P. (2013) · IBM Journal of Research and Development · doi:10.1147/jrd.2013.2272483 · Cited by 62
Trading Network Predicts Stock Price
Sun, X.-Q., Shen, H.-W., & Cheng, X.-Q. (2014) · Scientific Reports · doi:10.1038/srep03711 · Cited by 60
An ANN-based auditor decision support system using Benford's law
Bhattacharya, S., Dongming Xu, A., & Kumar, K. (2010) · Decision Support Systems · doi:10.1016/j.dss.2010.08.011 · Cited by 56
Multilevel Process Mining for Financial Audits
Werner, M., & Gehrke, N. (2015) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2015.2457907 · Cited by 54
Neural networks: the panacea in fraud detection?
Krambia‐Kapardis, M., Christodoulou, C. C., & Agathocleous, M. (2010) · Managerial Auditing Journal · doi:10.1108/02686901011061342 · Cited by 53
Data mining for financial prediction and trading: application to single and multiple markets
Chun, S., & Kim, S. H. (2003) · Expert Systems with Applications · doi:10.1016/s0957-4174(03)00113-1 · Cited by 52
Exploring the Growing Use of Technology in the Audit, with a Focus on Data Analytics
Eimers, P. (2016) · Data Archiving and Networked Services (DANS) · Cited by 47
Cohesiveness in Financial News and its Relation to Market Volatility
Piškorec, M., Antulov-Fantulin, N., Novak, P. K., Mozetič, I., Grćar, M., Vodenska, I., & Šmuc, T. (2014) · Scientific Reports · doi:10.1038/srep05038 · Cited by 41
Predicting Economic Indicators from Web Text Using Sentiment Composition
Levenberg, A., Pulman, S., Moilanen, K., Simpson, E., & Roberts, S. (2014) · International Journal of Computer and Communication Engineering · doi:10.7763/ijcce.2014.v3.302 · Cited by 33
Coupling News Sentiment with Web Browsing Data Improves Prediction of Intra-Day Price Dynamics
Ranco, G., Bordino, I., Giacomo Bormetti, A., Caldarelli, G., Lillo, F., & Treccani, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146576 · Cited by 32
An evolutionary trend reversion model for stock trading rule discovery
Zhang, X., Hu, Y. Q., Xie, K., Zhang, W., Su, L., & Liu, M. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.08.010 · Cited by 30
Corporate governance fraud detection from annual reports using big data analytics
Sadasivam, G. S., Subrahmanyam, M., Dasaraju, H., Pinnamaneni, B. P., & Lakshme, S. M. (2015) · International Journal of Big Data Intelligence · doi:10.1504/ijbdi.2016.073895 · Cited by 30
Applying machine learning in accounting research
den Bogaerd, M. V., & Aerts, W. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.04.172 · Cited by 28
Modelling the short term herding behaviour of stock markets
Shapira, Y., Berman, Y., & Ben‐Jacob, E. (2014) · New Journal of Physics · doi:10.1088/1367-2630/16/5/053040 · Cited by 25
Analytics in empirical/archival financial accounting research
Crawley, M. J., & Wahlen, J. M. (2014) · Business Horizons · doi:10.1016/j.bushor.2014.05.002 · Cited by 25
Identifying financially successful start-up profiles with data mining
Martens, D., Vanhoutte, C., Winne, S. D., Baesens, B., Sels, L., & Mues, C. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.10.052 · Cited by 18
Recent Trends in Equity PortfolioConstruction Analytics
Pachamanova, D. A., & Fabozzi, F. J. (2014) · The Journal of Portfolio Management · doi:10.3905/jpm.2014.40.3.137 · Cited by 16
Two factors affecting an auditor's ability to integrate audit evidence*
Moeckel, C. L. (1991) · Contemporary Accounting Research · doi:10.1111/j.1911-3846.1991.tb00845.x · Cited by 14
Case studies in Bayesian statistical modelling and analysis
Alston‐Knox, C., Mengersen, K. L., & Pettitt, T. (2013) · doi:10.1002/9781118394472 · Cited by 12
FEATURE EXTRACTION OF FRAUDULENT FINANCIAL REPORTING THROUGH UNSUPERVISED NEURAL NETWORKS
Huang, S., Tsaih, R., & Lin, W. (2014) · Neural Network World · doi:10.14311/nnw.2014.24.031 · Cited by 12
Kim, S. H. (2000) · Journal of Organizational Computing and Electronic Commerce · doi:10.1207/s15327744joce1004_04 · Cited by 7
Cited by
The digital transformation of external audit and its impact on corporate governance
Manita, R., Elommal, N., Baudier, P., & Hikkerova, L. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2019.119751 · Cited by 533
Is artificial intelligence improving the audit process?
Fedyk, A., Hodson, J., Khimich, N., & Fedyk, T. (2022) · Review of Accounting Studies · doi:10.1007/s11142-022-09697-x · Cited by 461
The Impact of Artificial Intelligence and Blockchain on the Accounting Profession
Zhang, Y., Xiong, F., Xie, Y., Fan, X., & Gu, H. (2020) · IEEE Access · doi:10.1109/access.2020.3000505 · Cited by 360
The Data Analytics Journey: Interactions Among Auditors, Managers, Regulation, and Technology*
Austin, A. A., Carpenter, T. D., Christ, M. H., & Nielson, C. S. (2021) · Contemporary Accounting Research · doi:10.1111/1911-3846.12680 · Cited by 172
Behavioral challenges to professional skepticism in auditors’ data analytics journey
Li, X. (2022) · Maandblad voor Accountancy en Bedrijfseconomie · doi:10.5117/mab.96.78525 · Cited by 11
Metadata
- Authors
- Gepp, A., Linnenluecke, M. K., O’Neill, T. J., & Smith, T.
- Venue
- Journal of Accounting Literature
- Publisher
- Emerald
- Published
- 2018-02-01
- Volume
- 40
- Issue
- 1
- Pages
- 102-115
- ISSN
- 0737-4607 (ISSN-L)
- OpenAlex
- W2598798227
- Cited by
- 352
- References
- 103
- FWCI
- 41.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.