What We Know About Spreadsheet Errors
The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
Although some spreadsheets are small “scratch pad” applications, many are large and complex, and many missioncritical decisions depend on spreadsheet analyses. In recent years, we have learned a good deal about the errors that people make when they develop spreadsheets. In general, errors seem to occur in a few percent of all cells, meaning that for large spreadsheets, the issue is how many errors there are, not whether an error exists. These error rates, although troubling, are in line with error rates in programming and other human cognitive domains. In programming, we have learned to follow strict development disciplines to eliminate most errors. Surveys of spreadsheet developers indicate that spreadsheet creation, in contrast, is informal, and that few organizations have comprehensive policies for spreadsheet development. Although prescriptive articles have focused on such disciplines as modularization and having assumptions sections, these may be far less important than postdevelopment testing.Request access from your librarian to read this article's full text.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research shows that errors are surprisingly common in the business setting [4]”
From Gene name errors: Lessons not learned (2021) · cites this paper as [4]
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(2013) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,799
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
(1998) · PDCA/Test · doi:10.1201/9781420048131.axh · Cited by 1,900
Identifying the organization of writing processes
Haves, J. (1980) · Medical Entomology and Zoology · Cited by 1,553
Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.6.2.107 · Cited by 1,477
Animal Intelligence: An Experimental Study of the Associative Processes in Animals
Kline, L. W., & Thorndike, E. L. (1898) · The American Journal of Psychology · doi:10.2307/1412682 · Cited by 1,092
Thinking, Problem Solving, Cognition
D., C. P., & Mayer, R. E. (1984) · The American Journal of Psychology · doi:10.2307/1422612 · Cited by 992
How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life
Gilovich, T. D. (1991) · Medical Entomology and Zoology · Cited by 990
Edmondson, A. C. (1996) · The Journal of Applied Behavioral Science · doi:10.1177/0021886396321001 · Cited by 937
Cited by
Items 501–589 of 589
Bolan, C. (2001) · Research Online (Edith Cowan University)
Obama, P. B. (2015)
Financial Modeling with Quantrix vs. Excel
Rubash, A. R., & Rubash, M. A. (2004)
Balla, É., Bujdosó, G., Csernoch, M., Tóth, M. D., Egri, S., Kónya, E., Mándy, T., Paulovits, G., Markóczi, I. R., Sarka, L., et al. (2015) · University of Debrecen Electronic Archive (University of Debrecen)
Laing, S. M. E. (2015) · Saint Mary's University Institutional Repository (Saint Mary's University)
Financial Analysis of Mining Investments Employing FAST Modeling Standard
Afra, S. (2014) · Eastern Mediterranean University Institutional Repository (Eastern Mediterranean University)
A számítógépes szövegkezelés mesterséges nyelve: Hibakezelés, hibaellenőrzés
Csernoch, M., & Bujdosó, G. (2015) · University of Debrecen Electronic Archive (University of Debrecen)
Coding, Configuration, and Build
(2013) · CRC Press eBooks · doi:10.3109/9781420088953-14
Power Systems Investments: A Real Options Analysis
Zambujal‐Oliveira, J. (2011) · IGI Global eBooks · doi:10.4018/978-1-61350-138-2.ch008
The Impact of Intelligent Interfaces on the Performance of Knowledge Base Systems
Ajeeli, A. T. A. (2016) · IRA-International Journal of Technology & Engineering · doi:10.21013/jte.v4.n2.p1
Polaris: Providing context aware navigation in spreadsheets
Jansen, B. (2016) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2016.7739690
Myrtveit, M. (2004)
Characteristics of Spreadsheets Developed with the SSMI MethodologyPreprint
Mireault, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01136
Engine Icing Data - An Analytics Approach
Fitzgerald, B. A., & Flegel, A. B. (2017)
Teaching Spreadsheet Documentation Skills using Practitioner based Workshops
o'haver, R. (2017) · e-publications@bond (Bond University)
Automated model-based spreadsheet debugging
Schmitz, T. (2017) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-18089
Architekturanalyse und Reengineering einer Prüfumgebung für Spreadsheets
Schüler, F. (2017) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-9299
Spreadsheet Tools for Data Analysts
Barowy, D. W. (2017) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/10678415.0
Tchórzewski, K. J. (2017) · Information System in Management · doi:10.22630/isim.2017.6.4.7
USING DISCRETE MARKOV CHAINS IN PREDICTION OF HEALTH ECONOMICS BEHAVIOUR
Bauer, W. (2017) · Information System in Management · doi:10.22630/isim.2017.6.4.1
Thayer, M. L. (2017) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University)
Korobko, A. (2018) · International Multidisciplinary Scientific GeoConference SGEM ... · doi:10.5593/sgem2018/2.1/s07.033
Error Identification in Presentation Slides
Cappel, J. J. (2000) · Journal of Computer Information Systems · doi:10.1080/08874417.2000.11646968
Bayiz, L. D. (2018) · Eastern Mediterranean University Institutional Repository (Eastern Mediterranean University)
Business plan, EXCEED : soluciones para Excel
Deferrari, M. (2015) · San Andres Digital Repository (University of San Andrés)
Spreadsheets in an ERP environment: not what the doctor orderedPreprint
Newman, N. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.02997
Entorno de ejecución para un sistema de hojas de cálculobasado en programación funcional
de Barrio, B., & Eduardo, L. (2019) · Hispana
Data Merger Computing for an Intelligent Report Generation
Thomas, C., Suresh, B. S., & Vijayalakshmi, M. N. (2020) · SN Computer Science · doi:10.1007/s42979-020-00157-4
Abstracting spreadsheet data flow through hypergraph redrawing
Birch, D., Stawinoga, N., Binks, J., Nicoletti, B., & Kelly, P. H. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04794
Intuitive, interactive, and scalable multi-resolution interfaces for accelerating data exploration
Rahman, S. (2020) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Easy to use spreadsheet application
Csizmazia, S. (2014) · reposiTUm (TU Wien) · doi:10.34726/hss.2014.22071
Coding, Configuration, and Build
(2003) · CRC Press eBooks · doi:10.1201/9780203494240.ch9
Harrison, S., Crawford, B., & Simpson, J. (2019) · International Kimberlite Conference (IKC) · doi:10.29173/ikc3437
Wubbel, J. (2017) · Wiley eBooks · doi:10.1002/9781119453680.refs
Franzetti, C. (2019) · Springer eBooks · doi:10.1007/978-3-662-58534-4_10
Cervesato, I. (2013) · Cognitive technologies · doi:10.1007/978-3-642-37747-1_11
Häcker, J., & Ernst, D. (2017) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-137-42658-1_3
Cervesato, I. (2013) · Cognitive technologies · doi:10.1007/978-3-642-37747-1_1
Franzetti, C. (2023) · Springer eBooks · doi:10.1007/978-3-662-67154-2_11
Ballesteros, I., de Barrio, L. E. B., & Mariño, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-84924-4_10
Ghignone, S., Bernardo, U., & Bellis, L. D. (2025) · Horticulturae · doi:10.3390/horticulturae11111323
Franzetti, C. (2025) · Springer eBooks · doi:10.1007/978-3-662-71428-7_11
Visual Programs Module Choice and Layout in the Nord Modular Patch Language.
Noble, J., & Biddle, R. (2001)
Λάθη και δυσκολίες σπουδαστών της Γ/βάθμιας εκπαίδευσης σε περιβάλλον λογιστικών φύλλων
Λιόβας, Δ. Γ. (2009) · University of Thessaly Institutional Repository (University of Thessaly) · doi:10.26253/heal.uth.5938
Reengineering und Erweiterung einer Prüfungsumgebung für Spreadsheets
Mauch, N. (2016) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-9553
Tiedtke, M. (2019) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-10783
Hermans, F. (2014) · Figshare · doi:10.6084/m9.figshare.1222882
Algoritmikus és alkalmazói készségek tesztelése
Csernoch, M., & Biró, P. (2013) · University of Debrecen Electronic Archive (University of Debrecen)
Meerkerk, W.-J., Vroegindeweij, R. (., Verhoeff, J. S. C. J., & Van der Linden, J. G. M. (. (2014) · Research Repository (Delft University of Technology)
Sebestyén, K. (2021) · University of Debrecen Electronic Archive (University of Debrecen)
Regnearkmodellering som investeringsverktøy for automatisert vogntransport i sykehus
Bøhn, A. G., Bergquist-Langlo, E., & Warendorph, F. (2019) · NVA (Nasjonalt vitenarkiv)
End-User Development of Web-based Decision Support Systems
Tschudnowsky, A. (2016) · Qucosa (Saxon State and University Library Dresden)
A felsőoktatási felnőttképzés néhány rekrutációs jellemzője
Polónyi, I. (2013) · University of Debrecen Electronic Archive (University of Debrecen)
Csernoch, M., & Biró, P. (2015) · University of Debrecen Electronic Archive (University of Debrecen)
Sprego helye az informatika tantervekben
Csernoch, M., & Biró, P. (2015) · University of Debrecen Electronic Archive (University of Debrecen)
Διδακτική των λογιστικών φύλλων (spreadsheets): προσεγγίσεις, προβλήματα, προτάσεις
Μελίδης, Π. (2007) · University of Thessaly Institutional Repository (University of Thessaly)
Meyer-Wachsmuth, H. (2010) · Multilingual Matters (Channel View Publications)
Nagel, M. (2025) · Theseus (Ammattikorkeakoulujen)
Srisawat, N., Chaiyakul, P., Rungrojcharoen, K., & Wongthanakul, S. (2025) · International Journal of Communication and Information Technology · doi:10.33545/2707661x.2025.v6.i1c.166
A Performance Comparison of Microsoft Excel and Python for Tabular Data Analysis
H., B. M. M. (2026) · Journal of Al-Qadisiyah for Computer Science and Mathematics · doi:10.29304/jqcsm.2026.18.12585
Decision Support for Financial Planning and Customer Service Management System
Devi, V. D. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.81564
José, C. D. A., & Katherine, L. R. L. (2026) · Universidad Industrial de Santander
Lovász, Z. (2026) · Pesci Egyetemi Archivum (University of Pécs) · doi:10.15170/xviippn-tk-ktk-2026-10
Benassi, L. P. (2026) · Cadernos Cajuína · doi:10.52641/cadcajv11i11.3925
Webová aplikace pro domácí sklad elektronických součástek a komponent
Bruthans, J. (2026) · DSpace VŠB-TUO (VŠB-TUO)
The Practical Data Scientists: Learn Data Science by Building One Real Project, Notebook-by-NotebookPreprint
Buncaras, I. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7482880
Sahoo, V. A. (2024) · Review of Contemporary Philosophy
Guimarães, A. V. M., Sato, M. F. C. B., & de Azeredo, E. R. (2026) · Encontro Nacional de Tecnologia do Ambiente Construído · doi:10.46421/entac.v21i1.8454
AESOL: Automated Electrical Schedule of Loads with Electrical Code Referencing
Cacanog, R. J. J., Ramon, J. J. P., Cariño, R. G. D., & Montero, V. J. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-9442-9_30
Upravljanje zalog z uporabo časovnih vrst v programu MS Excel
Pillai, A. S. (2026) · University of Maribor digital library (University of Maribor)
Fraud Risk in Self-Built Systems: When Generative AI Outpaces Internal Controls in Small Businesses
Akande, A., & Alugwe, S. (2026) · Journal of Science Technology and Social Transformation · doi:10.64235/215dfe52
Digital Accounting System to Improve Financial Transparency in An Employee Cooperative
Putra, Y. E., Liniarti, S., & Nasution, R. S. A. (2026) · Prestise Jurnal Pengabdian Kepada Masyarakat Bidang Ekonomi dan Bisnis · doi:10.15575/prestise.v6i1.55639
Santini, J. A. M. (2026) · San Andres Digital Repository (University of San Andrés)
Sari, I. N., Septeria, H., Melati, R., & Yanti, H. (2026) · Small Business Accounting Management and Entrepreneurship Review · doi:10.61656/sbamer.v6i2.542
Suryaningrum, D. H., Hardiansyah, M. D., Frahmadani, S., Syahputra, L., & Akashi, T. (2026) · Small Business Accounting Management and Entrepreneurship Review · doi:10.61656/sbamer.v6i2.543
Can LLMs Spot Data Anomalies That Make Table QA Impossible?
Wei, Y., Yang, S., Wang, N., Zhang, J., Yang, Y., Wang, H., Zha, L., Ye, W., Li, L., Peng, C., et al. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1039
Alvarez, A. P. H. (2026) · Repositorio Comunidad Politecnico Grancolombiano
Ковальчук, В. В. (2025) · Інституційний репозитарій Волинського університету імені Лесі Українки (Lesya Ukrainka Volyn National University)
Wasule, Y. (2026) · International Journal of Creative and Open Research in Engineering and Management · doi:10.55041/ijcope.v2i11.082
GDP.xlsx: Benchmarking Frontier Models on Professional WorkbooksPreprint
Garre, S., Mehta, S., & Chen, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.17766
A Taxonomy and Taxonomy-Guided Benchmark Reduction for Spreadsheet TasksPreprint
Vasilescu, B., Murphy-Hill, E. R., Parashar, A., Kumar, A., Soares, G., Marín, M. G., & Gulwani, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.21452
Gavilanes, R., Amaya-Mejía, R., & Riveros-Gavilanes, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7702098
Cervesato, I. (2013) · Cognitive technologies · doi:10.1007/978-3-642-37747-1_9
Modelling waiting lists and waiting times for cardiac surgery operations
Greaves, G. (2009) · OpenGrey (Institut de l'Information Scientifique et Technique)
Cervesato, I. (2013) · Cognitive technologies · doi:10.1007/978-3-642-37747-1_7
Voice Recognition Technology for Spreadsheet Navigation and Information Retrieval
Flood, D., McDaid, K., & McCaffery, F. (2009) · STOR (Dundalk Institute of Technology)
Metadata
- Authors
- Panko, R. R.
- Affiliations
- University of Hawaiʻi at Mānoa (US)
- Corresponding author
- Panko, Raymond R.
- Venue
- Journal of Organizational and End User Computing
- Publisher
- IGI Global Scientific Publishing
- Published
- 1998-04
- Volume
- 10
- Issue
- 2
- Pages
- 15-21
- ISSN
- 1546-2234 (ISSN-L)
- 1546-5012
- OpenAlex
- W2112338634
- Cited by
- 464
- References
- 64
- Citations by year
- 2026: 12 · 2025: 9 · 2024: 6 · 2023: 7 · 2022: 7 · 2021: 8 · 2020: 17 · 2019: 14 · 2018: 16 · 2017: 27 · 2016: 21 · 2015: 22 · 2014: 17 · 2013: 19 · 2012: 25
- FWCI
- 33.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Organizational and End User Computing (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- spreadsheet errors, error rate, spreadsheet development, spreadsheet testing, human error, modularization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.