What We Know About Spreadsheet Errors
The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
Although some spreadsheets are small “scratch pad” applications, many are large and complex, and many missioncritical decisions depend on spreadsheet analyses. In recent years, we have learned a good deal about the errors that people make when they develop spreadsheets. In general, errors seem to occur in a few percent of all cells, meaning that for large spreadsheets, the issue is how many errors there are, not whether an error exists. These error rates, although troubling, are in line with error rates in programming and other human cognitive domains. In programming, we have learned to follow strict development disciplines to eliminate most errors. Surveys of spreadsheet developers indicate that spreadsheet creation, in contrast, is informal, and that few organizations have comprehensive policies for spreadsheet development. Although prescriptive articles have focused on such disciplines as modularization and having assumptions sections, these may be far less important than postdevelopment testing.Request access from your librarian to read this article's full text.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research shows that errors are surprisingly common in the business setting [4]”
From Gene name errors: Lessons not learned (2021) · cites this paper as [4]
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(2013) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,799
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
(1998) · PDCA/Test · doi:10.1201/9781420048131.axh · Cited by 1,900
Identifying the organization of writing processes
Haves, J. (1980) · Medical Entomology and Zoology · Cited by 1,553
Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.6.2.107 · Cited by 1,477
Animal Intelligence: An Experimental Study of the Associative Processes in Animals
Kline, L. W., & Thorndike, E. L. (1898) · The American Journal of Psychology · doi:10.2307/1412682 · Cited by 1,092
Thinking, Problem Solving, Cognition
D., C. P., & Mayer, R. E. (1984) · The American Journal of Psychology · doi:10.2307/1422612 · Cited by 992
How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life
Gilovich, T. D. (1991) · Medical Entomology and Zoology · Cited by 990
Edmondson, A. C. (1996) · The Journal of Applied Behavioral Science · doi:10.1177/0021886396321001 · Cited by 937
Cited by
Items 301–400 of 589
Shubbak, M., & Thorne, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05231 · Cited by 4
The Lookup Technique to Replace Nested-IF Formulas in Spreadsheet ProgrammingPreprint
Grossman, T. A., Ozluk, O., & Gustavson, J. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.1188 · Cited by 4
Ghonge, A. L., & Dwivedi, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7559119 · Cited by 4
Advanced Models for Stylometric Applications
Savoy, J. (2020) · Springer eBooks · doi:10.1007/978-3-030-53360-1_7 · Cited by 3
Introduction to Stylistic Models and Applications
Savoy, J. (2020) · Springer eBooks · doi:10.1007/978-3-030-53360-1_1 · Cited by 3
Bass, L., Lewis, G. A., Myers, B. A., & Smith, D. B. (2009) · Defense Technical Information Center (DTIC) · doi:10.21236/ada512358 · Cited by 3
User perceptions and gender in end-user debugging: How do they affect outcomes?
Chintakovid, T., & Wiedenbeck, S. (2009) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2009.5295257 · Cited by 3
SODBench: A Large Language Model Approach to Documenting Spreadsheet OperationsPreprint
Indika, A., & Molybog, I. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.19864 · Cited by 3
Petroleum Development Oman Forecasting Management System
AL-Riyami, H. M., Sheibani, H. M. A., Subhi, H. A. A., Ajmi, H. T. A., Zohny, Z. Y., & Kindy, A. (2021) · Abu Dhabi International Petroleum Exhibition & Conference (ADIPEC) · doi:10.2118/208108-ms · Cited by 3
Bailey, S. L., Bono, R. S., Nash, D., & Kimmel, A. D. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194916 · Cited by 3
Workarounds produce pseudo-data quality: Insights from case studies.
Wibisono, A. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.03.059 · Cited by 3
Useful but tedious: An evaluation of mobile spreadsheets.
Flood, D., Harrison, R., & Nosseir, A. (2011) · PPIG · Cited by 3
Towards User Assistance for Documents via Interactional Semantic Technology
Kohlhase, A. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16111-7_12 · Cited by 3
Towards a Spreadsheet EngineeringPreprint
Vemula, V. R., Ball, D., & Thorne, S. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0803.0159 · Cited by 3
A dynamic graph-based visualization for spreadsheets
Kankuzi, B., & Ayalew, Y. (2008) · International Conference on Human-Computer Interaction · Cited by 3
Financial information description language and visualization/analysis tools
Horry, Y. (2017) · Computer Languages · doi:10.1016/j.cl.2017.05.005 · Cited by 3
Do Spreadsheet Errors Lead to Bad Decisions? Perspectives of Executives and Senior Managers
Caulkins, J. P., Morrison, E. L., & Weidemann, T. (2009) · Advances in end user computing series/Advances in end user computing (AEUC) book series · doi:10.4018/978-1-60566-136-0.ch004 · Cited by 3
An integrated project evaluation tool for PFI seaport projects
Kurniawan, F., Ogunlana, S. O., & Motawa, I. A. (2010) · Cited by 3
Detecting and Predicting Evolution in Spreadsheets - A Case Study in an Energy Network Company
Jansen, B., Hermans, F., & Tazelaar, E. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00074 · Cited by 3
SheetGit: A Tool for Collaborative Spreadsheet Development
Moreira, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-50230-4_32 · Cited by 3
LeBlanc, L. J., Bartolacci, M. R., & Grossman, T. A. (2016) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.2016.0856 · Cited by 3
Introduction to Classroom Sprego
Csernoch, M., & Biró, P. (2016) · University of Debrecen Electronic Archive (University of Debrecen) · Cited by 3
Controls over Spreadsheets for Financial Reporting in PracticePreprint
Coster, N., Leon, L. A., Kalbers, L. P., & Abraham, D. M. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.6887 · Cited by 3
Computational Models of Spreadsheet Development: Basis for Educational ApproachesPreprint
Hodnigg, K., Clermont, M., & Mittermeir, R. T. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0801.4274 · Cited by 3
The fourth workshop on end-user software engineering
Abraham, R., Burnett, M., & Shaw, M. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1370175.1370245 · Cited by 3
A Data Model to Support End User Software Engineering
Scaffidi, C. P. (2007) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icsecompanion.2007.11 · Cited by 3
Tool-assisted Spreadsheet Refactoring and Parsing Spreadsheet Formulas
Hoepelman, D. (2015) · Research Repository (Delft University of Technology) · Cited by 3
The use of Charts, Pivot Tables, and Array Formulas in two Popular Spreadsheet CorporaPreprint
Jansen, B., & Hermans, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.10642 · Cited by 3
Noble, J., & Biddle, R. (2003) · Software Visualization · doi:10.1007/978-1-4615-0457-3_12 · Cited by 3
GeoMCP: A Trustworthy Framework for AI-Assisted Analytical Geotechnical EngineeringPreprint
Bekele, Y. W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.01022 · Cited by 3
A Software Laboratory for Advancing Decision Support Simulation
Wagner, G. R., Paradice, D., & Courtney, J. F. (2007) · Springer eBooks · doi:10.1007/1-84628-231-4_22 · Cited by 3
Are Mobile Spreadsheet Applications Usable?
Flood, D., Harrison, R., Iacob, C., Nosseir, A., & McDaid, K. (2000) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2013010103 · Cited by 2
Analysis of Students' Programming Knowledge and Error Development
Albrecht, E. (2022) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-21 · Cited by 2
Kudebayeva, A., Harte, C. A., Bryan–Kinns, N., & Stockman, T. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2361209 · Cited by 2
An investigation of end user development success
McGill, T. J. (2002) · Murdoch University Research Portal · Cited by 2
Females' and males' end-user debugging strategies : a sensemaking perspective
Grigoreanu, V., Burnett, M., Wiedenbeck, S., Cao, J., & Rector, K. (2009) · Cited by 2
Towards improving conceptual modeling: an examination of common errors and their underlying reasons
Ram, S., & Currim, S. A. (2008) · Cited by 2
Al-nawaiseh, H. N. F., & Nawaiseh, M. E. (2026) · Al-Zaytoonah University Journal of Business · doi:10.15849/zjjb.v1i02.44 · Cited by 2
SUPPORT VECTOR MACHINE IN GENDER RECOGNITION
Stawska, Z. (2017) · Information System in Management · doi:10.22630/isim.2017.6.4.6 · Cited by 2
A Model-Based Framework for Legal Policy Simulation and Compliance Checking
Soltana, G. (2017) · Open Repository and Bibliography (University of Luxembourg) · Cited by 2
Preparation for Strategy Execution
Heesen, B. (2024) · Management for professionals · doi:10.1007/978-3-662-68807-6_3 · Cited by 2
On Reducing the Pre-release Failures of Web Plug-In on Social Networking Site
Yu, X., Li, J., & Zhong, H. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01680-6_22 · Cited by 2
Cross-source Data Error Detection Approach Based on Federated Learning
Chen, L., Guo, Y., Ge, C., Zheng, B., & Gao, Y. (2023) · International Journal of Software and Informatics · doi:10.21655/ijsi.1673-7288.00295 · Cited by 2
Han, Z., He, Y., Kang, S., Xie, M., Cui, W., Ge, S., Zhang, H., Zhang, D., Chaudhuri, S., Mao, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.07060 · Cited by 2
A Programming System forEnd-user Functional Programming
Alam, A. (2015) · Research Repository (University of Gloucestershire) · Cited by 2
Pedagógushallgatók nemzetközi mobilitási tervei
Dusa, Á. R. (2015) · University of Debrecen Electronic Archive (University of Debrecen) · Cited by 2
Szakmai szocializáció a felsőoktatásban
Pusztai, G., & Ceglédi, T. (2015) · Repository of the Academy's Library (Library of the Hungarian Academy of Sciences) · Cited by 2
A Graphical Approach for Reducing Spreadsheet Linking Errors
Morrison, C. E., Morrison, J., Melrose, J. P., & Wilson, E. V. (2003) · Advances in end user computing series/Advances in end user computing (AEUC) book series · doi:10.4018/978-1-59140-065-3.ch009 · Cited by 2
Tahirov, T. (2015) · SPE Annual Technical Conference and Exhibition · doi:10.2118/174768-ms · Cited by 2
Knowledge Based System for Cost Optimization
Tammineni, S. V., Scanlan, J. P., & Reed, P. A. S. (2007) · AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference (SDM) · doi:10.2514/6.2007-1907 · Cited by 2
Overreliance on Mathematical Accuracy of Computer Output: An Issue for IT Educators
Sims, I., O'Leary, C., & Boolaky, P. K. (2014) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2014070103 · Cited by 2
Cervesato, I. (2013) · Cognitive technologies · doi:10.1007/978-3-642-37747-1_8 · Cited by 2
Policy analytics need more than a spreadsheet: a case study in funding formulae
Hewson, P., Halliday, J. E., Gibson, A., & Asthana, S. (2013) · Annals of Operations Research · doi:10.1007/s10479-013-1475-4 · Cited by 2
Błaszczuk, D. J. (2017) · Information System in Management · doi:10.22630/isim.2017.6.4.2 · Cited by 2
Csernoch, M., & Biró, P. (2015) · University of Debrecen Electronic Archive (University of Debrecen) · Cited by 2
Intelligent Voice Navigation of Spreadsheets
Flood, D., McDaid, K., McCaffery, F., & Bishop, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87391-4_73 · Cited by 2
Spreadsheet Modeling for Insight
Powell, S. G. (2004) · Cited by 2
An Innovative Spreadsheet Authoring Environment
Petti, R. J., & Cannon, H. I. (2008) · The Journal of Internet Banking and Commerce · Cited by 2
Audit-Werkzeuge für Spreadsheets
Berberich, T., & Bach, A. (2012) · Fachbereich Informatik (University of Stuttgart) · Cited by 2
Bringing educational theory to end-user programming
Prabhakararao, S. (2004) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2003.1260250 · Cited by 2
End-User Programming Productivity Tools
Ko, A. J., Myers, B. A., Coblenz, M. J., & Stylos, J. (2006) · KiltHub Repository · doi:10.1184/r1/6622106 · Cited by 2
Using a visual language to create better spreadsheets
Jansen, B., & Hermans, F. (2014) · Research Repository (Delft University of Technology) · Cited by 2
The first workshop on end-user software engineering
Rothermel, G., & Elbaum, S. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2005.1553668 · Cited by 2
Takaki, S. T. (2005) · ScholarSpace (University of Hawaii at Manoa) · Cited by 2
How do Analysts Process Pension Information?Preprint
Døskeland, T., & Kinserdal, F. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1463226 · Cited by 2
Business Valuation Software: A Blueprint for ReliabilityPreprint
de Souza, C. A., & Bee, S. (2005) · SSRN Electronic Journal · doi:10.2139/ssrn.844543 · Cited by 2
Spreadsheet Modeling for Operations Research Practice
Grossman, T. A. (2015) · Wiley eBooks · doi:10.1002/9780470400531.eorms1099 · Cited by 2
Some Spreadsheet Poka-YokePreprint
Bekenn, B., & Hooper, R. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0930 · Cited by 2
Scaling up an end-user dependability framework for spreadsheets
Creelan, T. (2004) · Cited by 2
Live-Prüfung von Spreadsheets während der Bearbeitung
Toth, F. (2014) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-3459 · Cited by 2
Problem Solving in SpregoPreprint
Csernoch, M., & Biró, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.02262 · Cited by 2
Enron versus EUSES: A Comparison of Two Spreadsheet Corpora
Jansen, B. (2015) · Figshare · doi:10.6084/m9.figshare.1297900 · Cited by 2
Dynamic, incremental assertion propagation in end-user programming
Creswick, E. R. (2004) · Cited by 2
A Use Case-Engineering Resources Taxonomy for Analytical Spreadsheet ModelsPreprint
Grossman, T. A., & Mehrotra, V. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.00104 · Cited by 2
Why Spreadsheets are Inadequate for Uncertainty Analysis
Castrup, S. G. (2004) · Cited by 2
Beck, S. (2014) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-3306 · Cited by 2
Features Identification and Selection
Savoy, J. (2020) · Springer eBooks · doi:10.1007/978-3-030-53360-1_5 · Cited by 1
Sprego, End-user Programming in Spreadsheets.
Csernoch, M., & Biró, P. (2017) · PPIG · Cited by 1
Grammar Practices in the Digital World
Csernoch, M., & Imre, A. (2024) · Acta Universitatis Sapientiae Philologica · doi:10.47745/ausp-2024-0017 · Cited by 1
DSS Developed by Managers: What is Really Supported?
Carlsson, S. A. (2001) · Journal of Decision System · doi:10.3166/jds.10.217-240 · Cited by 1
Baars, H., & Kemper, H.-G. (2021) · Springer eBooks · doi:10.1007/978-3-8348-2344-1_3 · Cited by 1
Spreadsheet Error Correction Using an Activity Framework and a Cognitive Fit Perspective
Goswami, S., Chan, H. C., & Kim, H. W. (2006) · National University of Singapore · Cited by 1
Gender Differences in End-User Debugging Strategies
Beckwith, L., Grigoreanu, V., Subrahmaniyan, N., Wiedenbeck, S., Burnett, M., Cook, C. R., Bucht, K., & Drummond, R. (2007) · Cited by 1
Kulesz, D., Käfer, V., & Wagner, S. (2018) · Journal of Software Evolution and Process · doi:10.1002/smr.1934 · Cited by 1
Noprianto, N., Soewito, B., Gaol, F. L., Warnars, H. L. H. S., & Warnars, H. L. H. S. (2016) · Knowledge, Information, and Creativity Support Systems · doi:10.1109/kicss.2016.7951447 · Cited by 1
The Effect of the Frequency and Source of Instructional Messages on Knowledge Sharing Behavior
Cheng, X. (2021) · Journal of Information Systems · doi:10.2308/isys-2020-069 · Cited by 1
Liron, R. (2016) · theses.fr (ABES) · doi:10.70675/a513543ezdaf6z4961z81f5ze71b21c8834a · Cited by 1
Time, Cost and Quantity Interoperability: A New Common Language for General Contractors
Latreille, S., & Marcombe, P. (2025) · Lecture notes in civil engineering · doi:10.1007/978-3-031-84208-5_50 · Cited by 1
Examining support of narrative scripting for serious games
Kauhanen, M. (2009) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2009-08929 · Cited by 1
Preparation for Strategy Execution
Heesen, B. (2015) · Management for professionals · doi:10.1007/978-3-662-47923-0_3 · Cited by 1
Risks of user-development application in small business
Dahalin, Z. M. (2005) · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia) · Cited by 1
SPREADSHEET ERROR DETECTION: AN EMPIRICAL EXAMINATION IN THE CONTEXT OF GREECE
Maditinos, D., Chatzoudes, D., & Tsairidis, C. (2012) · Business Management and Education · doi:10.3846/bme.2012.10 · Cited by 1
Automating data preparation with statistical analysis
Wang, P. (2021) · Summit (Simon Fraser University) · Cited by 1
End-User Development in the Internet of Things
Roffarello, A. M. (2020) · PORTO@Iris · Cited by 1
Research on Enterprise Spreadsheet Model Based-on Semantic
Zhao, C., Zhao, L., & Zhang, X. (2009) · International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2009.650 · Cited by 1
Exploring Spreadsheet Use and Practices in a Technologically Constrained SettingPreprint
Mkamanga, K. M., & Thorne, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.07696 · Cited by 1
Nandam, S., & Paternina-Arboleda, C. D. (2026) · Information · doi:10.3390/info17050468 · Cited by 1
Errors in Operational Spreadsheets
Powell, S. G., Baker, K. R., & Lawson, B. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-577-3.ch011 · Cited by 1
STAT: Enhancing confidence in clinical data analysis
Tay, C. J. X., Koh, C. W., Qui, M., Huang, K. Y., Zhong, Y., & Chan, K. R. (2025) · Annals of the Academy of Medicine Singapore · doi:10.47102/annals-acadmedsg.202570 · Cited by 1
Metadata
- Authors
- Panko, R. R.
- Affiliations
- University of Hawaiʻi at Mānoa (US)
- Corresponding author
- Panko, Raymond R.
- Venue
- Journal of Organizational and End User Computing
- Publisher
- IGI Global Scientific Publishing
- Published
- 1998-04
- Volume
- 10
- Issue
- 2
- Pages
- 15-21
- ISSN
- 1546-2234 (ISSN-L)
- 1546-5012
- OpenAlex
- W2112338634
- Cited by
- 464
- References
- 64
- Citations by year
- 2026: 12 · 2025: 9 · 2024: 6 · 2023: 7 · 2022: 7 · 2021: 8 · 2020: 17 · 2019: 14 · 2018: 16 · 2017: 27 · 2016: 21 · 2015: 22 · 2014: 17 · 2013: 19 · 2012: 25
- FWCI
- 33.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Organizational and End User Computing (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- spreadsheet errors, error rate, spreadsheet development, spreadsheet testing, human error, modularization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.