What We Know About Spreadsheet Errors
The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
Although some spreadsheets are small “scratch pad” applications, many are large and complex, and many missioncritical decisions depend on spreadsheet analyses. In recent years, we have learned a good deal about the errors that people make when they develop spreadsheets. In general, errors seem to occur in a few percent of all cells, meaning that for large spreadsheets, the issue is how many errors there are, not whether an error exists. These error rates, although troubling, are in line with error rates in programming and other human cognitive domains. In programming, we have learned to follow strict development disciplines to eliminate most errors. Surveys of spreadsheet developers indicate that spreadsheet creation, in contrast, is informal, and that few organizations have comprehensive policies for spreadsheet development. Although prescriptive articles have focused on such disciplines as modularization and having assumptions sections, these may be far less important than postdevelopment testing.Request access from your librarian to read this article's full text.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research shows that errors are surprisingly common in the business setting [4]”
From Gene name errors: Lessons not learned (2021) · cites this paper as [4]
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(2013) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,799
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
(1998) · PDCA/Test · doi:10.1201/9781420048131.axh · Cited by 1,900
Identifying the organization of writing processes
Haves, J. (1980) · Medical Entomology and Zoology · Cited by 1,553
Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.6.2.107 · Cited by 1,477
Animal Intelligence: An Experimental Study of the Associative Processes in Animals
Kline, L. W., & Thorndike, E. L. (1898) · The American Journal of Psychology · doi:10.2307/1412682 · Cited by 1,092
Thinking, Problem Solving, Cognition
D., C. P., & Mayer, R. E. (1984) · The American Journal of Psychology · doi:10.2307/1422612 · Cited by 992
How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life
Gilovich, T. D. (1991) · Medical Entomology and Zoology · Cited by 990
Edmondson, A. C. (1996) · The Journal of Applied Behavioral Science · doi:10.1177/0021886396321001 · Cited by 937
Cited by
Items 101–200 of 589
Individualised interactive formative assessments to promote independent learning
Blayney, P., & Freeman, M. A. (2008) · Journal of Accounting Education · doi:10.1016/j.jaccedu.2008.01.001 · Cited by 30
Evaluating Mobile Applications: A Spreadsheet Case Study
Flood, D., Harrison, R., Iacob, C., & Duce, D. (2012) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2012100103 · Cited by 29
Calculation View: multiple-representation editing in spreadsheets
Sarkar, A., Gordon, A. D., Jones, S., & Toronto, N. (2018) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2018.8506584 · Cited by 29
Using objects of measurement to detect spreadsheet errors
Coblenz, M. J., Ko, A. J., & Myers, B. A. (2005) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2005.67 · Cited by 29
Test reuse in the spreadsheet paradigm
Ii, M. F., Jin, D., Rothermel, G., & Burnett, M. (2003) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2002.1173265 · Cited by 29
A knowledge-based system for cost modelling of aircraft gas turbines
Tammineni, S. V., Rao, A. R., Scanlan, J. P., Reed, P. A. S., & Keane, A. J. (2008) · Journal of Engineering Design · doi:10.1080/09544820701870805 · Cited by 29
Integrating Spreadsheet Engineering in a Management Science Course: A Hierarchical Approach
Grossman, T. A. (2006) · INFORMS Transactions on Education · doi:10.1287/ited.7.1.18 · Cited by 29
Stolee, K. T., Elbaum, S. G., & Sarma, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.10.004 · Cited by 28
BumbleBee: a refactoring environment for spreadsheet formulas
Hermans, F., & Dig, D. (2014) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2635868.2661673 · Cited by 28
Towards a taxonomy of errors in HTML and CSS
Park, T. H., Saxena, A., Jagannath, S., Wiedenbeck, S., & Forte, A. (2013) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2493394.2493405 · Cited by 28
Professional end user developers and software development knowledge
Segal, J. (2004) · Open Research Online (The Open University) · doi:10.21954/ou.ro.00016013 · Cited by 28
Test-driven development: can it work for spreadsheets?
McDaid, K., Rust, A., & Bishop, B. (2008) · International Workshop on End-User Software Engineering (WEUSE) · doi:10.1145/1370847.1370853 · Cited by 28
Spreadsheet DebuggingPreprint
Ayalew, Y., & Mittermeir, R. T. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0801.4280 · Cited by 27
Developing Computational Thinking Skills With Algorithm-Driven Spreadsheeting
Csernoch, M., Biró, P., & Máth, J. (2021) · IEEE Access · doi:10.1109/access.2021.3126757 · Cited by 27
Errors in Operational Spreadsheets: A Review of the State of the Art
Powell, S. G., Baker, K. R., & Lawson, B. (2009) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2009.197 · Cited by 27
Model-based simulation of legal policies: framework, tool support, and validation
Soltana, G., Sannier, N., Sabetzadeh, M., & Briand, L. (2016) · Software & Systems Modeling · doi:10.1007/s10270-016-0542-0 · Cited by 27
Investments in combined cycle natural gas-fired systems: A real options analysis
Zambujal‐Oliveira, J. (2013) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2012.11.015 · Cited by 26
Interactive fault localization techniques in a spreadsheet environment
Ruthruff, J. R., Burnett, M., & Rothermel, G. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.37 · Cited by 24
(1986) · De Gruyter eBooks · doi:10.1515/9783110849769-015 · Cited by 24
Chen, S., He, Y., Cui, W., Fan, J., Ge, S., Zhang, H., Zhang, D., & Chaudhuri, S. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3654925 · Cited by 24
Issues of Human Computer Interaction
Sarmento, A. (2004) · IGI Global eBooks · doi:10.4018/978-1-59140-191-9 · Cited by 24
How Electronic Spreadsheets Changed the World
Hesse, R., & Scerno, D. H. (2009) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.1080.0376 · Cited by 24
Spreadsheet testing in practice
Roy, S., Hermans, F., & van Deursen, A. (2017) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2017.7884634 · Cited by 23
Harteis, C., & Bauer, J. (2014) · Springer international handbooks of education · doi:10.1007/978-94-017-8902-8_26 · Cited by 23
An Alternative Fit through Problem Representation in Cognitive Fit Theory
Chan, H. C., Goswami, S., & Kim, H. (2012) · Journal of Database Management · doi:10.4018/jdm.2012040102 · Cited by 23
A Pilot Study Exploring Spreadsheet Risk in Scientific Research
AlTarawneh, G., & Thorne, S. (2017) · Cardiff Metropolitan Research Repository (Cardiff Metropolitan University) · doi:10.48550/arxiv.1703.09785 · Cited by 23
Measuring Spreadsheet Formula UnderstandabilityPreprint
Hermans, F., Pinzger, M., & van Deursen, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1209.3517 · Cited by 23
Spreadsheet visualisation to improve end-user understanding
Ballinger, D., Biddle, R., & Noble, J. (2003) · Cited by 22
Krishna, V., Cook, C., Keller, D. K., Wallace, J. C. C., Burnett, M., & Rothermel, G. (2002) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2001.972713 · Cited by 22
How Spreadsheet Applications Affect Information Quality
Baškarada, S. (2011) · Journal of Computer Information Systems · doi:10.1080/08874417.2011.11645488 · Cited by 22
Principles and methods of model validation for model risk reduction
Collier, Z. A., & Lambert, J. H. (2019) · Environment Systems & Decisions · doi:10.1007/s10669-019-09723-5 · Cited by 22
End-user programmers on the loose: A study of programming on the phone for the phone
Athreya, B., Bahmani, F., Diede, A., & Scaffidi, C. (2012) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2012.6344486 · Cited by 22
Analyzing large spreadsheet programs
Clermont, M. (2004) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2003.1287261 · Cited by 21
WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation
Rothermel, K. J., Cook, C., Burnett, M., Schonfeld, J., Green, T. R. G., & Rothermel, G. (2002) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2000.870414 · Cited by 21
A Scalable Approach to Spreadsheet Visualization
Clermont, M. (2003) · Cited by 21
Spatio-textual spreadsheets: geotagging via spatial coherence
Lieberman, M. D., Samet, H., Sankaranarayanan, J., & Sperling, J. (2009) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/1653771.1653860 · Cited by 21
An Empirical Study of End-User Behaviour in Spreadsheet Error Detection & CorrectionPreprint
Bishop, B., & McDaid, K. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0802.3479 · Cited by 21
UNSUPERVISED INFERENCE OF DATA FORMATS IN HUMAN-READABLE NOTATION
Scaffidi, C. P. (2007) · International Conference on Enterprise Information Systems · doi:10.5220/0002347902360241 · Cited by 20
Teachers' perception of Jupyter and R Shiny as digital tools for open education and sciencePreprint
Hanč, J., Štrauch, P., Paňková, E., & Hančová, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.11262 · Cited by 20
Two principles of end-user software engineering research
Segal, J. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1082983.1083240 · Cited by 20
TEACHERS’ ASSESSMENT AND STUDENTS’ SELF-ASSESSMENT ON THE STUDENTS’ SPREADSHEET KNOWLEDGE
Csernoch, M., & Biró, P. (2013) · University of Debrecen Electronic Archive (University of Debrecen) · Cited by 20
Excel Competency for the Professional Accountant: Advanced Applications, Controls, and Audit Add-ins
Brown, W. C., & Pike, B. J. (2010) · AIS Educator Journal · doi:10.3194/1935-8156-5.1.25 · Cited by 20
Westfall, R. D. (2001) · Communications of the Association for Information Systems · doi:10.17705/1cais.00626 · Cited by 20
Sharing reasoning about faults in spreadsheets: An empirical study
Lawrance, J., Abraham, R., Burnett, M., & Erwig, M. (2006) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2006.43 · Cited by 19
Reasoning about many-to-many requirement relationships in spreadsheets
Beckwith, L., Burnett, M., & Cook, C. (2003) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2002.1046367 · Cited by 19
Design patterns: augmenting design practice in parametric CAD systems
Qian, Z. C. (2009) · Summit (Simon Fraser University) · Cited by 19
Using Excel and Excel VBA for Preliminary Analysis in Big Data Research
Blayney, P., & Sun, Z. (2019) · Advances in data mining and database management book series · doi:10.4018/978-1-5225-7277-0.ch007 · Cited by 19
Finding errors in the Enron spreadsheet corpus
Schmitz, T., & Jannach, D. (2016) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2016.7739679 · Cited by 19
Spreadsheet Decision-Support Tools: Lessons Learned at Hewlett-Packard
Olavson, T., & Fry, C. (2008) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.1080.0368 · Cited by 19
Organisational Learning and Software Process Improvement: A Case Study
Segal, J. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44814-4_8 · Cited by 19
Scaling a Dataflow Testing Methodology to the MultiparadigmWorld of Commercial Spreadsheets
Fisher, M., Rothermel, G., Creelan, T., & Burnett, M. (2006) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2006.40 · Cited by 18
Klein, B. D., & Rossin, D. F. (1999) · Informing Science The International Journal of an Emerging Transdiscipline · doi:10.28945/599 · Cited by 18
Case study: Developing long-term knowledge with Sprego
Csapó, G., Sebestyén, K., Csernoch, M., & Abari, K. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10295-0 · Cited by 17
The Future of Spreadsheets in the Big Data EraPreprint
Birch, D., Lyford-Smith, D., & Guo, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.10231 · Cited by 17
Using Bayesian statistical methods to determine the level of error in large spreadsheets.
Bradley, L., & McDaid, K. (2009) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion.2009.5071019 · Cited by 17
XLBlocks: a Block-based Formula Editor for Spreadsheet Formulas
Jansen, B., & Hermans, F. (2019) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2019.8818748 · Cited by 16
Static Analysis of Spreadsheet Applications for Type-Unsafe Operations Detection
Cheng, T., & Rival, X. (2015) · Lecture notes in computer science · doi:10.1007/978-3-662-46669-8_2 · Cited by 16
Context in Spreadsheet Comprehension.
Kohlhase, A. E., Kohlhase, M., & Гусева, А. П. (2015) · Cited by 15
Spreadsheet Error Types and Their Prevalence in a Healthcare Context
Dobell, E., Herold, S., & Buckley, J. (2018) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2018040102 · Cited by 15
Beyond the mechanics of spreadsheets: using design instruction to address spreadsheet errors
Schneider, K. N., Becker, L. L., & Berg, G. G. (2017) · Accounting Education · doi:10.1080/09639284.2016.1274912 · Cited by 15
Towards a taxonomy of errors in PLC programming
Duschl, K. C., Gramß, D., Obermeier, M., & Vogel‐Heuser, B. (2014) · Cognition Technology & Work · doi:10.1007/s10111-014-0307-x · Cited by 15
An empirical study of spreadsheet authors' mental models in explaining and debugging tasks
Kankuzi, B., & Sajaniemi, J. (2013) · 2013 IEEE Symposium on Visual Languages and Human Centric Computing · doi:10.1109/vlhcc.2013.6645237 · Cited by 14
“I. INTRODUCTION Spreadsheets are one of the most widely used applications in business and other related fields for various purposes such as accounting [7], [9].”
BackgroundA mental model perspective for tool development and paradigm shift in spreadsheets
Kankuzi, B., & Sajaniemi, J. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.10.005 · Cited by 14
Enabling data science for the majority
Parameswaran, A. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3352063.3352148 · Cited by 14
Bad numbers: coping with flawed decision support
Willemain, T. R., Wallace, W. A., Fleischmann, K. R., Waisel, L. B., & Ganaway, S. N. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601605 · Cited by 14
An empirical study of fault localization for end-user programmers
Ruthruff, J. R., Burnett, M., & Rothermel, G. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2005.1553578 · Cited by 14
Controlling End User Computing Applications - a case studyPreprint
Chambers, J., & Hamill, J. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0809.3595 · Cited by 14
Spreadsheet practices and challenges in a large multinational conglomerate
Smith, J., Middleton, J., & Kraft, N. A. (2017) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2017.8103463 · Cited by 13
Pair Collaboration in End-User Debugging
Chintakovid, T., Wiedenbeck, S., Burnett, M., & Grigoreanu, V. (2006) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2006.36 · Cited by 13
Avdic, A. (2017) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2018010105 · Cited by 13
Supporting End-User Service Composition: A Systematic Review of Current Activities and Tools
Hang, F., & Zhao, L. (2015) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2015.70 · Cited by 13
Muchsini, B., Siswandari, S., Gunarhadi, G., & Wiranto, W. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2222866 · Cited by 13
A Review of Spreadsheet Error Reduction Techniques
Thorne, S. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02534 · Cited by 13
Toward an Integrated Framework for Declarative and Interactive Spreadsheet Debugging
Jannach, D., Baharloo, A., & Williamson, D. (2013) · International Conference on Evaluation of Novel Approaches to Software Engineering · doi:10.5220/0004410601170124 · Cited by 13
NOAH: interactive spreadsheet exploration with dynamic hierarchical overviews
Rahman, S., Bendre, M., Liu, Y., Zhu, S., Su, Z., Karahalios, K. G., & Parameswaran, A. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3447689.3447701 · Cited by 13
Planted-model evaluation of algorithms for identifying differences between spreadsheets
Harutyunyan, A., Borradaile, G., Chambers, C., & Scaffidi, C. (2012) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2012.6344471 · Cited by 13
Heuristics for the automatic identification of irregularities in spreadsheets
Clermont, M. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1082983.1083234 · Cited by 13
Exception handling in the spreadsheet paradigm
Burnett, M., Agrawal, A., & Zee, P. V. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.879817 · Cited by 12
Requirements Are All You Need: The Final Frontier for End-User Software Engineering
Robinson, D., Cabrera, C., Gordon, A. D., Lawrence, N. D., & Mennen, L. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708524 · Cited by 12
INTRODUCING CONDITIONAL ARRAY FORMULAS IN SPREADSHEET CLASSES
Csernoch, M. (2012) · University of Debrecen Electronic Archive (University of Debrecen) · Cited by 12
A Survey on Table Mining with Large Language Models: Challenges, Advancements and Prospects
Cheng, M., Mao, Q., Liu, Q., Zhou, Y., Li, Y., Wang, J., Lin, J., Cao, J., & Chen, E. (2026) · ACM Computing Surveys · doi:10.1145/3844608 · Cited by 12
Spreadsheets and the financial planning process: a case study of resistance to change
Howcroft, D. (2006) · Journal of Accounting & Organizational Change · doi:10.1108/18325910610690081 · Cited by 12
Tchórzewski, J. (2017) · Information System in Management · doi:10.22630/isim.2017.6.4.8 · Cited by 12
Spreadsheet structure inspection using low level access and visualisation
Ballinger, D., Biddle, R., & Noble, J. (2003) · Australasian User Interface Conference · Cited by 12
Sampling, Control, and Mass Balancing
WILLS, B. A., & Finch, J. A. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097053-0.00003-0 · Cited by 12
Detecting Spreadsheet Errors: An Education Case
Janvrin, D. J. (2008) · Issues in Accounting Education · doi:10.2308/iace.2008.23.3.435 · Cited by 12
Interpretation as a factor in understanding flawed spreadsheetsPreprint
Banks, D., & Monday, A. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0801.1856 · Cited by 12
Enron versus EUSES: A Comparison of Two Spreadsheet Corpora
Jansen, B. (2015) · Figshare · doi:10.6084/m9.figshare.1297900.v1 · Cited by 12
Pre-testing erroneous text-based documents: Logging end-user activities
Nagy, K., & Csernoch, M. (2023) · Frontiers in Education · doi:10.3389/feduc.2022.958635 · Cited by 11
How can non-technical end users effectively test their spreadsheets?
Poon, P., Kuo, F., Liu, H., & Chen, T. Y. (2014) · Information Technology and People · doi:10.1108/itp-01-2013-0004 · Cited by 11
An empirical evaluation of a testing and debugging methodology for Excel
Carver, J. C., Fisher, M., & Rothermel, G. (2006) · International Symposium on Empirical Software Engineering · doi:10.1145/1159733.1159775 · Cited by 11
Leon, L. A., Abraham, D. M., & Kalbers, L. P. (2010) · Communications of the Association for Information Systems · doi:10.17705/1cais.02728 · Cited by 11
A spreadsheet life cycle analysis and the impact of Sarbanes–Oxley
Leon, L. A., Kalbers, L. P., Coster, N., & Abraham, D. M. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.06.006 · Cited by 11
Spreadsheet Proficiency: Which Spreadsheet Skills Are Important?
Lee, C. B. P., Heng, T., Sam, K. M., & Xiong, G. (2018) · Cited by 11
An Abstract Domain to Infer Types over Zones in Spreadsheets
Cheng, T., & Rival, X. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33125-1_9 · Cited by 11
Visually testing recursive programs in spreadsheet languages
Burnett, M., Ren, B. Y., Ko, A. J., Cook, C. R., & Rothermel, G. (2001) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2001.995276 · Cited by 11
NEXCEL, a deductive spreadsheet
Cervesato, I. (2007) · The Knowledge Engineering Review · doi:10.1017/s0269888907001142 · Cited by 11
Using topes to validate and reformat data in end-user programming tools
Scaffidi, C. P., Cypher, A., Elbaum, S. G., Koesnandar, A., Lin, J. W., Myers, B. A., & Shaw, M. (2008) · International Workshop on End-User Software Engineering (WEUSE) · doi:10.1145/1370847.1370850 · Cited by 11
Hughes, J. A. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.123311 · Cited by 10
Investigating the Potential of Test-Driven Development for Spreadsheet EngineeringPreprint
Rust, A., Bishop, B., & McDaid, K. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0801.4802 · Cited by 10
Metadata
- Authors
- Panko, R. R.
- Affiliations
- University of Hawaiʻi at Mānoa (US)
- Corresponding author
- Panko, Raymond R.
- Venue
- Journal of Organizational and End User Computing
- Publisher
- IGI Global Scientific Publishing
- Published
- 1998-04
- Volume
- 10
- Issue
- 2
- Pages
- 15-21
- ISSN
- 1546-2234 (ISSN-L)
- 1546-5012
- OpenAlex
- W2112338634
- Cited by
- 464
- References
- 64
- Citations by year
- 2026: 12 · 2025: 9 · 2024: 6 · 2023: 7 · 2022: 7 · 2021: 8 · 2020: 17 · 2019: 14 · 2018: 16 · 2017: 27 · 2016: 21 · 2015: 22 · 2014: 17 · 2013: 19 · 2012: 25
- FWCI
- 33.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Organizational and End User Computing (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- spreadsheet errors, error rate, spreadsheet development, spreadsheet testing, human error, modularization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.