What We Know About Spreadsheet Errors
The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
Although some spreadsheets are small “scratch pad” applications, many are large and complex, and many missioncritical decisions depend on spreadsheet analyses. In recent years, we have learned a good deal about the errors that people make when they develop spreadsheets. In general, errors seem to occur in a few percent of all cells, meaning that for large spreadsheets, the issue is how many errors there are, not whether an error exists. These error rates, although troubling, are in line with error rates in programming and other human cognitive domains. In programming, we have learned to follow strict development disciplines to eliminate most errors. Surveys of spreadsheet developers indicate that spreadsheet creation, in contrast, is informal, and that few organizations have comprehensive policies for spreadsheet development. Although prescriptive articles have focused on such disciplines as modularization and having assumptions sections, these may be far less important than postdevelopment testing.Request access from your librarian to read this article's full text.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research shows that errors are surprisingly common in the business setting [4]”
From Gene name errors: Lessons not learned (2021) · cites this paper as [4]
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(2013) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,799
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
(1998) · PDCA/Test · doi:10.1201/9781420048131.axh · Cited by 1,900
Identifying the organization of writing processes
Haves, J. (1980) · Medical Entomology and Zoology · Cited by 1,553
Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.6.2.107 · Cited by 1,477
Animal Intelligence: An Experimental Study of the Associative Processes in Animals
Kline, L. W., & Thorndike, E. L. (1898) · The American Journal of Psychology · doi:10.2307/1412682 · Cited by 1,092
Thinking, Problem Solving, Cognition
D., C. P., & Mayer, R. E. (1984) · The American Journal of Psychology · doi:10.2307/1422612 · Cited by 992
How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life
Gilovich, T. D. (1991) · Medical Entomology and Zoology · Cited by 990
Edmondson, A. C. (1996) · The Journal of Applied Behavioral Science · doi:10.1177/0021886396321001 · Cited by 937
Cited by
Reconceptualizing System Usage: An Approach and Empirical Test
Burton-Jones, A., & Straub, D. W. (2006) · Information Systems Research · doi:10.1287/isre.1060.0096 · Cited by 1,040
The Ultimate qPCR Experiment: Producing Publication Quality, Reproducible Data the First Time
Taylor, S. C., Nadeau, K., Abbasi, M., Lachance, C., Nguyen, M., & Fenrich, J. (2019) · Trends in Biotechnology · doi:10.1016/j.tibtech.2018.12.002 · Cited by 830
The state of the art in end-user software engineering
Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., et al. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922658 · Cited by 633
User Developed Applications and Information Systems Success: A Test of DeLone and McLean's Model
McGill, T., Hobbs, V., & Klobas, J. (2003) · Information Resources Management Journal · doi:10.4018/irmj.2003010103 · Cited by 290
Data Organization in Spreadsheets
Broman, K. W., & Woo, K. (2018) · The American Statistician · doi:10.1080/00031305.2017.1375989 · Cited by 243
A critical review of the literature on spreadsheet errors
Powell, S. G., Baker, K. R., & Lawson, B. (2008) · Decision Support Systems · doi:10.1016/j.dss.2008.06.001 · Cited by 212
A framework and methodology for studying the causes of software errors in programming systems
Ko, A. J., & Myers, B. A. (2005) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2004.08.003 · Cited by 195
Tinkering and gender in end-user programmers' debugging
Beckwith, L., Kissinger, C., Burnett, M., Wiedenbeck, S., Lawrance, J., Blackwell, A., & Cook, C. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124808 · Cited by 176
A user-centred approach to functions in Excel
Jones, S., Blackwell, A. F., & Burnett, M. (2003) · ACM SIGPLAN International Conference on Functional Programming (ICFP) · doi:10.1145/944705.944721 · Cited by 170
Factors affecting the success of non-majors in learning to program
Wiedenbeck, S. (2005) · Proceedings of the 2005 international workshop on Computing education research - ICER '05 · doi:10.1145/1089786.1089788 · Cited by 158
End-user software engineering with assertions in the spreadsheet paradigm
Burnett, M., Cook, C. R., Pendse, O., Rothermel, G., Summet, J. W., & Wallace, C. (2003) · doi:10.5555/776816.776828 · Cited by 124
Validating the unit correctness of spreadsheet programs
Antoniu, T., Steckler, P. A., Krishnamurthi, S., Neuwirth, E., & Felleisen, M. (2004) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2004.1317466 · Cited by 123
Detecting and visualizing inter-worksheet smells in spreadsheets
Hermans, F., Pinzger, M., & van Deursen, A. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227171 · Cited by 120
Taylor, E. Z. (2006) · Journal of Information Systems · doi:10.2308/jis.2006.20.1.103 · Cited by 117
Severity and impact of computer user frustration: A comparison of student and workplace users
Lazar, J., Jones, A., Hackley, M., & Shneiderman, B. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2005.06.001 · Cited by 111
WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation
Rothermel, K. J., Cook, C. R., Burnett, M., Schonfeld, J., Green, T. R. G., & Rothermel, G. (2000) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/337180.337206 · Cited by 111
Detecting code smells in spreadsheet formulas
Hermans, F., Pinzger, M., & van Deursen, A. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405300 · Cited by 110
Harnessing curiosity to increase correctness in end-user programming
Wilson, A., Burnett, M., Beckwith, L., Granatir, O., Casburn, L., Cook, C., Durham, M., & Rothermel, G. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642665 · Cited by 109
Effectiveness of end-user debugging software features: are there gender issues?
Beckwith, L., Burnett, M., Wiedenbeck, S., Cook, C., Sorte, S., & Hastings, M. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055094 · Cited by 108
Erwig, M., & Burnett, M. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45587-6_12 · Cited by 100
Topes: reusable abstractions for validating data
Scaffidi, C. P., Myers, B. A., & Shaw, M. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1368088.1368090 · Cited by 98
End-user software engineering with assertions in the spreadsheet paradigm
Burnett, M., Cook, C., Pendse, O., Rothermel, G., Summet, J. W., & Wallace, C. (2003) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2003.1201191 · Cited by 98
Gender: An Important Factor in End-User Programming Environments?
Beckwith, L., & Burnett, M. (2005) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.28 · Cited by 96
Development and evaluation of a model of programming errors
Ko, A. J., & Myers, B. A. (2003) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2003.1260196 · Cited by 96
Cognitive capitalism human capital and the wellbeing of nations
Rindermann, H. (2018) · Cited by 93
IS Research Relevance Revisited: Subtle Accomplishment, Unfulfilled Promise, or Serial Hypocrisy?
Kock, N., Gray, P., Hoving, R., Klein, H. K., Myers, M. D., & Rockart, J. (2002) · Communications of the Association for Information Systems · doi:10.17705/1cais.00823 · Cited by 92
Errors in Operational Spreadsheets
Powell, S. G., Baker, K. R., & Lawson, B. (2009) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2009070102 · Cited by 90
Automatically Extracting Class Diagrams from Spreadsheets
Hermans, F., Pinzger, M., & van Deursen, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14107-2_4 · Cited by 89
Impact of errors in operational spreadsheets
Powell, S. G., Baker, K. R., & Lawson, B. (2009) · Decision Support Systems · doi:10.1016/j.dss.2009.02.002 · Cited by 87
Some Problems of Professional End User Developers
Segal, J. (2007) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2007) · doi:10.1109/vlhcc.2007.17 · Cited by 87
Empowering End Users in Debugging Trigger-Action Rules
Corno, F., Russis, L. D., & Roffarello, A. M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300618 · Cited by 86
Graphic designers who program as informal computer science learners
Dorn, B., & Guzdial, M. (2006) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/1151588.1151608 · Cited by 86
Detecting and refactoring code smells in spreadsheet formulas
Hermans, F., Pinzger, M., & van Deursen, A. (2014) · Empirical Software Engineering · doi:10.1007/s10664-013-9296-2 · Cited by 86
Auto-Detect: Data-Driven Error Detection in Tables
Huang, Z., & He, Y. (2018) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3183713.3196889 · Cited by 79
Enron's Spreadsheets and Related Emails: A Dataset and Analysis
Hermans, F., & Murphy-Hill, E. R. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.129 · Cited by 79
Girls Teaching Girls: Free-Choice Collaborative Learning Through Social Computing
Peters, M. R. (2007) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2007.50 · Cited by 78
Using a structured design approach to reduce risks in end user spreadsheet development
Janvrin, D. J., & Morrison, J. (2000) · Information & Management · doi:10.1016/s0378-7206(99)00029-4 · Cited by 78
Jannach, D., Schmitz, T., Hofer, B., & Wotawa, F. (2014) · Journal of Systems and Software · doi:10.1016/j.jss.2014.03.058 · Cited by 75
Enron's spreadsheets and related emails: a dataset and analysis
Hermans, F., & Murphy-Hill, E. R. (2015) · doi:10.5555/2819009.2819013 · Cited by 74
Chilcott, J., Tappenden, P., Rawdin, A., Johnson, M., Kaltenthaler, E., Paisley, S., Papaioannou, D., & Shippam, A. (2010) · Health Technology Assessment · doi:10.3310/hta14250 · Cited by 73
Finding high-level structures in spreadsheet programs
Mittermeir, R. T., & Clermont, M. (2003) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2002.1173080 · Cited by 73
Probing the improbable: methodological challenges for risks with low probabilities and high stakes
Ord, T., Hillerbrand, R., & Sandberg, A. (2010) · Journal of Risk Research · doi:10.1080/13669870903126267 · Cited by 72
“8 find error rates on the order of 88% (Panko 1998).”
BackgroundEnd-user software visualizations for fault localization
Ruthruff, J. R., Creswick, E. R., Burnett, M., Cook, C., Prabhakararao, S., Fisher, M., & Main, M. (2003) · ACM Symposium on Software Visualization (SoftVis) · doi:10.1145/774833.774851 · Cited by 72
Testing homogeneous spreadsheet grids with the "what you see is what you test" methodology
Burnett, M., Sheretov, A., Ren, B. Y., & Rothermel, G. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1010060 · Cited by 71
Better Together? An Evaluation of AI-Supported Code Translation
Weisz, J. D., Muller, M., Ross, S. I., Martinez, F., Houde, S., Agarwal, M., Talamadupula, K., & Richards, J. T. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511157 · Cited by 69
Spreadsheet Errors and Decision Making: Evidence from Field Interviews
Caulkins, J. P., Morrison, E. L., & Weidemann, T. (2007) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2007070101 · Cited by 67
Groce, A., Kulesza, T., Zhang, C., Shamasunder, S., Burnett, M., Wong, W.-K., Stumpf, S., Das, S., Shinsel, A., Bice, F., et al. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.59 · Cited by 66
Uni-Detect: A Unified Approach to Automated Error Detection in Tables
Wang, P., & He, Y. (2019) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3299869.3319855 · Cited by 66
Automatic generation and maintenance of correct spreadsheets
Erwig, M., Abraham, R., Cooperstein, I., & Kollmansberger, S. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1062455.1062494 · Cited by 66
Klein, B. D., & Rossin, D. F. (1999) · Omega · doi:10.1016/s0305-0483(99)00019-5 · Cited by 65
Development of a database for chemical mechanism assignments for volatile organic emissions
Carter, W. (2015) · Journal of the Air & Waste Management Association · doi:10.1080/10962247.2015.1013646 · Cited by 65
Response to Comments on Brandão et al. (2005)
Brandão, L. E. T., Dyer, J. S., & Hahn, W. J. (2005) · Decision Analysis · doi:10.1287/deca.1050.0042 · Cited by 64
An approach for categorizing end user programmers to guide software engineering research
Scaffidi, C. P., Shaw, M., & Myers, B. A. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1082983.1083232 · Cited by 63
Debreceny, R. S. (2006) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2006.407 · Cited by 63
Refactoring meets spreadsheet formulas
Badame, S., & Dig, D. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405299 · Cited by 62
End-user debugging strategies: A sensemaking perspective
Grigoreanu, V., Burnett, M., Wiedenbeck, S., Cao, J., Rector, K., & Kwan, I. (2012) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2147783.2147788 · Cited by 60
Integrating automated test generation into the WYSIWYT spreadsheet testing methodology
Fisher, M., Rothermel, G., Brown, D., Cao, M., Cook, C. R., & Burnett, M. (2006) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1131421.1131423 · Cited by 60
Model-based diagnosis of spreadsheet programs: a constraint-based debugging approach
Jannach, D., & Schmitz, T. (2014) · Automated Software Engineering · doi:10.1007/s10515-014-0141-7 · Cited by 60
Éducation aux TIC, cultures informatique et du numérique : quelques repères historiques
Drot-Delange, B., & Bruillard, É. (2012) · Etudes de communication/Études de communication · doi:10.4000/edc.3393 · Cited by 59
Automated test case generation for spreadsheets
Fisher, M., Cao, M., Rothermel, G., Cook, C. R., & Burnett, M. (2002) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/581339.581359 · Cited by 58
The Impact of Shadow IT Systems on Perceived Information Credibility and Managerial Decision Making
Myers, N., Starliper, M., Summers, S. L., & Wood, D. A. (2017) · Accounting Horizons · doi:10.2308/acch-51737 · Cited by 58
Struggling to Excel: A Field Study of Challenges Faced by Spreadsheet Users
Chambers, C., & Scaffidi, C. (2010) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2010.33 · Cited by 58
ExceLint: automatically finding spreadsheet formula errors
Barowy, D. W., Berger, E. D., & Zorn, B. G. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276518 · Cited by 57
A Hierarchy of Limitations in Machine Learning
Malik, M. M. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2002.05193 · Cited by 51
CUSTODES: automatic spreadsheet cell clustering and smell detection using strong and weak features
Cheung, S.-C., Chen, W., Liu, Y., & Xu, C. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884796 · Cited by 48
The Use of Problem‐Based Learning to Enhance MIS Education
Mykytyn, K., Pearson, A. M., Paul, S., & Mykytyn, P. P. (2008) · Decision Sciences Journal of Innovative Education · doi:10.1111/j.1540-4609.2007.00160.x · Cited by 48
Spreadsheet Engineering: A Research FrameworkPreprint
Grossman, T. A. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0711.0538 · Cited by 48
How Well Do Professional Developers Test with Code Coverage Visualizations? An Empirical Study
Lawrance, J., Clarke, S. M., Burnett, M., & Rothermel, G. (2005) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2005.44 · Cited by 47
Lessons from Mission-Critical Spreadsheets
Grossman, T. A., Mehrotra, V., & Özlük, Ö. (2007) · Communications of the Association for Information Systems · doi:10.17705/1cais.02060 · Cited by 47
An empirical study of fault localization for end-user programmers
Ruthruff, J. R., Burnett, M., & Rothermel, G. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1062455.1062523 · Cited by 46
Type inference for spreadsheets
Abraham, R., & Erwig, M. (2006) · International Symposium on Principles and Practice of Declarative Programming (PPDP) · doi:10.1145/1140335.1140346 · Cited by 45
Role of gender, self-efficacy, anxiety and testing formats in learning spreadsheets
Singh, A., Bhadauria, V. S., Jain, A., & Gurung, A. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.11.009 · Cited by 45
An auditing protocol for spreadsheet models
Powell, S. G., Baker, K. R., & Lawson, B. (2008) · Information & Management · doi:10.1016/j.im.2008.03.004 · Cited by 43
An IS Research Relevancy Manifesto
Westfall, R. D. (1999) · Communications of the Association for Information Systems · doi:10.17705/1cais.00214 · Cited by 42
Improving Investment Decisions Using a Stochastic Integrated Asset Model
Begg, S., Bratvold, R. B., & Campbell, J. M. (2001) · SPE Annual Technical Conference and Exhibition · doi:10.2118/71414-ms · Cited by 42
Interactive, visual fault localization support for end-user programmers
Ruthruff, J. R., Prabhakararao, S., Reichwein, J., Cook, C. R., Creswick, E. R., & Burnett, M. (2004) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2004.07.001 · Cited by 41
Energy and Carbon Management Systems: Organizational Implementation and Application
Melville, N. P., & Whisnant, R. (2014) · Journal of Industrial Ecology · doi:10.1111/jiec.12135 · Cited by 41
Strategies and behaviors of end-user programmers with interactive fault localization
Prabhakararao, S., Cook, C., Ruthruff, J., Creswick, E., Main, M., Durham, M., & Burnett, M. (2004) · IEEE Symposium on Human Centric Computing Languages and Environments, 2003. Proceedings. 2003 · doi:10.1109/hcc.2003.1260197 · Cited by 40
New Perspectives on the System Usage Construct
Burton‐Jones, A. (2005) · Digital Archive @ GSU · doi:10.57709/1063232 · Cited by 40
Gene name errors: Lessons not learned
Abeysooriya, M., Soria, M., Kasu, M. S., & Ziemann, M. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008984 · Cited by 39
Spreadsheets are Code: An Overview of Software Engineering Approaches Applied to Spreadsheets
Hermans, F., Jansen, B., Roy, S., Aivaloglou, E., Swidan, A., & Hoepelman, D. (2016) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2016.86 · Cited by 38
Chalhoub, G., & Sarkar, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501833 · Cited by 38
Detecting Errors in SpreadsheetsPreprint
Ayalew, Y., Clermont, M., & Mittermeir, R. T. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0805.1740 · Cited by 38
The impact of DSS use and information load on errors and decision quality
Williams, M. L., Dennis, A. R., Stam, A., & Aronson, J. E. (2005) · European Journal of Operational Research · doi:10.1016/j.ejor.2005.06.064 · Cited by 37
Automatic generation and maintenance of correct spreadsheets
Erwig, M., Abraham, R., Cooperstein, I., & Kollmansberger, S. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2005.1553556 · Cited by 37
A1: end-user programming for web-based system administration
Kandogan, E., Haber, E. M., Barrett, R., Cypher, A., Maglio, P. P., & Zhao, H. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095070 · Cited by 36
Spreadsheet quality assurance: a literature review
Poon, P., Lau, M. F., Yu, Y. T., & Tang, S.-F. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-023-2384-6 · Cited by 35
Interactive visual functional programming
Hanna, K. J. (2002) · ACM SIGPLAN International Conference on Functional Programming (ICFP) · doi:10.1145/581478.581493 · Cited by 35
Complexity Metrics for Spreadsheet ModelsPreprint
Bregar, A. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0802.3895 · Cited by 34
End-User Programmers and their Communities: An Artifact-based Analysis
Stolee, K. T., Elbaum, S. G., & Sarma, A. (2011) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2011.23 · Cited by 33
A qualitative study of animation programming in the wild
Dahotre, A., Zhang, Y., & Scaffidi, C. P. (2010) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/1852786.1852825 · Cited by 32
qRAT: an R-based stand-alone application for relative expression analysis of RT-qPCR data
Flatschacher, D., Speckbacher, V., & Zeilinger, S. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04823-7 · Cited by 32
Bratvold, R. B., & Begg, S. (2008) · AAPG Bulletin · doi:10.1306/06040808070 · Cited by 32
Abraham, R., Burnett, M., & Erwig, M. (2009) · Wiley eBooks · doi:10.1002/9780470050118.ecse415 · Cited by 32
Analyzing and Visualizing Spreadsheets
Hermans, F. (2013) · Figshare · doi:10.6084/m9.figshare.658936.v1 · Cited by 31
The Role of Visualization Tools in Spreadsheet Error Correction from a Cognitive Fit Perspective
Goswami, S., Chan, H. C., & Kim, H. C. (2008) · Journal of the Association for Information Systems · doi:10.17705/1jais.00162 · Cited by 31
A Paradigm for Spreadsheet Engineering MethodologiesPreprint
Grossman, T. A., & Özlük, Ö. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0802.3919 · Cited by 31
On the Fragmentation of Process Information: Challenges, Solutions, and Outlook
van der Aa, H., Leopold, H., Mannhardt, F., & Reijers, H. A. (2015) · Lecture notes in business information processing · doi:10.1007/978-3-319-19237-6_1 · Cited by 31
Psychological Issues in End-User Programming
Blackwell, A. F. (2006) · Human-computer interaction series · doi:10.1007/1-4020-5386-x_2 · Cited by 31
Garbage in, Garbage out? An Empirical Look at Oracle Mistakes by End-User Programmers
Phalgune, A., Kissinger, C., Burnett, M., Cook, C., Beckwith, L., & Ruthruff, J. R. (2005) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2005.40 · Cited by 30
Metadata
- Authors
- Panko, R. R.
- Affiliations
- University of Hawaiʻi at Mānoa (US)
- Corresponding author
- Panko, Raymond R.
- Venue
- Journal of Organizational and End User Computing
- Publisher
- IGI Global Scientific Publishing
- Published
- 1998-04
- Volume
- 10
- Issue
- 2
- Pages
- 15-21
- ISSN
- 1546-2234 (ISSN-L)
- 1546-5012
- OpenAlex
- W2112338634
- Cited by
- 464
- References
- 64
- Citations by year
- 2026: 12 · 2025: 9 · 2024: 6 · 2023: 7 · 2022: 7 · 2021: 8 · 2020: 17 · 2019: 14 · 2018: 16 · 2017: 27 · 2016: 21 · 2015: 22 · 2014: 17 · 2013: 19 · 2012: 25
- FWCI
- 33.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Organizational and End User Computing (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- spreadsheet errors, error rate, spreadsheet development, spreadsheet testing, human error, modularization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.