Automating string processing in spreadsheets using input-output examples
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
We describe the design of a string programming/expression language that supports restricted forms of regular expressions, conditionals and loops. The language is expressive enough to represent a wide variety of string manipulation tasks that end-users struggle with. We describe an algorithm based on several novel concepts for synthesizing a desired program in this language from input-output examples. The synthesis algorithm is very efficient taking a fraction of a second for various benchmark examples. The synthesis algorithm is interactive and has several desirable features: it can rank multiple solutions and has fast convergence, it can detect noise in the user input, and it supports an active interaction model wherein the user is prompted to provide outputs on inputs that may have multiple computational interpretations. The algorithm has been implemented as an interactive add-in for Microsoft Excel spreadsheet system. The prototype tool has met the golden test - it has synthesized part of itself, and has been used to solve problems beyond author's imagination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Learning regular sets from queries and counterexamples
Angluin, D. (1987) · Information and Computation · doi:10.1016/0890-5401(87)90052-6 · Cited by 2,114
Mitchell, T. M. (1982) · Artificial Intelligence · doi:10.1016/0004-3702(82)90040-6 · Cited by 1,412
Watch what I do: programming by demonstration
Cypher, A., Halbert, D. C., Kurlander, D., Lieberman, H. A., Maulsby, D., Myers, B. A., & Turransky, A. (1993) · Medical Entomology and Zoology · Cited by 1,027
Six Learning Barriers in End-User Programming Systems
Ko, A. J., Myers, B. A., & Aung, H. H. (2004) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.47 · Cited by 549
Oracle-guided component-based program synthesis
Jha, S., Gulwani, S., Seshia, S. A., & Tiwari, A. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806833 · Cited by 510
Self-citationFrom program verification to program synthesis
Srivastava, S., Gulwani, S., & Foster, J. S. (2010) · Proceedings of the 37th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/1706299.1706337 · Cited by 267
Self-citationDimensions in program synthesis
Gulwani, S. (2010) · Proceedings of the 12th international ACM SIGPLAN symposium on Principles and practice of declarative programming · doi:10.1145/1836089.1836091 · Cited by 238
Self-citationProgramming by Demonstration Using Version Space Algebra
Lau, T., Wolfman, S. A., Domingos, P., & Weld, D. S. (2003) · Machine Learning · doi:10.1023/a:1025671410623 · Cited by 178
PADS: a domain-specific language for processing ad hoc data
Fisher, K. S., & Gruber, R. E. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065046 · Cited by 132
Research works printed but not linked: 7
- Gualtieri M., 2009, Forrester Report for Application Development and Program Management Professionals
- Lau T., 2008, CHI 2008 Workshop on Usable AI
- Lau T., 2004, Workshop on SCLAS, AAAI
- Lau T. A., 2000, ICML
- Miller R. C., 2001, USENIX Annual Technical Conference
- 10.5555/645516.658243 · doi:10.5555/645516.658243
- Walkenbach J., 2010, John Wiley and Sons
Cited by
Items 601–700 of 767
Regular Programming Over Data Streams
Raghothaman, M. (2017) · ScholarlyCommons (University of Pennsylvania) · Cited by 2
Eventually Sound Points-To Analysis with Missing CodePreprint
Bastani, O., Clapp, L., Anand, S., Sharma, R., & Aiken, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.03436 · Cited by 2
SMT-based Robot Transition RepairPreprint
Holtz, J., Guha, A., & Biswas, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04397 · Cited by 2
Process Discovery for Structured Program SynthesisPreprint
Zhang, D., Kuhnle, A., Richardson, J., & Şensoy, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05804 · Cited by 2
Automatic Synthesis of Parallel and Distributed Unix Commands with KumQuat.Preprint
Vasilakis, N., Shen, J., & Rinard, M. (2020) · arXiv (Cornell University) · Cited by 2
FOREST: An Interactive Multi-tree Synthesizer for Regular ExpressionsPreprint
Ferreira, M. A., Terra-Neves, M., Ventura, M., Lynce, I., & Martins, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14235 · Cited by 2
MontePrep: Monte-Carlo-Driven Automatic Data Preparation without Target Data InstancesPreprint
Ge, C., Liu, Y., Tang, Y., Zhu, Y., Tu, Y., & Gao, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.17553 · Cited by 2
Kobaladze, Z., Arnania, A., & Sanikidze, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.00013 · Cited by 2
Component-based synthesis of motion planning algorithms
Schäfer, T. (2021) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-22992 · Cited by 2
Constraint microKanren in the CLP Scheme
Hemann, J. (2020) · IUScholarWorks (Indiana University) · Cited by 2
Agentic Reverse Engineering: From I/O to Code with Discovery AgentPreprint
Dong, Y., Qian, J., Zhang, H., Wang, P., Li, B., Jin, Z., Li, Y., Li, G., Yang, X., & Jiang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.15334 · Cited by 2
Han, Z., He, Y., Kang, S., Xie, M., Cui, W., Ge, S., Zhang, H., Zhang, D., Chaudhuri, S., Mao, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.07060 · Cited by 2
Self-Supervised Scaling of Terminal Environments for Scientific DomainsPreprint
Li, Z., Shi, Y., Li, Z., Yang, J., Wang, R., Wang, Y., Huang, J., Yu, J., Liu, N., Mi, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02710 · Cited by 2
Predicate Renaming via Large Language Models
Gentili, E., Ribeiro, T., Riguzzi, F., & Inoue, K. (2026) · Machine Learning · doi:10.1007/s10994-026-07075-1 · Cited by 1
Ish-Shalom, O., Itzhaky, S., Manevich, R., & Rinetzky, N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39322-9_9 · Cited by 1
Program Synthesis: Synthesizing Operators for Integer Manipulation
Seenuvasan, J., Prasad, S. S., & Kumar, N. S. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-63467-4_26 · Cited by 1
Tree-Based Synthesis of Web Test Sequences from Manual Actions
Jiang, P., Wang, S., & Liu, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-64626-3_14 · Cited by 1
G uardrail : Automated Integrity Constraint Synthesis From Noisy Data
Ma, P., Wang, Z., Ji, Z., Li, Z., Sun, A., & Wang, S. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3749166 · Cited by 1
Fariha, A., Cousins, L., Mahyar, N., & Meliou, A. (2026) · Information Systems · doi:10.1016/j.is.2026.102687 · Cited by 1
Table intelligence with large language models: A comprehensive survey and unified benchmark
Yang, S.-X., Wu, Z., Huang, H., & Mao, X.-L. (2026) · Computer Science Review · doi:10.1016/j.cosrev.2026.100996 · Cited by 1
Semantic Reification: A New Paradigm for Random Program Generation
Chopra, K., Li, C., Sotiropoulos, T., & Su, Z. (2026) · Proceedings of the ACM on Programming Languages · doi:10.1145/3808268 · Cited by 1
NeSyWikiCompiler: A Neural-Symbolic Compiler for Verifiable AI Knowledge Engineering
Zhang, B. (2026) · AI Engineering · doi:10.53941/aieng.2026.100011 · Cited by 1
Automated metadata transformation for a-priori deployed sensor networks
Bhattacharya, A., Culler, D., Hong, D., Whitehouse, K., & Ortiz, J. (2014) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/2668332.2668369 · Cited by 1
Parallel programming with inductive synthesis
Barman, S., Bodík, R., Jain, S. C., Pu, Y., Srivastava, S., & Tung, N. (2011) · USENIX conference on Hot topics in parallelism · Cited by 1
Synthesis for Vesicle Traffic Systems
Gupta, A., Mani, S., & Shukla, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99429-1_6 · Cited by 1
Dialog-Based Meaning Derivation Service for Technical Language Domains
Wachtel, A., Corallo, S., & Tichy, W. F. (2019) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icosc.2019.8665513 · Cited by 1
Neural Inference of API Functions from Input–Output Examples
Bavishi, R., Lemieux, C., Kant, N., Fox, R., Sen, K., & Stoica, I. G. (2018) · Cited by 1
Hermes: A Natural Language Interface Model for Software Transformation
Chagas, M. W., Farias, K., Gonçales, L. J., Kupssinskü, L. S., & Gluz, J. C. (2019) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.1145/3330204.3330253 · Cited by 1
Analogy-making as a Core primitive in the software engineering toolbox
Sotoudeh, M., & Thakur, A. (2020) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3426428.3426918 · Cited by 1
AUTOMAT[R]IX: learning simple matrix pipelines
Contreras-Ochando, L., Ferri, C., & Hernández‐Orallo, J. (2021) · Machine Learning · doi:10.1007/s10994-021-05950-7 · Cited by 1
Automated Inference of Production Rules for Glycans
Biswas, A., Gupta, A., Missula, M., & Thattai, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85633-5_4 · Cited by 1
Learning frameworks for program synthesis
Saha, S. (2019) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Program Synthesis with Algorithm Pseudocode Guidance
Wang, Z. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678657 · Cited by 1
Automatic Repair for Network Programs
Shi, L., Wang, Y., Alur, R., & Loo, B. T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99527-0_19 · Cited by 2
Deep NLP-Based Co-Evolvement for SynthesizingCode Analysis from Natural Language
Nan, Z., Guan, H., Shen, X., & Liao, C. (2021) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 1
Virtual Domain Specific Languages via Embedded Projectional Editing
Korz, N., & Andrzejak, A. (2023) · ACM SIGPLAN International Conference on Generative Programming: Concepts and Experiences (GPCE) · doi:10.1145/3624007.3624059 · Cited by 1
Reviving Dead Links on the Web with Fable
Zhu, J., Nyayachavadi, A., Zhu, J., Ruamviboonsuk, V., & Madhyastha, H. V. (2023) · ACM Internet Measurement Conference (IMC) · doi:10.1145/3618257.3624832 · Cited by 1
Verifying Infinitely Many Programs at Once
D’Antoni, L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44245-2_1 · Cited by 1
VRDSynth: Synthesizing Programs for Multilingual Visually Rich Document Information Extraction
Nguyen, T.-D., Do-Viet, T., Nguyen-Duy, H., Luu, T.-H., Lê, H., Le, X.-B. D., & Thongtanunam, P. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3680314 · Cited by 1
Riyad, O. F., & Junaed, J. A. (2025) · Workshop on Bangla Language Processing (BLP) · doi:10.18653/v1/2025.banglalp-1.65 · Cited by 1
One DSL to Rule Them All: IDE-Assisted Code Generation for Agile Data AnalysisPreprint
Andrzejak, A., Wenz, O., & Costa, D. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09818 · Cited by 1
On the representation and learning of concepts : programs, types, and bayes
Morales, L. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1
Learning structured task related abstractions
Penkov, S. (2019) · ERA · Cited by 1
Grammar Filtering For Syntax-Guided SynthesisPreprint
Morton, K., Hallahan, W. T., Shum, E., Piskač, R., & Santolucito, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02884 · Cited by 1
NetRep: Automatic Repair for Network ProgramsPreprint
Shi, L., Wang, Y., Alur, R., & Loo, B. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.06303 · Cited by 1
Efficient Pragmatic Program Synthesis with Informative SpecificationsPreprint
Vaduguru, S., Ellis, K., & Pu, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.02495 · Cited by 1
Programming by Example and Text-to-Code Translation for Conversational Code GenerationPreprint
Whitehouse, E., Gerard, W., Klimovich, Y., & Franco-Salvador, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.11554 · Cited by 1
Flener, P., & Schmid, U. (2023) · Springer eBooks · doi:10.1007/978-1-4899-7502-7_137-2 · Cited by 1
Program Synthesis is $Σ_3^0$-CompletePreprint
Kim, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.16997 · Cited by 1
Automatic String Data Validation with Pattern DiscoveryPreprint
Lin, X., Zhao, J., Di, P., Xiao, C., Mao, R., Ji, Y., Onizuka, M., Ding, Z., Shang, W., & Qin, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.03005 · Cited by 1
Verification and attack synthesis for network protocols
von Hippel, M. (2024) · Digital Repository Service (Northeastern University) · doi:10.17760/d20668635 · Cited by 1
Lexo: Eliminating Stealthy Supply-Chain Attacks via LLM-Assisted Program RegenerationPreprint
Lamprou, E., Dai, J., Ntousakis, G., Rinard, M., & Vasilakis, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.14522 · Cited by 1
Program Synthesis with Lightweight Abstractions
Guria, S. N. (2023) · University Libraries (University of Maryland) · doi:10.13016/dspace/txaj-5df6 · Cited by 1
Klop, P. (2023) · Research Repository (Delft University of Technology) · Cited by 1
Neuro-Symbolic Program Synthesis for Data-Efficient Learning
Barke, S. (2024) · eScholarship (California Digital Library) · Cited by 1
Speeding up program synthesis using specification discovery
de Jong, J. (. (2023) · Research Repository (Delft University of Technology) · Cited by 1
Projecting Computer Languages for a Protean Interaction
Gobert, C. (2024) · theses.fr (ABES) · doi:10.70675/a8b3c410zb7d6z40a1z8398z6d386e64da0a · Cited by 1
SheetCompass: Hierarchical Relation Graphs for Agentic Spreadsheet ReasoningPreprint
Panjing, H., Cheng, M., Luo, Y., Li, L., & Zhang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14452 · Cited by 1
The Case for Automated Hyperspecialization: Evidence from SATPreprint
Green, H., Goues, C. L., & Brown, F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.14836 · Cited by 1
From Validation to Automated Repair & Beyond with Constraint Solving
Samimi, H. (2013)
Protocol Design With Concolic Snippets
Alur, R., Deshmukh, J. V., Mador-Haim, S., Martin, M. M. K., Raghavan, A., & Udupa, A. (2012) · ScholarlyCommons (University of Pennsylvania)
Performance search engine driven by prior knowledge of optimization
Kim, Y., Černý, P., & Dennis, J. M. (2015) · ACM SIGPLAN International Workshop on Libraries, Languages and Compilers for Array Programming (ARRAY) · doi:10.1145/2774959.2774963
Textual Features for Programming by ExamplePreprint
Menon, A. K., Tamuz, O., Gulwani, S., Lampson, B., & Kalai, A. T. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1209.3811
Self-citationFormatting by Demonstration: An Interactive Machine Learning Approach
Tanner, K., Giraud-Carrier, C. G., & Olsen, D. R. (2014) · International Journal of Computer Applications · doi:10.5120/15090-3080
Program Boosting or Crowd-Sourcing for Correctness
Cochran, R., & Livshits, B. (2013)
From Validation to Automated Repair & Beyond with Constraint Solving
Angeles, L. (2013) · eScholarship (California Digital Library)
Constraint Based Program Synthesis for Embedded Software
Eldib, H. (2015) · VTechWorks (Virginia Tech)
Leveraging Human Intelligence: Semi-automated Processing in Assuring Access to Digital Content
Raza, M., & Milić-Frayling, N. (2013)
Inferring Semantic Information from Natural-Language Software Artifacts
Pandita, R. (2015) · NCSU Libraries Repository (North Carolina State University Libraries)
Loncaric, C. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2983946
Generating interactive web pages from storyboards
Panchekha, P. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2983948
High-Level Abstractions for Programming Network Policies
Yuan, Y. (2016) · ScholarlyCommons (University of Pennsylvania)
Automatic Label Data Abstraction Based on Information Entropy (Application Paper)
Kudo, F., Moriwaki, N., Akitomi, T., Serita, S., & Kitano, Y. (2016) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2016.31
Applications of Formal Methods to Data Wrangling and Education
Gulwani, S. (2017)
Self-citationTOWARD SYMBIOTIC HUMAN-AI INTERACTION FOCUSING ON PROGRAMMING BY EXAMPLE
Lee, T. Y. (2017) · University Libraries (University of Maryland) · doi:10.13016/m2np3k
Extracting Format Transformation Examples from Manual Data Corrections
Azuan, N. A., Embury, S. M., & Paton, N. W. (2018) · Communications in computer and information science · doi:10.1007/978-3-030-00063-9_1
FormalMiner: A Formal Framework for Refinement Mining
Cerone, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-04771-9_15
Automated synthesis of data extraction and transformation programs
Yaghmazadeh, N. (2017) · Texas ScholarWorks (Texas Digital Library) · doi:10.15781/t2zk56545
Program synthesis for generalized planning
Segovia‐Aguas, J. (2018) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Towards unifying spreadsheets with databases for ad-hoc interactive data management at scale
Bendre, M. (2018) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Drachsler-Cohen, D., & Yahav, E. (2017)
Andreas, J. (2018) · eScholarship (California Digital Library)
Model-based decision support for subjective preference blending
Kellermann, T. J. (2019) · SUNScholar (Stellenbosch University)
MintHint: Automated Synthesis of Repair HintsPreprint
Kaleeswaran, S., Tulsian, V., Kanade, A., & Orso, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.1286
Abstract Learning Frameworks for Synthesis
Löding, C., Madhusudan, P., & Neider, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.05612
Extracting and utilizing hidden structures in large datasets
Gao, Y. (2019) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Scalable Synthesis and Verification: Towards Reliable Autonomy
Dathathri, S. (2020) · CaltechTHESIS (California Institute of Technology) · doi:10.7907/4j39-v857
Program Testing and Synthesis by Program Semantics
Cheng, L. (2020)
Session-layer Attack Traffic Classification by Program SynthesisPreprint
Shi, L., Li, Y., Alur, R., & Loo, B. T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06135
Safety Synthesis Sans SpecificationPreprint
Bloem, R., Chockler, H., Ebrahimi, M., Fisman, D., & Riener, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07630
Abstraction, Generalization, and Embodiment in Neural Program Synthesis
Shin, E. C. R. (2020) · eScholarship (California Digital Library)
Fariha, A., Cousins, L., Mahyar, N., & Meliou, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14800
Towards Data Wrangling Automation through Dynamically-Selected Background Knowledge
Contreras-Ochando, L. (2020) · RiuNet (Universitat Politècnica de València) · doi:10.4995/thesis/10251/160724
Flexible Imputation Method for Sensor Data based on Programming by Example: APREP-S
Nagashima, H., & Kato, Y. (2021) · Journal of Information Processing · doi:10.2197/ipsjjip.29.157
Data preparation and domain-agnostic duplicate detection
Koumarelas, I. (2021) · publish.UP (University of Potsdam) · doi:10.25932/publishup-48913
Syntax Guided Neural Program Repair.Preprint
Zhu, Q., Sun, Z., Xiao, Y.-A., Zhang, W., Yuan, K. F., Xiong, Y., & Zhang, L. (2021) · arXiv (Cornell University)
Interaction History for Building Human-Data Interfaces
Wu, Y. (2021) · eScholarship (California Digital Library)
CLX: Towards a scalable and comprehensible design of PBE data transformationsPreprint
Jin, Z., Cafarella, M., Jagadish, H. V., Kandel, S., Minar, M., & Hellerstein, J. M. (2018) · arXiv (Cornell University)
Orion: Automatic Repair for Network Programs.
Shi, L., Wang, Y., Alur, R., & Loo, B. T. (2021)
MP-CodeCheck: Evolving Logical Expression Code Anomaly Learning with Iterative Self-SupervisionPreprint
Muff, U. C., Lee, C. C., Gottschlich, P., & Gottschlich, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.07225
Metadata
- Authors
- Gulwani, S.
- Affiliations
- Microsoft (United States) (US)
- Corresponding author
- Gulwani, Sumit
- ORCID
- Gulwani, Sumit
- Venue
- ACM SIGPLAN Notices
- Published
- 2011-01-26
- Volume
- 46
- Issue
- 1
- Pages
- 317-330
- ISSN
- 0362-1340 (ISSN-L)
- 1558-1160
- OpenAlex
- W2132525863
- Cited by
- 581
- References
- 23
- Citations by year
- 2026: 10 · 2025: 19 · 2024: 26 · 2023: 35 · 2022: 29 · 2021: 60 · 2020: 74 · 2019: 56 · 2018: 54 · 2017: 55 · 2016: 39 · 2015: 36 · 2014: 38 · 2013: 19 · 2012: 20
- FWCI
- 92.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM SIGPLAN Notices (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Physical Sciences › Computer Science › Software › Logic, programming, and type systems
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- string processing, spreadsheet programming, program synthesis, input-output examples, regular expressions, interactive synthesis, Excel add-in, noise detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.