Automating string processing in spreadsheets using input-output examples
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
We describe the design of a string programming/expression language that supports restricted forms of regular expressions, conditionals and loops. The language is expressive enough to represent a wide variety of string manipulation tasks that end-users struggle with. We describe an algorithm based on several novel concepts for synthesizing a desired program in this language from input-output examples. The synthesis algorithm is very efficient taking a fraction of a second for various benchmark examples. The synthesis algorithm is interactive and has several desirable features: it can rank multiple solutions and has fast convergence, it can detect noise in the user input, and it supports an active interaction model wherein the user is prompted to provide outputs on inputs that may have multiple computational interpretations. The algorithm has been implemented as an interactive add-in for Microsoft Excel spreadsheet system. The prototype tool has met the golden test - it has synthesized part of itself, and has been used to solve problems beyond author's imagination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Learning regular sets from queries and counterexamples
Angluin, D. (1987) · Information and Computation · doi:10.1016/0890-5401(87)90052-6 · Cited by 2,114
Mitchell, T. M. (1982) · Artificial Intelligence · doi:10.1016/0004-3702(82)90040-6 · Cited by 1,412
Watch what I do: programming by demonstration
Cypher, A., Halbert, D. C., Kurlander, D., Lieberman, H. A., Maulsby, D., Myers, B. A., & Turransky, A. (1993) · Medical Entomology and Zoology · Cited by 1,027
Six Learning Barriers in End-User Programming Systems
Ko, A. J., Myers, B. A., & Aung, H. H. (2004) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.47 · Cited by 549
Oracle-guided component-based program synthesis
Jha, S., Gulwani, S., Seshia, S. A., & Tiwari, A. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806833 · Cited by 510
Self-citationFrom program verification to program synthesis
Srivastava, S., Gulwani, S., & Foster, J. S. (2010) · Proceedings of the 37th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/1706299.1706337 · Cited by 267
Self-citationDimensions in program synthesis
Gulwani, S. (2010) · Proceedings of the 12th international ACM SIGPLAN symposium on Principles and practice of declarative programming · doi:10.1145/1836089.1836091 · Cited by 238
Self-citationProgramming by Demonstration Using Version Space Algebra
Lau, T., Wolfman, S. A., Domingos, P., & Weld, D. S. (2003) · Machine Learning · doi:10.1023/a:1025671410623 · Cited by 178
PADS: a domain-specific language for processing ad hoc data
Fisher, K. S., & Gruber, R. E. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065046 · Cited by 132
Research works printed but not linked: 7
- Gualtieri M., 2009, Forrester Report for Application Development and Program Management Professionals
- Lau T., 2008, CHI 2008 Workshop on Usable AI
- Lau T., 2004, Workshop on SCLAS, AAAI
- Lau T. A., 2000, ICML
- Miller R. C., 2001, USENIX Annual Technical Conference
- 10.5555/645516.658243 · doi:10.5555/645516.658243
- Walkenbach J., 2010, John Wiley and Sons
Cited by
Items 201–300 of 767
Scenario-based programming for SDN policies
Yuan, Y., Lin, D., Alur, R., & Loo, B. T. (2015) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/2716281.2836119 · Cited by 40
Zhong, Z., Guo, J., Yang, W., Peng, J., Xie, T., Lou, J., Liu, T., & Zhang, D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1189 · Cited by 40
Adaptive Concretization for Parallel Program Synthesis
Jeon, J., Qiu, X., Solar-Lezama, A., & Foster, J. S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-21668-3_22 · Cited by 40
Neural Guided Constraint Logic Programming for Program SynthesisPreprint
Zhang, L., Rosenblatt, G., Fetaya, E., Liao, R., Byrd, W. E., Might, M., Urtasun, R., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02840 · Cited by 40
Dango: A Mixed-Initiative Data Wrangling System using Large Language Model
Chen, W., Tong, W., Case, A., & Zhang, T. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714135 · Cited by 41
HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesis
Barke, S., Gonzalez, E. A., Kasibatla, S. R., Berg-Kirkpatrick, T., & Polikarpova, N. (2024) · neural information processing systems · doi:10.52202/079017-0499 · Cited by 39
Learning to Learn Programs from Examples: Going Beyond Program Structure
Ellis, K., & Gulwani, S. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/227 · Cited by 39
Self-citationSketch-Driven Regular Expression Generation from Natural Language and Examples
Ye, X., Chen, Q., Wang, X., Dillig, I., & Durrett, G. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00339 · Cited by 39
Self-Service Data Preparation: Research to Practice.
Hellerstein, J. M., Heer, J., & Kandel, S. (2018) · IEEE Data(base) Engineering Bulletin · Cited by 40
Abstract Learning Frameworks for Synthesis
Löding, C., Madhusudan, P., & Neider, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-662-49674-9_10 · Cited by 38
Bayesian synthesis of probabilistic programs for automatic data modeling
Saad, F. A., Cusumano-Towner, M., Schaechtle, U., Rinard, M., & Mansinghka, V. K. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 37
Data Engineering for Data Analytics: A Classification of the Issues, and Case StudiesPreprint
Nazábal, A., Williams, C. K. I., Colavizza, G., Smith, C. R., & Williams, A. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12929 · Cited by 38
Automating object transformations for dynamic software updating
Magill, S., Hicks, M., Subramanian, S., & McKinley, K. S. (2012) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2384616.2384636 · Cited by 37
Web question answering with neurosymbolic program synthesis
Chen, Q., Lamoreaux, A., Wang, X., Durrett, G., Bastani, O., & Dillig, I. (2021) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3453483.3454047 · Cited by 37
AutoTSG: learning and synthesis for incident troubleshooting
Shetty, M., Bansal, C., Upadhyayula, S. P., Radhakrishna, A., & Gupta, A. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3558958 · Cited by 13
Automated Data Extraction Using Predictive Program Synthesis
Raza, M., & Gulwani, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10668 · Cited by 37
Self-citationMiltner, A., Fisher, K. S., Pierce, B. C., Walker, D., & Zdancewic, S. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3158089 · Cited by 37
Synthesis of biological models from mutation experiments
Koksal, A. S., Pu, Y., Srivastava, S., Bodik, R., Fisher, J., & Piterman, N. (2013) · Proceedings of the 40th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/2429069.2429125 · Cited by 36
Sampling for Bayesian Program Learning
Ellis, K., Solar-Lezama, A., & Tenenbaum, J. B. (2016) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 36
Interpretable Program Synthesis
Zhang, T., Chen, Z., Zhu, Y., Vaithilingam, P., Wang, X., & Glassman, E. L. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445646 · Cited by 36
Automatic programming: The open issue?
O’Neill, M., & Spector, L. C. (2019) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-019-09364-2 · Cited by 36
Example-directed synthesis: a type-theoretic interpretation
Frankle, J., Osera, P.-M., Walker, D., & Zdancewic, S. (2016) · ACM SIGPLAN Notices · doi:10.1145/2914770.2837629 · Cited by 36
FlashNormalize: programming by examples for text normalization
Kini, D., & Gulwani, S. (2015) · International Conference on Artificial Intelligence · Cited by 35
Self-citationCACheck: Detecting and Repairing Cell Arrays in Spreadsheets
Dou, W., Xu, C., Cheung, S.-C., & Wei, J. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584059 · Cited by 35
FlashRegex: deducing anti-ReDoS regexes from examples
Li, Y., Xu, Z., Cao, J., Chen, H., Ge, T., Cheung, S.-C., & Zhao, H. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3416556 · Cited by 35
Learning Moore machines from input–output traces
Giantamidis, G., Tripakis, S., & Basagiannis, S. (2019) · International Journal on Software Tools for Technology Transfer · doi:10.1007/s10009-019-00544-0 · Cited by 35
Digging for fold: synthesis-aided API discovery for Haskell
James, M. B., Guo, Z. K., Wang, Z., Doshi, S., Peleg, H., Jhala, R., & Polikarpova, N. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428273 · Cited by 34
Programming by Example Using Least General Generalizations
Raza, M., Gulwani, S., & Milić-Frayling, N. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8744 · Cited by 33
Self-citationMeta-Interpretive Learning of Data Transformation Programs
Cropper, A., Tamaddoni-Nezhad, A., & Muggleton, S. H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-40566-7_4 · Cited by 32
Data-guided repair of selection statements
Gopinath, D., Khurshid, S., Saha, D., & Chandra, S. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568303 · Cited by 29
Syntax-Guided Synthesis with Quantitative Syntactic Objectives
Hu, Q., & D’Antoni, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-96145-3_21 · Cited by 32
Collie, B., Ginsbach, P., Woodruff, J., Rajan, A., & O’boyle, M. F. P. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3416618 · Cited by 32
Bagchi, S., Aggarwal, V., Chaterji, S., Douglis, F., Gamal, A. E., Han, J., Henz, B. J., Hoffmann, H., Jana, S., Kulkarni, M., et al. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.3006807 · Cited by 31
Modular Synthesis of Sketches Using Models
Singh, R., Singh, R., Xu, Z., Krosnick, R., & Solar-Lezama, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-642-54013-4_22 · Cited by 31
Codex Hacks HackerRank: Memorization Issues and a Framework for Code Synthesis EvaluationPreprint
Karmakar, A., Prenner, J. A., D’Ambros, M., & Robbes, R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.02684 · Cited by 31
Drosos, I., Sarkar, A., Xu, X., Negreanu, C., Rintel, S., & Tankelevitch, L. (2024) · Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work · doi:10.1145/3663384.3663389 · Cited by 30
Playgol: Learning Programs Through Play
Cropper, A. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/841 · Cited by 30
SQUARES: a SQL synthesizer using query reverse engineering
Orvalho, P., Terra-Neves, M., Ventura, M., Martins, R., & Manquinho, V. M. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3415478.3415492 · Cited by 30
Synthesizing Reactive Programs
Madhusudan, P. (2011) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.csl.2011.428 · Cited by 30
FIDEX: filtering spreadsheet data using examples
Wang, X., Gulwani, S., & Singh, R. (2016) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2983990.2984030 · Cited by 30
Self-citationComputing programs for generalized planning using a classical planner
Segovia‐Aguas, J., Jiménez, S., & Jönsson, A. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.10.006 · Cited by 30
Inductive program synthesis over noisy data
Handa, S., & Rinard, M. (2020) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3368089.3409732 · Cited by 30
APIfix: output-oriented program synthesis for combating breaking changes in libraries
Gao, X., Radhakrishna, A., Soares, G., Shariffdeen, R., Gulwani, S., & Roychoudhury, A. (2021) · Proceedings of the ACM on Programming Languages · doi:10.1145/3485538 · Cited by 29
Self-citationATR: template-based repair for Alloy specifications
Zheng, G., Nguyen, T. H., Brida, S. G., Regis, G., Aguirre, N., Frias, M. F., & Bagheri, H. (2022) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3533767.3534369 · Cited by 29
NL2Formula: Generating Spreadsheet Formulas from Natural Language Queries
Zhao, W., Hou, Z., Wu, S., Gao, Y., Dong, H., Wan, Y., Zhang, H., Sui, Y., & Zhang, H. (2024) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2024.findings-eacl.158 · Cited by 29
Rules, L. O.-R., & A, F. A. L. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48751-4 · Cited by 29
Automated Discovery of Data Transformations for Robotic Process AutomationPreprint
Leno, V., Dumas, M., Rosa, M. L., Maggi, F. M., & Polyvyanyy, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01007 · Cited by 29
Algebro-geometric Algorithms for Template-Based Synthesis of Polynomial Programs
Goharshady, A. K., Hitarth, S., Mohammadi, F., & Motwani, H. J. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3586052 · Cited by 28
Program Synthesis with Pragmatic CommunicationPreprint
Pu, Y., Ellis, K., Kryven, M., Tenenbaum, J. B., & Solar-Lezama, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05060 · Cited by 28
DReX: A Declarative Language for Efficiently Evaluating Regular String Transformations
Alur, R., D’Antoni, L., & Raghothaman, M. (2014) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2676726.2676981 · Cited by 27
Programming Pedagogy and Assessment in the Era of AI/ML: A Position Paper
Raman, A., & Kumar, V. (2022) · Bangalore Annual Compute Conference · doi:10.1145/3561833.3561843 · Cited by 27
A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies
Zhao, Y., Li, Z., & Cong, G. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3636218.3636235 · Cited by 27
Using program synthesis for social recommendations
Cheung, A., Solar-Lezama, A., & Madden, S. R. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398507 · Cited by 27
NoFAQ: synthesizing command repairs from examples
D’Antoni, L., Singh, R., & Vaughn, M. L. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3106241 · Cited by 27
Data context informed data wrangling
Koehler, M., Bogatu, A., Civili, C., Κωνσταντίνου, Ν., Abel, E., Fernandes, A. A. A., Keane, J. A., Libkin, L. O., & Paton, N. W. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258015 · Cited by 27
Miltner, A., Maina, S., Fisher, K. S., Pierce, B. C., Walker, D., & Zdancewic, S. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3341699 · Cited by 27
Automatic diagnosis and correction of logical errors for functional programming assignments
Lee, J., Song, D., So, S., & Oh, H. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276528 · Cited by 27
Library learning for neurally-guided Bayesian program induction
Ellis, K., Morales, L., Sablé-Meyer, M., Solar-Lezama, A., & Tenenbaum, J. B. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 27
Learning Text Patterns Using Separate-and-Conquer Genetic Programming
Bartoli, A., Lorenzo, A. D., Medvet, E., & Tarlao, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16501-1_2 · Cited by 27
COLDECO: An End User Spreadsheet Inspection Tool for AI-Generated Code
Ferdowsi, K., Williams, J., Drosos, I., Gordon, A. D., Negreanu, C., Polikarpova, N., Sarkar, A., & Zorn, B. (2023) · 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc57772.2023.00017 · Cited by 17
Synthesis with Abstract Examples
Drachsler-Cohen, D., Shoham, S., & Yahav, E. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-63387-9_13 · Cited by 26
Incorporating Data Context to Cost-Effectively Automate End-to-End Data Wrangling
Koehler, M., Abel, E., Bogatu, A., Civili, C., Mazilu, L., Κωνσταντίνου, Ν., Fernandes, A. A. A., Keane, J. A., Libkin, L. O., & Paton, N. W. (2019) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2907588 · Cited by 26
Discovering data transfer routines from user interaction logs
Leno, V., Augusto, A., Dumas, M., Rosa, M. L., Maggi, F. M., & Polyvyanyy, A. (2021) · Information Systems · doi:10.1016/j.is.2021.101916 · Cited by 26
Data Integration over Distributed and Heterogeneous Data Endpoints
Araújo, S. (2014) · Data Archiving and Networked Services (DANS) · doi:10.4233/uuid:8214a00d-3702-40d4-b989-441c9364b43d · Cited by 26
Takenouchi, K., Ishio, T., Okada, J., & Sakata, Y. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476249.3476253 · Cited by 25
Neurosymbolic repair for low-code formula languages
Bavishi, R., Joshi, H., Cambronero, J., Fariha, A., Gulwani, S., Le, V., Radiček, I., & Tiwari, A. (2022) · Proc. ACM Program. Lang. · doi:10.1145/3563327 · Cited by 20
Self-citationICEBAR: Feedback-Driven Iterative Repair of Alloy Specifications
Brida, S. G., Regis, G., Zheng, G., Bagheri, H., Nguyen, T. H., Aguirre, N., & Frias, M. F. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556944 · Cited by 25
Playing regex golf with genetic programming
Bartoli, A., Lorenzo, A. D., Medvet, E., & Tarlao, F. (2014) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2576768.2598333 · Cited by 25
Data Curation with Deep Learning [Vision]Preprint
Thirumuruganathan, S., Tang, N., Ouzzani, M., & Doan, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.01384 · Cited by 30
Oracle-Guided Program Selection from Large Language Models
Fan, Z., Ruan, H., Mechtaev, S., & Roychoudhury, A. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3680308 · Cited by 24
Learning Abstractions for Program Synthesis
Wang, X., Anderson, G., Dillig, I., & McMillan, K. L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-96145-3_22 · Cited by 24
Chen, S., He, Y., Cui, W., Fan, J., Ge, S., Zhang, H., Zhang, D., & Chaudhuri, S. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3654925 · Cited by 24
Towards Understanding Human Mistakes of Programming by Example: An Online User Study
Lee, T. Y., Dugan, C., & Bederson, B. B. (2017) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3025171.3025203 · Cited by 24
Benchmarking Multimodal Regex Synthesis with Complex Structures
Ye, X., Chen, Q., Dillig, I., & Durrett, G. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.541 · Cited by 24
Searching entangled program spaces
Koppel, J., Guo, Z. K., de Vries, E., Solar-Lezama, A., & Polikarpova, N. (2022) · Proceedings of the ACM on Programming Languages · doi:10.1145/3547622 · Cited by 24
A Hazard Analysis Framework for Code Synthesis Large Language Models
Khlaaf, H., Mishkin, P., Achiam, J., Krueger, G., & Brundage, M. (2022) · arXiv · doi:10.48550/arxiv.2207.14157 · Cited by 23
Using Reactive Synthesis: An End-to-End Exploratory Case Study
Ma’ayan, D., & Maoz, S. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00071 · Cited by 23
Complexity verification using guided theorem enumeration
Srikanth, A., Sahin, B., & Harris, W. R. (2016) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/3009837.3009864 · Cited by 23
Raza, M., & Gulwani, S. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3380608 · Cited by 23
Self-citationFeedback-driven semi-supervised synthesis of program transformations
Gao, X. Y., Barke, S., Radhakrishna, A., Soares, G., Gulwani, S., Leung, A., Nagappan, N., & Tiwari, A. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428287 · Cited by 23
Self-citationTowards Benchmarking Feature Type Inference for AutoML Platforms
Shah, V., Lacanlale, J., Kumar, P., Yang, K., & Kumar, A. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3457274 · Cited by 23
Code building genetic programming
Pantridge, E., & Spector, L. C. (2020) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3377930.3390239 · Cited by 23
Learning to Represent Programs with Property SignaturesPreprint
Odena, A., & Sutton, C. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09030 · Cited by 23
Applying genetic programming to PSB2: the next generation program synthesis benchmark suite
Helmuth, T., & Kelly, P. (2022) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-022-09434-y · Cited by 22
Modeling Software Execution Environment
Qi, D., Sumner, W. N., Qin, F., Zheng, M., Zhang, X., & Roychoudhury, A. (2012) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2012.51 · Cited by 22
Programming with a read-eval-synth loop
Peleg, H., Gabay, R., Itzhaky, S., & Yahav, E. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428227 · Cited by 22
A large-scale benchmark for few-shot program induction and synthesis
Alet, F., Lopez-Contreras, J., Koppel, J., Nye, M., Solar-Lezama, A., Lozano‐Pérez, T., Kaelbling, L. P., & Tenenbaum, J. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 22
Synthesizing Web Element Locators (T)
Bajaj, K., Pattabiraman, K., & Mesbah, A. (2015) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.23 · Cited by 22
Shu, C., & Zhang, H. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10734 · Cited by 22
Complete Bottom-Up Predicate Invention in Meta-Interpretive Learning
Hocquette, C., & Muggleton, S. H. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/320 · Cited by 16
MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark
Xing, J., He, Y., Zhou, M., Dong, H., Han, S. Z., Chen, L., Zhang, D., Chaudhuri, S., & Jagadish, H. V. (2025) · neural information processing systems · doi:10.52202/085713-2319 · Cited by 22
AskIt: Unified Programming Interface for Programming with Large Language Models
Okuda, K., & Amarasinghe, S. P. (2024) · Proceedings of the CGO/Proceedings of the ... CGO · doi:10.1109/cgo57630.2024.10444830 · Cited by 21
Interactive Robot Transition Repair With SMT
Holtz, J., Guha, A., & Biswas, J. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/681 · Cited by 21
Decidable Synthesis of Programs with Uninterpreted Functions
Krogmeier, P., Mathur, U., Murali, A., Madhusudan, P., & Viswanathan, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-53291-8_32 · Cited by 21
Toward Code Generation: A Survey and Lessons from Semantic ParsingPreprint
Lee, C. C., Gottschlich, J., & Roth, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03317 · Cited by 21
LLM4TDG: test-driven generation of large language models based on enhanced constraint reasoning
Liu, J., Liang, R., Zhu, X., Zhang, Y., Liu, Y., & Liu, Q. (2025) · Cybersecurity · doi:10.1186/s42400-024-00335-4 · Cited by 20
NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification
Zhang, W., Shen, L., Xu, S., Wang, J., Zhao, J., Qu, H., & Yuan, L.-P. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747668 · Cited by 20
Search-Based Regular Expression Inference on a GPU
Valizadeh, M., & Berger, M. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3591274 · Cited by 20
Generative AI for Software Development: A Family of Studies on Code Generation
Dakhel, A. M., Nikanjam, A., Khomh, F., Desmarais, M. C., & Washizaki, H. (2024) · Springer eBooks · doi:10.1007/978-3-031-55642-5_7 · Cited by 20
Perfect Is the Enemy of Good: Best-Effort Program Synthesis
Peleg, H., & Polikarpova, N. (2020) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.ecoop.2020.2 · Cited by 20
Metadata
- Authors
- Gulwani, S.
- Affiliations
- Microsoft (United States) (US)
- Corresponding author
- Gulwani, Sumit
- ORCID
- Gulwani, Sumit
- Venue
- ACM SIGPLAN Notices
- Published
- 2011-01-26
- Volume
- 46
- Issue
- 1
- Pages
- 317-330
- ISSN
- 0362-1340 (ISSN-L)
- 1558-1160
- OpenAlex
- W2132525863
- Cited by
- 581
- References
- 23
- Citations by year
- 2026: 10 · 2025: 19 · 2024: 26 · 2023: 35 · 2022: 29 · 2021: 60 · 2020: 74 · 2019: 56 · 2018: 54 · 2017: 55 · 2016: 39 · 2015: 36 · 2014: 38 · 2013: 19 · 2012: 20
- FWCI
- 92.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM SIGPLAN Notices (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Physical Sciences › Computer Science › Software › Logic, programming, and type systems
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- string processing, spreadsheet programming, program synthesis, input-output examples, regular expressions, interactive synthesis, Excel add-in, noise detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.