Automating string processing in spreadsheets using input-output examples
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
We describe the design of a string programming/expression language that supports restricted forms of regular expressions, conditionals and loops. The language is expressive enough to represent a wide variety of string manipulation tasks that end-users struggle with. We describe an algorithm based on several novel concepts for synthesizing a desired program in this language from input-output examples. The synthesis algorithm is very efficient taking a fraction of a second for various benchmark examples. The synthesis algorithm is interactive and has several desirable features: it can rank multiple solutions and has fast convergence, it can detect noise in the user input, and it supports an active interaction model wherein the user is prompted to provide outputs on inputs that may have multiple computational interpretations. The algorithm has been implemented as an interactive add-in for Microsoft Excel spreadsheet system. The prototype tool has met the golden test - it has synthesized part of itself, and has been used to solve problems beyond author's imagination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Learning regular sets from queries and counterexamples
Angluin, D. (1987) · Information and Computation · doi:10.1016/0890-5401(87)90052-6 · Cited by 2,114
Mitchell, T. M. (1982) · Artificial Intelligence · doi:10.1016/0004-3702(82)90040-6 · Cited by 1,412
Watch what I do: programming by demonstration
Cypher, A., Halbert, D. C., Kurlander, D., Lieberman, H. A., Maulsby, D., Myers, B. A., & Turransky, A. (1993) · Medical Entomology and Zoology · Cited by 1,027
Six Learning Barriers in End-User Programming Systems
Ko, A. J., Myers, B. A., & Aung, H. H. (2004) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.47 · Cited by 549
Oracle-guided component-based program synthesis
Jha, S., Gulwani, S., Seshia, S. A., & Tiwari, A. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806833 · Cited by 510
Self-citationFrom program verification to program synthesis
Srivastava, S., Gulwani, S., & Foster, J. S. (2010) · Proceedings of the 37th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/1706299.1706337 · Cited by 267
Self-citationDimensions in program synthesis
Gulwani, S. (2010) · Proceedings of the 12th international ACM SIGPLAN symposium on Principles and practice of declarative programming · doi:10.1145/1836089.1836091 · Cited by 238
Self-citationProgramming by Demonstration Using Version Space Algebra
Lau, T., Wolfman, S. A., Domingos, P., & Weld, D. S. (2003) · Machine Learning · doi:10.1023/a:1025671410623 · Cited by 178
PADS: a domain-specific language for processing ad hoc data
Fisher, K. S., & Gruber, R. E. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065046 · Cited by 132
Research works printed but not linked: 7
- Gualtieri M., 2009, Forrester Report for Application Development and Program Management Professionals
- Lau T., 2008, CHI 2008 Workshop on Usable AI
- Lau T., 2004, Workshop on SCLAS, AAAI
- Lau T. A., 2000, ICML
- Miller R. C., 2001, USENIX Annual Technical Conference
- 10.5555/645516.658243 · doi:10.5555/645516.658243
- Walkenbach J., 2010, John Wiley and Sons
Cited by
Items 101–200 of 767
Synthesis from Examples: Interaction Models and Algorithms
Gulwani, S. (2012) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc.2012.69 · Cited by 86
Self-citationInductive Logic Programming At 30: A New Introduction
Cropper, A., & Dumančić, S. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13507 · Cited by 83
Islam, M. A., Ali, M. E., & Parvez, M. R. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.285 · Cited by 81
Unsupervised learning by program synthesis
Ellis, K., Solar-Lezama, A., & Tenenbaum, J. B. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 81
Phoenix: automated data-driven synthesis of repairs for static analysis violations
Bavishi, R., Yoshida, H., & Prasad, M. R. (2019) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3338906.3338952 · Cited by 81
Interactive Program Synthesis by Augmented Examples
Zhang, T., Lowmanstone, L., Wang, X., & Glassman, E. L. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415900 · Cited by 57
Beyond Code Generation: LLM-supported Exploration of the Program Design Space
Zamfirescu-Pereira, J. D., Jun, E., Terry, M. A., Yang, Q., & Hartmann, B. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714154 · Cited by 80
Compositional program synthesis from natural language and examples
Raza, M., Gulwani, S., & Milić-Frayling, N. (2015) · International Conference on Artificial Intelligence · Cited by 79
Self-citationHow Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark
Qiu, R., Zeng, W. W., Ezick, J., Lott, C., & Tong, H. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2406.06647 · Cited by 79
Automatically Generating Algebra Problems
Singh, R., Gulwani, S., & Rajamani, S. K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8341 · Cited by 78
Self-citationProgrammatic and direct manipulation, together at last
Chugh, R., Hempel, B., Spradlin, M., & Albers, J. (2016) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2908080.2908103 · Cited by 78
Smith, C., & Albarghouthi, A. (2016) · Proceedings of the 37th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2908080.2908102 · Cited by 76
Bug synthesis: challenging bug-finding tools with deep faults
Roy, S., Pandey, A., Dolan-Gavitt, B., & Hu, Y. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3236084 · Cited by 75
A review of generalized planning
Jiménez, S., Segovia‐Aguas, J., & Jönsson, A. (2019) · The Knowledge Engineering Review · doi:10.1017/s0269888918000231 · Cited by 75
FrAngel: component-based synthesis with control structures
Shi, K., Steinhardt, J., & Liang, P. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3290386 · Cited by 73
Program synthesis by type-guided abstraction refinement
Guo, Z. K., James, M. B., Justo, D., Zhou, J., Wang, Z., Jhala, R., & Polikarpova, N. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3371080 · Cited by 73
PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis
Gebreegziabher, S. A., Zhang, Z., Tang, X., Meng, Y., Glassman, E. L., & Li, T. J.-J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581352 · Cited by 72
Synthesizing regular expressions from examples for introductory automata assignments
Lee, M., So, S., & Oh, H. (2016) · ACM SIGPLAN International Conference on Generative Programming: Concepts and Experiences (GPCE) · doi:10.1145/2993236.2993244 · Cited by 72
PSB2: the second program synthesis benchmark suite
Helmuth, T., & Kelly, P. (2021) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3449639.3459285 · Cited by 71
Interactive analysis of big data
Heer, J., & Kandel, S. (2012) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/2331042.2331058 · Cited by 71
Component-based synthesis of table consolidation and transformation tasks from examples
Feng, Y., Martins, R., Geffen, J. V., Dillig, I., & Chaudhuri, S. (2017) · ACM SIGPLAN Notices · doi:10.1145/3140587.3062351 · Cited by 70
Alur, R., Černý, P., & Radhakrishna, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-21668-3_10 · Cited by 70
Quality of Automated Program Repair on Real-World Defects
Motwani, M., Soto, M., Brun, Y., Just, R., & Goues, C. L. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2998785 · Cited by 69
Kuhail, M. A., Mathew, S. S., Khalil, A., Berengueres, J., & Shah, S. J. H. (2024) · Science of Computer Programming · doi:10.1016/j.scico.2024.103111 · Cited by 68
Write, Execute, Assess: Program Synthesis with a REPL
Ellis, K., Nye, M., Pu, Y., Sosa, F., Tenenbaum, J., & Solar-Lezama, A. (2019) · arXiv · doi:10.48550/arxiv.1906.04604 · Cited by 65
Regular combinators for string transformations
Alur, R., Freilich, A., & Raghothaman, M. (2014) · ACM/IEEE Symposium on Logic in Computer Science (LICS) · doi:10.1145/2603088.2603151 · Cited by 65
Automated synthesis of symbolic instruction encodings from I/O samples
Godefroid, P., & Taly, A. (2012) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2254064.2254116 · Cited by 65
Synthesis of data completion scripts using finite tree automata
Wang, X., Dillig, I., & Singh, R. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133886 · Cited by 65
The three pillars of machine programming
Gottschlich, J., Solar-Lezama, A., Tatbul, N., Carbin, M., Rinard, M., Barzilay, R., Amarasinghe, S. P., Tenenbaum, J. B., & Mattson, T. (2018) · ACM SIGPLAN International Workshop on Machine Learning and Programming Languages (MAPL) · doi:10.1145/3211346.3211355 · Cited by 65
Program synthesis using conflict-driven learning
Feng, Y., Martins, R., Bastani, O., & Dillig, I. (2018) · ACM SIGPLAN Notices · doi:10.1145/3296979.3192382 · Cited by 64
Algorithmic program synthesis: introduction
Bodík, R., & Jobstmann, B. (2013) · International Journal on Software Tools for Technology Transfer · doi:10.1007/s10009-013-0287-9 · Cited by 63
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving
Islam, M. A., Ali, M. E., & Parvez, M. R. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.269 · Cited by 63
Improving Neural Program Synthesis with Inferred Execution Traces
Shin, E. C. R., Polosukhin, I., & Song, D. X. (2018) · neural information processing systems · Cited by 62
Lyra 2: Designing Interactive Visualizations by Demonstration
Zong, J., Barnwal, D., Neogy, R., & Satyanarayan, A. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030367 · Cited by 62
Inductive logic programming at 30
Cropper, A., Dumančić, S., Evans, R., & Muggleton, S. H. (2022) · Machine Learning · doi:10.1007/s10994-021-06089-1 · Cited by 61
Bottom-up synthesis of recursive functional programs using angelic execution
Miltner, A., Nuñez, A. T., Brendel, A., Chaudhuri, S., & Dillig, I. (2022) · Proceedings of the ACM on Programming Languages · doi:10.1145/3498682 · Cited by 61
Transforming spreadsheet data types using examples
Singh, R., & Gulwani, S. (2016) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2837614.2837668 · Cited by 61
Self-citationNavigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets
Gao, Y., Huang, S., & Parameswaran, A. (2018) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3183713.3183746 · Cited by 60
Reconciling enumerative and deductive program synthesis
Huang, K., Qiu, X., Shen, P., & Wang, Y. (2020) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3385412.3386027 · Cited by 60
A colorful approach to text processing by example
Yessenov, K., Tulsiani, S., Menon, A. K., Miller, R. C., Gulwani, S., Lampson, B., & Kalai, A. T. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502040 · Cited by 59
Self-citationSynthesizing program input grammars
Bastani, O., Sharma, R., Aiken, A., & Liang, P. (2017) · ACM SIGPLAN Notices · doi:10.1145/3140587.3062349 · Cited by 59
Inferring Logical Forms From Denotations
Pasupat, P., & Liang, P. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1003 · Cited by 56
Chen, Y., Yuan, Y., Zhang, Z., Zheng, Y., Liu, J., Ni, F., Hao, J., Mao, H., & Zhang, F. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714962 · Cited by 60
Synthesizing database programs for schema refactoring
Wang, Y., Dong, J., Shah, R., & Dillig, I. (2019) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3314221.3314588 · Cited by 57
On the fly synthesis of edit suggestions
Miltner, A., Gulwani, S., Le, V., Leung, A., Radhakrishna, A., Soares, G., Tiwari, A., & Udupa, A. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360569 · Cited by 47
Self-citationA suite of abstract domains for static analysis of string values
Costantini, G., Ferrara, P., & Cortesi, A. (2013) · Software Practice and Experience · doi:10.1002/spe.2218 · Cited by 56
Synthesizing transformations on hierarchically structured data
Yaghmazadeh, N., Klinger, C., Dillig, I., & Chaudhuri, S. (2016) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2908080.2908088 · Cited by 56
Kim, J., Hu, Q., D’Antoni, L., & Reps, T. (2021) · Proceedings of the ACM on Programming Languages · doi:10.1145/3434311 · Cited by 56
Interactive parser synthesis by example
Leung, A., Sarracino, J., & Lerner, S. (2015) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2737924.2738002 · Cited by 55
TF-Coder: Program Synthesis for Tensor Manipulations
Shi, K., Bieber, D., & Singh, R. (2022) · ACM Transactions on Programming Languages and Systems · doi:10.1145/3517034 · Cited by 54
Program Synthesis Using Deduction-Guided Reinforcement Learning
Chen, Y., Wang, C., Bastani, O., Dillig, I., & Feng, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-53291-8_30 · Cited by 54
Bias reformulation for one-shot function induction
Dianhuan, L., Eyal, D., Kevin, E., Joshua, T., & Stephen, M. (2014) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/978-1-61499-419-0-525 · Cited by 53
Programming by Examples: Applications, Algorithms, and Ambiguity Resolution
Gulwani, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40229-1_2 · Cited by 52
Self-citationProgram synthesis: challenges and opportunities
David, C., & Kroening, D. (2017) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2015.0403 · Cited by 52
Data Diff: Interpretable, Executable Summaries of Changes in Distributions for Data Wrangling
Sutton, C., Hobson, T., Geddes, J., & Caruana, R. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220057 · Cited by 42
Small-Step Live Programming by Example
Ferdowsifard, K., Ordookhanians, A., Peleg, H., Lerner, S., & Polikarpova, N. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415869 · Cited by 42
Path-based inductive synthesis for program inversion
Srivastava, S., Gulwani, S., Chaudhuri, S., & Foster, J. S. (2011) · ACM SIGPLAN Notices · doi:10.1145/1993316.1993557 · Cited by 51
Self-citationLearning a Static Analyzer from Data
Bielik, P., Raychev, V., & Vechev, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-63387-9_12 · Cited by 51
Automatically translating image processing libraries to halide
Ahmad, M. B. S., Ragan‐Kelley, J., Cheung, A., & Kamil, S. A. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356549 · Cited by 51
Synthesizing highly expressive SQL queries from input-output examples
Wang, C., Cheung, A., & Bodik, R. (2017) · ACM SIGPLAN Notices · doi:10.1145/3140587.3062365 · Cited by 48
Towards Synthesizing Complex Programs from Input-Output Examples
Chen, X., Liu, C., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01284 · Cited by 31
Jiang, Y., & Yang, C. P. (2024) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi13010026 · Cited by 50
Static Analysis of String Values
Costantini, G., Ferrara, P., & Cortesi, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24559-6_34 · Cited by 50
Dou, W., Cheung, S.-C., & Wei, J. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2568225.2568316 · Cited by 50
Learning higher-order logic programs through abstraction and invention
Cropper, A., & Muggleton, S. (2016) · Oxford University Research Archive (ORA) (University of Oxford) · Cited by 52
Afzal, S., Rajmohan, C., Kesarwani, M., Mehta, S., & Patel, H. (2021) · IEEE International Conference on Smart Data Services (SMDS) · doi:10.1109/smds53860.2021.00016 · Cited by 50
Programming not only by example
Peleg, H., Shoham, S., & Yahav, E. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180189 · Cited by 38
Programming by Examples: PL Meets ML
Gulwani, S., & Jain, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71237-6_1 · Cited by 49
Self-citationFlashFill++: Scaling Programming by Example by Cutting to the Chase
Cambronero, J., Gulwani, S., Le, V., Perelman, D., Radhakrishna, A., Simon, C., & Tiwari, A. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3571226 · Cited by 49
Self-citationCan language models automate data wrangling?
Jaimovitch-López, G., Ferri, C., Hernández-Orallo, J., Martínez-Plumed, F., & Ramírez-Quintana, M. J. (2023) · Machine Learning · doi:10.1007/s10994-022-06259-9 · Cited by 48
Synthesizing Imperative Programs from Examples Guided by Static Analysis
So, S., & Oh, H. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66706-5_18 · Cited by 48
Automated migration of hierarchical data to relational tables using programming-by-example
Yaghmazadeh, N., Wang, X., & Dillig, I. (2018) · Proceedings of the VLDB Endowment · doi:10.1145/3187009.3177735 · Cited by 48
Auto-transform: learning-to-transform by patterns
Jin, Z., He, Y., & Chauduri, S. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3407790.3407831 · Cited by 47
SyGuS-Comp 2016: Results and Analysis
Alur, R., Fisman, D., Singh, R., & Solar-Lezama, A. (2016) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.229.13 · Cited by 47
Learning Moore Machines from Input-Output Traces
Giantamidis, G., & Tripakis, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48989-6_18 · Cited by 47
Trinity: an extensible synthesis framework for data science
Martins, R., Chen, J., Chen, Y., Feng, Y., & Dillig, I. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3352063.3352098 · Cited by 47
Question selection for interactive program synthesis
Ji, R., Liang, J., Xiong, Y., Zhang, L., & Hu, Z. (2020) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3385412.3386025 · Cited by 47
PYEVOLVE: Automating Frequent Code Changes in Python ML Systems
Dilhara, M., Dig, D., & Ketkar, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00091 · Cited by 46
Sharma, A., Li, X., Guan, H., Sun, G., Zhang, L., Wang, L., Wu, K. J., Cao, L., Zhu, E., Sim, A., et al. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386931 · Cited by 46
Is Programming by Example Solved by LLMs?
Ellis, K., & Ellis, K. (2024) · neural information processing systems · doi:10.52202/079017-1422 · Cited by 46
NetEgg: Programming Network Policies by Examples
Yuan, Y., Alur, R., & Loo, B. T. (2014) · ACM Workshop on Hot Topics in Networks (HotNets) · doi:10.1145/2670518.2673879 · Cited by 46
Learning efficient logic programs
Cropper, A., & Muggleton, S. H. (2019) · Machine Learning · doi:10.1007/s10994-018-5712-6 · Cited by 31
Bespoke: Interactively Synthesizing Custom GUIs from Command-Line Applications By Demonstration
Vaithilingam, P., & Guo, P. J. (2019) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3332165.3347944 · Cited by 46
Aquila: a practically usable verification system for production-scale programmable data planes
Tian, B., Gao, J., Liu, M., Zhai, E., Chen, Y., Zhou, Y., Dai, L., Feng, Y., Ma, M., Tang, M., et al. (2021) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3452296.3472937 · Cited by 46
Code search with input/output queries: Generalizing, ranking, and assessment
Stolee, K. T., Elbaum, S. G., & Dwyer, M. B. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2015.04.081 · Cited by 46
BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided ExplorationPreprint
Odena, A., Shi, K., Bieber, D., Singh, R., Sutton, C. A., & Dai, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.14381 · Cited by 46
Learning abstract structure for drawing by efficient motor program inductionPreprint
Tian, L. Y., Ellis, K., Kryven, M., & Tenenbaum, J. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03519 · Cited by 46
CheckCell: data debugging for spreadsheets
Barowy, D. W., Gochev, D., & Berger, E. D. (2014) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2660193.2660207 · Cited by 45
Learning constraints in spreadsheets and tabular data
Kolb, S., Paramonov, S., Guns, T., & Raedt, L. D. (2017) · Machine Learning · doi:10.1007/s10994-017-5640-x · Cited by 45
Extending Program Synthesis Grammars for Grammar-Guided Genetic Programming
Forstenlechner, S., Fagan, D., Nicolau, M., & O’Neill, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99253-2_16 · Cited by 44
Program Boosting: Program Synthesis via Crowd-Sourcing
Cochran, R. A., D’Antoni, L., Livshits, B., Molnár, D., & Veanes, M. (2014) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2676726.2676973 · Cited by 43
Conflict resolution for structured merge via version space algebra
Zhu, F., & He, F. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276536 · Cited by 43
PIDS: attribute decomposition for improved compression and query performance in columnar storage
Jiang, H., Liu, C., Jin, Q., Paparrizos, J., & Elmore, A. J. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3380750.3380761 · Cited by 43
Software Testing Research Challenges: An Industrial Perspective
Alshahwan, N., Harman, M., & Marginean, A. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00008 · Cited by 45
SpreadsheetCoder: Formula Prediction from Semi-structured ContextPreprint
Chen, X., Maniatis, P., Singh, R., Sutton, C. A., Dai, H., Lin, M., & Zhou, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15339 · Cited by 45
WebRobot: web robotic process automation using interactive programming-by-demonstration
Dong, R., Huang, Z., Lam, I. I., Chen, Y., & Wang, X. (2022) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3519939.3523711 · Cited by 42
Will Code Remain a Relevant User Interface for End-User Programming with Generative AI Models?
Sarkar, A. (2023) · Proceedings of the 2023 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software · doi:10.1145/3622758.3622882 · Cited by 23
Integrating Programming by Example and Natural Language Programming
Manshadi, M., Gildea, D., & Allen, J. F. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8695 · Cited by 41
FlashProfile: a framework for synthesizing data profiles
Padhi, S., Jain, P., Perelman, D., Polozov, O., Gulwani, S., & Millstein, T. D. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276520 · Cited by 41
Self-citationSatyanarayan, A., & Jones, G. M. (2024) · doi:10.21428/e4baedd9.2d7598a2 · Cited by 40
Metadata
- Authors
- Gulwani, S.
- Affiliations
- Microsoft (United States) (US)
- Corresponding author
- Gulwani, Sumit
- ORCID
- Gulwani, Sumit
- Venue
- ACM SIGPLAN Notices
- Published
- 2011-01-26
- Volume
- 46
- Issue
- 1
- Pages
- 317-330
- ISSN
- 0362-1340 (ISSN-L)
- 1558-1160
- OpenAlex
- W2132525863
- Cited by
- 581
- References
- 23
- Citations by year
- 2026: 10 · 2025: 19 · 2024: 26 · 2023: 35 · 2022: 29 · 2021: 60 · 2020: 74 · 2019: 56 · 2018: 54 · 2017: 55 · 2016: 39 · 2015: 36 · 2014: 38 · 2013: 19 · 2012: 20
- FWCI
- 92.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM SIGPLAN Notices (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Physical Sciences › Computer Science › Software › Logic, programming, and type systems
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- string processing, spreadsheet programming, program synthesis, input-output examples, regular expressions, interactive synthesis, Excel add-in, noise detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.