Automating string processing in spreadsheets using input-output examples
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
We describe the design of a string programming/expression language that supports restricted forms of regular expressions, conditionals and loops. The language is expressive enough to represent a wide variety of string manipulation tasks that end-users struggle with. We describe an algorithm based on several novel concepts for synthesizing a desired program in this language from input-output examples. The synthesis algorithm is very efficient taking a fraction of a second for various benchmark examples. The synthesis algorithm is interactive and has several desirable features: it can rank multiple solutions and has fast convergence, it can detect noise in the user input, and it supports an active interaction model wherein the user is prompted to provide outputs on inputs that may have multiple computational interpretations. The algorithm has been implemented as an interactive add-in for Microsoft Excel spreadsheet system. The prototype tool has met the golden test - it has synthesized part of itself, and has been used to solve problems beyond author's imagination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Learning regular sets from queries and counterexamples
Angluin, D. (1987) · Information and Computation · doi:10.1016/0890-5401(87)90052-6 · Cited by 2,114
Mitchell, T. M. (1982) · Artificial Intelligence · doi:10.1016/0004-3702(82)90040-6 · Cited by 1,412
Watch what I do: programming by demonstration
Cypher, A., Halbert, D. C., Kurlander, D., Lieberman, H. A., Maulsby, D., Myers, B. A., & Turransky, A. (1993) · Medical Entomology and Zoology · Cited by 1,027
Six Learning Barriers in End-User Programming Systems
Ko, A. J., Myers, B. A., & Aung, H. H. (2004) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.47 · Cited by 549
Oracle-guided component-based program synthesis
Jha, S., Gulwani, S., Seshia, S. A., & Tiwari, A. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806833 · Cited by 510
Self-citationFrom program verification to program synthesis
Srivastava, S., Gulwani, S., & Foster, J. S. (2010) · Proceedings of the 37th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/1706299.1706337 · Cited by 267
Self-citationDimensions in program synthesis
Gulwani, S. (2010) · Proceedings of the 12th international ACM SIGPLAN symposium on Principles and practice of declarative programming · doi:10.1145/1836089.1836091 · Cited by 238
Self-citationProgramming by Demonstration Using Version Space Algebra
Lau, T., Wolfman, S. A., Domingos, P., & Weld, D. S. (2003) · Machine Learning · doi:10.1023/a:1025671410623 · Cited by 178
PADS: a domain-specific language for processing ad hoc data
Fisher, K. S., & Gruber, R. E. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065046 · Cited by 132
Research works printed but not linked: 7
- Gualtieri M., 2009, Forrester Report for Application Development and Program Management Professionals
- Lau T., 2008, CHI 2008 Workshop on Usable AI
- Lau T., 2004, Workshop on SCLAS, AAAI
- Lau T. A., 2000, ICML
- Miller R. C., 2001, USENIX Annual Technical Conference
- 10.5555/645516.658243 · doi:10.5555/645516.658243
- Walkenbach J., 2010, John Wiley and Sons
Cited by
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
Competition-level code generation with AlphaCode
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Dal Lago, A., et al. (2022) · Science · doi:10.1126/science.abq1158 · Cited by 1,043
Competition-Level Code Generation with AlphaCode
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Lago, A. D., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.07814 · Cited by 1,043
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., A., M. S. A., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2023) · BOA (University of Milano-Bicocca) · Cited by 724
Vaithilingam, P., Zhang, T., & Glassman, E. L. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519665 · Cited by 660
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Grounded Copilot: How Programmers Interact with Code-Generating Models
Barke, S., James, M. B., & Polikarpova, N. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3586030 · Cited by 436
Program Synthesis with Large Language Models
Austin, J., Odena, A., Nye, M., Bosma, M., Michalewski, H., Dohan, D., Jiang, E., Cai, C., Terry, M., Le, Q., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07732 · Cited by 388
Liu, J., Xia, C. S., Wang, Y., & Zhang, L. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-0943 · Cited by 384
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Kazemitabaar, M., Chow, J., Ma, C. K. T., Ericson, B. J., Weintrop, D., & Grossman, T. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580919 · Cited by 366
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
Nijkamp, E., Pang, B., Hayashi, H., Tu, L., Wang, H., Zhou, Y., Savarese, S., & Xiong, C. (2022) · arXiv · doi:10.48550/arxiv.2203.13474 · Cited by 330
Is the cure worse than the disease? overfitting in automated program repair
Smith, E. K., Barr, E. T., Le Goues, C., & Brun, Y. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786825 · Cited by 323
Gulwani, S., Polozov, O., & Singh, R. (2017) · Foundations and Trends in Programming Languages · doi:10.1561/2500000010 · Cited by 319
Self-citationRobustFill: Neural Program Learning under Noisy I/O
Devlin, J., Uesato, J., Bhupatiraju, S., Singh, R. K., Mohamed, A., & Kohli, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07469 · Cited by 91
Neuro-Symbolic Program Synthesis
Parisotto, E., Mohamed, A., Singh, R. K., Li, L. C., Zhou, D., & Kohli, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01855 · Cited by 92
Overview and Importance of Data Quality for Machine Learning Tasks
Jain, A., Patel, H., Nagalapatti, L., Gupta, N., Mehta, S., Guttula, S., Mujumdar, S., Afzal, S., Sharma Mittal, R., & Munigala, V. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3406477 · Cited by 293
Spreadsheet data manipulation using examples
Gulwani, S., Harris, W. R., & Singh, R. (2012) · Communications of the ACM · doi:10.1145/2240236.2240260 · Cited by 292
Self-citationSQLizer: query synthesis from natural language
Yaghmazadeh, N., Wang, Y., Dillig, I., & Dillig, T. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133887 · Cited by 279
An Empirical Study of the Non-Determinism of ChatGPT in Code Generation
Ouyang, S., Zhang, J. M., Harman, M., & Wang, M. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3697010 · Cited by 258
An end-to-end learning-based cost estimator
Sun, J., & Li, G. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3368289.3368296 · Cited by 256
Synthesizing data structure transformations from input-output examples
Feser, J. K., Chaudhuri, S., & Dillig, I. (2015) · Proceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2737924.2737977 · Cited by 251
Synthesis of loop-free programs
Gulwani, S., Jha, S., Tiwari, A., & Venkatesan, R. (2011) · ACM SIGPLAN Notices · doi:10.1145/1993316.1993506 · Cited by 237
Self-citationBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · UCL Discovery (University College London) · Cited by 237
Synthetic Data for Deep LearningPreprint
Nikolenko, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11512 · Cited by 231
FlashMeta: a framework for inductive program synthesis
Polozov, O., & Gulwani, S. (2015) · Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications · doi:10.1145/2814270.2814310 · Cited by 225
Self-citationS3: syntax- and semantic-guided repair synthesis via programming by examples
Le, X.-B. D., Chu, D.-H., Lo, D., Le Goues, C., & Visser, W. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106309 · Cited by 220
Scaling Enumerative Program Synthesis via Divide and Conquer
Alur, R., Radhakrishna, A., & Udupa, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-662-54577-5_18 · Cited by 211
Formal verification of hybrid systems
Alur, R. (2011) · Proceedings of the ninth ACM international conference on Embedded software · doi:10.1145/2038642.2038685 · Cited by 210
FlashExtract: a framework for data extraction by examples
Le, V., & Gulwani, S. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594333 · Cited by 209
Self-citationLearning syntactic program transformations from examples.
de Sousa, R. R. (2018) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 208
InverseCSG: automatic conversion of 3D models to CSG trees
Du, T., Inala, J. P., Pu, Y., Spielberg, A., Schulz, A., Rus, D. L., Solar-Lezama, A., & Matusik, W. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275006 · Cited by 203
Albarghouthi, A., Gulwani, S., & Kincaid, Z. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39799-8_67 · Cited by 201
Self-citationInductive programming meets the real world
Gulwani, S., Hernández-Orallo, J., Kitzelmann, E., Muggleton, S. H., Schmid, U., & Zorn, B. (2015) · Communications of the ACM · doi:10.1145/2736282 · Cited by 136
Self-citationInCoder: A Generative Model for Code Infilling and Synthesis
Fried, D., Aghajanyan, A., Lin, J., Wang, S., Wallace, E., Shi, F., Zhong, R., Yih, W.-T., Zettlemoyer, L., & Lewis, M. (2022) · arXiv · doi:10.48550/arxiv.2204.05999 · Cited by 187
A Machine Learning Framework for Programming by Example
Menon, A. K., Tamuz, O., Gulwani, S., Lampson, B., & Kalai, A. T. (2013) · International Conference on Machine Learning · Cited by 186
Self-citationType-and-example-directed program synthesis
Osera, P.-M., & Zdancewic, S. (2015) · Proceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2737924.2738007 · Cited by 185
How Large Language Models Will Disrupt Data Management
Fernandez, R. C., Elmore, A. J., Franklin, M. J., Krishnan, S., & Tan, C. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3611479.3611527 · Cited by 115
Structured Generative Models of Natural Source Code
Maddison, C. J., & Tarlow, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.0514 · Cited by 122
Synthesizing highly expressive SQL queries from input-output examples
Wang, C., Cheung, A., & Bodik, R. (2017) · Proceedings of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3062341.3062365 · Cited by 178
Foofah: Transforming Data By Example
Jin, Z., Anderson, M. R., Cafarella, M., & Jagadish, H. V. (2017) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3035918.3064034 · Cited by 170
Survey on the Analysis of User Interactions and Visualization Provenance
Xu, K., Ottley, A., Walchshofer, C., Streit, M., Chang, R., & Wenskovitch, J. E. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14035 · Cited by 168
SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation
Ma, Z., Zhang, B., Tang, J., Yu, J., Zhang, X., Zhang, X., Luo, S., Zhang, X., & Tang, J. (2024) · neural information processing systems · doi:10.52202/079017-3007 · Cited by 167
Synthesizing program input grammars
Bastani, O., Sharma, R., Aiken, A., & Liang, P. (2017) · Proceedings of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3062341.3062349 · Cited by 131
Component-based synthesis of table consolidation and transformation tasks from examples
Feng, Y., Martins, R., Van Geffen, J., Dillig, I., & Chaudhuri, S. (2017) · Proceedings of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3062341.3062351 · Cited by 131
Execution-Guided Neural Program Synthesis.
Chen, X., Liu, C., & Song, D. X. (2018) · International Conference on Learning Representations · Cited by 163
Automated software transplantation
Barr, E. T., Harman, M., Jia, Y., Marginean, A., & Petke, J. (2015) · Proceedings of the 2015 International Symposium on Software Testing and Analysis · doi:10.1145/2771783.2771796 · Cited by 132
What's Wrong with Computational Notebooks? Pain Points, Needs, and Design Opportunities
Chattopadhyay, S., Prasad, I., Henley, A. Z., Sarma, A., & Barik, T. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376729 · Cited by 159
Spreadsheet table transformations from examples
Harris, W. R., & Gulwani, S. (2011) · ACM SIGPLAN Notices · doi:10.1145/1993316.1993536 · Cited by 159
Self-citationTRANSIT: specifying protocols with concolic snippets
Udupa, A., Raghavan, A., Deshmukh, J. V., Mador-Haim, S., Martin, M. M. K., & Alur, R. (2013) · Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2491956.2462174 · Cited by 158
Component-based synthesis for complex APIs
Feng, Y., Martins, R., Wang, Y., Dillig, I., & Reps, T. W. (2017) · Proceedings of the 44th ACM SIGPLAN Symposium on Principles of Programming Languages · doi:10.1145/3009837.3009851 · Cited by 113
Program synthesis using natural language
Desai, A., Gulwani, S., Hingorani, V., Jain, N., Karkare, A., Marron, M., R, S., & Roy, S. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884786 · Cited by 111
Self-citationIn-IDE Code Generation from Natural Language: Promise and Challenges
Xu, F. F., Vasilescu, B., & Neubig, G. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3487569 · Cited by 154
Learning semantic string transformations from examples
Singh, R., & Gulwani, S. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2212351.2212356 · Cited by 121
Self-citationProactive wrangling: mixed-initiative end-user programming of data transformation scripts
Guo, P. J., Kandel, S., Hellerstein, J. M., & Heer, J. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047205 · Cited by 109
Drosos, I., Barik, T., Guo, P. J., DeLine, R., & Gulwani, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376442 · Cited by 107
Self-citationSolving the Search for Source Code
Stolee, K. T., Elbaum, S., & Dobos, D. (2014) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2581377 · Cited by 122
Learning programs from noisy data
Raychev, V., Bielik, P., Vechev, M., & Krause, A. (2016) · Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages · doi:10.1145/2837614.2837671 · Cited by 123
Andreas, J., Klein, D., & Levine, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1197 · Cited by 74
SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Models
Li, H., Su, J., Chen, Y., Li, Q., & Zhang, Z.-X. (2023) · neural information processing systems · doi:10.52202/075280-0220 · Cited by 134
NLyze: interactive programming by natural language for spreadsheet data analysis and manipulation
Gulwani, S., & Marron, M. (2014) · Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2588555.2612177 · Cited by 97
Self-citationNo Need to Lift a Finger Anymore? Assessing the Quality of Code Generation by ChatGPT
Liu, Z., Tang, Y., Luo, X., Zhou, Y., & Zhang, L. F. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3392499 · Cited by 128
FlashRelate: extracting relational data from semi-structured spreadsheets using examples
Barowy, D. W., Gulwani, S., Hart, T., & Zorn, B. G. (2015) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2737924.2737952 · Cited by 128
Self-citationOn the Design of AI-powered Code Assistants for Notebooks
Mcnutt, A. M., Wang, C., Deline, R. A., & Drucker, S. M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580940 · Cited by 77
DreamCoder: growing generalizable, interpretable knowledge with wake–sleep Bayesian program learning
Ellis, K., Wong, L., Nye, M., Sablé-Meyer, M., Cary, L., Anaya Pozo, L., Hewitt, L., Solar-Lezama, A., & Tenenbaum, J. B. (2023) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2022.0050 · Cited by 125
Template-based program verification and program synthesis
Srivastava, S., Gulwani, S., & Foster, J. S. (2012) · International Journal on Software Tools for Technology Transfer · doi:10.1007/s10009-012-0223-4 · Cited by 124
Self-citationTerpreT: A Probabilistic Programming Language for Program Induction
Gaunt, A. L., Brockschmidt, M., Singh, R. K., Kushman, N., Kohli, P., Taylor, J., & Tarlow, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.04428 · Cited by 74
Program synthesis using abstraction refinement
Wang, X., Dillig, I., & Singh, R. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3158151 · Cited by 73
User Interaction Models for Disambiguation in Programming by Example
Mayer, M., Soares, G., Grechkin, M., Le, V., Marron, M., Polozov, O., Singh, R., Zorn, B., & Gulwani, S. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807459 · Cited by 97
Self-citationLLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluation
Fakhoury, S., Naik, A., Sakkas, G., Chakraborty, S., & Lahiri, S. K. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3428972 · Cited by 120
Synthesizing Number Transformations from Input-Output Examples
Singh, R., & Gulwani, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31424-7_44 · Cited by 120
Self-citationHypothesis Search: Inductive Reasoning with Language Models
Wang, R., Zelikman, E., Poesia, G., Pu, Y., Haber, N., & Goodman, N. D. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2309.05660 · Cited by 123
Liu, M. X., Sarkar, A., Negreanu, C., Zorn, B., Williams, J., Toronto, N., & Gordon, A. D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580817 · Cited by 119
Rousillon: Scraping Distributed Hierarchical Web Data
Chasins, S. E., Mueller, M., & Bodik, R. (2018) · Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3242587.3242661 · Cited by 85
Learning to Infer Program SketchesPreprint
Nye, M., Hewitt, L., Tenenbaum, J. B., & Solar-Lezama, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06349 · Cited by 119
BlinkFill: semi-supervised programming by example for syntactic string transformations
Singh, R. (2016) · Proceedings of the VLDB Endowment · doi:10.14778/2977797.2977807 · Cited by 118
Li, T. J.-J., Labutov, I., Li, X. N., Zhang, X., Shi, W., Ding, W., Mitchell, T. M., & Myers, B. A. (2018) · 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2018.8506506 · Cited by 44
Synthesizing benchmarks for predictive modeling
Cummins, C., Petoumenos, P., Wang, Z., & Leather, H. (2017) · Proceedings of the CGO/Proceedings of the ... CGO · doi:10.1109/cgo.2017.7863731 · Cited by 114
Program synthesis using conflict-driven learning
Feng, Y., Martins, R., Bastani, O., & Dillig, I. (2018) · Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3192366.3192382 · Cited by 111
Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decomposition
Kazemitabaar, M., Williams, J., Drosos, I., Grossman, T., Henley, A. Z., Negreanu, C., & Sarkar, A. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676345 · Cited by 112
Accelerating search-based program synthesis using learned probabilistic models
Lee, W., Heo, K., Alur, R., & Naik, M. (2018) · Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3192366.3192410 · Cited by 77
Example-directed synthesis: a type-theoretic interpretation
Frankle, J., Osera, P.-M., Walker, D., & Zdancewic, S. (2016) · Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages · doi:10.1145/2837614.2837629 · Cited by 73
Multi-modal synthesis of regular expressions
Chen, Q., Wang, X., Ye, X., Durrett, G., & Dillig, I. (2020) · Proceedings of the 41st ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3385412.3385988 · Cited by 79
DreamCoder: bootstrapping inductive program synthesis with wake-sleep library learning
Ellis, K., Wong, C., Nye, M., Sablé-Meyer, M., Morales, L., Hewitt, L., Cary, L., Solar-Lezama, A., & Tenenbaum, J. B. (2021) · Proceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation · doi:10.1145/3453483.3454080 · Cited by 103
SPoC: Search-based Pseudocode to Code
Kulal, S., Pasupat, P., Chandra, K., Lee, M., Padon, O., Aiken, A., & Liang, P. (2019) · arXiv · doi:10.48550/arxiv.1906.04908 · Cited by 103
Synthesizing geometry constructions
Gulwani, S., Korthikanti, V. A., & Tiwari, A. (2011) · ACM SIGPLAN Notices · doi:10.1145/1993316.1993505 · Cited by 103
Self-citationB2: Bridging Code and Interactive Visualization in Computational Notebooks
Wu, Y., Hellerstein, J. M., & Satyanarayan, A. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415851 · Cited by 70
Automated Metadata Construction to Support Portable Building Applications
Bhattacharya, A., Hong, D., Culler, D., Ortiz, J., Whitehouse, K., & Wu, E. (2015) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/2821650.2821667 · Cited by 102
mage: Fluid Moves Between Code and Graphical Work in Computational Notebooks
Kery, M. B., Ren, D., Hohman, F., Moritz, D., Wongsuphasawat, K., & Patel, K. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379337.3415842 · Cited by 96
Automated repair of HTML generation errors in PHP applications using string constraint solving
Samimi, H., Schäfer, M., Artzi, S., Millstein, T. D., Tip, F., & Hendren, L. J. (2012) · doi:10.5555/2337223.2337257 · Cited by 96
SmartSynth: synthesizing smartphone automation scripts from natural language
Le, V., Gulwani, S., & Su, Z. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464443 · Cited by 84
Self-citationAutomatically synthesizing SQL queries from input-output examples
Zhang, S., & Sun, Y. (2013) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693082 · Cited by 94
Optimizing synthesis with metasketches
Bornholt, J., Torlak, E., Grossman, D., & Ceze, L. (2016) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2837614.2837666 · Cited by 94
MintHint: automated synthesis of repair hints
Kaleeswaran, S., Tulsian, V., Kanade, A., & Orso, A. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568258 · Cited by 81
Predicting a Correct Program in Programming by Example
Singh, R., & Gulwani, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-21690-4_23 · Cited by 92
Self-citationPerelman, D., Gulwani, S., Grossman, D., & Provost, P. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594297 · Cited by 70
Self-citationProgram Synthesis and Semantic Parsing with Learned Code Idioms
Shin, E. C. R., Allamanis, M., Brockschmidt, M., & Polozov, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.10816 · Cited by 47
Candidate Digital Tasks Selection Methodology for Automation with Robotic Process Automation
Choi, D., R’bigui, H., & Cho, C. (2021) · Sustainability · doi:10.3390/su13168980 · Cited by 88
Active Automata Learning in Practice: An Annotated Bibliography of the Years 2011 to 2016
Howar, F. M., & Steffen, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-96562-8_5 · Cited by 87
Learning Generative Models of 3D Structures
Chaudhuri, S., Ritchie, D., Wu, J., Xu, K., & Zhang, H. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14020 · Cited by 61
Synthesis from Examples: Interaction Models and Algorithms
Gulwani, S. (2012) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc.2012.69 · Cited by 86
Self-citation
Metadata
- Authors
- Gulwani, S.
- Affiliations
- Microsoft (United States) (US)
- Corresponding author
- Gulwani, Sumit
- ORCID
- Gulwani, Sumit
- Venue
- ACM SIGPLAN Notices
- Published
- 2011-01-26
- Volume
- 46
- Issue
- 1
- Pages
- 317-330
- ISSN
- 0362-1340 (ISSN-L)
- 1558-1160
- OpenAlex
- W2132525863
- Cited by
- 581
- References
- 23
- Citations by year
- 2026: 10 · 2025: 19 · 2024: 26 · 2023: 35 · 2022: 29 · 2021: 60 · 2020: 74 · 2019: 56 · 2018: 54 · 2017: 55 · 2016: 39 · 2015: 36 · 2014: 38 · 2013: 19 · 2012: 20
- FWCI
- 92.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM SIGPLAN Notices (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Physical Sciences › Computer Science › Software › Logic, programming, and type systems
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- string processing, spreadsheet programming, program synthesis, input-output examples, regular expressions, interactive synthesis, Excel add-in, noise detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.