Programming not only by example
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Recent years have seen great progress in automated synthesis techniques that can automatically generate code based on some intent expressed by the programmer, but communicating this intent remains a major challenge. When the expressed intent is coarse-grained (for example, restriction on the expected type of an expression), the synthesizer often produces a long list of results for the programmer to choose from, shifting the heavy-lifting to the user. An alternative approach, successfully used in end-user synthesis, is programming by example (PBE), where the user leverages examples to interactively and iteratively refine the intent. However, using only examples is not expressive enough for programmers, who can observe the generated program and refine the intent by directly relating to parts of the generated program.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Alur, R., Bodik, R., Juniwal, G., Martin, M. M. K., Raghothaman, M., Seshia, S. A., Singh, R., Solar-Lezama, A., Torlak, E., & Udupa, A. (2013) · 2013 Formal Methods in Computer-Aided Design · doi:10.1109/fmcad.2013.6679385 · Cited by 656
Automating string processing in spreadsheets using input-output examples
Gulwani, S. (2011) · ACM SIGPLAN Notices · doi:10.1145/1925844.1926423 · Cited by 581
Code completion with statistical language models
Raychev, V., Vechev, M., & Yahav, E. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594321 · Cited by 555
Self-citationSmith, C., & Albarghouthi, A. (2016) · Proceedings of the 37th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2908080.2908102 · Cited by 76 · cited 1×
“B IG λ [31] synthesizes MapReduce processes via sketching and type derivations over lambda calculus and a vocabulary.”
Research works printed but not linked: 37
- 10.1007/978-3-642-39799-8_67 · DOI
- Rajeev Alur, Dana Fisman, Rishabh Singh, and Armando Solar-Lezama. 2016. SyGuS-Comp 2016: Results and Analysis. arXiv preprint arXiv:1611.07627 (2016). · arXiv
- 10.1007/978-3-662-54577-5_18 · DOI
- Tobias Anton. 2005. XPath-Wrapper Induction by generalizing tree traversal patterns. In Lernen, Wissensentdeckung und Adaptivitt (LWA) 2005, GI Workshops, Saarbrcken. 126--133.
- 10.1145/2814228.2814235 · DOI
- 10.5555/521138.786844 · doi:10.5555/521138.786844
- 10.1145/1707801.1706339 · DOI
- 10.1145/2851141.2851167 · DOI
- 10.1145/3009837.3009851 · DOI · Paper page
- 10.1145/2737924.2737977 · DOI · Paper page
- 10.1145/2568225.2568250 · DOI · Paper page
- 10.1145/1926385.1926423 · DOI · Paper page
- 10.1109/SYNASC.2012.69 · DOI
- 10.1145/2491956.2462192 · DOI · Paper page
- 10.1109/ICSM.2011.6080790 · DOI · Paper page
- 10.1145/2983990.2983993 · DOI
- 10.1145/1932682.1869463 · doi:10.1145/1932682.1869463
- 10.1145/2983990.2983993 · DOI
- Jürgen Landauer and Masahito Hirakawa. 1995. Visual AWK: A Model for Text Processing by Demonstration.. In vl. 267--274. · doi:10.5555/832276.834280
- 10.5555/369505.369519 · doi:10.5555/369505.369519
- 10.1145/2594291.2594333 · DOI · Paper page
- 10.1145/2345156.2254115 · doi:10.1145/2345156.2254115
- 10.1145/2884781.2884842 · doi:10.1145/2884781.2884842
- 10.1145/2737924.2738007 · DOI · Paper page
- 10.5555/645388.651571 · doi:10.5555/645388.651571
- 10.1145/2254064.2254098 · DOI
- 10.1145/2908080.2908093 · DOI · Paper page
- 10.1145/2814270.2814310 · DOI · Paper page
- 10.1145/1379022.1375599 · DOI
- 10.1145/1168917.1168907 · DOI
- 10.1145/2499370.2462174 · DOI
- 10.1145/1706299.1706338 · DOI
- 10.1145/1133981.1134022 · doi:10.1145/1133981.1134022
- 10.1145/1273442.1250787 · DOI
- 10.1145/3062341.3062365 · DOI · Paper page
- 10.5555/168080.168108 · doi:10.5555/168080.168108
- 10.1145/2736277.2741659 · DOI
Cited by
Vaithilingam, P., Zhang, T., & Glassman, E. L. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519665 · Cited by 660
Grounded Copilot: How Programmers Interact with Code-Generating Models
Barke, S., James, M. B., & Polikarpova, N. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3586030 · Cited by 436
Exploring the Learnability of Program Synthesizers by Novice Programmers
Jayagopal, D., Lubin, J., & Chasins, S. E. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545659 · Cited by 40
“The first of these studies [55] compares how successful participants were using (i) a traditional programming-by-example synthesizer in which users provide input-output examples versus (ii) a variant of the synthesizer using a paradigm the authors dub “pro-gramming not only by example” that also…”
ResultGrounded Copilot: How Programmers Interact with Code-Generating Models
Barke, S., James, M. B., & Polikarpova, N. (2022) · arXiv · doi:10.48550/arxiv.2206.15000 · Cited by 23
“It could also provide expert prompt syntax, similar to advanced operators in Google search; for example, including :use plt.show() in a comment prompt might restrict the assistant’s suggestions to only those snippets using the expression plt.show() , like the work of [Peleg et al. 2018].”
Method
Metadata
- Authors
- Peleg, H., Shoham, S., & Yahav, E.
- Venue
- Proceedings of the 40th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2018-05-27
- Pages
- 1114-1124
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2761958682
- Cited by
- 38
- References
- 4
- FWCI
- 2.08
- Type
- conference paper
- Language
- en
- Open access
- green
- Funders
- European Union (615688)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Programming not only by example. https://app.cochat.ai/papers/10.1145/3180155.3180189
- The paper
- Peleg, H., Shoham, S., & Yahav, E. (2018). Programming not only by example. Proceedings of the 40th International Conference on Software Engineering. https://doi.org/10.1145/3180155.3180189
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.