Towards a context-aware IDE-based meta search engine for recommendation about programming errors and exceptions
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Study shows that software developers spend about 19% of their time looking for information in the web during software development and maintenance. Traditional web search forces them to leave the working environment (e.g., IDE) and look for information in the web browser. It also does not consider the context of the problems that the developers search solutions for. The frequent switching between web browser and the IDE is both time-consuming and distracting, and the keyword-based traditional web search often does not help much in problem solving. In this paper, we propose an Eclipse IDE-based web search solution that exploits the APIs provided by three popular web search engines-Google, Yahoo, Bing and a popular programming Q & A site, StackOverflow, and captures the content-relevance, context-relevance, popularity and search engine confidence of each candidate result against the encountered programming problems. Experiments with 75 programming errors and exceptions using the proposed approach show that inclusion of different types of contextual information associated with a given exception can enhance the recommendation accuracy of a given exception. Experiments both with two existing approaches and existing web search engines confirm that our approach can perform better than them in terms of recall, mean precision and other performance measures with little computational cost.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Roy, C. K., & Cordy, J. R. (2008) · 2008 16th IEEE International Conference on Program Comprehension · doi:10.1109/icpc.2008.41 · Cited by 533 · cited 1×
“We consider the code surrounding the exception location in the source file as the source code context of the target exception, and use a state of the art code clone detection technique, NiCad [16] to determine its relevance with the code snippets extracted from the result pages.”
MethodSelf-citation(2009) · doi:10.1145/1518701.1518944 · Cited by 447
Example-centric programming: integrating web search into the development environment
Brandt, J., Dontcheva, M., Weskamp, M., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753402 · Cited by 324
What makes a good code example?: A study of programming Q&A in StackOverflow
Nasehi, S. M., Sillito, J., Maurer, F., & Burns, C. (2012) · 2012 28th IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405249 · Cited by 287 · cited 1×
“5) StackOverflow Vote Score ( S so ): StackOverflow, a popular programming Q & A site with 1.9 million users, maintains a score for each question, answer and comment posted by the users, and the score can be considered as a social and technical recognition of their merit [12].”
BackgroundInfluentialSourcerer: a search engine for open source code supporting structure-based search
Bajracharya, S., Ngo, T., Linstead, E., Dou, Y., Rigor, P., Baldi, P., & Lopes, C. (2006) · Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications · doi:10.1145/1176617.1176671 · Cited by 219
Seahawk: Stack Overflow in the IDE
Ponzanelli, L., Bacchelli, A., & Lanza, M. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606701 · Cited by 95 · cited 9×
“Thus, the filtered exception message and the list describing the context of the exception develop the search query which we use to collect results from different search engines in proactive mode.”
BackgroundMethodInfluentialSeahawk: Stack Overflow in the IDE
Ponzanelli, L., Bacchelli, A., & Lanza, M. (2016) · Cited by 82
Context-based recommendation to support problem solving in software development
Cordeiro, J., Antunes, B., & Gomes, P. (2012) · doi:10.5555/2666719.2666739 · Cited by 56
Codetrail: Connecting source code and web resources
Goldman, M., & Miller, R. C. (2009) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2009.04.003 · Cited by 51 · cited 1×
“Goldman and Miller [10] conducted a study where they analyzed the events produced by the web browser and the IDE in temporal proximity, and concluded that 23% web pages visited were related to software development.”
BackgroundContext-based recommendation to support problem solving in software development
Cordeiro, J., Antunes, B., & Gomes, P. (2012) · 2012 Third International Workshop on Recommendation Systems for Software Engineering (RSSE) · doi:10.1109/rsse.2012.6233418 · Cited by 46
Research works printed but not linked: 1
- usmani, 2012, A comparative study of google and bing search engines in context of precision and relative recall parameter, CSE Journal, 4, 21
Cited by
Measuring Program Comprehension: A Large-Scale Field Study with Professionals
Xia, X., Bao, L., Lo, D., Xing, Z., Hassan, A. E., & Li, S. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2734091 · Cited by 326
Mining StackOverflow to turn the IDE into a self-confident programming prompter
Ponzanelli, L., Bavota, G., Di Penta, M., Oliveto, R., & Lanza, M. (2014) · Proceedings of the 11th Working Conference on Mining Software Repositories · doi:10.1145/2597073.2597077 · Cited by 240
“Other tools used Stack Overflow as main source for recommendation systems to suggest, within the IDE, code samples and discussions to the developer [7, 32, 37, 29].”
MethodAugmenting API documentation with insights from stack overflow
Treude, C., & Robillard, M. P. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884800 · Cited by 239
“[29] developed a contextaware IDE-based meta search engine for recommendations about programming errors and exceptions.”
MethodThe Impact of API Change- and Fault-Proneness on the User Ratings of Android Apps
Bavota, G., Linares-Vasquez, M., Bernal-Cardenas, C. E., Penta, M. D., Oliveto, R., & Poshyvanyk, D. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2367027 · Cited by 186
“Also, another opportunity would be to integrate API change-and fault-proneness analysis in IDEs code-search mechanisms [64], [65], [66], [67], [68], [69].”
BackgroundWhat do developers search for on the web?
Xia, X., Bao, L., Lo, D., Kochhar, P. S., Hassan, A. E., & Xing, Z. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9514-4 · Cited by 174
“…need to design next-generation IDEs that can help developers to do what they want without the need for constant switching between search engines and the IDE. Past studies (e.g., Ponzanelli et al. 2013; Rahman et al. 2014) also investigate how to integrate search engines or Stack Overflow into IDEs.”
Background
Metadata
- Authors
- Rahman, M. M., Yeasmin, S., & Roy, C. K.
- Affiliations
- University of Saskatchewan (CA)
- Venue
- 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE)
- Publisher
- IEEE
- Published
- 2014-02
- Pages
- 194-203
- OpenAlex
- W2016035035
- Semantic Scholar
- a6f1bb6ab494adb05fcf6a74af05ea048fbe5816
- Cited by
- 75
- References
- 15
- Citations by year
- 2026: 1 · 2024: 5 · 2023: 4 · 2022: 5 · 2021: 7 · 2020: 5 · 2019: 9 · 2018: 8 · 2017: 12 · 2016: 8 · 2015: 6 · 2014: 5
- FWCI
- 8.82
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- context-aware retrieval, metasearch engines, integrated development environment, eclipses, search engines, Stack Overflow, search result relevance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards a context-aware IDE-based meta search engine for recommendation about programming errors and exceptions. https://app.cochat.ai/papers/10.1109/csmr-wcre.2014.6747170
- The paper
- Rahman, M. M., Yeasmin, S., & Roy, C. K. (2014). Towards a context-aware IDE-based meta search engine for recommendation about programming errors and exceptions. 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE). https://doi.org/10.1109/csmr-wcre.2014.6747170
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.