IP-QAT: in-product questions, answers, & tips
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
We present IP-QAT, a new community-based question and answer system for software users. Unlike most community forums, IP-QAT is integrated into the actual software application, allowing users to easily post questions, answers and tips without having to leave the application. Our in-product implementation is context-aware and shows relevant posts based on a user's recent activity. It is also designed with minimal transaction costs to encourage users to easily post, include annotated images and file attachments, as well as tag their posts with relevant UI components. We describe a robust cloud-based system implementation, which allowed us to release IP-QAT to 37 users for a 2 week field study. Our study showed that IP-QAT increased user contributions, and subjectively, users found our system more useful and easier to use, in comparison to the existing commercial discussion board.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Knowledge sharing and yahoo answers: everyone knows something
Adamic, L. A., Zhang, J., Bakshy, E., & Ackerman, M. S. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367587 · Cited by 732
Design lessons from the fastest q&a site in the west
Mamykina, L., Manoim, B., Mittal, M., Hripcsak, G., & Hartmann, B. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979366 · Cited by 553 · cited 6×
“Outside of the software domain, many question and answer (Q&A) sites, such as Yahoo! Answers [2] and Stack Overflow [16], have become popular, and have shown to be a fast and effective way to learn from the community.”
BackgroundInfluentialThe anatomy of a large-scale social search engine
Horowitz, D., & Kamvar, S. D. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772735 · Cited by 425 · cited 1×
“The Q&A site Aardvark [14] differs from most others in that it routes questions directly to individual users who are known to be online to elicit faster responses.”
BackgroundPredictors of answer quality in online Q&A sites
Harper, F. M., Raban, D., Rafaeli, S., & Konstan, J. A. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357191 · Cited by 412 · cited 1×
“A sizable body of work focuses on the analysis of general purpose Q&A sites such as Yahoo Answers [2,3,6,11], Windows Live QnA [24], and a popular Korean Q&A site, Naver [12,19].”
BackgroundSikuli: using GUI screenshots for search and automation
Yeh, T., Chang, T.-H., & Miller, R. C. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622213 · Cited by 346 · cited 1×
“Additionally, images can be a useful way to quickly “scan” and find interesting topics [25], so we would like to promote visual information to the top level of the system.”
BackgroundExample-centric programming: integrating web search into the development environment
Brandt, J., Dontcheva, M., Weskamp, M., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753402 · Cited by 324 · cited 1×
“Small reductions in the transaction cost may individually not seem to make a huge difference, but previous work has shown that small improvements in interactions can cause categorical behavior changes that far exceed the benefits of the resulting decrease in task times [4,8,18].”
ResultA survey of software learnability: metrics, methodologies and guidelines
Grossman, T., Fitzmaurice, G., & Attar, R. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518803 · Cited by 322 · cited 2×
“Despite years of HCI research, learnability continues to be a challenge for software applications [9].”
BackgroundSelf-citationAnswer Garden: A tool for growing organizational memory
Acherman, M. S. (1990) · Medical Entomology and Zoology · Cited by 293
What would other programmers do: suggesting solutions to error messages
Hartmann, B., MacDougall, D., Brandt, J., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753478 · Cited by 280 · cited 1×
“With Blueprint [4] [13] is also integrated into an IDE and uses a recommender system to match build and debugging errors the user is having to solutions which have worked for other users in similar situations.”
MethodGray, W. D., & Boehm-Davis, D. A. (2000) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.6.4.322 · Cited by 268 · cited 1×
“Small reductions in the transaction cost may individually not seem to make a huge difference, but previous work has shown that small improvements in interactions can cause categorical behavior changes that far exceed the benefits of the resulting decrease in task times [4,8,18].”
ResultFacts or friends?: distinguishing informational and conversational questions in social Q&A sites
Harper, F. M., Moy, D., & Konstan, J. A. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518819 · Cited by 259 · cited 1×
“A sizable body of work focuses on the analysis of general purpose Q&A sites such as Yahoo Answers [2,3,6,11], Windows Live QnA [24], and a popular Korean Q&A site, Naver [12,19].”
BackgroundQuestions in, knowledge in?: a study of naver's question answering community
Nam, K. K., Ackerman, M. S., & Adamic, L. A. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518821 · Cited by 225 · cited 1×
“A sizable body of work focuses on the analysis of general purpose Q&A sites such as Yahoo Answers [2,3,6,11], Windows Live QnA [24], and a popular Korean Q&A site, Naver [12,19].”
BackgroundIdentifying authoritative actors in question-answering forums: the case of Yahoo! answers
Bouguessa, M., Dumoulin, B., & Wang, S. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401994 · Cited by 224
Answer Garden: a tool for growing organizational memory
Ackerman, M. S., & Malone, T. W. (1990) · ACM SIGOIS Bulletin · doi:10.1145/91478.91485 · Cited by 211
Answer Garden: a tool for growing organizational memory
Ackerman, M. S., & Malone, T. W. (1990) · Proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on Office information systems · doi:10.1145/91474.91485 · Cited by 184 · cited 1×
“An early example of a Q&A based knowledge system is Ackerman’s Answer Garden [1] which maintained an organically growing database of questions and expert answers for a single domain.”
BackgroundCommunityCommands: command recommendations for software applications
Matejka, J., Li, W., Grossman, T., & Fitzmaurice, G. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622214 · Cited by 125 · cited 3×
“While working, users often have many short periods of down-time [17], and if the community help content is being displayed within the application the user will have a chance to glance over during this time.”
BackgroundSelf-citationToolClips: an investigation of contextual video assistance for functionality understanding
Grossman, T., & Fitzmaurice, G. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753552 · Cited by 125 · cited 3×
“Singh et al. explored discussion forums of 8 open source software applications [21,22] and by qualitatively analyzing the threads was able to identify a number of problematic interactions encountered during the help-seeking process.”
BackgroundMethodInfluentialSelf-citationOver the Shoulder Learning: Supporting Brief Informal Learning
Twidale, M. B. (2005) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-005-9007-7 · Cited by 116
Observed behavior and perceived value of authors in usenet newsgroups: bridging the gap
Fiore, A. T., Tiernan, S. L., & Smith, M. A. (2002) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503434 · Cited by 102 · cited 1×
“Usenet newsgroups [7], pre-dating even the internet, and more recently web-based discussion forums, have been a popular method for people to communicate online.”
MethodExpert identification in community question answering: exploring question selection bias
Pal, A., & Konstan, J. A. (2010) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1871437.1871658 · Cited by 85 · cited 2×
“Some online systems, such as Intuit’s TurboTax, have community Q&A services integrated into their websites [20].”
BackgroundMethodMatejka, J., Grossman, T., & Fitzmaurice, G. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979349 · Cited by 60
Self-citationDesign and evaluation of a command recommendation system for software applications
Li, W., Matejka, J., Grossman, T., Konstan, J. A., & Fitzmaurice, G. (2011) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1970378.1970380 · Cited by 57 · cited 3×
“This is especially true for complex and feature rich programs which have been shown to continuously grow in their number of features with each release [15].”
BackgroundSelf-citationWhy users of yahoo! answers do not answer questions
Dearman, D., & Truong, K. N. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753376 · Cited by 55 · cited 1×
“A sizable body of work focuses on the analysis of general purpose Q&A sites such as Yahoo Answers [2,3,6,11], Windows Live QnA [24], and a popular Korean Q&A site, Naver [12,19].”
BackgroundOpen Source Technical Support: A Look at Peer Help-Giving
Singh, V., Twidale, M. B., & Rathi, D. (2006) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2006.370 · Cited by 46 · cited 1×
“explored discussion forums of 8 open source software applications [21,22] and by qualitatively analyzing the threads was able to identify a number of problematic interactions encountered during the help-seeking process.”
BackgroundWhither the Experts? Social Affordances and the Cultivation of Experts in Community Q&A Systems
Welser, H. T., Gleave, E., Barash, V., Smith, M. A., & Meckes, J. (2009) · doi:10.1109/cse.2009.254 · Cited by 27 · cited 1×
“A sizable body of work focuses on the analysis of general purpose Q&A sites such as Yahoo Answers [2,3,6,11], Windows Live QnA [24], and a popular Korean Q&A site, Naver [12,19].”
BackgroundThe confusion of crowds: non-dyadic help interactions
Singh, V., & Twidale, M. B. (2008) · Proceedings of the 2008 ACM conference on Computer supported cooperative work · doi:10.1145/1460563.1460670 · Cited by 22 · cited 1×
“explored discussion forums of 8 open source software applications [21,22] and by qualitatively analyzing the threads was able to identify a number of problematic interactions encountered during the help-seeking process.”
BackgroundModern software product support processes and the usage of multimedia formats
Chilana, P. K., Grossman, T., & Fitzmaurice, G. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979400 · Cited by 17
Self-citation
Research works printed but not linked: 1
- 10.1037/1076-898x.6.4.322 · doi:10.1037/1076-898x.6.4.322 · Paper page
Cited by
A Comprehensive Survey and Classification of Approaches for Community Question Answering
Srba, I., & Bielikova, M. (2016) · ACM Transactions on the Web · doi:10.1145/2934687 · Cited by 161
“—Transferability, motivated by the high success of the CQA system on the open web, several studies concerning with CQA transferability to different domains have been conducted so far, for example, regarding how CQA concepts can be embedded into various software applications [Matejka et al. 2011], applied as a suppleme…”
BackgroundMethodUnderstanding Newcomers to 3D Printing: Motivations, Workflows, and Barriers of Casual Makers
Hudson, N., Alcock, C., & Chilana, P. K. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858266 · Cited by 165
“Some recent tools have already started exploring ways of helping users share expertise and learn socially within webbased and desktop software applications [7,26] as well as within programming environments [17].”
BackgroundMixT: automatic generation of step-by-step mixed media tutorials
Chi, P.-Y., Ahn, S., Ren, A., Dontcheva, M., Li, W., & Hartmann, B. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380130 · Cited by 113
LemonAid: selection-based crowdsourced contextual help for web applications
Chilana, P. K., Ko, A. J., & Wobbrock, J. O. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208620 · Cited by 79
“Similar approaches that try to link community discussions in the interface have appeared recently in the IP-QAT system [20] and in commercial contexts [37] as well.”
BackgroundMixT: automatic generation of step-by-step mixed media tutorials
Chi, P.-Y., Ahn, S., Ren, A., Hartmann, B., Dontcheva, M., & Li, W. (2012) · CHI '12 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2212776.2223662 · Cited by 66
Metadata
- Authors
- Matejka, J., Grossman, T., & Fitzmaurice, G.
- Affiliations
- Autodesk Research, Toronto, ON, Canada
- Venue
- Proceedings of the 24th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2011-10-16
- Pages
- 175-184
- OpenAlex
- W2132930719
- Cited by
- 43
- References
- 26
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3 · 2023: 2 · 2022: 5 · 2020: 5 · 2019: 2 · 2018: 2 · 2017: 2 · 2016: 5 · 2015: 3 · 2014: 2 · 2013: 5 · 2012: 4
- FWCI
- 2.64
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Expert finding and Q&A systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Decision Sciences › Information Systems and Management › Knowledge Management and Sharing
- Keywords
- question answering systems, community forums, context-aware recommendation, user contribution, cloud systems, forum, transaction costs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.