CoChat

Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study

Zhang, Tianyi, Hartmann, Björn, Kim, Miryung, Glassman, Elena L. · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

The DOI matches its Crossref record; 57 of the 59 references it cites were found in a registry or an index.

Abstract

APIs are becoming the fundamental building block of modern software and their usability is crucial to programming efficiency and software quality. Yet API designers find it hard to gather and interpret user feedback on their APIs. To close the gap, we interviewed 23 API designers from 6 companies and 11 open-source projects to understand their practices and needs. The primary way of gathering user feedback is through bug reports and peer reviews, as formal usability testing is prohibitively expensive to conduct in practice. Participants expressed a strong desire to gather real-world use cases and understand users' mental models, but there was a lack of tool support for such needs. In particular, participants were curious about where users got stuck, their workarounds, common mistakes, and unanticipated corner cases. We highlight several opportunities to address those unmet needs, including developing new mechanisms that systematically elicit users' mental models, building mining frameworks that identify recurring patterns beyond shallow statistics about API usage, and exploring alternative design choices made in similar libraries.

Overview

Integrity signals

Registry

Crossref · 10.1145/3313831.3376382

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 57 references

Research works printed but not linked: 7

  1. Matej Balog, Alexander L Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2016. Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989 (2016). · arXiv
  2. Steven Clarke. 2005. Describing and measuring API usability with the cognitive dimensions. In Cognitive Dimensions of Notations 10th Anniversary Workshop. Citeseer, 131.
  3. 10.5555/2337223.2337255 · doi:10.5555/2337223.2337255
  4. Robyn Longhurst. 2003. Semi-structured interviews and focus groups. Key methods in geography 3 (2003), 143--156.
  5. 10.1109/WAPI.2017.2 · DOI
  6. 10.5555/2486788.2486804 · doi:10.5555/2486788.2486804
  7. 10.5555/2487085.2487146 · doi:10.5555/2487085.2487146

Cited by

See all 25

Metadata

Authors
Zhang, T., Hartmann, B., Kim, M., & Glassman, E. L.
Affiliations
  • Harvard University (US)
  • University of California, Berkeley (US)
  • University of California, Los Angeles (US)
Venue
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2020-04-21
Pages
1-13
OpenAlex
W3028676906
Cited by
25
References
59
Citations by year
2026: 1 · 2025: 1 · 2024: 6 · 2023: 2 · 2022: 5 · 2021: 9 · 2020: 1
FWCI
3.22
Type
conference paper
Language
en
Open access
closed
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Funders
  • National Science Foundation (CCF-1764077, CCF-1527923, CCF-1723773)
  • Office of Naval Research (N00014-18-1-2037)
Topics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
API design, API usability, user feedback, mental models, bug reports, peer review, usage mining, open source software, corner cases

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study. https://app.cochat.ai/papers/10.1145/3313831.3376382
The paper
Zhang, T., Hartmann, B., Kim, M., & Glassman, E. L. (2020). Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376382

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.