CoChat

Towards Human-Bot Collaborative Software Architecting with ChatGPT

Open access
Ahmad, Aakash, Waseem, Muhammad, Liang, Peng, Fahmideh, Mahdi, Aktar, Mst Shamima, Mikkonen, Tommi · 2023 · Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Architecting software-intensive systems can be a complex process. It deals with the daunting tasks of unifying stakeholders’ perspectives, designers’ intellect, tool-based automation, pattern-driven reuse, and so on, to sketch a blueprint that guides software implementation and evaluation. Despite its benefits, architecture-centric software engineering (ACSE) suffers from a multitude of challenges. ACSE challenges could stem from a lack of standardized processes, socio-technical limitations, and scarcity of human expertise etc. that can impede the development of existing and emergent classes of software. Software Development Bots (DevBots) trained on large language models can help synergise architects’ knowledge with artificially intelligent decision support to enable rapid architecting in a human-bot collaborative ACSE. An emerging solution to enable this collaboration is ChatGPT, a disruptive technology not primarily introduced for software engineering, but is capable of articulating and refining architectural artifacts based on natural language processing. We detail a case study that involves collaboration between a novice software architect and ChatGPT to architect a service-based software. Future research focuses on harnessing empirical evidence about architects’ productivity and explores socio-technical aspects of architecting with ChatGPT to tackle challenges of ACSE.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3593434.3593468

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 5

  1. Anonymous. 2023. Replication Package: Towards Human-Bot Collaborative Software Architecting with ChatGPT. In https://anonymous.4open.science/r/ChatGPT4SA-2B61.
  2. Laurent Avila-Chauvet, Diana Mejía, and Christian Oswaldo Acosta Quiroz. 2023. ChatGPT as a Support Tool for Online Behavioral Task Programming. SSRN preprint SSRN:4329020 (2023).
  3. Sebastian Herold, Christoph Knieke, Mirco Schindler, and Andreas Rausch. 2020. Towards Improving Software Architecture Degradation Mitigation by Machine Learning. In Proceedings of the 12th International Conference on Adaptive and Self-Adaptive Systems and Applications (ADAPTIVE). IARIA, 36–39.
  4. Sajed Jalil, Suzzana Rafi, Thomas D LaToza, Kevin Moran, and Wing Lam. 2023. ChatGPT and Software Testing Education: Promises & Perils. arXiv preprint arXiv:2302.03287 (2023). · arXiv
  5. Junaid Qadir. 2022. Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education. TechRxiv preprint techrxiv.21789434 (2022).

Cited by

See all 168

Metadata

Authors
Ahmad, A., Waseem, M., Liang, P., Fahmideh, M., Aktar, M. S., & Mikkonen, T.
Affiliations
  • Lancaster University (GB)
  • University of Jyväskylä (FI)
  • Wuhan University (CN)
  • University of Southern Queensland (AU)
Venue
Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering
Publisher
ACM
Published
2023-06-14
Pages
279-285
OpenAlex
W4380568688
Cited by
168
References
12
Citations by year
2026: 21 · 2025: 55 · 2024: 61 · 2023: 31
FWCI
29.82
Type
conference paper
Language
en
Open access
Locations
  • International Conference on Evaluation and Assessment in Software Engineering (EASE) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Lancaster EPrints (Lancaster University) (submittedVersion)
  • Jyväskylä University Digital Archive (University of Jyväskylä) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Natural Science Foundation of China (62172311)
  • Jyväskylän Yliopisto
Topics
  • Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Keywords
software architecture, ChatGPT, large language models, AI decision support

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Towards Human-Bot Collaborative Software Architecting with ChatGPT. https://app.cochat.ai/papers/10.1145/3593434.3593468
The paper
Ahmad, A., Waseem, M., Liang, P., Fahmideh, M., Aktar, M. S., & Mikkonen, T. (2023). Towards Human-Bot Collaborative Software Architecting with ChatGPT. Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering. https://doi.org/10.1145/3593434.3593468

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.