CoChat

A Systematic Mapping Study of Software Development With GitHub

Open access
Cosentino, Valerio, Canovas Izquierdo, Javier L., Cabot, Jordi · 2017 · IEEE Access
Cited by 168

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Context: GitHub, nowadays the most popular social coding platform, has become the reference for mining Open Source repositories, a growing research trend aiming at learning from previous software projects to improve the development of new ones. In the last years, a considerable amount of research papers have been published reporting findings based on data mined from GitHub. As the community continues to deepen in its understanding of software engineering thanks to the analysis performed on this platform, we believe that it is worthwhile to reflect on how research papers have addressed the task of mining GitHub and what findings they have reported. Objective: The main objective of this paper is to identify the quantity, topic, and empirical methods of research works, targeting the analysis of how software development practices are influenced by the use of a distributed social coding platform like GitHub. Method: A systematic mapping study was conducted with four research questions and assessed 80 publications from 2009 to 2016. Results: Most works focused on the interaction around coding-related tasks and project communities. We also identified some concerns about how reliable were these results based on the fact that, overall, papers used small data sets and poor sampling techniques, employed a scarce variety of methodologies and/or were hard to replicate. Conclusions: This paper attested the high activity of research work around the field of Open Source collaboration, especially in the software domain, revealed a set of shortcomings and proposed some actions to mitigate them. We hope that this paper can also create the basis for additional studies on other collaborative activities (like book writing for instance) that are also moving to GitHub.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2017.2682323

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 94

  1. 10.1109/ISSRE.2013.6698918 · DOI · Paper page
  2. zhang, 2014, A exploratory study of @-mention in GitHub’s pull-requests, Proc APSEC, 343
  3. 10.1109/MSR.2015.22 · DOI
  4. 10.1145/2441776.2441792 · DOI · Paper page
  5. 10.1145/2597073.2597113 · DOI
  6. 10.1109/ICSE.2015.55 · DOI · Paper page
  7. 10.1109/MSR.2015.42 · DOI · Paper page
  8. 10.1145/2786805.2786854 · DOI · Paper page
  9. 10.1145/2695664.2695856 · DOI
  10. tsay, 2014, Let’s talk about it: Evaluating contributions through discussion in GitHub, Proc FSE, 144
  11. 10.1145/2568225.2568315 · DOI · Paper page
  12. 10.1109/ICPC.2016.7503718 · DOI · Paper page
  13. 10.1109/SANER.2016.68 · DOI
  14. 10.1007/s10664-015-9393-5 · DOI · Paper page
  15. 10.1145/2804360.2804366 · DOI
  16. 10.1109/ICSE.2013.6606588 · DOI · Paper page
  17. 10.1109/ICSE.2013.6606557 · DOI
  18. 10.1145/2491411.2491415 · DOI · Paper page
  19. 10.1145/2884781.2884826 · DOI · Paper page
  20. stanciulescu, 2015, Forked and integrated variants in an open-source firmware project, Proc ICS, 151
  21. 10.1145/2897659.2897663 · DOI
  22. 10.1109/ICSE.2015.74 · DOI
  23. 10.1007/978-3-662-45550-0_46 · doi:10.1007/978-3-662-45550-0_46
  24. 10.1109/IISA.2015.7388026 · doi:10.1109/iisa.2015.7388026
  25. 10.1109/BESC.2014.7059515 · DOI
  26. 10.1145/1882362.1882435 · DOI · Paper page
  27. 10.1145/2556420.2558863 · DOI
  28. 10.1016/j.infsof.2015.01.008 · DOI
  29. 10.1145/2788993.2789838 · doi:10.1145/2788993.2789838
  30. 10.1109/SANER.2016.27 · DOI
  31. 10.1145/2675133.2675284 · DOI
  32. 10.1080/01639269.2015.1062586 · doi:10.1080/01639269.2015.1062586
  33. 10.1007/s10664-016-9436-6 · DOI
  34. 10.5381/jot.2015.14.4.e1 · doi:10.5381/jot.2015.14.4.e1
  35. 10.1145/2597073.2597121 · DOI
  36. 10.1109/ICSME.2016.31 · DOI · Paper page
  37. 10.1109/SANER.2015.7081875 · DOI
  38. kikas, 2015, Issue dynamics in GitHub projects, Proc Int Conf Product-Focused Softw Process Improvement, 295, 10.1007/978-3-319-26844-6_22 · doi:10.1007/978-3-319-26844-6_22
  39. 10.1145/2875913.2875914 · DOI
  40. jarczyk, 2014, GitHub projects. Quality analysis of open-source software, Proc SocInfo, 80
  41. 10.1587/transinf.2015EDP7363 · DOI
  42. 10.1145/2597073.2597119 · doi:10.1145/2597073.2597119
  43. 10.1109/APSEC.2015.12 · DOI
  44. 10.1145/2597073.2597118 · DOI · Paper page
  45. 10.1145/2597073.2597117 · DOI · Paper page
  46. junior, 2014, Using formal concept analysis to study social coding in GitHub, Proc MSR, 1
  47. 10.1109/IEEM.2015.7385840 · DOI
  48. 10.1109/IWESEP.2016.19 · DOI
  49. 10.1109/CHASE.2015.9 · DOI
  50. 10.2197/ipsjjip.24.339 · DOI
  51. 10.1142/S0219525914500246 · DOI
  52. 10.1145/2597073.2597120 · DOI
  53. weber, 2014, What makes an open source code popular on GitHub?, Proc ICDMW, 851
  54. 10.1109/CHASE.2015.14 · DOI
  55. 10.1145/2702123.2702549 · DOI · Paper page
  56. 10.1007/978-1-4302-1834-0 · DOI
  57. 10.1109/MSR.2015.36 · DOI
  58. 10.1109/HICSS.2014.405 · DOI
  59. 10.1109/WI-IAT.2012.228 · DOI
  60. 10.1109/MSR.2015.26 · DOI · Paper page
  61. 10.1287/mnsc.1060.0560 · DOI · Paper page
  62. 10.1109/ICSM.2008.4658096 · DOI
  63. 10.1016/S0065-2458(06)69005-0 · DOI
  64. 10.1145/2597073.2597114 · DOI
  65. 10.1007/978-3-642-02032-2_15 · DOI
  66. 10.1145/2556420.2556483 · DOI
  67. amann, 2014, Software mining studies: Goals, approaches, artifacts, and replicability, LASER Summer School, 121
  68. 10.1145/2666539.2666571 · DOI
  69. 10.1145/1368088.1368115 · DOI
  70. cosentino, 2016, Findings from GitHub. Methods, datasets and limitations, Proc MSR, 137
  71. 10.1109/SocialCom.2013.35 · DOI · Paper page
  72. 10.1145/2089125.2089127 · DOI · Paper page
  73. 10.1109/CSMR.2013.41 · DOI · Paper page
  74. 10.1145/2568225.2568305 · DOI
  75. mergel, 2014, Introducing Open Collaboration in the Public Sector The Case of Social Coding on GitHub
  76. 10.1109/MS.2013.13 · DOI · Paper page
  77. 10.1145/2797433.2797476 · DOI
  78. 10.1109/ICSM.2015.7332512 · doi:10.1109/icsm.2015.7332512
  79. 10.1145/2487788.2487832 · DOI
  80. yu, 2014, Who should review this pull-request: Reviewer recommendation to expedite crowd collaboration, Proc APSEC, 1, 335
  81. 10.1109/CINE.2015.13 · DOI
  82. 10.1109/WCRE.2013.6671288 · DOI
  83. 10.1145/2666539.2666570 · DOI
  84. 10.1145/2441776.2441794 · DOI
  85. lima, 2014, Coding together at scale: GitHub as a collaborative social network, Proc ICWSM, 10
  86. 10.1145/2141512.2141583 · DOI
  87. 10.1109/MS.2012.172 · DOI · Paper page
  88. 10.1109/APSEC.2013.104 · doi:10.1109/apsec.2013.104
  89. 10.1109/MSR.2012.6224294 · DOI · Paper page
  90. xavier, 2014, Understanding the popularity of reporters and assignees in the GitHub, Proc SEKE, 484
  91. 10.1145/2492517.2492627 · DOI
  92. badashian, 2014, Involvement, contribution and influence in GitHub and StackOverflow, Proceedings of CSSE, 19
  93. 10.1145/2468356.2468381 · DOI
  94. blincoe, 2015, Understanding the popular users: Following, affiliation influence and leadership on GitHub, Proc IST, 70, 30

Cited by

See all 168

Metadata

Authors
Cosentino, V., Canovas Izquierdo, J. L., & Cabot, J.
Venue
IEEE Access
Published
2017
Volume
5
Pages
7173-7192
ISSN
2169-3536 (ISSN-L)
OpenAlex
W2601908482
Cited by
168
References
4
FWCI
18.08
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.