How Data ScientistsWork Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
In recent years there has been an increasing trend in which data scientists and domain experts work together to tackle complex scientific questions. However, such collaborations often face challenges. In this paper, we aim to decipher this collaboration complexity through a semi-structured interview study with 22 interviewees from teams of bio-medical scientists collaborating with data scientists. In the analysis, we adopt the Olsons' four-dimensions framework proposed in Distance Matters to code interview transcripts. Our findings suggest that besides the glitches in the collaboration readiness, technology readiness, and coupling of work dimensions, the tensions that exist in the common ground building process influence the collaboration outcomes, and then persist in the actual collaboration process. In contrast to prior works' general account of building a high level of common ground, the breakdowns of content common ground together with the strengthen of process common ground in this process is more beneficial for scientific discovery. We discuss why that is and what the design suggestions are, and conclude the paper with future directions and limitations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810 · cited 1×
“ese differences, if not properly shared, communicated and integrated within the group, could become hidden biases that hold back the progress of scientific discovery. The work of Tversky and Kahneman [44, 91] argues that people, even scientists and data scientists who are professional in analyzing data, have trouble t…”
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Awareness and coordination in shared workspaces
Dourish, P., & Bellotti, V. (1992) · Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 · doi:10.1145/143457.143468 · Cited by 2,550 · cited 1×
“The second concept, common ground [37], refers to how much common knowledge and awareness [28] collaborators have about the task and about each other.”
BackgroundMotivated closing of the mind: “Seizing” and “freezing”
Kruglanski, A. W., & Webster, D. M. (1996) · Psychological Review · doi:10.1037/0033-295x.103.2.263 · Cited by 2,379
Olson, G. M., & Olson, J. S. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1523_4 · Cited by 1,983 · cited 3×
“s. Different from teams in general workplaces that are driven efficiently towards clear business goals and specific performance evaluations that match one optimal solution to a well-specified problem [65], this differentiation of content and process common ground and their development and interaction with each other o…”
BackgroundInfluentialHow a Cockpit Remembers Its Speeds
Hutchins, E. (1995) · Cognitive Science · doi:10.1207/s15516709cog1903_1 · Cited by 1,880 · cited 1×
“, [27, 35, 42]).”
Stasser, G., & Titus, W. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.48.6.1467 · Cited by 1,850
Communities of Practice and Social Learning Systems: the Career of a Concept
Wenger, E. (2010) · Social Learning Systems and Communities of Practice · doi:10.1007/978-1-84996-133-2_11 · Cited by 1,348
Information sharing and team performance: A meta-analysis
Mesmer-Magnus, J. R., & DeChurch, L. A. (2009) · Journal of Applied Psychology · doi:10.1037/a0013773 · Cited by 1,273 · cited 1×
“her than novel, unshared information. This is known as the "shared information bias" [86] and often prevents the group from finding the alternative solution, usually an ideal or optimal one [29, 58]. On the other hand, comprehensive information sharing has pooling and exchange as well as integration cost and…”
BackgroundSocial coding in GitHub: transparency and collaboration in an open software repository
Dabbish, L., Stuart, C., Tsay, J., & Herbsleb, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145396 · Cited by 999
Crabtree, B. F., Miller, W. L., & Swenson, M. M. (1995) · Nursing Research · doi:10.1097/00006199-199507000-00011 · Cited by 956
Scientific Collaboration on the Internet
(2008) · doi:10.7551/mitpress/9780262151207.001.0001 · Cited by 286
The Reproducibility Crisis in Science: A Statistical Counterattack
Peng, R. (2015) · Significance · doi:10.1111/j.1740-9713.2015.00827.x · Cited by 224
Does Distance Still Matter? Revisiting the CSCW Fundamentals on Distributed Collaboration
Bjørn, P., Esbensen, M., Jensen, R. E., & Matthiesen, S. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2670534 · Cited by 147
Walking the Tightrope: The Balancing Acts of a Large e-Research Project
Lawrence, K. A. (2006) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-006-9025-0 · Cited by 121 · cited 1×
“In the more general open science and cyberinfrastructure contexts, tensions and challenges are not rarely seen, which have been attributed to the interdisciplinary nature of the team [94], related motivational factors [84] and cultural differences [9], the remote and cross-culture team structure [54, 57], the data-cen…”
BackgroundWorking Together Apart: Collaboration over the Internet
Olson, J. S., & Olson, G. M. (2014) · Synthesis Lectures on Human-Centered Informatics · doi:10.2200/s00542ed1v01y201310hci020 · Cited by 95
Cited by
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781
Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342
Self-citationHow AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study
Piorkowski, D., Park, S., Wang, A. Y., Wang, D., Muller, M., & Portnoy, F. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449205 · Cited by 151
Self-citationHow Experienced Designers of Enterprise Applications Engage AI as a Design Material
Yildirim, N., Kass, A., Tung, T., Upton, C., Costello, D., Giusti, R., Lacin, S., Lovic, S., O'Neill, J. M., Meehan, R. O., et al. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517491 · Cited by 71
(2022) · doi:10.1145/3491102.3501868 · Cited by 36
“the design challenges that result from data work [47, 54, 82].”
Background
Metadata
- Authors
- Mao, Y., Wang, D., Muller, M., Varshney, K. R., Baldini, I., Dugan, C., & Mojsilović, A.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-12-05
- Volume
- 3
- Issue
- GROUP
- Pages
- 1-23
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2971867419
- Cited by
- 124
- References
- 17
- FWCI
- 12.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.