Trace Ethnography: Following Coordination through Documentary Practices
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
We detail the methodology of 'trace ethnography', which combines the richness of participant- observation with the wealth of data in logs so as to reconstruct patterns and practices of users in distributed sociotechnical systems. Trace ethnography is a flexible, powerful technique that is able to capture many distributed phenomena that are otherwise difficult to study. Our approach integrates and extends a number of longstanding techniques across the social and computational sciences, and can be combined with other methods to provide rich descriptions of collaboration and organization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ethnography in/of the World System: The Emergence of Multi-Sited Ethnography
Marcus, G. E. (1995) · Annual Review of Anthropology · doi:10.1146/annurev.an.24.100195.000523 · Cited by 8,885 · cited 1×
“Methodologies like multi-sited ethnography, as expressed by George Marcus, [18] have emerged with significant vigor, especially around topics like globalization, migration, nationalism, and other issues that are not typically present in a single site.”
BackgroundSorting Things Out: Classification and Its Consequences
Bowker, G. C., & Star, S. L. (1999) · doi:10.7551/mitpress/6352.001.0001 · Cited by 6,188
The Ethnography of Infrastructure
STAR, S. L. (1999) · American Behavioral Scientist · doi:10.1177/00027649921955326 · Cited by 4,486
Robust De-anonymization of Large Sparse Datasets
Narayanan, A., & Shmatikov, V. (2008) · 2008 IEEE Symposium on Security and Privacy (sp 2008) · doi:10.1109/sp.2008.33 · Cited by 2,372 · cited 1×
“Such issues are not hypothetical, as there have been many widely-publicized instances in which seeminglyharmless trace data has been released to the public for research with disastrous consequences [20].”
BackgroundTechnology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471 · cited 1×
“At present, increasingly sophisticated ‘cultural probes’ are also being deployed to give ethnographers a richer understanding of local practices at a fraction of the cost of fieldwork [9,14].”
BackgroundDocuments and professional practice: “bad” organisational reasons for “good” clinical records
Heath, C., & Luff, P. (1996) · Proceedings of the 1996 ACM conference on Computer supported cooperative work · doi:10.1145/240080.240342 · Cited by 255 · cited 1×
“document organizational phenomena not explicitly stated in the record [12,2,3].”
BackgroundThe work of sustaining order in wikipedia: the banning of a vandal
Geiger, R. S., & Ribes, D. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718941 · Cited by 245 · cited 2×
“In a previous paper we used trace ethnography to explore and theorize how users, editors, administrators, and bots collaborated in an event that led to the banning of a vandal [11].”
BackgroundMethodSelf-citation
Cited by
Starbird, K., Arif, A., & Wilson, T. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359229 · Cited by 370
“ethnography [25] and network ethnography [36], which provide similarly valuable lenses for following human activities through and across online platforms and noting how technologies and social structures (e.”
BackgroundValidity Issues in the Use of Social Network Analysis with Digital Trace Data
University of Texas at Austin, Howison, J., Wiggins, A., Syracuse University, Crowston, K., & Syracuse University (2011) · Journal of the Association for Information Systems · doi:10.17705/1jais.00282 · Cited by 369
Data entry: towards the critical study of digital data and education
Selwyn, N. (2015) · Learning, Media and Technology · doi:10.1080/17439884.2014.921628 · Cited by 336
Collaboration Through Open Superposition: A Theory of the Open Source Way1
Howison, J., & Crowston, K. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.02 · Cited by 175
“The reconstruction of the work episodes from archival records relies on a method which Geiger and Ribes (2011) would later call " trace ethnography, " which involves a process of inversion (Bowker and Star 2000) that connects back from digital trace records to lived experience.”
BackgroundMethodActing the Part: Examining Information Operations Within #BlackLivesMatter Discourse
Arif, A., Stewart, L. G., & Starbird, K. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274289 · Cited by 152
Geiger, R. S. (2016) · Information, Communication & Society · doi:10.1080/1369118x.2016.1153700 · Cited by 125
Self-citationLeavitt, A. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675175 · Cited by 113
Influence and Improvisation: Participatory Disinformation during the 2020 US Election
Starbird, K., DiResta, R., & DeButts, M. (2023) · Social Media + Society · doi:10.1177/20563051231177943 · Cited by 90
ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia
Halfaker, A., & Geiger, R. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415219 · Cited by 82
“tegies around labeling: found trace data and community labeling campaigns. Found trace data from wikis. Wikipedians have long used the wiki platform to record digital traces about decisions they make [38]. These traces can sometimes be assumed to reflect a useful labeled data for modeling, although like all found data…”
BackgroundSelf-citationEthnography of scaling, or, how to a fit a national research infrastructure in the room
Ribes, D. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531624 · Cited by 77
“My own investigations of Wikipedia [11, 12] and the Open Science Grid [35] have been based on archival traces documented in logs and in ticketing systems.”
BackgroundSelf-citationWhen the levee breaks: without bots, what happens to Wikipedia's quality control processes?
Geiger, R. S., & Halfaker, A. (2013) · Proceedings of the 9th International Symposium on Open Collaboration · doi:10.1145/2491055.2491061 · Cited by 67
Self-citationThe Labor of Maintaining and Scaling Free and Open-Source Software Projects
Geiger, R. S., Howard, D., & Irani, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449249 · Cited by 49
Self-citationGeiger, R. S., Varoquaux, N., Mazel-Cabasse, C., & Holdgraf, C. (2018) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-018-9333-1 · Cited by 32
Self-citation'Is' to 'Was': Coordination and Commemoration in Posthumous Activity on Wikipedia Biographies
Keegan, B. C., & Brubaker, J. R. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675238 · Cited by 20
Knowledge Sharing in Tension: Interacting and Documenting on Stack Overflow
Hillman, T., Seredko, A., Nivala, M., & Osborne, T. (2021) · Proceedings of the Eighth ACM Conference on Learning @ Scale · doi:10.1145/3430895.3460981 · Cited by 4
“Analysis of the assembled datasets drew on an approach that has been characterized as trace ethnography [2, 6] where an interpretive stance is maintained while numeric and categorical trace data is visualized and analyzed alongside more traditional ethnographic data.”
Background
Metadata
- Authors
- Geiger, R. S., & Ribes, D.
- Venue
- 2011 44th Hawaii International Conference on System Sciences
- Publisher
- IEEE
- Published
- 2011-01
- Pages
- 1-10
- ISSN
- 1530-1605 (ISSN-L)
- OpenAlex
- W2111155984
- Cited by
- 232
- References
- 7
- FWCI
- 31.47
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.