Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Wikipedia has become one of the most important information resources on the Web by promoting peer collaboration and enabling virtually anyone to edit anything. However, this mutability also leads many to distrust it as a reliable source of information. Although there have been many attempts at developing metrics to help users judge the trustworthiness of content, it is unknown how much impact such measures can have on a system that is perceived as inherently unstable. Here we examine whether a visualization that exposes hidden article information can impact readers' perceptions of trustworthiness in a wiki environment. Our results suggest that surfacing information relevant to the stability of the article and the patterns of editor behavior can have a significant impact on users' trust across a variety of page types.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The other is to provide independent augmenting tooling to truthfully highlight an AI system's trustworthiness cues, which the creators may have downplayed or hidden [29, 53, 68].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [29]
Citations
Cites
Resnick, P., Kuwabara, K., Zeckhauser, R., & Friedman, E. (2000) · Communications of the ACM · doi:10.1145/355112.355122 · Cited by 2,190 · cited 1×
“It has been the subject of considerable research due to its importance in virtually all online interactions, ranging from e-commerce transactions to online discussion groups [11][12].”
BackgroundInternet encyclopaedias go head to head
Giles, J. (2005) · Nature · doi:10.1038/438900a · Cited by 1,978 · cited 1×
“A 2005 Nature study [7] found that Wikipedia had only slightly more errors than the Encyclopedia Britannica (approximately 4 to every 3) for a sample of science-related articles.”
BackgroundCrowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923 · cited 1×
“Users were recruited via Amazon’s Mechanical Turk web service using procedures similar to [10].”
MethodSelf-citationSocial translucence: an approach to designing systems that support social processes
Erickson, T., & Kellogg, W. A. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/344949.345004 · Cited by 998 · cited 1×
“There may be other negative effects of surfacing information as well: Erickson & Kellogg highlight the importance of some information remaining private, or at least not highly salient [4].”
BackgroundThe elements of computer credibility
Fogg, B. J., & Tseng, H. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303001 · Cited by 802 · cited 3×
“One such important factor is external credibility [6].”
BackgroundInfluentialStudying cooperation and conflict between authors with history flow visualizations
Viégas, F. B., Wattenberg, M., & Dave, K. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985765 · Cited by 768 · cited 2×
“Visualizations of article history have been developed to help improve this transparency [13][14].”
BackgroundHe says, she says: conflict and coordination in Wikipedia
Kittur, A., Suh, B., Pendleton, B. A., & Chi, E. H. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240698 · Cited by 574 · cited 2×
“The degree of controversy of an article was measured using the technique described in [9], based on the number of revisions to an article labeled by users as controversial.”
BackgroundMethodSelf-citationHow do users evaluate the credibility of Web sites?: a study with over 2,500 participants
Fogg, B. J., Soohoo, C., Danielson, D. R., Marable, L., Stanford, J., & Tauber, E. R. (2003) · Proceedings of the 2003 conference on Designing for user experiences · doi:10.1145/997078.997097 · Cited by 565 · cited 1×
“Metrics were chosen that were likely to affect trust based on past research and best practices [3][5][12], which suggested two key principles compatible with Wikipedia’s history information: disclosing the past history of the content and of the author.”
BackgroundA content-driven reputation system for the wikipedia
Adler, B. T., & de Alfaro, L. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242608 · Cited by 440 · cited 2×
“Anonymous users with low edit-counts often spam and commit vandalism [1].”
BackgroundDesigning trust into online experiences
Shneiderman, B. (2000) · Communications of the ACM · doi:10.1145/355112.355124 · Cited by 426 · cited 3×
“Metrics were chosen that were likely to affect trust based on past research and best practices [3][5][12], which suggested two key principles compatible with Wikipedia’s history information: disclosing the past history of the content and of the author .”
Background
Research works printed but not linked: 1
- 10.5555/1784297.1784348 · doi:10.5555/1784297.1784348
Cited by
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034
Self-citationBreaking monotony with meaning: Motivation in crowdsourcing markets
Chandler, D., & Kapelner, A. (2013) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2013.03.003 · Cited by 398
“However, one important area of research with economic implications has been to demonstrate the extent to which crowdsourced work is accurate and substitutable for work performed by experts (Snow et al., 2008; Kittur et al., 2008; Sheng et al., 2008).”
BackgroundCho, J.-H., Chan, K., & Adali, S. (2015) · ACM Computing Surveys · doi:10.1145/2815595 · Cited by 342
“Kittur et al. [2008] examine the stability of Wikipedia to evaluate its trustworthiness in terms of how much an article has been changed since the last viewing.”
BackgroundSocial use of computer-mediated communication by adults on the autism spectrum
Burke, M., Kraut, R., & Williams, D. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718991 · Cited by 186
“Similar mechanisms have been proposed in Wikipedia, making page revision and conflict history—and thus an article’s potential trustworthiness—salient [20], and modeling editing and communication behavior of candidates for promotion to administrator [7].”
BackgroundAugmenting web pages and search results to support credibility assessment
Schwarz, J., & Morris, M. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979127 · Cited by 181
“Examples of this type of intervention include augmenting Wikipedia pages with a visualization of edit history [23], and creating certifications or whitelists for trustworthy sites (such as HON certification [www.hon.ch]).”
Background
Metadata
- Authors
- Kittur, A., Suh, B., & Chi, E. H.
- Affiliations
- Carnegie Mellon University (US)
- Palo Alto Research Center (US)
- Palo Alto Research Center Inc., Palo Alto, CA, USA
- Venue
- Proceedings of the 2008 ACM conference on Computer supported cooperative work
- Publisher
- ACM
- Published
- 2008-11-08
- Pages
- 477-480
- OpenAlex
- W2158083740
- Cited by
- 122
- References
- 16
- Citations by year
- 2025: 1 · 2024: 3 · 2023: 3 · 2022: 4 · 2021: 6 · 2020: 5 · 2019: 2 · 2018: 5 · 2017: 8 · 2016: 10 · 2015: 6 · 2014: 9 · 2013: 19 · 2012: 7
- FWCI
- 19.75
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Computer Supported Cooperative Work (CSCW) (publishedVersion)
- Topics
- Social Sciences › Communication › Wikis in Education and Collaboration
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Information Systems › Expert finding and Q&A systems
- Keywords
- Wikipedia, wikis, trustworthiness, information visualization, user perception, collaborative editing, content reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia. https://app.cochat.ai/papers/10.1145/1460563.1460639
- The paper
- Kittur, A., Suh, B., & Chi, E. H. (2008). Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia. Proceedings of the 2008 ACM conference on Computer supported cooperative work. https://doi.org/10.1145/1460563.1460639
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.