Factual accuracy and trust in information: The role of expertise
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
In the past few decades, the task of judging the credibility of information has shifted from trained professionals (e.g., editors) to end users of information (e.g., casual Internet users). Lacking training in this task, it is highly relevant to research the behavior of these end users. In this article, we propose a new model of trust in information, in which trust judgments are dependent on three user characteristics: source experience, domain expertise, and information skills. Applying any of these three characteristics leads to different features of the information being used in trust judgments; namely source, semantic, and surface features (hence, the name 3S-model). An online experiment was performed to validate the 3S-model. In this experiment, Wikipedia articles of varying accuracy (semantic feature) were presented to Internet users. Trust judgments of domain experts on these articles were largely influenced by accuracy whereas trust judgments of novices remained mostly unchanged. Moreover, despite the influence of accuracy, the percentage of trusting participants, both experts and novices, was high in all conditions. Along with the rationales provided for such trust judgments, the outcome of the experiment largely supports the 3S-model, which can serve as a framework for future research on trust in information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chaiken, S. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.39.5.752 · Cited by 5,516
Categorization and Representation of Physics Problems by Experts and Novices*
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981) · Cognitive Science · doi:10.1207/s15516709cog0502_2 · Cited by 5,248 · cited 3×
“For example, Chi, Feltovich, and Glaser (1981) found evidence for this difference by presenting physics problems to both experts and novices.”
BackgroundConditions for intuitive expertise: A failure to disagree.
Kahneman, D., & Klein, G. (2009) · American Psychologist · doi:10.1037/a0016755 · Cited by 2,443 · cited 1×
“…a presented statement is just outside of the area of expertise, its validity might still be checked by bringing to bear the knowledge an expert possesses, which is typically a systematic process (resulting in the phenomenon of “fractionated expertise,” described by Kahneman & Klein, 2009, p. 522).”
BackgroundInternet encyclopaedias go head to head
Giles, J. (2005) · Nature · doi:10.1038/438900a · Cited by 1,978 · cited 2×
“In the case of Wikipedia, this is likely because the overall quality of Wikipedia is quite high (Giles, 2005).”
BackgroundInfluentialOn-line trust: concepts, evolving themes, a model
Corritore, C. L., Kracher, B., & Wiedenbeck, S. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00041-7 · Cited by 1,200
Metzger, M. J. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20672 · Cited by 871
Hilligoss, B., & Rieh, S. Y. (2008) · Information Processing & Management · doi:10.1016/j.ipm.2007.10.001 · Cited by 611
Prominence-interpretation theory: explaining how people assess credibility online
Fogg, B. J. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765951 · Cited by 335 · cited 11×
“Fogg and Tseng (1999) summarized this difference as credibility meaning believability and as trust meaning dependability. Credibility can be described as perceived information quality, or the assessment of information quality by a user. Credibility is mostly seen as consisting of two key elements: trustworthiness (wel…”
BackgroundMethodInfluential
Cited by
Wineburg, S., & McGrew, S. (2019) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811912101102 · Cited by 394
Lateral reading: Reading less and learning more when evaluating digital information
Wineburg, S., & McGrew, S. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3048994 · Cited by 198
Web credibility assessment: Conceptualization, operationalization, variability, and models
Choi, W., & Stvilia, B. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23543 · Cited by 168
“Lucassen and Schraagen (2011) suggested the 3S model; 3S indicates the three information characteristics: semantic, surface, and source features.”
BackgroundFlanagin, A. J., Winter, S., & Metzger, M. J. (2020) · Information, Communication & Society · doi:10.1080/1369118x.2018.1547411 · Cited by 116
“This is consistent with past research (e.g., Blikstad-Balas, 2016; Flanagin & Metzger, 2011; Kubiszewski et al., 2011; Lucassen & Schraagen, 2011), and is likely a manifestation of the authority and reputation heuristics that have been observed to a ff ect credibility evaluation in other online…”
BackgroundResultTopic familiarity and information skills in online credibility evaluation
Lucassen, T., Muilwijk, R., Noordzij, M. L., & Schraagen, J. M. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22743 · Cited by 110
Self-citation
Metadata
- Authors
- Lucassen, T., & Schraagen, J. M.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2011-04-19
- Volume
- 62
- Issue
- 7
- Pages
- 1232-1242
- ISSN
- 1532-2882 (ISSN-L)
- OpenAlex
- W2169248394
- Cited by
- 148
- References
- 8
- FWCI
- 30.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.