On the interpretation of likelihood ratios in forensic science evidence: Presentation formats and the weak evidence effect
Open accessAbstract
Likelihood ratios are increasingly being adopted to convey expert evaluative opinions to courts. In the absence of appropriate databases, many of these likelihood ratios will include verbal rather than numerical estimates of the support offered by the analysis. However evidence suggests that verbal formulations of uncertainty are a less effective form of communication than equivalent numerical formulations. Moreover, when evidence strength is low a misinterpretation of the valence of the evidence - a "weak evidence effect" - has been found. We report the results of an experiment involving N=404 (student and online) participants who read a brief summary of a burglary trial containing expert testimony. The expert evidence was varied across conditions in terms of evidence strength (low or high) and presentation method (numerical, verbal, table or visual scale). Results suggest that of these presentation methods, numerical expressions produce belief-change and implicit likelihood ratios which were most commensurate with those intended by the expert and most resistant to the weak evidence effect. These findings raise questions about the extent to which low strength verbal evaluative opinions can be effectively communicated to decision makers at trial.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Each method of communicating uncertainty is fraught with issues based on the interpretation placed on these communications by listeners.
“What has become clear is that each method of communication is fraught with issues based on the interpretation that is placed on these communications by those that are listening to them”
From Communication, forensic science, and the law (2021) · cites this paper as Martire et al., 2014
Misinterpretation of phrases such as 'weak support' can lead to miscarriages of justice.
“since misinterpretation can lead to miscarriages of justice (Martire et al., 2014;Saks & Koehler, 2008).”
From Communication, forensic science, and the law (2021) · cites this paper as Martire et al., 2014
The numbers may be large and the statistical analysis complex, meaning that the significance can be difficult to put into context even for those that are more numerate.
“The numbers may be large and the statistical analysis complex, meaning that the significance can be difficult to put into context even for those that are more numerate (Martire et al., 2014).”
From Communication, forensic science, and the law (2021) · cites this paper as Martire et al., 2014
Cites
Strengthening Forensic Science in the United States: A Path Forward
Council, N. R. (2009) · CrimRxiv · doi:10.21428/cb6ab371.b2d683d2 · Cited by 1,461 · see citing works
Budescu, D. V., Broomell, S., & Por, H.-H. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02284.x · Cited by 402 · see citing works
Effective Communication of Uncertainty in the IPCC Reports
Budescu, D. V., Por, H.-H., & Broomell, S. B. (2012) · Climatic Change · doi:10.1007/s10584-011-0330-3 · Cited by 261 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Kliegr, T., Bahník, Š., & Fürnkranz, J. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103458 · Cited by 139 · see citing works
Curley, L. J., Munro, J., & Dror, I. E. (2022) · Medicine, Science and the Law · doi:10.1177/00258024221080655 · Cited by 80 · see citing works
Communication, forensic science, and the law
Hackman, L. (2021) · WIREs Forensic Science · doi:10.1002/wfs2.1396 · Cited by 20 · see citing works
“What has become clear is that each method of communication is fraught with issues based on the interpretation that is placed on these communications by those that are listening to them, which emphasizes the need to forensic practitioners to not use phrases such as “weak support” that have a specific meaning for them,…”
BackgroundInfluentialForensic DNA Interpretation and Human Factors: Improving the Practice Through a Systems Approach
Taylor, M. K. (2024) · doi:10.6028/nist.ir.8503 · Cited by 14 · see citing works
A transparent approach: Openness in forensic science reporting
Ballantyne, K. N., Summersby, S., Pearson, J. R., Nicol, K., Pirie, E., Quinn, C., & Kogios, R. (2024) · Forensic Science International: Synergy · doi:10.1016/j.fsisyn.2024.100474 · Cited by 13 · see citing works
- Authors
- Martire, K. A., Kemp, R. I., Sayle, M., & Newell, B. R.
- Affiliations
- UNSW Sydney (AU)
- Corresponding author
- Martire, K.A.
- Venue
- Forensic Science International
- Publisher
- Elsevier BV
- Published
- 2014-07
- Volume
- 240
- Pages
- 61-68
- ISSN
- 0379-0738 (ISSN-L)
- OpenAlex
- W2052194403
- Cited by
- 98
- References
- 3
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 11 · 2023: 8 · 2022: 13 · 2021: 9 · 2020: 14 · 2019: 12 · 2018: 6 · 2017: 7 · 2016: 5 · 2015: 2 · 2014: 2
- FWCI
- 71.88
- Type
- journal article
- Language
- en
- Open access
- green
- handle.unsw.edu.au
- Licence
- cc-by-nc-nd
- Locations
- Forensic Science International (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- Funders
- Australian Research Council
- Topics
- Social Sciences › Law › Jury Decision Making Processes
- Social Sciences › Law › Legal processes and jurisprudence
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- likelihood ratios, expert testimony, presentation format, belief revision, quality of evidence, jury decision-making
- MeSH terms
- Adolescent, Adult, Aged, Criminal Law, Female, Humans, Male, Middle Aged, Likelihood Functions, Forensic Sciences, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review