How Good Is That Agreement?
Abstract
Clinical Epidemiology and Biostatistics Unit, Royal Children's Hospital, Parkville, Victoria 3052, Australia (address for correspondence)
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
According to Byrt's criteria, the agreement between reviewers was excellent.
“According to Byrt's criteria, 41 the agreement between reviewers was excellent.”
From Effectiveness of Manual Therapy and Therapeutic Exercise for Temporomandibular Disorders: Systematic Review and Meta-Analysis (2016) · cites this paper as [41]
Cited by
Sorted by citations
Armijo‐Olivo, S., Stiles, C. R., Hagen, N. A., Biondo, P. D., & Cummings, G. G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01516.x · Cited by 1,539 · see citing works
Armijo-Olivo, S., Pitance, L., Singh, V., Neto, F., Thie, N., & Michelotti, A. (2016) · Physical Therapy · doi:10.2522/ptj.20140548 · Cited by 413 · see citing works
Martins, S. S., Fenton, M. C., Keyes, K. M., Blanco, C., Zhu, H., & Storr, C. L. (2012) · Psychological Medicine · doi:10.1017/s0033291711002145 · Cited by 283 · see citing works
Baid, S. K., Sinaii, N., Wade, M., Rubino, D., & Nieman, L. K. (2007) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2006-2861 · Cited by 144 · see citing works
Armijo-Olivo, S., Ospina, M., da Costa, B. R., Egger, M., Saltaji, H., Fuentes, J., Ha, C., & Cummings, G. G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096920 · Cited by 124 · see citing works
Assessment of ACTH assay variability: a multicenter study
Pecori Giraldi, F., Saccani, A., Cavagnini, F., & _, _. (2011) · European Journal of Endocrinology · doi:10.1530/eje-10-0962 · Cited by 80 · see citing works
da Costa, B. R., Beckett, B., Diaz, A., Resta, N. M., Johnston, B. C., Egger, M., Jüni, P., & Armijo-Olivo, S. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0441-7 · Cited by 62 · see citing works
Armijo-Olivo, S., Fuentes, J., Ospina, M., Saltaji, H., & Hartling, L. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-116 · Cited by 60 · see citing works
Comparing machine and human reviewers to evaluate the risk of bias in randomized controlled trials
Armijo‐Olivo, S., Craig, R., & Campbell, S. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1398 · Cited by 31 · see citing works
Beukema, S., van Velsen, L., Jansen-Kosterink, S., & Karreman, J. (2017) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0210 · Cited by 10 · see citing works
Sundman, J., Fehrm, J., & Friberg, D. (2018) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-018-4970-z · Cited by 11 · see citing works
- Authors
- Byrt, T.
- Corresponding author
- Byrt, Ted
- Venue
- Epidemiology
- Published
- 1996-09
- Volume
- 7
- Issue
- 5
- Pages
- 561
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2419324624
- Cited by
- 390
- References
- 0
- Citations by year
- 2026: 9 · 2025: 13 · 2024: 21 · 2023: 24 · 2022: 20 · 2021: 17 · 2020: 16 · 2019: 17 · 2018: 19 · 2017: 14 · 2016: 15 · 2015: 12 · 2014: 20 · 2013: 9 · 2012: 20
- FWCI
- 0.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- agreement, interobserver agreement, measurement reliability
- MeSH terms
- Humans, Statistics as Topic, Observer Variation, Prevalence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review