The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Subjective assessment of adnexal masses with the use of ultrasonography: an analysis of interobserver variability and experience
Abstract
Objective: The aim of the study was to evaluate the subjective assessment of ultrasonographic images for discriminating between malignant and benign adnexal masses. Study design: The study was prospective. Initially, one ultrasonographer preoperatively assessed 300 consecutive patients with adnexal masses. Subsequently, the recorded transparent photographic prints were independently assessed by five investigators, with different qualifications and level of experience, who were also given a brief clinical history of the patients (i.e. the age, menstrual status, family history of ovarian cancer, previous pelvic surgery and the presenting symptoms). The diagnostic performance of the observers was compared with the histopathology classification of malignant or benign tumors. The end‐points were accuracy, interobserver agreement and the possible effect of experience. Results: The first ultrasonographer and the most experienced investigator both obtained an accuracy of 92%. There was very good agreement between these two investigators in the classification of the adnexal masses (Cohen's kappa 0.85). The less experienced observers obtained a significantly lower accuracy, which varied between 82% and 87%. Their interobserver agreement was moderate to good (Cohen's kappa 0.52 to 0.76). Conclusion: Experienced ultrasonographers using some clinical information and their subjective assessment of ultrasonographic images can differentiate malignant from benign masses in most cases. The accuracy and the level of interobserver agreement are both correlated with experience. About 10% of masses were extremely difficult to classify (only < 50% of assessors were correct). Copyright © 1999 International Society of Ultrasound in Obstetrics and Gynecology
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Practical Statistics for Medical Research.
Walter, S. D., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,668
An Introduction to Medical Statistics.
(1931) · Journal of the American Medical Association · doi:10.1001/jama.1931.02730150055037 · Cited by 2,084
Statistical methods for assessing observer variability in clinical measures.
Brennan, P., & Silman, A. (1992) · BMJ · doi:10.1136/bmj.304.6840.1491 · Cited by 985
(1992) · Journal of Diagnostic Medical Sonography · doi:10.1177/875647939200800127 · Cited by 551
Lerner, J. P., Timor-Tritsch, I. E., Federman, A., & Abramovich, G. (1994) · American Journal of Obstetrics and Gynecology · doi:10.1016/s0002-9378(13)70284-9 · Cited by 261
Valentin, L., Sladkevicius, P., & Maršál, K. (1994) · PubMed · Cited by 144
Tekay, A., & Jouppila, P. I. (1992) · Ultrasound in Obstetrics and Gynecology · doi:10.1046/j.1469-0705.1992.02050338.x · Cited by 115
Cited by
Simple ultrasound-based rules for the diagnosis of ovarian cancer
Timmerman, D., Testa, A. C., Bourne, T., Ameye, L., Jurkovic, D., Van Holsbeke, C., Paladini, D., Van Calster, B., Vergote, I., Van Huffel, S., et al. (2008) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.5365 · Cited by 613
Self-citationTimmerman, D., Testa, A. C., Bourne, T., Ferrazzi, E., Ameye, L., Konstantinovic, M. L., Van Calster, B., Collins, W. P., Vergote, I., Van Huffel, S., et al. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2005.01.7632 · Cited by 482
Self-citationDiagnosis, Treatment, and Follow-Up of Borderline Ovarian Tumors
Fischerova, D., Zikan, M., Dundr, P., & Cibula, D. (2012) · The Oncologist · doi:10.1634/theoncologist.2012-0139 · Cited by 279
Meys, E. M. J., Kaijser, J., Kruitwagen, R. F. P. M., Slangen, B. F. M., Van Calster, B., Aertgeerts, B., Verbakel, J. Y., Timmerman, D., & Van Gorp, T. (2016) · European Journal of Cancer · doi:10.1016/j.ejca.2016.01.007 · Cited by 270
Self-citationESGO/ISUOG/IOTA/ESGE Consensus Statement on preoperative diagnosis of ovarian tumors
Timmerman, D., Planchamp, F., Bourne, T., Landolfo, C., du Bois, A., Chiva, L., Cibula, D., Concin, N., Fischerova, D., Froyman, W., et al. (2021) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.23635 · Cited by 114
Self-citation
Metadata
- Authors
- Timmerman, D., Schwärzler, P., Collins, W. P., Claerhout, F., Coenen, M., Amant, F., Vergote, I., & Bourne, T. H.
- Venue
- Ultrasound in Obstetrics & Gynecology
- Publisher
- Wiley
- Published
- 1999-01
- Volume
- 13
- Issue
- 1
- Pages
- 11-16
- ISSN
- 0960-7692 (ISSN-L)
- 1469-0705
- OpenAlex
- W2006721934
- Cited by
- 300
- References
- 8
- FWCI
- 4.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Subjective assessment of adnexal masses with the use of ultrasonography: an analysis of interobserver variability and experience. https://app.cochat.ai/papers/10.1046/j.1469-0705.1999.13010011.x
- The paper
- Timmerman, D., Schwärzler, P., Collins, W. P., Claerhout, F., Coenen, M., Amant, F., Vergote, I., & Bourne, T. H. (1999). Subjective assessment of adnexal masses with the use of ultrasonography: an analysis of interobserver variability and experience. Ultrasound in Obstetrics & Gynecology. https://doi.org/10.1046/j.1469-0705.1999.13010011.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.