Overview of the ShARe/CLEF eHealth Evaluation Lab 2013
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521 · cited 1×
“Pooled sets for the training queries were created by merging the top 30 ranked documents returned by the two IR models (Vector Space Model [36] and BM25 [37]) and removing duplicates.”
MethodCumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841 · cited 2×
“1); NDCG@10 was computed using the original relevance assessments on a 4-point scale.”
Background2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text
Uzuner, Ö., South, B. R., Shen, S., & DuVall, S. L. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000203 · Cited by 1,252
Self-citationSavova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895 · cited 1×
“PubMed6 returns 12,860 references, including pioneering studies [9– 12] and recent reviews [13–18].”
BackgroundSelf-citationA comparison of statistical significance tests for information retrieval evaluation
Smucker, M. D., Allan, J., & Carterette, B. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321528 · Cited by 718
What can natural language processing do for clinical decision support?
Demner-Fushman, D., Chapman, W. W., & McDonald, C. J. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.08.007 · Cited by 688
Self-citationTupac, J. D. (1963) · Spartan Books · Cited by 530
eHealth Trends in Europe 2005-2007: A Population-Based Survey
Kummervold, P. E., Chronaki, C. E., Lausen, B., Prokosch, H.-U., Rasmussen, J., Santana, S., Staniszewski, A., & Wangberg, S. C. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1023 · Cited by 449
More accurate tests for the statistical significance of result differences
Yeh, A. (2000) · Proceedings of the 18th conference on Computational linguistics - · doi:10.3115/992730.992783 · Cited by 378
A shared task involving multi-label classification of clinical free text
Pestian, J. P., Brew, C., Matykiewicz, P., Hovermale, D. J., Johnson, N., Cohen, K. B., & Duch, W. (2007) · Proceedings of the Workshop on BioNLP 2007 Biological, Translational, and Clinical Language Processing - BioNLP '07 · doi:10.3115/1572392.1572411 · Cited by 359
Cited by
Peng, Y., Yan, S., & Lu, Z. (2019) · Proceedings of the 18th BioNLP Workshop and Shared Task · doi:10.18653/v1/w19-5006 · Cited by 899
Clinical text data in machine learning: systematic review
Spasic, I., & Nenadic, G. (2020) · JMIR Medical Informatics · doi:10.2196/17984 · Cited by 358
Enhancing clinical concept extraction with contextual embeddings
Si, Y., Wang, J., Xu, H., & Roberts, K. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz096 · Cited by 322
Yang, X., Bian, J., Fang, R., Bjarnadottir, R. I., Hogan, W. R., & Wu, Y. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz144 · Cited by 74
“19 While previous studies 20–23 have explored features from linguistics (eg, capitalization of letters, prefix, and suffix), disclosure (such as sections in the clinical notes), and medical knowledge (eg, semantic tags from the UMLS), they also identified a critical bottleneck caused by…”
BackgroundLevy, A., Agrawal, M., Satyanarayan, A., & Sontag, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445522 · Cited by 73
MCN: A comprehensive corpus for medical concept normalization
Luo, Y.-F., Sun, W., & Rumshisky, A. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103132 · Cited by 62
Yang, X., Zhang, H., He, X., Bian, J., & Wu, Y. (2020) · JMIR Medical Informatics · doi:10.2196/22982 · Cited by 29
Deep learning approach to detection of colonoscopic information from unstructured reports
Seong, D., Choi, Y. H., Shin, S.-Y., & Yi, B.-K. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02121-7 · Cited by 16
“The representative clinical text datasets are MIMIC-III [25] and NLP community challenges, such as n2c2 NLP Research Data Sets [26], ShARe/CLEF eHealth [27], and CEGS N-GRID [19].”
MethodFamily history information extraction via deep joint learning
Shi, X., Jiang, D., Huang, Y., Wang, X., Chen, Q., Yan, J., & Tang, B. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0995-5 · Cited by 15
Metadata
- Authors
- Suominen, H., Salanterä, S., Velupillai, S., Chapman, W. W., Savova, G., Elhadad, N., Pradhan, S., South, B. R., Mowery, D. L., Jones, G. J. F., Leveling, J., Kelly, L., Goeuriot, L., Martinez, D., & Zuccon, G.
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Berlin Heidelberg
- Published
- 2013
- Pages
- 212-231
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W2915128229
- Cited by
- 255
- References
- 32
- FWCI
- 131.28
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.