A note on using the F-measure for evaluating record linkage algorithms
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Misclassification costs are informed by the nature and effect of the medical intervention at hand.
“Misclassification costs are informed by the nature and effect of the medical intervention at hand (eg, the decision to perform surgery or not).”
From Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance (2025) · cites this paper as [98]
Cites
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278 · see citing works
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288 · see citing works
Fellegi, I. P., & Sunter, A. B. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501049 · Cited by 2,520 · see citing works
Advances in Record-Linkage Methodology as Applied to Matching the 1985 Census of Tampa, Florida
Jaro, M. A. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478785 · Cited by 1,401 · see citing works
Christen, P. (2012) · Springer eBooks · doi:10.1007/978-3-642-31164-2 · Cited by 1,111 · see citing works
Self-citationEfficient clustering of high-dimensional data sets with application to reference matching
McCallum, A., Nigam, K., & Ungar, L. (2000) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/347090.347123 · Cited by 1,102 · see citing works
Measuring classifier performance: a coherent alternative to the area under the ROC curve
Hand, D. J. (2009) · Machine Learning · doi:10.1007/s10994-009-5119-5 · Cited by 1,037 · see citing works
Self-citationA Survey of Indexing Techniques for Scalable Record Linkage and Deduplication
Christen, P. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.127 · Cited by 685 · see citing works
Self-citationConstruction and Assessment of Classification Rules
Wade, M. R., & Hand, D. J. (1999) · Technometrics · doi:10.2307/1270579 · Cited by 621 · see citing works
Self-citationConstruction and Assessment of Classification Rules.
Ringrose, T. J., & Hand, D. J. (1997) · Biometrics · doi:10.2307/2533581 · Cited by 490 · see citing works
Self-citationData Quality and Record Linkage Techniques
Herzog, T. N., Winkler, W. E., & Scheuren, F. J. (2007) · Springer eBooks · doi:10.1007/0-387-69505-2 · Cited by 439 · see citing works
Getoor, L., & Machanavajjhala, A. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2367502.2367564 · Cited by 353 · see citing works
A taxonomy of privacy-preserving record linkage techniques
Vatsalan, D., Christen, P., & Verykios, V. S. (2013) · Information Systems · doi:10.1016/j.is.2012.11.005 · Cited by 295 · see citing works
Self-citationAn Introduction to Duplicate Detection
Naumann, F., & Herschel, M. (2010) · Synthesis lectures on data management · doi:10.2200/s00262ed1v01y201003dtm003 · Cited by 250 · see citing works
Winkler, W. E., & Newcombe, H. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289701 · Cited by 245 · see citing works
Quality and Complexity Measures for Data Linkage and Deduplication
Christen, P., & Goiser, K. (2007) · Studies in computational intelligence · doi:10.1007/978-3-540-44918-8_6 · Cited by 213 · see citing works
Self-citationData Quality and Record Linkage Techniques
Reiter, J. P. (2008) · Journal of the American Statistical Association · doi:10.1198/jasa.2008.s229 · Cited by 180 · see citing works
Assessing the Performance of Classification Methods
Hand, D. J. (2012) · International Statistical Review · doi:10.1111/j.1751-5823.2012.00183.x · Cited by 177 · see citing works
Self-citationIterative Automated Record Linkage Using Mixture Models
Larsen, M. D., & Rubin, D. B. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332956 · Cited by 172 · see citing works
A Method for Calibrating False-Match Rates in Record Linkage
Belin, T. R., & Rubin, D. B. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476563 · Cited by 161 · see citing works
Evaluating diagnostic tests: The area under the ROC curve and the balance of errors
Hand, D. J. (2010) · Statistics in Medicine · doi:10.1002/sim.3859 · Cited by 140 · see citing works
Self-citationMethods for evaluating and creating data quality
Winkler, W. E. (2004) · Information Systems · doi:10.1016/j.is.2003.12.003 · Cited by 133 · see citing works
Record Linkage: Statistical Models for Matching Computer Records
Copas, J. B., & Hilton, F. J. (1990) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982975 · Cited by 117 · see citing works
Methodological Developments in Data Linkage
(2015) · Wiley series in probability and statistics · doi:10.1002/9781119072454 · Cited by 103 · see citing works
Sadinle, M., & Fienberg, S. E. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.757231 · Cited by 88 · see citing works
A Bayesian Procedure for File Linking to Analyze End-of-Life Medical Costs
Gutman, R., Afendulis, C. C., & Zaslavsky, A. M. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.726889 · Cited by 77 · see citing works
Disclosure risk assessment in statistical microdata protection via advanced record linkage
Domingo‐Ferrer, J., & Torra, V. (2003) · Statistics and Computing · doi:10.1023/a:1025666923033 · Cited by 72 · see citing works
Methodological Developments in Data Linkage
Harron, K. L., Goldstein, H., & Dibben, C. J. L. (2015) · CERN Document Server (European Organization for Nuclear Research) · Cited by 50 · see citing works
Detecting duplicates in a homicide registry using a Bayesian partitioning approach
Sadinle, M. (2014) · The Annals of Applied Statistics · doi:10.1214/14-aoas779 · Cited by 48 · see citing works
(1993) · Architectural Science Review · doi:10.1080/00038628.1993.9696752 · Cited by 48 · see citing works
Christen, P. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656282 · Cited by 43 · see citing works
Self-citationProbabilistic Record Linkage and Deduplication after Indexing, Blocking, and Filtering
Murray, J. S. (2015) · Journal of Privacy and Confidentiality · doi:10.29012/jpc.v7i1.643 · Cited by 41 · see citing works
Reid, A., Davies, R., & Garrett, E. (2002) · History and Computing · doi:10.3366/hac.2002.14.1-2.61 · Cited by 31 · see citing works
Efficient Entity Resolution with Adaptive and Interactive Training Data Selection
Christen, P., Vatsalan, D., & Wang, Q. (2015) · Proceedings · doi:10.1109/icdm.2015.63 · Cited by 22 · see citing works
Self-citationGutman, R., Sammartino, C. J., Green, T. C., et al. (2015) · Statistics in Medicine · doi:10.1002/sim.6586 · Cited by 18 · see citing works
Fast Record Linkage of Very Large Files in Support of Decennial and Administrative Records Projects
Winkler, W. E., Yancey, W. E., & Porter, E. (2010) · Cited by 13 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Chicco, D., & Jurman, G. (2020) · BMC Genomics · doi:10.1186/s12864-019-6413-7 · Cited by 6,143 · see citing works
“Recently, several scientists highlighted drawbacks of the F 1 measure [66, 67]: in fact, Hand and Peter [68] claim that alternative measures should be used instead, due to its major conceptual flaws.”
BackgroundA review of the F-measure: its history, properties, criticism, and alternatives
Christen, P., Hand, D. J., & Kirielle, N. (2024) · ACM Computing Surveys · doi:10.1145/3606367 · Cited by 236 · see citing works
Self-citationVan Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112 · see citing works
An Evolving TinyML Compression Algorithm for IoT Environments Based on Data Eccentricity
Signoretti, G., Silva, M., Andrade, P., Silva, I., Sisinni, E., & Ferrari, P. (2021) · Sensors · doi:10.3390/s21124153 · Cited by 73 · see citing works
Liang, J., Li, Z.-W., Yue, C.-T., Hu, Z., Cheng, H., Liu, Z.-X., & Guo, W.-F. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac254 · Cited by 23 · see citing works
- Authors
- Hand, D., & Christen, P.
- Affiliations
- Imperial College London (GB)
- Australian National University (AU)
- Corresponding author
- Christen, Peter
- Venue
- Statistics and Computing
- Published
- 2017-04-19
- Volume
- 28
- Issue
- 3
- Pages
- 539-547
- ISSN
- 0960-3174 (ISSN-L)
- 1573-1375
- OpenAlex
- W2606460416
- Cited by
- 247
- References
- 36
- Citations by year
- 2026: 12 · 2025: 19 · 2024: 32 · 2023: 32 · 2022: 30 · 2021: 62 · 2020: 31 · 2019: 17 · 2018: 11 · 2017: 1
- FWCI
- 14.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics and Computing (publishedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/K032208/1)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- data linkage, F-measure, precision and recall, evaluation metrics, class imbalance, entity resolution, record matching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review