Searching for the GOAT of tennis win prediction
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Sports forecasting models – beyond their interest to bettors – are important resources for sports analysts and coaches. Like the best athletes, the best forecasting models should be rigorously tested and judged by how well their performance holds up against top competitors. Although a number of models have been proposed for predicting match outcomes in professional tennis, their comparative performance is largely unknown. The present paper tests the predictive performance of 11 published forecasting models for predicting the outcomes of 2395 singles matches during the 2014 season of the Association of Tennis Professionals Tour. The evaluated models fall into three categories: regression-based, point-based, and paired comparison models. Bookmaker predictions were used as a performance benchmark. Using only 1 year of prior performance data, regression models based on player ranking and an Elo approach developed by FiveThirtyEight were the most accurate approaches. The FiveThirtyEight model predictions had an accuracy of 75% for matches of the most highly-ranked players, which was competitive with the bookmakers. The inclusion of career-to-date improved the FiveThirtyEight model predictions for lower-ranked players (from 59% to 64%) but did not change the performance for higher-ranked players. All models were 10–20 percentage points less accurate at predicting match outcomes among lower-ranked players than matches with the top players in the sport. The gap in performance according to player ranking and the simplicity of the information used in Elo ratings highlight directions for further model development that could improve the practical utility and generalizability of forecasting in tennis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493 · cited 1×
“…paper, discrimination was measured as the mean prediction for matches higher-ranked players won minus the mean prediction for matches they lost (i.e. upsets), which is equal to the integrated discrimination improvement (IDI) measure used in diagnostic settings (Pencina, D’Agostino, and Vasan 2008).”
MethodRank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons
Bradley, R. A., & Terry, M. E. (1952) · Biometrika · doi:10.2307/2334029 · Cited by 2,412
RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434
Measuring the Incidence of Insider Trading in a Market for State-Contingent Claims
Shin, H. S. (1993) · The Economic Journal · doi:10.2307/2234240 · Cited by 197 · cited 1×
“The present paper uses the correction method proposed by Shin (1993), which has been shown to outperform basic normalization and regression-based corrections (Štrumbelj 2014).”
Method
Research works printed but not linked: 46
- 2012, “A Common-Opponent Stochastic Model for Predicting the Outcome of Professional Tennis Matches.”, Computers & Mathematics with Applications, 64, 3820, 10.1016/j.camwa.2012.03.005 · DOI
- 2008, “Testing Rosen’s Sequential Elimination Tournament Model Incentives and Player Performance in Professional Tennis.”, Journal of Sports Economics, 9, 287, 10.1177/1527002507306790 · doi:10.1177/1527002507306790
- 2002, “What is this Thing called mental toughness? An investigation of Elite Sport Performers.”, Journal of Applied Sport Psychology, 14, 205, 10.1080/10413200290103509 · DOI · Paper page
- 2012, “Predicting the Outcomes of Tennis Matches using a Low-Level Point Model.”, IMA Journal of Management Mathematics, 24, 311
- 1999, “Parameter Estimation in Large Dynamic Paired Comparison Experiments.”, Applied Statistics, 48, 377
- 2005, “Probability of Winning at Tennis I. Theory and Data.”, Studies in Applied Mathematics, 114, 241, 10.1111/j.0022-2526.2005.01547.x · doi:10.1111/j.0022-2526.2005.01547.x
- 2011, “The Methodology of Officially Recognized International Sports Rating Systems.”, Journal of Quantitative Analysis in Sports, 7, 10
- 2011, “A Bradley-Terry Type Model for Forecasting Tennis Match Results.”, International Journal of Forecasting, 27, 619, 10.1016/j.ijforecast.2010.04.004 · DOI · Paper page
- 2011, “A Bradley-Terry Type Model for Forecasting Tennis Match Results.”, International Journal of Forecasting, 27, 619, 10.1016/j.ijforecast.2010.04.004 · DOI · Paper page
- 2010, “Are Differences in Ranks Good Predictors for Grand Slam Tennis Matches?”, International Journal of Forecasting, 26, 551, 10.1016/j.ijforecast.2009.12.006 · DOI
- 2002, “What is this Thing called mental toughness? An investigation of Elite Sport Performers.”, Journal of Applied Sport Psychology, 14, 205, 10.1080/10413200290103509 · DOI · Paper page
- 2001, “On the Tactical Significance of Game Situations in Anticipating Ball Trajectories in Tennis.”, Research Quarterly for Exercise and Sport, 72, 143, 10.1080/02701367.2001.10608944 · DOI
- 2014, “Developing an Improved Tennis Ranking System.”, Journal of Quantitative Analysis in Sports, 10, 109
- 2012, “A Common-Opponent Stochastic Model for Predicting the Outcome of Professional Tennis Matches.”, Computers & Mathematics with Applications, 64, 3820, 10.1016/j.camwa.2012.03.005 · DOI
- 1999, “Parameter Estimation in Large Dynamic Paired Comparison Experiments.”, Applied Statistics, 48, 377
- 2014, “Developing an Improved Tennis Ranking System.”, Journal of Quantitative Analysis in Sports, 10, 109
- 2009, “Is Federer Stronger in a Tournament without Nadal? An Evaluation of Odds and Seedings for Wimbledon 2009.”, Research Report Series/Department of Statistics and Mathematics, 94
- 2011, “The Methodology of Officially Recognized International Sports Rating Systems.”, Journal of Quantitative Analysis in Sports, 7, 10
- 2001, “On the Tactical Significance of Game Situations in Anticipating Ball Trajectories in Tennis.”, Research Quarterly for Exercise and Sport, 72, 143, 10.1080/02701367.2001.10608944 · DOI
- 2005, “Probability of Winning at Tennis I. Theory and Data.”, Studies in Applied Mathematics, 114, 241, 10.1111/j.0022-2526.2005.01547.x · doi:10.1111/j.0022-2526.2005.01547.x
- 2012, “Bradley-Terry Models in R: The BradleyTerry2 Package.”, Journal of Statistical Software, 48, 1
- 2015, “A Mixture-of-Modelers Approach to Forecasting NCAA Tournament Outcomes.”, Journal of Quantitative Analysis in Sports, 11, 13
- 2013, “The Predictive Power of Ranking Systems in Association Football.”, International Journal of Applied Pattern Recognition, 1, 27, 10.1504/IJAPR.2013.052339 · DOI
- 2001, “Are Points in Tennis Independent and Identically Distributed? Evidence from a Dynamic Binary Panel Data Model.”, Journal of the American Statistical Association, 96, 500, 10.1198/016214501753168217 · DOI · Paper page
- 2001, “Are Points in Tennis Independent and Identically Distributed? Evidence from a Dynamic Binary Panel Data Model.”, Journal of the American Statistical Association, 96, 500, 10.1198/016214501753168217 · DOI · Paper page
- 2012, “Bradley-Terry Models in R: The BradleyTerry2 Package.”, Journal of Statistical Software, 48, 1
- 1978, The Rating of Chessplayers, Past and Present
- 2014, “On Determining Probability Forecasts from Betting Odds.”, International Journal of Forecasting, 30, 934, 10.1016/j.ijforecast.2014.02.008 · DOI
- 2009, “Is Federer Stronger in a Tournament without Nadal? An Evaluation of Odds and Seedings for Wimbledon 2009.”, Research Report Series/Department of Statistics and Mathematics, 94
- 2005, “Combining Player Statistics to Predict Outcomes of Tennis Matches.”, IMA Journal of Management Mathematics, 16, 113, 10.1093/imaman/dpi001 · doi:10.1093/imaman/dpi001
- 1993, “Measuring the Incidence of Insider Trading in a Market for State-Contingent Claims.”, The Economic Journal, 103, 1141, 10.2307/2234240 · DOI · Paper page
- 2015, “A Mixture-of-Modelers Approach to Forecasting NCAA Tournament Outcomes.”, Journal of Quantitative Analysis in Sports, 11, 13
- 1978, The Rating of Chessplayers, Past and Present
- 1999, “Are Sports Seedings Good Predictors?: An Evaluation.”, International Journal of Forecasting, 15, 83, 10.1016/S0169-2070(98)00067-3 · DOI
- 2003, “Forecasting the Winner of a Tennis Match.”, European Journal of Operational Research, 148, 257, 10.1016/S0377-2217(02)00682-3 · doi:10.1016/s0377-2217(02)00682-3
- 2014, “On Determining Probability Forecasts from Betting Odds.”, International Journal of Forecasting, 30, 934, 10.1016/j.ijforecast.2014.02.008 · DOI
- 1999, “Are Sports Seedings Good Predictors?: An Evaluation.”, International Journal of Forecasting, 15, 83, 10.1016/S0169-2070(98)00067-3 · DOI
- 2008, “Evaluating the Added Predictive Ability of a New Marker: From Area under the Roc Curve to Reclassification and Beyond.”, Statistics in Medicine, 27, 157, 10.1002/sim.2929 · DOI · Paper page
- 2008, “Testing Rosen’s Sequential Elimination Tournament Model Incentives and Player Performance in Professional Tennis.”, Journal of Sports Economics, 9, 287, 10.1177/1527002507306790 · doi:10.1177/1527002507306790
- 2013, “The Predictive Power of Ranking Systems in Association Football.”, International Journal of Applied Pattern Recognition, 1, 27, 10.1504/IJAPR.2013.052339 · DOI
- 2006, Advances in Neural Information Processing Systems, 569
- 2005, “Combining Player Statistics to Predict Outcomes of Tennis Matches.”, IMA Journal of Management Mathematics, 16, 113, 10.1093/imaman/dpi001 · doi:10.1093/imaman/dpi001
- 2012, “Predicting the Outcomes of Tennis Matches using a Low-Level Point Model.”, IMA Journal of Management Mathematics, 24, 311
- 2010, “Are Differences in Ranks Good Predictors for Grand Slam Tennis Matches?”, International Journal of Forecasting, 26, 551, 10.1016/j.ijforecast.2009.12.006 · DOI
- 2003, “Forecasting the Winner of a Tennis Match.”, European Journal of Operational Research, 148, 257, 10.1016/S0377-2217(02)00682-3 · doi:10.1016/s0377-2217(02)00682-3
- 2006, Advances in Neural Information Processing Systems, 569
Cited by
Big ideas in sports analytics and statistical tools for their investigation
Baumer, B. S., Matthews, G. J., & Nguyen, Q. (2023) · WIREs Computational Statistics · doi:10.1002/wics.1612 · Cited by 56
A study of forecasting tennis matches via the Glicko model
Yue, J. C., Chou, E. P., Hsieh, M.-H., & Hsiao, L.-C. (2022) · PLOS ONE · doi:10.1371/journal.pone.0266838 · Cited by 22
Are betting returns a useful measure of accuracy in (sports) forecasting?
Wunderlich, F., & Memmert, D. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.08.009 · Cited by 18
Metadata
- Authors
- Kovalchik, S. A.
- Venue
- Journal of Quantitative Analysis in Sports
- Publisher
- Walter de Gruyter GmbH
- Published
- 2016-01-01
- Volume
- 12
- Issue
- 3
- ISSN
- 1559-0410 (ISSN-L)
- 2194-6388
- OpenAlex
- W2336677943
- Cited by
- 96
- References
- 4
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Searching for the GOAT of tennis win prediction. https://app.cochat.ai/papers/10.1515/jqas-2015-0059
- The paper
- Kovalchik, S. A. (2016). Searching for the GOAT of tennis win prediction. Journal of Quantitative Analysis in Sports. https://doi.org/10.1515/jqas-2015-0059
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.