CoChat

Searching for the GOAT of tennis win prediction

Open access
Kovalchik, Stephanie Ann · 2016 · Journal of Quantitative Analysis in Sports
Cited by 96

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Sports forecasting models – beyond their interest to bettors – are important resources for sports analysts and coaches. Like the best athletes, the best forecasting models should be rigorously tested and judged by how well their performance holds up against top competitors. Although a number of models have been proposed for predicting match outcomes in professional tennis, their comparative performance is largely unknown. The present paper tests the predictive performance of 11 published forecasting models for predicting the outcomes of 2395 singles matches during the 2014 season of the Association of Tennis Professionals Tour. The evaluated models fall into three categories: regression-based, point-based, and paired comparison models. Bookmaker predictions were used as a performance benchmark. Using only 1 year of prior performance data, regression models based on player ranking and an Elo approach developed by FiveThirtyEight were the most accurate approaches. The FiveThirtyEight model predictions had an accuracy of 75% for matches of the most highly-ranked players, which was competitive with the bookmakers. The inclusion of career-to-date improved the FiveThirtyEight model predictions for lower-ranked players (from 59% to 64%) but did not change the performance for higher-ranked players. All models were 10–20 percentage points less accurate at predicting match outcomes among lower-ranked players than matches with the top players in the sport. The gap in performance according to player ranking and the simplicity of the information used in Elo ratings highlight directions for further model development that could improve the practical utility and generalizability of forecasting in tennis.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1515/jqas-2015-0059

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 46

  1. 2012, “A Common-Opponent Stochastic Model for Predicting the Outcome of Professional Tennis Matches.”, Computers & Mathematics with Applications, 64, 3820, 10.1016/j.camwa.2012.03.005 · DOI
  2. 2008, “Testing Rosen’s Sequential Elimination Tournament Model Incentives and Player Performance in Professional Tennis.”, Journal of Sports Economics, 9, 287, 10.1177/1527002507306790 · doi:10.1177/1527002507306790
  3. 2002, “What is this Thing called mental toughness? An investigation of Elite Sport Performers.”, Journal of Applied Sport Psychology, 14, 205, 10.1080/10413200290103509 · DOI · Paper page
  4. 2012, “Predicting the Outcomes of Tennis Matches using a Low-Level Point Model.”, IMA Journal of Management Mathematics, 24, 311
  5. 1999, “Parameter Estimation in Large Dynamic Paired Comparison Experiments.”, Applied Statistics, 48, 377
  6. 2005, “Probability of Winning at Tennis I. Theory and Data.”, Studies in Applied Mathematics, 114, 241, 10.1111/j.0022-2526.2005.01547.x · doi:10.1111/j.0022-2526.2005.01547.x
  7. 2011, “The Methodology of Officially Recognized International Sports Rating Systems.”, Journal of Quantitative Analysis in Sports, 7, 10
  8. 2011, “A Bradley-Terry Type Model for Forecasting Tennis Match Results.”, International Journal of Forecasting, 27, 619, 10.1016/j.ijforecast.2010.04.004 · DOI · Paper page
  9. 2011, “A Bradley-Terry Type Model for Forecasting Tennis Match Results.”, International Journal of Forecasting, 27, 619, 10.1016/j.ijforecast.2010.04.004 · DOI · Paper page
  10. 2010, “Are Differences in Ranks Good Predictors for Grand Slam Tennis Matches?”, International Journal of Forecasting, 26, 551, 10.1016/j.ijforecast.2009.12.006 · DOI
  11. 2002, “What is this Thing called mental toughness? An investigation of Elite Sport Performers.”, Journal of Applied Sport Psychology, 14, 205, 10.1080/10413200290103509 · DOI · Paper page
  12. 2001, “On the Tactical Significance of Game Situations in Anticipating Ball Trajectories in Tennis.”, Research Quarterly for Exercise and Sport, 72, 143, 10.1080/02701367.2001.10608944 · DOI
  13. 2014, “Developing an Improved Tennis Ranking System.”, Journal of Quantitative Analysis in Sports, 10, 109
  14. 2012, “A Common-Opponent Stochastic Model for Predicting the Outcome of Professional Tennis Matches.”, Computers & Mathematics with Applications, 64, 3820, 10.1016/j.camwa.2012.03.005 · DOI
  15. 1999, “Parameter Estimation in Large Dynamic Paired Comparison Experiments.”, Applied Statistics, 48, 377
  16. 2014, “Developing an Improved Tennis Ranking System.”, Journal of Quantitative Analysis in Sports, 10, 109
  17. 2009, “Is Federer Stronger in a Tournament without Nadal? An Evaluation of Odds and Seedings for Wimbledon 2009.”, Research Report Series/Department of Statistics and Mathematics, 94
  18. 2011, “The Methodology of Officially Recognized International Sports Rating Systems.”, Journal of Quantitative Analysis in Sports, 7, 10
  19. 2001, “On the Tactical Significance of Game Situations in Anticipating Ball Trajectories in Tennis.”, Research Quarterly for Exercise and Sport, 72, 143, 10.1080/02701367.2001.10608944 · DOI
  20. 2005, “Probability of Winning at Tennis I. Theory and Data.”, Studies in Applied Mathematics, 114, 241, 10.1111/j.0022-2526.2005.01547.x · doi:10.1111/j.0022-2526.2005.01547.x
  21. 2012, “Bradley-Terry Models in R: The BradleyTerry2 Package.”, Journal of Statistical Software, 48, 1
  22. 2015, “A Mixture-of-Modelers Approach to Forecasting NCAA Tournament Outcomes.”, Journal of Quantitative Analysis in Sports, 11, 13
  23. 2013, “The Predictive Power of Ranking Systems in Association Football.”, International Journal of Applied Pattern Recognition, 1, 27, 10.1504/IJAPR.2013.052339 · DOI
  24. 2001, “Are Points in Tennis Independent and Identically Distributed? Evidence from a Dynamic Binary Panel Data Model.”, Journal of the American Statistical Association, 96, 500, 10.1198/016214501753168217 · DOI · Paper page
  25. 2001, “Are Points in Tennis Independent and Identically Distributed? Evidence from a Dynamic Binary Panel Data Model.”, Journal of the American Statistical Association, 96, 500, 10.1198/016214501753168217 · DOI · Paper page
  26. 2012, “Bradley-Terry Models in R: The BradleyTerry2 Package.”, Journal of Statistical Software, 48, 1
  27. 1978, The Rating of Chessplayers, Past and Present
  28. 2014, “On Determining Probability Forecasts from Betting Odds.”, International Journal of Forecasting, 30, 934, 10.1016/j.ijforecast.2014.02.008 · DOI
  29. 2009, “Is Federer Stronger in a Tournament without Nadal? An Evaluation of Odds and Seedings for Wimbledon 2009.”, Research Report Series/Department of Statistics and Mathematics, 94
  30. 2005, “Combining Player Statistics to Predict Outcomes of Tennis Matches.”, IMA Journal of Management Mathematics, 16, 113, 10.1093/imaman/dpi001 · doi:10.1093/imaman/dpi001
  31. 1993, “Measuring the Incidence of Insider Trading in a Market for State-Contingent Claims.”, The Economic Journal, 103, 1141, 10.2307/2234240 · DOI · Paper page
  32. 2015, “A Mixture-of-Modelers Approach to Forecasting NCAA Tournament Outcomes.”, Journal of Quantitative Analysis in Sports, 11, 13
  33. 1978, The Rating of Chessplayers, Past and Present
  34. 1999, “Are Sports Seedings Good Predictors?: An Evaluation.”, International Journal of Forecasting, 15, 83, 10.1016/S0169-2070(98)00067-3 · DOI
  35. 2003, “Forecasting the Winner of a Tennis Match.”, European Journal of Operational Research, 148, 257, 10.1016/S0377-2217(02)00682-3 · doi:10.1016/s0377-2217(02)00682-3
  36. 2014, “On Determining Probability Forecasts from Betting Odds.”, International Journal of Forecasting, 30, 934, 10.1016/j.ijforecast.2014.02.008 · DOI
  37. 1999, “Are Sports Seedings Good Predictors?: An Evaluation.”, International Journal of Forecasting, 15, 83, 10.1016/S0169-2070(98)00067-3 · DOI
  38. 2008, “Evaluating the Added Predictive Ability of a New Marker: From Area under the Roc Curve to Reclassification and Beyond.”, Statistics in Medicine, 27, 157, 10.1002/sim.2929 · DOI · Paper page
  39. 2008, “Testing Rosen’s Sequential Elimination Tournament Model Incentives and Player Performance in Professional Tennis.”, Journal of Sports Economics, 9, 287, 10.1177/1527002507306790 · doi:10.1177/1527002507306790
  40. 2013, “The Predictive Power of Ranking Systems in Association Football.”, International Journal of Applied Pattern Recognition, 1, 27, 10.1504/IJAPR.2013.052339 · DOI
  41. 2006, Advances in Neural Information Processing Systems, 569
  42. 2005, “Combining Player Statistics to Predict Outcomes of Tennis Matches.”, IMA Journal of Management Mathematics, 16, 113, 10.1093/imaman/dpi001 · doi:10.1093/imaman/dpi001
  43. 2012, “Predicting the Outcomes of Tennis Matches using a Low-Level Point Model.”, IMA Journal of Management Mathematics, 24, 311
  44. 2010, “Are Differences in Ranks Good Predictors for Grand Slam Tennis Matches?”, International Journal of Forecasting, 26, 551, 10.1016/j.ijforecast.2009.12.006 · DOI
  45. 2003, “Forecasting the Winner of a Tennis Match.”, European Journal of Operational Research, 148, 257, 10.1016/S0377-2217(02)00682-3 · doi:10.1016/s0377-2217(02)00682-3
  46. 2006, Advances in Neural Information Processing Systems, 569

Cited by

See all 96

Metadata

Authors
Kovalchik, S. A.
Venue
Journal of Quantitative Analysis in Sports
Published
2016-01-01
Volume
12
Issue
3
ISSN
  • 1559-0410 (ISSN-L)
  • 2194-6388
OpenAlex
W2336677943
Cited by
96
References
4
FWCI
14.83
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Searching for the GOAT of tennis win prediction. https://app.cochat.ai/papers/10.1515/jqas-2015-0059
The paper
Kovalchik, S. A. (2016). Searching for the GOAT of tennis win prediction. Journal of Quantitative Analysis in Sports. https://doi.org/10.1515/jqas-2015-0059

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.