Cited by 6Sports Analytics and PerformanceSports Performance and TrainingSports injuries and prevention

Going deep: models for continuous-time within-play valuation of game outcomes in American football with tracking data

Open access
Yurko, Ronald, Matano, Francesca, Richardson, Lee F., Granered, Nicholas, Pospisil, Taylor, Pelechrinis, Konstantinos, Ventura, Samuel L.·2020·Journal of Quantitative Analysis in Sports

Abstract

Continuous-time assessments of game outcomes in sports have become increasingly common in the last decade. In American football, only discrete-time estimates of play value were possible, since the most advanced public football datasets were recorded at the play-by-play level. While measures such as expected points and win probability are useful for evaluating football plays and game situations, there has been no research into how these values change throughout the course of a play. In this work, we make two main contributions: First, we introduce a general framework for continuous-time within-play valuation in the National Football League using player-tracking data. Our modular framework incorporates several modular sub-models, to easily incorporate recent work involving player tracking data in football. Second, we use a long short-term memory recurrent neural network to construct a ball-carrier model to estimate how many yards the ball-carrier is expected to gain from their current position, conditional on the locations and trajectories of the ball-carrier, their teammates and opponents. Additionally, we demonstrate an extension with conditional density estimation so that the expectation of any measure of play value can be calculated in continuous-time, which was never before possible at such a granular level.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1515/jqas-2019-0056

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Yurko et al. (2020) use tracking data to model the expected yards gained for a ball-carrier during the course of a play.

    “For example, Yurko et al. (2020) use tracking data provided by the 2019 NFL Big Data Bowl (see Section 7) to model the expected yards gained for a ball-carrier during the course of a play.”

    From Big ideas in sports analytics and statistical tools for their investigation (2023) · cites this paper as Yurko et al. (2020)

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 20

  1. Burke, B. 2019. "Deepqb: Deep Learning with Player Track- ing to Quantify Quarterback Decision-Making & Perfor- mance." MIT Sloan Sports Analytics Conference. http://www. sloansportsconference.com/wp-content/uploads/2019/02/ DeepQB.pdf.
  2. Cervone, D., L. Bornn, and K. Goldsberry. 2016a. "Nba Court Realty." in 10th MIT Sloan Sports Analytics Conference.
  3. Cervone, D., A. D'Amour, L. Bornn, and K. Goldsberry. 2014. "Point- wise: Predicting Points and Valuing Decisions in Real Time with NBA Optical Tracking Data." MIT Sloan Sports Analytics Conference 28:3. http://www.sloansportsconference.com/wp- content/uploads/2018/09/cervone_ssac_2014.pdf.
  4. Cervone, D., A. D'Amour, L. Bornn, and K. Goldsberry. 2016b. "A Multiresolution Stochastic Process Model for Predicting Basketball Possession Outcomes." Journal of the American Statistical Association 111:585-599.
  5. Chen, T. and C. Guestrin. 2016. "Xgboost: A Scalable Tree Boosting System." in Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD'16, New York, NY, USA: ACM, 785-794. http://doi.acm.org/10. 1145/2939672.2939785. · DOI · Paper page
  6. Decroos, T., L. Bransen, J. V. Haaren, and J. Davis. 2019. "Actions Speak Louder than Goals: Valuing Player Actions in Soccer." MIT Sloan Sports Analytics Conference.
  7. Deshpande, S. K. and K. Evans. 2019. "Expected Hypothetical Com- pletion Probability." Journal of Quantitative Analysis in Sports, Forthcoming. https://operations.nfl.com/media/3668/big- data-bowl-deshpande_evans.pdf.
  8. Fernandez, J. and L. Bornn. 2018. "Wide Open Spaces: A Statisti- cal Technique for Measuring Space Creation in Professional Soccer." MIT Sloan Sports Analytics Conference.
  9. Fernández, J., L. Bornn, and D. Cervone. 2019. "Decomposing the Immeasurable Sport: A Deep Learning Expected Possession Value Framework for Soccer." MIT Sloan Sports Analytics Conference. http://www.sloansportsconference.com/wp- content/uploads/2019/02/Decomposing-the-Immeasurable- Sport.pdf.
  10. Friedman, J., T. Hastie, and R. Tibshirani. 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent." Journal of Statistical Software 33:1-22.
  11. Glorot, X., A. Bordes, and Y. Bengio. 2011. "Deep Sparse Recti- fier Neural Networks." Pp. 315-323 in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, edited by G. Gordon, D. Dunson, and M. Dudík, volume 15, Fort Lauderdale, FL, USA: PMLR, Proceedings of Machine Learn- ing Research, volume 15. http://proceedings.mlr.press/v15/ glorot11a.html.
  12. Goodfellow, I., Y. Bengio, and A. Courville. 2016. Deep Learn- ing. Cambridge, MA, USA: MIT Press. http://www. deeplearningbook.org/.
  13. Gudmundsson, J. and M. Horton. 2016. "Spatio-Temporal Analysis of Team Sports -A Survey." CoRR abs/1602.06994. http:// arxiv.org/abs/1602.06994. · arXiv
  14. Haykin, S. 1998. Neural Networks: A Comprehensive Founda- tion. 2nd ed. Upper Saddle River, NJ, USA: Prentice Hall PTR.
  15. Hochstedler, J. 2016. "Finding the Open Receiver: A Quantitative Geospatial Analysis of Quarterback Decision-Making." MIT Sloan Sports Analytics Conference.
  16. Link, D., S. Lang, and P. Seidenschwarz. 2016. "Real Time Quan- tification of Dangerousity in Football Using Spatiotemporal Tracking Data." PLoS One 11. https://doi.org/10.1371/journal. pone.0168768. · DOI
  17. Pospisil, T. and A. Lee. 2018. "Rfcde: Random Forests for Con- ditional Density Estimation." https://arxiv.org/abs/1804. 05753.
  18. Tibshirani, R. 1996. "Regression Shrinkage and Selection via the Lasso." Journal of the Royal Statistical Society. Series B (Methodological) 58:267-288.
  19. Voronoi, G. 1908. "Nouvelles applications des paramétres conti- nus à la théorie des formes quadratiques. premier mémoire. sur quelques propriétés des formes quadratiques positives parfaites." Journal für die reine und angewandte Mathematik 133:97-178.
  20. Yurko, R., S. Ventura, and M. Horowitz. 2019. "nflwar: A Reproducible Method for Offensive Player Evaluation in Football." Journal of Quantitative Analysis in Sports 15:163-183.

Cited by

Sorted by citations

Authors
Yurko, R., Matano, F., Richardson, L. F., Granered, N., Pospisil, T., Pelechrinis, K., & Ventura, S. L.
Affiliations
  • Carnegie Mellon University (US)
  • University of Pittsburgh (US)
Venue
Journal of Quantitative Analysis in Sports
Published
2020-06-25
Volume
16
Issue
2
Pages
163-182
ISSN
  • 1559-0410 (ISSN-L)
  • 2194-6388
OpenAlex
W2948758375
Cited by
6
References
1
Citations by year
2026: 2 · 2025: 2 · 2020: 2
FWCI
0.40
Type
journal article
Language
en
Open access
Locations
  • Journal of Quantitative Analysis in Sports (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Sports Analytics and Performance
  • Health Sciences › Medicine › Orthopedics and Sports Medicine › Sports Performance and Training
  • Health Sciences › Medicine › Orthopedics and Sports Medicine › Sports injuries and prevention
Keywords
American football, player tracking data, LSTM-RNN, winning probability, conditional density estimation, National Football League, match outcome prediction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review