Going deep: models for continuous-time within-play valuation of game outcomes in American football with tracking data
Open accessAbstract
Continuous-time assessments of game outcomes in sports have become increasingly common in the last decade. In American football, only discrete-time estimates of play value were possible, since the most advanced public football datasets were recorded at the play-by-play level. While measures such as expected points and win probability are useful for evaluating football plays and game situations, there has been no research into how these values change throughout the course of a play. In this work, we make two main contributions: First, we introduce a general framework for continuous-time within-play valuation in the National Football League using player-tracking data. Our modular framework incorporates several modular sub-models, to easily incorporate recent work involving player tracking data in football. Second, we use a long short-term memory recurrent neural network to construct a ball-carrier model to estimate how many yards the ball-carrier is expected to gain from their current position, conditional on the locations and trajectories of the ball-carrier, their teammates and opponents. Additionally, we demonstrate an extension with conditional density estimation so that the expectation of any measure of play value can be calculated in continuous-time, which was never before possible at such a granular level.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Yurko et al. (2020) use tracking data to model the expected yards gained for a ball-carrier during the course of a play.
“For example, Yurko et al. (2020) use tracking data provided by the 2019 NFL Big Data Bowl (see Section 7) to model the expected yards gained for a ball-carrier during the course of a play.”
From Big ideas in sports analytics and statistical tools for their investigation (2023) · cites this paper as Yurko et al. (2020)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Flagged first, then by citations
Research works printed but not linked: 20
- Burke, B. 2019. "Deepqb: Deep Learning with Player Track- ing to Quantify Quarterback Decision-Making & Perfor- mance." MIT Sloan Sports Analytics Conference. http://www. sloansportsconference.com/wp-content/uploads/2019/02/ DeepQB.pdf.
- Cervone, D., L. Bornn, and K. Goldsberry. 2016a. "Nba Court Realty." in 10th MIT Sloan Sports Analytics Conference.
- Cervone, D., A. D'Amour, L. Bornn, and K. Goldsberry. 2014. "Point- wise: Predicting Points and Valuing Decisions in Real Time with NBA Optical Tracking Data." MIT Sloan Sports Analytics Conference 28:3. http://www.sloansportsconference.com/wp- content/uploads/2018/09/cervone_ssac_2014.pdf.
- Cervone, D., A. D'Amour, L. Bornn, and K. Goldsberry. 2016b. "A Multiresolution Stochastic Process Model for Predicting Basketball Possession Outcomes." Journal of the American Statistical Association 111:585-599.
- Chen, T. and C. Guestrin. 2016. "Xgboost: A Scalable Tree Boosting System." in Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD'16, New York, NY, USA: ACM, 785-794. http://doi.acm.org/10. 1145/2939672.2939785. · DOI · Paper page
- Decroos, T., L. Bransen, J. V. Haaren, and J. Davis. 2019. "Actions Speak Louder than Goals: Valuing Player Actions in Soccer." MIT Sloan Sports Analytics Conference.
- Deshpande, S. K. and K. Evans. 2019. "Expected Hypothetical Com- pletion Probability." Journal of Quantitative Analysis in Sports, Forthcoming. https://operations.nfl.com/media/3668/big- data-bowl-deshpande_evans.pdf.
- Fernandez, J. and L. Bornn. 2018. "Wide Open Spaces: A Statisti- cal Technique for Measuring Space Creation in Professional Soccer." MIT Sloan Sports Analytics Conference.
- Fernández, J., L. Bornn, and D. Cervone. 2019. "Decomposing the Immeasurable Sport: A Deep Learning Expected Possession Value Framework for Soccer." MIT Sloan Sports Analytics Conference. http://www.sloansportsconference.com/wp- content/uploads/2019/02/Decomposing-the-Immeasurable- Sport.pdf.
- Friedman, J., T. Hastie, and R. Tibshirani. 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent." Journal of Statistical Software 33:1-22.
- Glorot, X., A. Bordes, and Y. Bengio. 2011. "Deep Sparse Recti- fier Neural Networks." Pp. 315-323 in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, edited by G. Gordon, D. Dunson, and M. Dudík, volume 15, Fort Lauderdale, FL, USA: PMLR, Proceedings of Machine Learn- ing Research, volume 15. http://proceedings.mlr.press/v15/ glorot11a.html.
- Goodfellow, I., Y. Bengio, and A. Courville. 2016. Deep Learn- ing. Cambridge, MA, USA: MIT Press. http://www. deeplearningbook.org/.
- Gudmundsson, J. and M. Horton. 2016. "Spatio-Temporal Analysis of Team Sports -A Survey." CoRR abs/1602.06994. http:// arxiv.org/abs/1602.06994. · arXiv
- Haykin, S. 1998. Neural Networks: A Comprehensive Founda- tion. 2nd ed. Upper Saddle River, NJ, USA: Prentice Hall PTR.
- Hochstedler, J. 2016. "Finding the Open Receiver: A Quantitative Geospatial Analysis of Quarterback Decision-Making." MIT Sloan Sports Analytics Conference.
- Link, D., S. Lang, and P. Seidenschwarz. 2016. "Real Time Quan- tification of Dangerousity in Football Using Spatiotemporal Tracking Data." PLoS One 11. https://doi.org/10.1371/journal. pone.0168768. · DOI
- Pospisil, T. and A. Lee. 2018. "Rfcde: Random Forests for Con- ditional Density Estimation." https://arxiv.org/abs/1804. 05753.
- Tibshirani, R. 1996. "Regression Shrinkage and Selection via the Lasso." Journal of the Royal Statistical Society. Series B (Methodological) 58:267-288.
- Voronoi, G. 1908. "Nouvelles applications des paramétres conti- nus à la théorie des formes quadratiques. premier mémoire. sur quelques propriétés des formes quadratiques positives parfaites." Journal für die reine und angewandte Mathematik 133:97-178.
- Yurko, R., S. Ventura, and M. Horowitz. 2019. "nflwar: A Reproducible Method for Offensive Player Evaluation in Football." Journal of Quantitative Analysis in Sports 15:163-183.
Cited by
Sorted by citations
Big ideas in sports analytics and statistical tools for their investigation
Baumer, B. S., Matthews, G. J., & Nguyen, Q. (2023) · WIREs Computational Statistics · doi:10.1002/wics.1612 · Cited by 44 · see citing works
- Authors
- Yurko, R., Matano, F., Richardson, L. F., Granered, N., Pospisil, T., Pelechrinis, K., & Ventura, S. L.
- Affiliations
- Carnegie Mellon University (US)
- University of Pittsburgh (US)
- Venue
- Journal of Quantitative Analysis in Sports
- Publisher
- Walter de Gruyter GmbH
- Published
- 2020-06-25
- Volume
- 16
- Issue
- 2
- Pages
- 163-182
- ISSN
- 1559-0410 (ISSN-L)
- 2194-6388
- OpenAlex
- W2948758375
- Cited by
- 6
- References
- 1
- Citations by year
- 2026: 2 · 2025: 2 · 2020: 2
- FWCI
- 0.40
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Quantitative Analysis in Sports (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Sports Analytics and Performance
- Health Sciences › Medicine › Orthopedics and Sports Medicine › Sports Performance and Training
- Health Sciences › Medicine › Orthopedics and Sports Medicine › Sports injuries and prevention
- Keywords
- American football, player tracking data, LSTM-RNN, winning probability, conditional density estimation, National Football League, match outcome prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review