Cited by 44Sports Analytics and PerformanceData Analysis with RForecasting Techniques and Applications

Big ideas in sports analytics and statistical tools for their investigation

Open access
Baumer, Benjamin S., Matthews, Gregory J., Nguyen, Quang·2023·WIREs Computational Statistics

Abstract

Abstract Sports analytics—broadly defined as the pursuit of improvement in athletic performance through the analysis of data—has expanded its footprint both in the professional sports industry and in academia over the past 30 years. In this article, we connect four big ideas that are common across multiple sports: the expected value of a game state, win probability, measures of team strength, and the use of sports betting market data. For each, we explore both the shared similarities and individual idiosyncracies of analytical approaches in each sport. While our focus is on the concepts underlying each type of analysis, any implementation necessarily involves statistical methodologies, computational tools, and data sources. Where appropriate, we outline how data, models, tools, and knowledge of the sport combine to generate actionable insights. We also describe opportunities to share analytical work, but omit an in‐depth discussion of individual player evaluation as beyond our scope. This article should serve as a useful overview for anyone becoming interested in the study of sports analytics. This article is categorized under: Applications of Computational Statistics > Education in Computational Statistics

Integrity signals

Registry

Crossref · 10.1002/wics.1612

Cites

86 of 86 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

7 of 71 cited sources checked · 5 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Yam and Lopez (2019) estimate that a better 4th down strategy would be worth about 0.4 wins per season on average.

    “In addition, they estimate that a better strategy would be worth about 0.4 wins per season on average, a substantial amount comparable to the effect size reported by Pelechrinis et al. (2019) above.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Yam and Lopez (2019) source
  • Premisecitation

    Yurko et al. (2020) use tracking data to model the expected yards gained for a ball-carrier during the course of a play.

    “For example, Yurko et al. (2020) use tracking data provided by the 2019 NFL Big Data Bowl (see Section 7) to model the expected yards gained for a ball-carrier during the course of a play.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Yurko et al. (2020) source
  • Premisecitation

    The two win probability frameworks proposed by Lock and Nettleton (2014) and Yurko et al. (2019) were also implemented in Yam and Lopez (2019) with minimal modifications.

    “The two win probability frameworks proposed by Lock and Nettleton (2014) and Yurko et al. (2019) were also implemented in Yam and Lopez (2019) with minimal modifications.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Yam and Lopez (2019) source

      Section 3.4 (Outcome) says Yam and Lopez replicated Lock and Nettleton’s random-forest model, and Appendix A.1 says their only deviation was how they trained it. But section 3.4 identifies the second model as a generalized additive model adapted from Horowitz (2016), not Yurko et al. (2019). (LLM, conf=0.92)

      Experimental — accuracy not yet measured
  • Premisecitation

    Yurko et al. (2019) estimate win probability in the NFL using a generalized additive model (GAM), as part of the nflscrapR package and nflWAR framework.

    “In addition, Yurko et al. (2019) estimate win probability in the NFL using a generalized additive model (GAM), as part of the nflscrapR package (Horowitz et al., 2020) and nflWAR framework.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Yurko et al. (2019) source
    • cites Horowitz et al., 2020

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisecitation

    The winning entry in the 2014 Kaggle March Machine Learning Mania competition was based on a fairly simple logistic regression model trained on betting market data.

    “Among the published papers, we learned that the winning entry was based on a fairly simple logistic regression model trained on betting market data (Lopez & Matthews, 2015).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Lopez & Matthews, 2015 source

      Section 3 (Model selection) says the winning submission used a logistic regression model whose only covariate was the betting point spread. But it also says the submission combined that model with a separate efficiency-based model; the top submission, S2, weighted the efficiency model more heavily. Describing the winning entry as a single model trained on betting market data omits that substantial component. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim. 50
  • May combine two claims. 26
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Fernandez et al. (2021) implement deep learning methods to examine the instantaneous expected value of soccer possessions.

    “Fernandez et al. (2021) implement deep learning methods to examine the instantaneous expected value of soccer possessions.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Fernandez et al. (2021) source
  • May combine two claims.

    Premisenone given

    Yurko et al. (2019)'s win probability model is fully reproducible and uses publicly available data.

    “A vital highlight of Yurko et al. (2019)'s win probability model is that it is fully reproducible and uses publicly available data.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Yurko et al. (2019) source
  • May combine two claims.

    Findingown data

    In the example with runners on first and third, tied bottom ninth, no one out, the expected number of runs scored in the remainder of the inning is 1.94 and the probability of scoring zero runs is 0.13.

    “Information derived from Table 1 reveals that the expected number of runs scored in the remainder of the inning is 1.94 runs, while the probability of scoring zero runs is 0.13.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: For a state with runners on first and third and no outs in a tied bottom ninth, the probability of scoring zero runs is 0.13.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    The EPV model estimate of the probability of Chalmers making the three-point shot in the example is 42.5%.

    “Chalmers' shot is worth 3 points, so the EPV of 1.276 points implies that the model estimate of the probability of Chalmers making this shot is 42.5%.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    In that example, by walking the hitter to load the bases, the defense reduces the chances of scoring to 82%, even though they raise the expected number of runs scored to 2.22.

    “However, by walking the hitter to load the bases, they create the opportunity to force the lead runner at home and thus reduce the chances of scoring to 82%, even though they raise the expected number of runs scored to 2.22.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: For a state with bases loaded and no outs in a tied bottom ninth, the probability of scoring at least one run is 82%.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In the illustrative chess game, the author was rated 1732 and his opponent was rated 1683 prior to the game.

    “Prior to the game, the author was rated 1732, whereas his opponent was rated 1683.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    The post-game Elo rating for the author in the illustrative chess game is 1740.

    “The post-game Elo rating for the author is thus R Ã a ¼ 1732 þ 20 1 À 0:591 ð Þ¼1740:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    The probability of the author defeating their opponent in the illustrative chess game was 0.591.

    “The probability of the author (a) defeating their opponent (b) was Π ab ¼ 1 1 þ 20 1683À1732 ð Þ =400 ¼ 0:591:”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    The sum of implied probabilities from moneylines is greater than one, which is why the sportsbook makes money regardless of who wins the championship.

    “The sum of those probabilities is greater than one-this is why the sportsbook makes money regardless of who wins the championship.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

    Findingnone given

    In the FanDuel futures market on January 9, 2023, the Boston Celtics have a 16.3% chance of winning the 2023 NBA championship, and the Milwaukee Bucks have a 13.3% chance.

    “In this case, the FanDuel futures market suggests that the Celtics have a 16.3% chance of winning the championship, while the Milwaukee Bucks have the second best chance, at 13.3%.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In American football, teams are going for it on fourth down far more often than in the past, a direct result of statistical analysis showing that most teams were previously overly conservative.

    “In American football, teams are going for it on fourth down far more often than in the past, a direct result of statistical analysis showing that most teams were previously overly conservative (Lopez, 2020).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lopez, 2020

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Four big ideas are common across multiple sports: the expected value of a game state, win probability, measures of team strength, and the use of sports betting market data.

    “In this article, we connect four big ideas that are common across multiple sports: the expected value of a game state, win probability, measures of team strength, and the use of sports betting market data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Similar insights are now being made in less obvious settings, including esports.

    “Similar insights are now being made in less obvious settings, including esports (Clark et al., 2020;Maymin, 2021).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Clark et al., 2020

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Maymin, 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Sports analytics has expanded its footprint both in the professional sports industry and in academia over the past 30 years.

    “Sports analytics-broadly defined as the pursuit of improvement in athletic performance through the analysis of data-has expanded its footprint both in the professional sports industry and in academia over the past 30 years.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In baseball, teams are using defensive shifts to maximize the probability of recording an out, encouraging hitters to improve their launch angles, and optimizing pitcher repertoires to minimize contact.

    “And, of course, in baseball, teams are using defensive shifts to maximize the probability of recording an out, encouraging hitters to improve their launch angles, and optimizing pitcher repertoires to minimize contact (Healey, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Healey, 2017

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    In basketball, analytics has driven a shift in conventional wisdom about shot selection, with most teams shooting more three-pointers, settling for fewer long two-point shots, deploying more versatile defenders, and relying less on pounding the ball into the paint.

    “In basketball, analytics has driven a shift in the conventional wisdom about shot selection.Most teams are shooting more three-pointers, settling for fewer long two-point shots, deploying more versatile defenders, and relying less on the strategy of pounding the ball into the paint in an attempt to get a highpercentage shot (Schuhmann, 2021).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schuhmann, 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    High-resolution tracking data allows researchers to produce advanced analyses of captured spatiotemporal information and better understand the game.

    “This high-resolution data allows researchers to produce advanced analyses of the captured spatiotemporal information and better understand the game.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The strategy of maximizing expected points in basketball has led directly to the proliferation of three-point shooting in the NBA.

    “The strategy of maximizing expected points in basketball has led directly to the proliferation of three-point shooting in the NBA.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Generally, the goal of any sport is to score more points than the other team, which most often means trying to score as many points as possible, leading to a general strategy of maximizing expected points.

    “Generally, the goal of any sport is to score more points than the other team, which most often means trying to score as many points as possible, leading to a general strategy of maximizing expected points.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Maximizing the probability of scoring is optimal in any sudden-death situation, which has (but currently does not) included overtime in American football.

    “Maximizing the probability of scoring is optimal in any sudden-death situation, which has (but currently does not) included overtime in American football (Martin et al., 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Martin et al., 2018

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Carroll et al. (1988) determine that every extra 25 yards is associated with 2 more points scored on average for a football team.

    “They determine that every extra 25 yards is associated with 2 more points scored on average for a football team.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Carroll et al. (1988)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Baseball and cricket differ in strategies such as batting order or sacrifice plays.

    “For example, despite belonging to the same bat-and-ball family, baseball and cricket differ in strategies such as batting order or sacrifice plays.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Tango et al. (2007) conclude that the sacrifice bunt is rarely worth it, because most teams would be expected to score more runs with a runner on first and no outs than they would with a runner on second and one out.

    “Tango et al. (2007) (and many subsequent analyses) conclude that the sacrifice bunt is rarely worth it, because most teams would be expected to score more runs with a runner on first and no outs than they would with a runner on second and one out.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Tango et al. (2007)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    In the bottom of the ninth inning of a tied baseball game, the optimal strategy for winning the game is maximizing the probability of scoring at least one run, which may differ from the strategy of maximizing expected runs.

    “For example, in the bottom of the ninth inning of a tied baseball game, the optimal strategy for winning the game is maximizing the probability of scoring at least one run, which may differ from the strategy of maximizing expected runs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Cervone et al. (2014, 2016) introduce expected possession value (EPV) as a continuous-time estimate of the expected number of points for the offensive team on a given possession using player and ball locations.

    “In basketball, Cervone et al. (2014) and Cervone et al. (2016) introduce expected possession value (EPV) as a means toward an assessment of a player's on-court performance.This metric is a continuous-time estimate of the expected number of points for the offensive team on a given possession using player and ball locations.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Cervone et al. (2014)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Cervone et al. (2016) source

      Checked before — its earlier verdict is held back until a new check runs.

  • May combine two claims.

    Premisecitation

    Beaudoin and Swartz (2010) show that NHL coaches do not always employ the optimal strategies, usually by waiting too long to pull their goalies.

    “Beaudoin and Swartz (2010) show that NHL coaches do not always employ the optimal strategies, usually by waiting too long to pull their goalies.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Beaudoin and Swartz (2010)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Premisecitation

    Romer (2006) concluded that teams do not go for it enough if teams are trying to maximize their probability of winning the game.

    “They concluded that teams do not go for it enough if teams are trying to maximize their probability of winning the game.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Romer (2006) source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    The expected run matrix is foundational in baseball analytics.

    “The collection of estimates  Xjs ½ for all 24 states is called the expected run matrix, 2 and it is foundational in baseball analytics.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Over the past decade or so, professional sports leagues have collected tracking data which record the locations of all players and the ball (or puck) throughout a game.

    “Over the past decade or so, professional sports leagues have collected tracking data which record the locations of all players and the ball (or puck) throughout a game.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Lopez (2020) concludes that coaches are too conservative on 4th down decision making, but notes further that past estimates of the magnitude of how conservative coaches are on 4th down may be overstated due to the way in which to go yardage was recorded only approximately in the past.

    “Lopez (2020) also concludes that coaches are too conservative on 4th down decision making, but notes further that past estimates of the magnitude of how conservative coaches are on 4th down may be overstated due to the way in which to go yardage was recorded only approximately in the past.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Lopez (2020)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Alamar (2010) determines that teams are under-utilizing passing plays in some situations.

    “Based on play-by-play data from 2005 through 2008, they determine that teams are under-utilizing passing plays in some situations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alamar (2010)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Urschel and Zhuang (2011) conclude that coaches in the NFL tend to make conservative decisions.

    “Using data from the 2009 NFL season, they conclude, as many have, that coaches in the NFL tend to make conservative decisions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Urschel and Zhuang (2011) source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    In a low run-scoring environment where hits are hard to come by, stolen bases and sacrifice bunts may be comparatively more valuable.

    “Conversely, in a low run-scoring environment where hits are hard to come by, stolen bases and sacrifice bunts may be comparatively more valuable.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Macdonald (2012) uses expected goals to evaluate ice hockey players, but does not have access to player tracking data necessary to evaluate possessions.

    “Macdonald (2012) uses expected goals to evaluate ice hockey players, but does not have access to player tracking data necessary to evaluate possessions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Macdonald (2012)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Deshpande and Jensen (2016) extend Stern (1994)'s framework by applying it in a Bayesian setting.

    “On a related note, Deshpande and Jensen (2016) extend Stern (1994)'s framework by applying it in a Bayesian setting.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Deshpande and Jensen (2016)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Yurko et al. (2019)'s work inspired nflfastR (Carl & Baldwin, 2022), now considered the successor to nflscrapR.

    “One of Yurko et al. (2019)'s goals was also to encourage researchers to “use, explore, and improve upon our work,” which ultimately inspired nflfastR (Carl & Baldwin, 2022), now considered the successor to nflscrapR.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Carl & Baldwin, 2022

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Brenzel et al. (2019) use three-dimensional Markov models to estimate win probability throughout a curling match.

    “Brenzel et al. (2019) use three-dimensional Markov models to estimate win probability throughout a curling match.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brenzel et al. (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The Bradley-Terry model is perhaps the most widely-used probability model for predicting the outcome of a paired comparison.

    “Perhaps the most widely-used probability model for predicting the outcome of a paired comparison is the Bradley-Terry model (BTM) (Bradley & Terry, 1952).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bradley & Terry, 1952 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The Elo rating system was originally developed for chess (Elo, 1978).

    “Another widely known tool for measuring team strength is the Elo rating system (Elo, 1978), which was originally developed for chess.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Elo, 1978

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Expected winning percentage (Pythagorean expectation) was developed by James (2003).

    “A simple method for estimating team strength that has become popular in sports analytics is expected winning percentage-often called Pythagorean expectation-developed by James (2003).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites James (2003)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    Wins and losses carry some signal of team strength, but we can do better than win-loss records.

    “As binary outcomes, and with all sports (except perhaps chess) involving some element of chance, wins and losses carry some signal of team strength, but we can do better.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The International Chess Federation (FIDE) uses K = 10 for players with any previously achieved rating of at least 2400.

    “The International Chess Federation (FIDE) uses K ¼ 10 for players with any previously achieved rating of at least 2400.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites FIDE, 2022

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    FIDE gives K = 40 to new players with under 30 games played, and players under the age of 18 with rating less than 2300.

    “Finally, K ¼ 40 is given to new players with under 30 games played, and players under the age of 18 with rating less than 2300 (FIDE, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites FIDE, 2022

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Some researchers have tried to demonstrate a positive return on betting strategies, with very limited success.

    “Some researchers have then tried to demonstrate a positive return on some of these betting strategies, with very limited success.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Gandar et al. (1988) concludes that statistical tests fail to reject the hypothesis of rationality of NFL betting markets.

    “Early work by Gandar et al. (1988) examines the rationality of NFL betting markets and concludes that statistical tests fail to reject the hypothesis of rationality.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gandar et al. (1988) source
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    The efficiency of betting market data in estimating true probabilities has been demonstrated time and time again.

    “The efficiency of betting market data in this respect has been demonstrated time and time again.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The teamcolors R package provides color palettes and logos for men's and women's professional and collegiate sports teams, as well as color and fill scale functions compatible with ggplot2.

    “The teamcolors R package (Baumer & Matthews, 2020) provides color palettes and logos for men's and women's professional and collegiate sports teams, as well as color and fill scale functions compatible with ggplot2 (Wickham et al., 2022).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Baumer & Matthews, 2020

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Wickham et al., 2022

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Normalized implied probabilities are accurate, unbiased, and efficient estimates of the true unknowable probabilities.

    “Many different researchers have shown that these normalized implied probabilities are accurate, unbiased, and efficient estimates of the true unknowable probabilities (see Lopez et al., 2018 for discussion and an extensive list of references).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lopez et al., 2018 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Metrick (1996) finds that bettors overback the heaviest favorites.

    “Metrick (1996) finds that bettors overback the heaviest favorites.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Metrick (1996)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The use of team colors to identify lines makes it possible to follow the trajectory of most teams over the course of the season in Figure 5.

    “However, the use of team colors to identify the lines makes it possible to follow the trajectory of most teams over the course of the season.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Soebbing and Humphreys (2013) find evidence that sports bettors think tanking in the NBA is occurring, although the evidence for whether it actually is remains mixed.

    “Soebbing and Humphreys (2013) find evidence that sports bettors think tanking in the NBA is occurring, although the evidence for whether it actually is remains mixed.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Soebbing and Humphreys (2013)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The sportyR package contains generic playing surfaces for baseball, basketball, curling, American football, ice hockey, soccer, and tennis that can be added to ggplot graphics with a single function call.

    “Thankfully, the sportyR package (Drucker, 2022) contains generic playing surfaces for baseball, basketball, curling, American football, ice hockey, soccer, and tennis that can be added to ggplot graphics with a single function call.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Drucker, 2022

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Catcher framing is a concept that scouts talked about for decades, but that could not be quantified by analysts until data of the appropriate resolution became available.

    “Catcher framing is a notable example of a concept that scouts talked about for decades, but that could not be quantified by analysts until data of the appropriate resolution became available.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Deshpande & Wyner, 2017

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    As a maturing discipline, sports analytics has been able to address fundamental questions common to many sports.

    “However, as a maturing discipline, sports analytics has been able to address fundamental questions common to many sports.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Play-by-play data allows us to make valuations between plays, while player tracking data allows us to make valuations within plays.

    “While play-by-play data allows us to make valuations between plays, player tracking data allows us to make valuations within plays.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Over time, the resolution of baseball data has improved to include play-by-play data, pitch-by-pitch data, and now player tracking data.

    “Over time, the resolution of baseball data has improved to include play-by-play data, pitch-by-pitch data, and now player tracking data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    These R packages enable research by making data more easily available.

    “Thus, these R packages enable research by making data more easily available.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    As the granularity of baseball data has evolved over time, so too have the statistical methodologies for modeling that data, and the tools for working with it.

    “As the granularity of baseball data has evolved over time, so too have the statistical methodologies for modeling that data, and the tools for working with it.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    These venues have been an important source of new ideas and have contributed to the diversification of the field by breaking down barriers to entry.

    “These venues have been an important source of new ideas and have contributed to the diversification of the field by breaking down barriers to entry.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The dynamic of increased data resolution catalyzing new research directions is playing out in all sports.

    “this same dynamic is playing out in all sports”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Increased resolution of available data has catalyzed new research directions in baseball.

    “the increased resolution of available data has catalyzed new research directions in baseball”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Because R is scriptable, these packages make it easier to share research that is reproducible.

    “Moreover, because R is scriptable, they make it easier to share research that is reproducible.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    As an applied science, sports analytics may lack a grand unified theory that succinctly characterizes game play across all sports.

    “As an applied science, sports analytics may lack a grand unified theory that succinctly characterizes game play across all sports.”
    Quote in the paperNot a substantial claim
63 of 63
  • The paper relies on this without support.

    For a state with runners on first and third and no outs in a tied bottom ninth, the probability of scoring zero runs is 0.13.

    “Information derived from Table 1 reveals that the expected number of runs scored in the remainder of the inning is 1.94 runs, while the probability of scoring zero runs is 0.13.”
  • The paper relies on this without support.

    For a state with bases loaded and no outs in a tied bottom ninth, the probability of scoring at least one run is 82%.

    “However, by walking the hitter to load the bases, they create the opportunity to force the lead runner at home and thus reduce the chances of scoring to 82%, even though they raise the expected number of runs scored to 2.22.”
2 of 2

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Effects described as comparable differ nearly tenfold

    Minor

    The cited estimates are 0.4 and 3.8 wins per season. Calling their effect sizes comparable conflicts with the paper's own figures.

  • Celtics' fractional odds include the returned stake

    Minor

    A +390 moneyline pays $390 in winnings on a $100 stake, so the fractional odds are 3.9:1. The stated 4.9:1 is the total return relative to the stake, not the fractional odds.

    Reported 4.9 · recomputed 3.9

2 of 2

Cites

Flagged first, then by citations

2 of the 88 references couldn’t be matched to a known paper.

Research works printed but not linked: 12

  1. Albert J., 2016, Handbook of statistical methods and analyses in sports, 520
  2. Baumer B., 2014, The sabermetric revolution: Assessing the growth of analytics in baseball, 187, 10.9783/9780812209129 · DOI
  3. Carroll B. N., 1988, The hidden game of football, 415
  4. Cochran J., 2017, The Oxford anthology of statistics in sports, volume 1: 2000–2004, 544
  5. Dewan J., 1993, STATS basketball scoreboard 1993–1994, 288
  6. Funt D.(2022).At Sloan sports conference criticism mounts over diversity access.The Washington Post.https://www.washingtonpost.com/sports/2022/06/13/sloan-sports-conference-diversity/
  7. Glickman M. E., 2017, Handbook of statistical methods and analyses in sports, 113
  8. Goldner K., 2017, Handbook of statistical methods and analyses in sports, 199
  9. Horowitz M., 2020, NflscrapR: Compiling the NFL play‐by‐play API for easy use in r
  10. James B., 2003, The new Bill James historical baseball abstract
  11. Koning R. H., 2017, Handbook of statistical methods and analyses in sports, 371
  12. Macdonald B. (2012). An expected goals model for evaluating NHL teams and players.Proceedings of the 2012 MIT Sloan Sports Analytics Conference.https://assets.pubpub.org/mku181yp/ee0d61ed-af35-4b1f-ba86-71c216935690.pdf

Cited by

Sorted by citations

Authors
Baumer, B. S., Matthews, G. J., & Nguyen, Q.
Affiliations
  • Smith College (US)
  • Loyola University Chicago (US)
  • Carnegie Mellon University (US)
Corresponding author
Baumer, Benjamin S.
Venue
WIREs Computational Statistics
Publisher
Wiley
Published
2023-05-10
Volume
15
Issue
6
ISSN
  • 1939-0068 (ISSN-L)
  • 1939-5108
OpenAlex
W4376141713
Cited by
44
References
88
Citations by year
2026: 16 · 2025: 12 · 2024: 12 · 2023: 4
FWCI
13.37
Type
journal article
Language
en
Open access
Locations
  • Wiley Interdisciplinary Reviews Computational Statistics (publishedVersion)
  • Loyola eCommons (Loyola University of Chicago) (submittedVersion, cc-by-nc-nd)
  • Smith ScholarWorks (Smith College) (submittedVersion, cc-by)
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Sports Analytics and Performance
  • Physical Sciences › Computer Science › Artificial Intelligence › Data Analysis with R
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
Keywords
sports analytics, winning probability, athletic performance improvement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review