Model-free Study of Ordinary Least Squares Linear Regression
Open accessAbstract
Ordinary least squares (OLS) linear regression is one of the most basic statistical techniques for data analysis. In the main stream literature and the statistical education, the study of linear regression is typically restricted to the case where the covariates are fixed, errors are mean zero Gaussians with variance independent of the (fixed) covariates. Even though OLS has been studied under misspecification from as early as the 1960's, the implications have not yet caught up with the main stream literature and applied sciences. The present article is an attempt at a unified viewpoint that makes the various implications of misspecification stand out.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Under standard assumptions, as N approaches infinity, Var(γj)^-1/2 (γj - γj) converges in distribution to N(0,1), where Var(γj)^1/2 is a consistent estimator of the White standard error.
“Under standard assumptions [Wooldridge, 2010], as N → ∞ we have Var(γ j ) -1/2 γj -γ j d → N (0, 1), where Var(γ j ) 1/2 is a consistent estimator of the White standard error of γe [Kuchibhotla et al., 2018, Fogliato et al., 2021].”
From Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judge (2025) · cites this paper as Kuchibhotla et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity
White, H. (1980) · Econometrica · doi:10.2307/1912934 · Cited by 25,861 · see citing works
Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model
Long, J. S., & Ervin, L. H. (2000) · The American Statistician · doi:10.1080/00031305.2000.10474549 · Cited by 1,779 · see citing works
Bootstrapping Regression Models
Freedman, D. A. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345638 · Cited by 1,035 · see citing works
Anderson, T. W. (1955) · Proceedings of the American Mathematical Society · doi:10.1090/s0002-9939-1955-0069229-1 · Cited by 528 · see citing works
A Unified Theory of Estimation and Inference for Nonlinear Dynamic Models.
Davidson, J. E. H., Gallant, A. R., & White, H. (1988) · The Economic Journal · doi:10.2307/2233735 · Cited by 481 · see citing works
Shao, Q.-M. (2000) · Journal of Theoretical Probability · doi:10.1023/a:1007849609234 · Cited by 323 · see citing works
Chernozhukov, V., Chetverikov, D., & Kato, K. (2013) · doi:10.1920/wp.cem.2013.7613 · Cited by 312 · see citing works
How Close is the Sample Covariance Matrix to the Actual Covariance Matrix?
Vershynin, R. (2011) · Journal of Theoretical Probability · doi:10.1007/s10959-010-0338-z · Cited by 243 · see citing works
Dynamic Nonlinear Econometric Models
Pötscher, B. M., & Prucha, I. R. (1997) · Springer eBooks · doi:10.1007/978-3-662-03486-6 · Cited by 202 · see citing works
Asymptotics of Estimating Equations under Natural Conditions
Yuan, K., & Jennrich, R. I. (1998) · Journal of Multivariate Analysis · doi:10.1006/jmva.1997.1731 · Cited by 103 · see citing works
Bentkus, V. (2005) · Theory of Probability and Its Applications · doi:10.1137/s0040585x97981123 · Cited by 89 · see citing works
The estimating function bootstrap
Hu, F., & Kalbfleisch, J. D. (2000) · Canadian Journal of Statistics · doi:10.2307/3315958 · Cited by 88 · see citing works
Bounds for the uniform deviation of empirical measures
Devroye, L. (1982) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(82)90083-5 · Cited by 67 · see citing works
Berry-Esseen bounds for econometric time series
Hörmann, S. (2009) · Cited by 18 · see citing works
Glivenko–Cantelli theorems for classes of convex sets
Elker, J., Pollard, D., & Stute, W. (1979) · Advances in Applied Probability · doi:10.1017/s000186780003305x · Cited by 18 · see citing works
Flagged first, then by citations
Research works printed but not linked: 14
- Abadie, A., Imbens, G. W., and Zheng, F. (2014). Inference for misspecified models with fixed regressors. J. Amer. Statist. Assoc. , 109(508):1601-1614.
- Bachoc, F., Preinerstorfer, D., and Steinberger, L. (2016). Uniformly valid confidence intervals post-model-selection. ArXiv e-prints .
- Buja, A., Berk, R., Brown, L., George, E., Pitkin, E., Traskin, M., Zhan, K., and Zhao, L. (2014). Models as Approximations, Part I: A Conspiracy of Nonlinearity and Random Regressors in Linear Regression. ArXiv e-prints .
- DasGupta, A. (2008). Asymptotic theory of statistics and probability . Springer Texts in Statistics. Springer, New York.
- Durrett, R. (2010). Probability: theory and examples , volume 31 of Cambridge Series in Statistical and Probabilistic Mathematics . Cambridge University Press, Cambridge, fourth edition.
- Fahrmeir, L. (1990). Maximum likelihood estimation in misspecified generalized linear models. Statistics , 21(4):487-502.
- Kuchibhotla, A. K., Brown, L. D., Buja, A., George, E. I., and Zhao, L. (2018). A Model Free Perspective for Linear Regression: Uniform-in-model Bounds for Post Selection Inference. ArXiv e-prints .
- Levit, B. Y. (1976). On the efficiency of a class of non-parametric estimates. Theory of Probability & Its Applications , 20(4):723-740.
- Liu, R. Y. and Singh, K. (1995). Using i.i.d. bootstrap inference for general noni.i.d. models. J. Statist. Plann. Inference , 43(1-2):67-75.
- McNeney, W. B. (1998). Asymptotic efficiency in semiparametric models with non-i.i.d. data . ProQuest LLC, Ann Arbor, MI. Thesis (Ph.D.)-University of Washington.
- Newey, W. (1990). Semiparametric efficiency bounds. Journal of Applied Econometrics , 5(2):99-135.
- Pollard, D. (1984). Convergence of stochastic processes . Springer Series in Statistics. Springer-Verlag, New York.
- van der Vaart, A. W. and Wellner, J. A. (1996). Weak convergence and empirical processes . Springer Series in Statistics. Springer-Verlag, New York. With applications to statistics.
- White, H. (2001). Asymptotic Theory for Econometricians . Economic theory, econometrics, and mathematical economics. Academic Press.
Cited by
Sorted by citations
Models as Approximations II: A Model-Free Theory of Parametric Regression
Buja, A., Brown, L., Kuchibhotla, A. K., Berk, R. A., George, E. I., & Zhao, L. H. (2019) · Statistical Science · doi:10.1214/18-sts694 · Cited by 48 · see citing works
Self-citationValid post-selection inference in model-free linear regression
Kuchibhotla, A. K., Brown, L. D., Buja, A., Cai, J., George, E. I., & Zhao, L. H. (2020) · The Annals of Statistics · doi:10.1214/19-aos1917 · Cited by 30 · see citing works
Self-citationTailored inference for finite populations: conditional validity and transfer across distributions
Jin, Y., & Rothenhaüsler, D. (2023) · Biometrika · doi:10.1093/biomet/asad022 · Cited by 7 · see citing works
Hybrid confidence intervals for informative uniform asymptotic inference after model selection
McCloskey, A. (2023) · Biometrika · doi:10.1093/biomet/asad023 · Cited by 5 · see citing works
Models as Approximations—Rejoinder
Buja, A., Kuchibhotla, A. K., Berk, R. A., George, E. I., Tchetgen, E. T., & Zhao, L. H. (2019) · Statistical Science · doi:10.1214/19-sts762 · Cited by 3 · see citing works
Self-citationAnalysis of sectoral public expenditures governance and their impact on economic growth
Hamza, B. (2024) · Corporate Law & Governance Review · doi:10.22495/clgrv6i4p2 · Cited by 1 · see citing works
Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judge
Spiliopoulou, E., Fogliato, R., Burnsky, H., Soliman, T., Ma, J., Horwood, G., & Ballesteros, M. (2025) · arXiv · doi:10.48550/arxiv.2508.06709
“Under standard assumptions [Wooldridge, 2010], as N → ∞ we have (cid:100) Var(ˆ γ j ) − 1 / 2 ˆ γ j − γ j d → N (0 , 1) , where (cid:100) Var(ˆ γ j ) 1 / 2 is a consistent estimator of the White standard error of ˆ γ e [Kuchibhotla et al., 2018, Fogliato et al., 2021].”
maars: Tidy Inference under the 'Models as Approximations' Framework in R
Fogliato, R., Shrotriya, S., & Kuchibhotla, A. K. (2021) · arXiv · doi:10.48550/arxiv.2106.11188
Self-citationJin, Y., & Rothenhaüsler, D. (2021) · arXiv (Cornell University)
- Authors
- Kuchibhotla, A. K., Brown, L. D., & Buja, A.
- ORCID
- Kuchibhotla, Arun K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1809.10538
- OpenAlex
- W2893291735
- Cited by
- 8
- References
- 15
- Citations by year
- 2024: 1 · 2023: 2 · 2021: 2 · 2020: 1 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Keywords
- ordinary least squares, linear regression, model misspecification, model-independent analysis, heteroscedastic errors, non-Gaussian errors, statistical inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
