The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models
Abstract
This paper proposes a procedure for the estimation of discrete Markov decision models and studies its statistical and computational properties.Our Nested Pseudo-Likelihood method (NPL) is similar to Rust's Nested Fixed Point algorithm (NFXP), but the order of the two nested algorithms is swapped.First, we prove that NPL produces the Maximum Likelihood Estimator under the same conditions as NFXP.Our procedure requires fewer policy iterations at the expense of more likelihood-climbing iterations.We focus on a class of in…nite-horizon, partial likelihood problems for which NPL results in large computational gains.Second, based on this algorithm we de…ne a class of consistent and asymptotically equivalent Sequential Policy Iteration (PI) estimators, which encompasses both Hotz-Miller's CCP estimator and the partial Maximum Likekihood estimator.This presents the researcher with a "menu" of sequential estimators re ‡ecting a trade-o¤ between …nite-sample precision and computational cost.Using actual and simulated data we compare the relative performance of these estimators.In all our experiments the bene…ts in terms of precision of using a 2-stage PI estimator instead of 1-stage (i.e., Hotz-Miller) are very signi…cant.More interestingly, the bene…ts of MLE relative to 2-stage PI are small.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conditional logit analysis of qualitative choice behavior
McFadden, D. L. (1972) · eScholarship (California Digital Library) · Cited by 14,203
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316887 · Cited by 6,024
Automobile Prices in Market Equilibrium
Berry, S., Levinsohn, J., & Pakes, A. (1995) · Econometrica · doi:10.2307/2171802 · Cited by 4,883
Estimating Discrete-Choice Models of Product Differentiation
Berry, S. T. (1994) · The RAND Journal of Economics · doi:10.2307/2555829 · Cited by 2,939
Heckman, J., & Singer, B. (1984) · Econometrica · doi:10.2307/1911491 · Cited by 2,788
Numerical Methods in Economics
Judd, K. L. (1998) · MIT Press Books · Cited by 2,580
Econometric Models of Probabilistic Choice
McFadden, D. L. (1981) · Medical Entomology and Zoology · Cited by 2,036
Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher
Rust, J. (1987) · Econometrica · doi:10.2307/1911259 · Cited by 1,724
The Career Decisions of Young Men
Keane, M. P., & Wolpin, K. I. (1997) · Journal of Political Economy · doi:10.1086/262080 · Cited by 1,390
Conditional Choice Probabilities and the Estimation of Dynamic Models
Hotz, V. J., & Miller, R. A. (1993) · The Review of Economic Studies · doi:10.2307/2298122 · Cited by 1,008
How Social Security and Medicare Affect Retirement Behavior In a World of Incomplete Markets
Rust, J., & Phelan, C. (1997) · Econometrica · doi:10.2307/2171940 · Cited by 888
Patents as Options: Some Estimates of the Value of Holding European Patent Stocks
Pakes, A. (1984) · National Bureau of Economic Research · doi:10.3386/w1340 · Cited by 722
Job Matching and Occupational Choice
Miller, R. A. (1984) · Journal of Political Economy · doi:10.1086/261276 · Cited by 618
Structural estimation of markov decision processesPreprint
Rust, J. P. (1986) · RePEc: Research Papers in Economics · Cited by 501
Identifying Dynamic Discrete Decision Processes
Magnac, T., & Thesmar, D. (2002) · Econometrica · doi:10.1111/1468-0262.00306 · Cited by 496
Keane, M. P., & Wolpin, K. I. (1994) · The Review of Economics and Statistics · doi:10.2307/2109768 · Cited by 479
Using Randomization to Break the Curse of Dimensionality
Rust, J. (1997) · Econometrica · doi:10.2307/2171751 · Cited by 407
A method of moments interpretation of sequential estimators
Newey, W. K. (1984) · Economics Letters · doi:10.1016/0165-1765(84)90083-1 · Cited by 331
Job Exit Behavior of Older Men
Berkovec, J., & Stern, S. (1991) · Econometrica · doi:10.2307/2938246 · Cited by 290
A Simulation Estimator for Dynamic Models of Discrete Choice
Hotz, V. J., Miller, R. A., Sanders, S., & Smith, J. (1994) · The Review of Economic Studies · doi:10.2307/2297981 · Cited by 268
The Specification and Estimation of Dynamic Stochastic Discrete Choice Models: A Survey
Eckstein, Z., & Wolpin, K. I. (1989) · The Journal of Human Resources · doi:10.2307/145996 · Cited by 257
The Dynamics of Markups and Inventories in Retailing Firms
Aguirregabiria, V. (1999) · Review of Economic Studies · doi:10.1111/1467-937x.00088 · Cited by 244
Self-citationNumerical dynamic programming in economicsPreprint
Rust, J. P. (1996) · RePEc: Research Papers in Economics · Cited by 237
A Dynamic Stochastic Model of Medical Care Use and Work Absence
Gilleskie, D. B. (1998) · Econometrica · doi:10.2307/2998539 · Cited by 212
Markov Decision Processes: Markov Decision Processes: Discrete Stochastic Dynamic Programming
Thomas, L. C. (1995) · Journal of the Operational Research Society · doi:10.1057/jors.1995.110 · Cited by 204
Uniform Consistency of Kernel Estimators of a Regression Function under Generalized Conditions
Bierens, H. J. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10478031 · Cited by 183
Optimal Pricing with Costly Adjustment: Evidence from Retail-Grocery Prices
Slade, M. E. (1998) · The Review of Economic Studies · doi:10.1111/1467-937x.00036 · Cited by 176
The Effect of Work Experience on Female Wages and Labour Supply
Altug, S., & Miller, R. A. (1998) · Review of Economic Studies · doi:10.1111/1467-937x.00035 · Cited by 171
Dynamic choice in social settings
Manski, C. F. (1993) · Journal of Econometrics · doi:10.1016/0304-4076(93)90115-l · Cited by 150
Is There a Curse of Dimensionality for Contraction Fixed Points in the Worst Case?
Rust, J. P., Traub, J. F., & Wozniakowski, H. (2002) · Econometrica · doi:10.1111/1468-0262.00276 · Cited by 40
Measuring the Value of Children by Sex and Age Using a Dynamic Programming Model
Ahn, N. (1995) · The Review of Economic Studies · doi:10.2307/2298033 · Cited by 37
Cited by
Estimating Dynamic Models of Imperfect Competition
Bajari, P., Benkard, C. L., & Levin, J. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00796.x · Cited by 836
Sequential Estimation of Dynamic Discrete Games
Aguirregabiria, V., & Mira, P. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00731.x · Cited by 704
Self-citationIdentifying Dynamic Discrete Decision Processes
Magnac, T., & Thesmar, D. (2002) · Econometrica · doi:10.1111/1468-0262.00306 · Cited by 496
Dynamic discrete choice structural models: A survey
Aguirregabiria, V., & Mira, P. (2010) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.09.007 · Cited by 458
Self-citation(2011) · Econometrica · doi:10.3982/ecta7743 · Cited by 382
Metadata
- Authors
- Aguirregabiria, V., & Mira, P.
- Venue
- Econometrica
- Publisher
- The Econometric Society
- Published
- 2002-07
- Volume
- 70
- Issue
- 4
- Pages
- 1519-1543
- ISSN
- 0012-9682 (ISSN-L)
- 1468-0262
- OpenAlex
- W3023432200
- Cited by
- 336
- References
- 31
- FWCI
- 9.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.