The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Presidential Address: The Scientific Outlook in Financial Economics
Abstract
Given the competition for top journal space, there is an incentive to produce “significant” results. With the combination of unreported tests, lack of adjustment for multiple tests, and direct and indirect p‐hacking, many of the results being published will fail to hold up in the future. In addition, there are basic issues with the interpretation of statistical significance. Increasing thresholds may be necessary, but still may not be sufficient: if the effect being studied is rare, even t > 3 will produce a large number of false positives. Here I explore the meaning and limitations of a p‐value. I offer a simple alternative (the minimum Bayes factor). I present guidelines for a robust, transparent research culture in financial economics. Finally, I offer some thoughts on the importance of risk‐taking (from the perspective of authors and editors) to advance our field. SUMMARY: Empirical research in financial economics relies too much on p‐values, which are poorly understood in the first place. Journals want to publish papers with positive results and this incentivizes researchers to engage in data mining and “p‐hacking.” The outcome will likely be an embarrassing number of false positives—effects that will not be repeated in the future. The minimum Bayes factor (which is a function of the p‐value) combined with prior odds provides a simple solution that can be reported alongside the usual p‐value. The Bayesianized p‐value answers the question: What is the probability that the null is true? The same technique can be used to answer: What threshold of t‐statistic do I need so that there is only a 5% chance that the null is true? The threshold depends on the economic plausibility of the hypothesis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK*
Sharpe, W. F. (1964) · The Journal of Finance · doi:10.1111/j.1540-6261.1964.tb02865.x · Cited by 19,441
The Cross‐Section of Expected Stock Returns
FAMA, E. F., & FRENCH, K. R. (1992) · The Journal of Finance · doi:10.1111/j.1540-6261.1992.tb04398.x · Cited by 17,261
Newey, W. K., & West, K. D. (1987) · Econometrica · doi:10.2307/1913610 · Cited by 16,936
Risk, Return, and Equilibrium: Empirical Tests
Fama, E. F., & MacBeth, J. D. (1973) · Journal of Political Economy · doi:10.1086/260061 · Cited by 14,258
A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
Newey, W., & West, K. (1986) · National Bureau of Economic Research · doi:10.3386/t0055 · Cited by 12,278
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
A five-factor asset pricing model
Fama, E. F., & French, K. R. (2015) · Journal of Financial Economics · doi:10.1016/j.jfineco.2014.10.010 · Cited by 7,852
Lintner, J. (1965) · The Review of Economics and Statistics · doi:10.2307/1924119 · Cited by 6,877
Lintner, J. (1975) · Stochastic Optimization Models in Finance · doi:10.1016/b978-0-12-780850-5.50018-6 · Cited by 6,743
Higher market valuation of companies with a small board of directors
Yermack, D. (1996) · Journal of Financial Economics · doi:10.1016/0304-405x(95)00844-5 · Cited by 6,603
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Equilibrium in a Capital Asset Market
Mossin, J. (1966) · Econometrica · doi:10.2307/1910098 · Cited by 4,910
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
A comprehensive look at the empirical performance of equity premium prediction
Welch, I., & Goyal, A. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm014 · Cited by 3,987
Sever, P. S., Dahlöf, B., Poulter, N. R., Wedel, H., Beevers, G., Caulfield, M., Collins, R., Kjeldsen, S. E., Kristinsson, A., McInnes, G. T., et al. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12948-0 · Cited by 3,782
Boards: Does one size fit all☆
COLES, J., DANIEL, N., & NAVEEN, L. (2008) · Journal of Financial Economics · doi:10.1016/j.jfineco.2006.08.008 · Cited by 3,075
IX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,341
Statistical Methods for Research Workers.
I., L., & Fisher, R. A. (1926) · Journal of the Royal Statistical Society · doi:10.2307/2341488 · Cited by 2,128
… and the Cross-Section of Expected Returns
Harvey, C. R., Liu, Y., & Zhu, H. (2016) · Review of Financial Studies · doi:10.1093/rfs/hhv059 · Cited by 2,119
Self-citationHARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
P-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant
Gelman, A., & Stern, H. (2006) · The American Statistician · doi:10.1198/000313006x152649 · Cited by 1,407 · cited 1×
“See Gelman and Stern (2006).”
The Extent and Consequences of P-Hacking in Science
Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002106 · Cited by 1,388
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,185
What are the odds? A practical guide to computing and reporting Bayes factors
Jarosz, A. F., & Wiley, J. (2014) · The Journal of Problem Solving · doi:10.7771/1932-6246.1167 · Cited by 1,101
Gauchat, G. (2012) · American Sociological Review · doi:10.1177/0003122412438225 · Cited by 1,091
The Statistical Crisis in Science
Gelman, A., & Loken, E. (2014) · American Scientist · doi:10.1511/2014.111.460 · Cited by 963
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Bem, D. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0021524 · Cited by 893
Gigerenzer, G. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.033 · Cited by 890
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478397 · Cited by 775
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Trafimow, D., & Marks, M. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1012991 · Cited by 597
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548
The effectiveness and cost-effectiveness of prophylactic removal of wisdom teeth.
Song, O'Meara, Wilson, Golder, & Kleijnen (2000) · Health Technology Assessment · doi:10.3310/hta4150 · Cited by 478
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Some Difficulties of Interpretation Encountered in the Application of the Chi-Square Test
Berkson, J. (1938) · Journal of the American Statistical Association · doi:10.1080/01621459.1938.10502329 · Cited by 411
Drinking Water Source and Chlorination Byproducts II. Risk of Colon and Rectal Cancers
Hildesheim, M. E., Cantor, K. P., Lynch, C. F., Dosemeci, M., Lubin, J., Alavanja, M., & Craun, G. (1998) · Epidemiology · doi:10.1097/00001648-199801000-00008 · Cited by 357
Predicting short-term stock fluctuations by using processing fluency
Alter, A. L., & Oppenheimer, D. M. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601071103 · Cited by 330
Goodman, S. N. (1993) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116700 · Cited by 303
Marital satisfaction and break-ups differ across on-line and off-line meeting venues
Cacioppo, J. T., Cacioppo, S., Gonzaga, G. C., Ogburn, E. L., & VanderWeele, T. J. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1222447110 · Cited by 223
Too good to be true: Publication bias in two prominent studies from experimental psychology
Francis, G. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0227-9 · Cited by 206
Ritchie, S. J., Wiseman, R., & French, C. C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033423 · Cited by 186
The Positive Philosophy of Auguste Comte
Comte, A. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511701467 · Cited by 178
Tests of Significance Considered as Evidence
Berkson, J. (1942) · Journal of the American Statistical Association · doi:10.2307/2279000 · Cited by 174
Of P-Values and Bayes: A Modest Proposal
Goodman, S. N. (2001) · Epidemiology · doi:10.1097/00001648-200105000-00006 · Cited by 164
Rejection odds and rejection ratios: A proposal for statistical practice in testing hypotheses
Bayarri, M. J., Benjamin, D. J., Berger, J. O., & Sellke, T. M. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.12.007 · Cited by 126
Positive results receive more citations, but only in some disciplines
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-012-0757-y · Cited by 71
Seeing What We Want to See: Confirmation Bias in Animal Behavior Research
Marsh, D. M., & Hanlon, T. J. (2007) · Ethology · doi:10.1111/j.1439-0310.2007.01406.x · Cited by 53
How to Write an Effective Referee Report and Improve the Scientific Review Process
Berk, J., Harvey, C. R., & Hirshleifer, D. A. (2017) · The Journal of Economic Perspectives · doi:10.1257/jep.31.1.231 · Cited by 41
Self-citationWould a stock by any other ticker smell as sweet?
Head, A., Smith, G., & Wilson, J. (2007) · The Quarterly Review of Economics and Finance · doi:10.1016/j.qref.2007.03.008 · Cited by 40
Hutton, J. L. (2010) · Pharmaceutical Medicine · doi:10.1007/bf03256810 · Cited by 19
When Are Results Too Good to Be True?
Churchill, G. A. (2014) · Genetics · doi:10.1534/genetics.114.169912 · Cited by 11
On becoming a Bayesian: Early correspondences between J. Cornfield and L. J. Savage
Greenhouse, J. B. (2012) · Statistics in Medicine · doi:10.1002/sim.5604 · Cited by 3
There’s Something in a Name: Value Relevance of Congruent Ticker Symbols
Srinivasan, R., & Umashankar, N. (2014) · Customer Needs and Solutions · doi:10.1007/s40547-014-0018-8 · Cited by 2
Cited by
Hou, K., Xue, C., & Zhang, L. (2020) · The Review of Financial Studies · doi:10.1093/rfs/hhy131 · Cited by 989
Is There a Replication Crisis in Finance?
JENSEN, T. I., KELLY, B., & PEDERSEN, L. H. (2023) · The Journal of Finance · doi:10.1111/jofi.13249 · Cited by 489
Dissecting climate risks: Are they reflected in stock prices?
Faccini, R., Matin, R., & Skiadopoulos, G. (2023) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2023.106948 · Cited by 445
Corporate culture: Evidence from the field
Graham, J. R., Grennan, J., Harvey, C. R., & Rajgopal, S. (2022) · Journal of Financial Economics · doi:10.1016/j.jfineco.2022.07.008 · Cited by 428
Self-citationCochrane, J. H. (2017) · Review of Finance · doi:10.1093/rof/rfx010 · Cited by 322
Metadata
- Authors
- HARVEY, C. R.
- Venue
- The Journal of Finance
- Publisher
- Wiley
- Published
- 2017-08
- Volume
- 72
- Issue
- 4
- Pages
- 1399-1440
- ISSN
- 0022-1082 (ISSN-L)
- 1540-6261
- OpenAlex
- W2964125295
- Cited by
- 461
- References
- 61
- FWCI
- 61.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.