CoChat

Replicating Empirical Research In Behavioral Ecology: How And Why It Should Be Done But Rarely Ever Is

Kelly, Clint D · 2006 · The Quarterly Review of Biology
Cited by 154

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

That empirical evidence is replicable is the foundation of science. Ronald Fisher a founding father of biostatistics, recommended that a null hypothesis be rejected more than once because "no isolated experiment, however significant in itself can suffice for the experimental demonstration of any natural phenomenon" (Fisher 1974:14). Despite this demand, animal behaviorists and behavioral ecologists seldom replicate studies. This practice is not part of our scientific culture, as it is in chemistry or physics, due to a number of factors, including a general disdain by journal editors and thesis committees for unoriginal work. I outline why and how we should replicate empirical studies, which studies should be given priority, and then elaborate on why we do not engage in this necessary endeavor. I also explain how to employ various statistics to test the replicability of a series of studies and illustrate these using published studies from the literature.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1086/506236

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 78

  1. 10.1038/ncb0206-101 · DOI
  2. 10.1086/285606 · DOI · Paper page
  3. Bacon W A, The Advancement of Learning
  4. 10.1007/BF00300576 · DOI
  5. Birkhead T R, 2000, Promiscuity: An Evolutionary History of Sperm Competition
  6. Birkhead T R, 2002, International Society for Behavioral Ecology Newsletter, 14, 15
  7. Branscomb L M, 1985, American Scientist, 73, 421
  8. 10.1016/S0169-5347(97)01253-6 · DOI
  9. 10.1038/369528a0 · doi:10.1038/369528a0
  10. 10.1038/308358a0 · DOI · Paper page
  11. 10.1016/S0003-3472(86)80115-4 · DOI · Paper page
  12. 10.1086/415033 · DOI · Paper page
  13. 10.1038/20794 · doi:10.1038/20794
  14. 10.1093/beheco/14.3.446 · DOI · Paper page
  15. 10.1038/23856 · DOI
  16. Daniel L G, 1998, Research in the Schools, 5, 23
  17. 10.1038/439784b · DOI
  18. 10.1073/pnas.93.21.11723 · DOI · Paper page
  19. 10.1038/427393a · doi:10.1038/427393a
  20. Fisher R A, The Design of Experiments. Ninth Edition
  21. Foster S A, Geographic Variation in Behavior: Perspectives on Evolutionary Mechanisms. Oxford and
  22. 10.1093/beheco/10.5.476 · DOI · Paper page
  23. Gotelli N J, A Primer of Ecology
  24. 10.1111/j.1469-8986.1996.tb02121.x · DOI · Paper page
  25. Hooper J., Of Moths and Men: An Evolutionary Tale: Intrigue, Tragedy and the Peppered Moth
  26. 10.1006/anbe.1997.0579 · DOI
  27. 10.1017/S1464793101005875 · DOI · Paper page
  28. 10.2307/3802789 · DOI · Paper page
  29. 10.1111/j.0956-7976.2005.01538.x · DOI · Paper page
  30. 10.1037/0003-066X.56.1.16 · doi:10.1037/0003-066x.56.1.16 · Paper page
  31. 10.1038/20917 · DOI · Paper page
  32. 10.1037/0003-066X.43.8.635 · DOI
  33. Levin J R, 1998, Research in the Schools, 5, 43
  34. 10.1037/h0026141 · DOI · Paper page
  35. 10.1038/334287a0 · DOI · Paper page
  36. 10.1038/355440a0 · DOI
  37. 10.1016/j.anbehav.2004.02.017 · DOI
  38. 10.1037/h0045549 · DOI
  39. Mogie M., 2004, Proceedings of the Royal Society of London B, 271, S82, 10.1098/rsbl.2003.0105 · DOI
  40. Montgomerie R M, 2005, International Society for Behavioral Ecology Newsletter, 17, 16
  41. 10.1038/357238a0 · DOI · Paper page
  42. 10.1016/S0169-5347(01)02235-2 · DOI · Paper page
  43. 10.1086/286110 · DOI · Paper page
  44. 10.1016/j.anbehav.2004.11.017 · DOI
  45. 10.1093/beheco/arh107 · DOI · Paper page
  46. 10.1126/science.216.4547.753 · DOI
  47. Neuliep J W, Editor
  48. Nix T W, 1998, Research in the Schools, 5, 3
  49. Oakes M W, 1986, Statistical Inference: A Commentary for the Social and Behavioural Sciences.
  50. 10.1098/rspb.1997.0065 · DOI · Paper page
  51. 10.1086/303223 · DOI · Paper page
  52. 10.1146/annurev.ecolsys.31.1.441 · DOI · Paper page
  53. 10.1098/rspb.2000.1072 · DOI · Paper page
  54. 10.1038/35055617 · DOI · Paper page
  55. 10.1007/s00265-004-0796-3 · doi:10.1007/s00265-004-0796-3
  56. 10.1037/0003-066X.44.10.1276 · DOI · Paper page
  57. 10.1080/00220973.1993.10806592 · DOI · Paper page
  58. 10.1146/annurev.ecolsys.36.102403.112501 · DOI · Paper page
  59. 10.1098/rspb.1999.0677 · DOI · Paper page
  60. 10.1016/j.anbehav.2003.10.012 · doi:10.1016/j.anbehav.2003.10.012
  61. 10.1111/j.1467-9450.2005.00436.x · DOI
  62. 10.1111/j.1095-8649.2002.tb01702.x · DOI
  63. Stoehr A M, 1999, Animal Behaviour, 57, F22, 10.1006/anbe.1998.1016 · DOI
  64. 10.1016/S0003-3472(85)80197-4 · DOI · Paper page
  65. 10.1016/S0065-3454(03)01004-0 · DOI
  66. 10.1038/367165a0 · doi:10.1038/367165a0
  67. 10.1093/icb/45.5.821 · DOI · Paper page
  68. 10.1080/00220973.1993.10806596 · DOI · Paper page
  69. Thompson B., 1996, Educational Research, 25, 26
  70. 10.1093/beheco/9.6.546 · DOI · Paper page
  71. 10.1086/303233 · DOI
  72. Tomkins J L, 2003, Developmental Instability: Causes and Consequences, edited by M Polak.
  73. Trivers R L, 1871, Parental investment and sexual selection. Pages 136‐179 in Sexual Selection and the Descent of Man
  74. 10.1126/science.179.4068.90 · DOI · Paper page
  75. 10.1006/anbe.1998.1055 · DOI
  76. 10.1016/S0169-5347(02)02533-8 · DOI · Paper page
  77. 10.1016/j.anbehav.2003.06.003 · DOI
  78. Zar J H, Biostatistical Analysis

Cited by

See all 154

Metadata

Authors
Kelly, C. D.
Venue
The Quarterly Review of Biology
Published
2006-09
Volume
81
Issue
3
Pages
221-236
ISSN
  • 0033-5770 (ISSN-L)
  • 1539-7718
OpenAlex
W2030136684
Cited by
154
References
7
FWCI
4.93
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.