Bias in analytic research

Sackett, David L.

doi:10.1016/0021-9681(79)90012-2

Cited by 2,075Statistical Methods in EpidemiologyMeta-analysis and systematic reviewsAdvanced Causal Inference Techniques

Bias in analytic research

Sackett, David L.·1979·Journal of Chronic Diseases

DOI 10.1016/0021-9681(79)90012-2

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/0021-9681(79)90012-2

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Within-group effects may be comparatively less prone to publication bias.
“This is unsurprising given observations that within-group effects may be comparatively less prone to publication bias (Sackett, 1979, p. 59).”
From Second language (L2) gains through digital game-based language learning (DGBLL): A meta-analysis (2022) · cites this paper as Sackett, 1979

Limitations of the Application of Fourfold Table Analysis to Hospital Data
Berkson, J. (1946) · Biometrics Bulletin · doi:10.2307/3002000 · Cited by 1,810 · see citing works
CASE-CONTROL STUDIES IN THE EVALUATION OF DRUG-INDUCED ILLNESS
JICK, H., & VESSEY, M. P. (1978) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112502 · Cited by 123 · see citing works

Flagged first, then by citations

Sorted by citations

Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · see citing works
“Many possible sources of bias have been described and a variety of terms are used [68,69].”
The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions.
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252 · see citing works
Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration
Vandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543 · see citing works
Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and elaboration
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2014) · International Journal of Surgery · doi:10.1016/j.ijsu.2014.07.014 · Cited by 2,969 · see citing works
Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779 · see citing works
Metabolic Syndrome and Risk of Incident Cardiovascular Events and Death
Gami, A. S., Witt, B. J., Howard, D. E., Erwin, P. J., Gami, L. A., Somers, V. K., & Montori, V. M. (2007) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2006.09.032 · Cited by 1,888 · see citing works
Bias and causal associations in observational research
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07451-2 · Cited by 1,553 · see citing works
Recall bias in epidemiologic studies
Coughlin, S. S. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90060-3 · Cited by 1,381 · see citing works
Clinical Prediction Rules: Applications and Methodological Standards
Wasson, J. H., Sox, H. C., Neff, R. K., & Goldman, L. (1985) · New England Journal of Medicine · doi:10.1056/nejm198509263131306 · Cited by 1,357 · see citing works
How bad are the effects of bad leaders? A meta-analysis of destructive leadership and its outcomes
Schyns, B., & Schilling, J. (2013) · The Leadership Quarterly · doi:10.1016/j.leaqua.2012.09.001 · Cited by 1,245 · see citing works
Bias: Table 1
Delgado-Rodríguez, M., & Llorca, J. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.008466 · Cited by 1,064 · see citing works
The use of google trends in health care research: a systematic review
Nuti, S. V., Wayda, B., Ranasinghe, I., Wang, S., Dreyer, R. P., Chen, S. I., & Murugiah, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109583 · Cited by 1,086 · see citing works
Meta-analysis Spurious precision? Meta-analysis of observational studies
Egger, M., Schneider, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7125.140 · Cited by 997 · see citing works
Pain and women's satisfaction with the experience of childbirth: A systematic review
Hodnett, E. D. (2002) · American Journal of Obstetrics and Gynecology · doi:10.1016/s0002-9378(02)70189-0 · Cited by 967 · see citing works
Comorbidities of epilepsy: current concepts and future perspectives
Keezer, M. R., Sisodiya, S. M., & Sander, J. W. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(15)00225-2 · Cited by 778 · see citing works
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715 · see citing works
The New Neurobiology of Autism: Cortex, Connectivity, and Neuronal Organization
Minshew, N. J., & Williams, D. L. (2007) · Archives of Neurology · doi:10.1001/archneur.64.7.945 · Cited by 592 · see citing works
Design of Treatment Trials for Functional Gastrointestinal Disorders
Irvine, E. J., Tack, J., Crowell, M. D., Gwee, K. A., Ke, M., Schmulson, M. J., Whitehead, W. E., & Spiegel, B. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.02.010 · Cited by 550 · see citing works
Causal inference and counterfactual prediction in machine learning for actionable healthcare
Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459 · see citing works
Time-dependent bias was common in survival analyses published in leading clinical journals
van Walraven, C., Davis, D., Forster, A. J., & Wells, G. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.008 · Cited by 337 · see citing works
Mining Electronic Health Records (EHRs): A Survey
Yadav, P., Steinbach, M., Kumar, V., & Simon, G. (2018) · ACM Computing Surveys · doi:10.1145/3127881 · Cited by 299 · see citing works
Design of Treatment Trials for Functional Gastrointestinal Disorders
Irvine, E. J., Whitehead, W. E., Chey, W. D., Matsueda, K., Shaw, M., Talley, N. J., & Veldhuyzen van Zanten, S. J. O. (2006) · Gastroenterology · doi:10.1053/j.gastro.2005.11.058 · Cited by 286 · see citing works
A peculiar prevalence of p values just below .05
Masicampo, E. J., & Lalande, D. R. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.711335 · Cited by 266 · see citing works
A meta-analytic review of the psychosocial adjustment of youth with inflammatory bowel disease
Greenley, R. N., Hommel, K. A., Nebel, J., Raboin, T., Li, S.-H., Simpson, P., & Mackner, L. (2010) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp120 · Cited by 259 · see citing works
False Alarms and Pseudo-Epidemics: The Limitations of Observational Epidemiology
Grimes, D. A., & Schulz, K. F. (2012) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e31826af61a · Cited by 254 · see citing works
Risk factors for Kaposi's sarcoma in homosexual men
Marmor, M., Laubenstein, L., William, D., Friedman-Kien, A., Byrum, R. D., D'Onofrio, S., & Dubin, N. (1982) · The Lancet · doi:10.1016/s0140-6736(82)92275-9 · Cited by 238 · see citing works
Smoking, alcohol, and coffee consumption preceding Parkinson’s disease: A case-control study
Benedetti, M. D., Bower, J. H., Maraganore, D. M., McDonnell, S. K., Peterson, B. J., Ahlskog, J. E., Schaid, D. J., & Rocca, W. A. (2000) · Neurology · doi:10.1212/wnl.55.9.1350 · Cited by 234 · see citing works
Effect of interpretive bias on research evidence
Kaptchuk, T. J. (2003) · BMJ · doi:10.1136/bmj.326.7404.1453 · Cited by 222 · see citing works
Initiation of Antihypertensive Treatment During Nonsteroidal Anti-inflammatory Drug Therapy
Gurwitz, J. H. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520100043031 · Cited by 220 · see citing works
Alcohol challenge responses predict future alcohol use disorder symptoms: A 6-year prospective study
King, A. C., McNamara, P. J., Hasin, D. S., & Cao, D. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.08.001 · Cited by 205 · see citing works
Bias in case-control studies. A review.
Kopec, J. A., & Esdaile, J. M. (1990) · Journal of Epidemiology and Community Health · doi:10.1136/jech.44.3.179 · Cited by 190 · see citing works
Placebo effect studies are susceptible to response bias and to other types of biases
Hróbjartsson, A., Kaptchuk, T. J., & Miller, F. G. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.008 · Cited by 150 · see citing works
Incentives and disincentives to participation by clinicians in randomised controlled trials
Rendell, J. M., Merritt, R. K., & Geddes, J. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000021.pub3 · Cited by 127 · see citing works
Pessimistic, Anxious, and Depressive Personality Traits Predict All-Cause Mortality: The Mayo Clinic Cohort Study of Personality and Aging
Grossardt, B. R., Bower, J. H., Geda, Y. E., Colligan, R. C., & Rocca, W. A. (2009) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31819e67db · Cited by 121 · see citing works
Coffee and coronary heart disease
Myers, M. G. (1992) · Archives of Internal Medicine · doi:10.1001/archinte.1992.00400210009002 · Cited by 113 · see citing works
Impact of referral bias on clinical and epidemiological studies of Alzheimer's disease
Kokmen, E., Özsarfati, Y., Beard, C. M., O'Brien, P. C., & Rocca, W. A. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00031-3 · Cited by 105 · see citing works
Biomedical and behavioral outcomes of Keep It Up!: an ehealth HIV prevention program RCT.
Mustanski, B., Parsons, J. T., Sullivan, P. S., Madkins, K., Rosenberg, E., & Swann, G. (2018) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.04.026 · Cited by 103 · see citing works
Alcohol and intimate partner violence: do we have enough information to act?
Gil-González, D., Vives-Cases, C., Álvarez-Dardet, C., & Latour-Pérez, J. (2006) · European Journal of Public Health · doi:10.1093/eurpub/ckl016 · Cited by 98 · see citing works
Bias in psychiatric case–control studies: Literature survey
Lee, W., Bindman, J., Ford, T., Glozier, N., Moran, P., Stewart, R., & Hotopf, M. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.027250 · Cited by 92 · see citing works
Performance of Kiestra Total Laboratory Automation Combined with MS in Clinical Microbiology Practice
Mutters, N. T., Hodiamont, C. J., Jong, M. D. D., Overmeijer, H. P. J., Boogaard, M. V. D., & E.Visser, C. (2014) · Annals of Laboratory Medicine · doi:10.3343/alm.2014.34.2.111 · Cited by 82 · see citing works
Meta-analysis in medical research: Potentials and limitations
Zwahlen, M., Renehan, A., & Egger, M. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2006.12.001 · Cited by 70 · see citing works
A surge of p -values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too)
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78 · see citing works
The Life of p : “Just Significant” Results are on the Rise
Leggett, N. C., Thomas, N. A., Loetscher, T., & Nicholls, M. E. R. (2013) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2013.863371 · Cited by 64 · see citing works
The SEE Study: safety, efficacy, and equity of implementing autonomous artificial intelligence for diagnosing diabetic retinopathy in youth
Wolf, R. M., Liu, T. Y. A., Thomas, C., Prichett, L., Zimmer-Galler, I., Smith, K., Abramoff, M. D., & Channa, R. (2021) · Diabetes Care · doi:10.2337/dc20-1671 · Cited by 62 · see citing works
Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis
Armijo-Olivo, S., Fuentes, J., Ospina, M., Saltaji, H., & Hartling, L. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-116 · Cited by 60 · see citing works
Second language (L2) gains through digital game-based language learning (DGBLL): A meta-analysis
Dixon, D. H., Dixon, T., & Jordan, E. (2022) · Language Learning & Technology · doi:10.64152/10125/73464 · Cited by 88 · see citing works
Effects of a stepped-care intervention programme among older subjects who screened positive for depressive symptoms in general practice: the PROMODE randomised controlled trial
van der Weele, G. M., de Waal, M. W. M., van den Hout, W. B., de Craen, A. J. M., Spinhoven, P., Stijnen, T., Assendelft, W. J. J., van der Mast, R. C., & Gussekloo, J. (2012) · Age and Ageing · doi:10.1093/ageing/afs027 · Cited by 39 · see citing works
Studies of symptoms in primary care
Donner-Banzhoff, N., Kunz, R., & Rosser, W. (2001) · Family Practice · doi:10.1093/fampra/18.1.33 · Cited by 29 · see citing works
Expected‐value bias in routine third‐trimester growth scans
Drukker, L., Droste, R., Chatelain, P., Noble, J. A., & Papageorghiou, A. T. (2020) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.21929 · Cited by 29 · see citing works
Biases inherent in studies of coffee consumption in early pregnancy and the risks of subsequent events
Leviton, A. (2018) · Nutrients · doi:10.3390/nu10091152 · Cited by 27 · see citing works
The Association Between Apolipoprotein E Allele 4 and Late-Onset Alzheimer's Disease: Pathogenic Relationship or Differential Survival Bias
Riggs, J. E., & Keefover, R. W. (1994) · Archives of Neurology · doi:10.1001/archneur.1994.00540200024011 · Cited by 26 · see citing works
Amiodarone-Induced Thyrotoxicosis in Adults with Congenital Heart Disease -Clinical Presentation and Response to Therapy
Stan, M. N., Sathananthan, M., Warnes, C. A., Brennan, M. D., Thapa, P., & Bahn, R. S. (2014) · Endocrine Practice · doi:10.4158/ep13059.or · Cited by 18 · see citing works
Optimizing Expectations via Mobile Apps: A New Approach for Examining and Enhancing Placebo Effects
Gruszka, P., Burger, C., & Jensen, M. P. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00365 · Cited by 15 · see citing works
Epidemiological fallacies of modern psychiatric research
Newson, R. S., Karlsson, H., & Tiemeier, H. (2011) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2010.539268 · Cited by 12 · see citing works
Associations between total physical activity levels and academic performance in adults: A systematic review and meta-analysis
Trott, M., Kentzer, N., Horne, J., Langdown, B., & Smith, L. (2024) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1618_23 · Cited by 11 · see citing works
The trend of quality of publications in endodontic surgery: a 10-year systematic survey of the literature
Del Fabbro, M., Corbella, S., Tsesis, I., & Taschieri, S. (2015) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2014.09.002 · Cited by 6 · see citing works
The effect of prior mental health on persistent physical symptoms after exposure to a chemical disaster
Min, Y.-S., Kim, S.-Y., Choi, S.-K., & Ahn, Y.-S. (2023) · Healthcare · doi:10.3390/healthcare11071004 · Cited by 3 · see citing works

Authors: Sackett, D. L.
Corresponding author: Sackett, David L.
Venue: Journal of Chronic Diseases
Publisher: Elsevier BV
Published: 1979-01
Volume: 32
Issue: 1-2
Pages: 51-63
ISSN: 0021-9681 (ISSN-L)
DOI: 10.1016/0021-9681(79)90012-2
OpenAlex: W2075917870
Cited by: 2,075
References: 2
Citations by year: 2026: 28 · 2025: 42 · 2024: 27 · 2023: 31 · 2022: 53 · 2021: 58 · 2020: 49 · 2019: 44 · 2018: 46 · 2017: 41 · 2016: 63 · 2015: 52 · 2014: 70 · 2013: 69 · 2012: 79
FWCI: 26.71
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Journal of Chronic Diseases (publishedVersion)
PubMed (publishedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords: case-control study, cohort studies, rare diseases, research trends over time
MeSH terms: Epidemiologic Methods, Terminology as Topic, Research Design, Retrospective Studies, Sampling Studies, Statistics as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Bias in analytic research

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Record

About these checks