The unit of analysis error in studies about physicians' patient care behavior
The DOI matches its Crossref record; 66 of the 67 references it cites were found in a registry or an index.
Abstract
Objective To estimate the frequency with which patients are incorrectly used as the unit of analysis among statistical calculations in published studies of physicians' patient care behavior. Design Retrospective review of studies published during 1980-1990. ARTICLES: 54 articles retrieved by a computerized search using medical subject headings for physicians and study characteristics. Article selection criteria included the requirement that the physician should have been the correct unit of analysis. Intervention Presence of the error was determined by consensus using published criteria. Main results The error was present in 38 articles (70%). The number of study physicians was reported in 35 articles (65%). The error was found in 57% of articles that reported the number of study physicians and in 95% of those that did not. The error rate was not lower among articles published more recently nor among those published in journals with higher rates of article citations in the medical literature. Conclusion The unit of analysis error occurs frequently and can generate artificially low p values. Failure to report the number of study physicians can be a clue that this type of error has been made.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Authors often fail to account for intraclass correlation in clustered studies, leading to a 'unit of analysis' error (Divine 1992), whereby P values are spuriously low, CIs unduly narrow and statistical significance overestimated.”
From Compulsory community and involuntary outpatient treatment for people with severe mental disorders. (2017) · cites this paper as Divine 1992
Citations
Cites
Applied Regression Analysis and Other Multivariable Methods
Walker, E. (1989) · Technometrics · doi:10.1080/00401706.1989.10488486 · Cited by 8,538
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Some statistical methods useful in circulation research.
Wallenstein, S., Zucker, C. L., & Fleiss, J. L. (1980) · Circulation Research · doi:10.1161/01.res.47.1.1 · Cited by 3,886
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628 · cited 3×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Comparing the Means of Several Groups
Godfrey, K. (1985) · New England Journal of Medicine · doi:10.1056/nejm198512053132305 · Cited by 737
Statistical Problems in the Reporting of Clinical Trials
Pocock, S. J., Hughes, M. D., & Lee, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198708133170706 · Cited by 662 · cited 1×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Statistics with applications to the biological and health sciences
Remington, R. D., & Schork, M. A. (1970) · Medical Entomology and Zoology · Cited by 521
Central Vein Catheterization: Failure and Complication Rates by Three Percutaneous Approaches
Sznajder, J. I. (1986) · Archives of Internal Medicine · doi:10.1001/archinte.1986.00360140065007 · Cited by 496
A Randomized Trial of Continuing Medical Education
Sibley, J. C., Sackett, D. L., Neufeld, V., Gerrard, B., Rudnick, K. V., & Fraser, W. (1982) · New England Journal of Medicine · doi:10.1056/nejm198203043060904 · Cited by 342
A Randomized Trial of a Family Physician Intervention for Smoking Cessation
Wilson, D. M. (1988) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1988.03410110078031 · Cited by 239
Research works printed but not linked: 1
- Snedecor GW, Cochran WG. Statistical methods, 7th ed. Ames, IA: Iowa State University Press, 1980.
Cited by
Items 701–750 of 750
Role of homeopathic medicines in prevention and treatment of paralytic ileus
Rao, A. M., Fitzgerald, J. E. F., & Ahmed, I. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009271
RetractedScoriels, L., Barnett, J. H., & Jones, P. B. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008661
Unilateral electroconvulsive therapy versus bilateral electroconvulsive therapy for schizophrenia
Essali, A., Albaroudi, B., Jaber, B., Mukhallalati, A. A., & Gillies, D. M. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011933
Lurasidone versus placebo for schizophrenia
Donnelly, L., & Sampson, S. J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010448
Ensayos clínicos con asignación aleatoria de grupos
Argimón, J. M. (2010) · Elsevier eBooks · doi:10.1016/b978-84-8086-461-9.50015-1
Long-acting aripiprazole (depot) versus placebo for schizophrenia
Hodgson, R. E., Belgamwar, R. B., & Walsh, S. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012360
Chlorpromazine versus lithium for people with schizophrenia
Cardoso, D., Tyrrell, K., Guerra, C. M., & Rikhraj, S. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012737
Oestrogen (adjunct) versus placebo for women with schizophrenia
Chua, W. L. L., Grigorov, H. S., & Hiley, J. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012220
Koepsell, T. D. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat05299
Abhijnhan, A., Cipriani, A., & Barbui, C. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006571
Benzodiazapines for catatonia in persons with schizophrenia and other serious mental illnesses
Gibson, R., & Walcott, G. O. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006570
Evaluating and Improving Physician Prescribing
Lu, C. Y., Majumdar, T. L. S. R., Lipton, H. L., & Soumerai, S. B. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch19
Li, J., Shen, J., Li, B., & Wu, J. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013492
Castiello, S., Mendoza, M. A. A., Ortiz‐Orendain, J., Itzaman, I., Landa-Ramírez, É., Carmona, J., & Murphy, R. A. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013625
Duloxetine for Generalized Anxiety Disorder (GAD)
Carter, K., McKibben-Sanders, J., & Nunez, A. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008339
Pyridoxal 5 phosphate for neuroleptic-induced tardive dyskinesia
Adelufosi, A. O., Abayomi, O., & Ojo, T. M.-F. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010501
Antiglucocorticoid and related treatments for psychosis
Garner, B., Phillips, L., Bendall, S., Parslow, R., & Hetrick, S. E. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006995 · Cited by 1
Occupational therapy for care home residents with stroke
Fletcher-Smith, J. C., Walker, M. F., Feltham, M. G., Steultjens, E. M. J., & Sackley, C. M. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010116
Punnoose, S., & Belgamwar, M. R. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004838
Pharmacological interventions for reduction of weight gain in people with schizophrenia
Hahn, M., Agarwal, S. M., Ahsan, Z. A., Lockwood, J., Duncan, M. J., Takeuchi, H., Cohn, T. A., Taylor, V. H., Remington, G. J., & Faulkner, G. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013338 · Cited by 1
Aripiprazole versus sulpiride for people with schizophrenia and schizophrenia-like psychoses
Bhattacharjee, J., & El-Sayeh, H. G. G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012075
Franceschi, S., & Plummer, M. (2013) · Springer eBooks · doi:10.1007/978-0-387-09834-0_9
Razzouk, G., Azzouz, M. S., Hawasly, K., & Koudsi, A. Y. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006615
Anticholinergics for neuroleptic-induced parkinsonism
Lawson, F., Jethwa, K., de Lima, M. S., Soares, B. G., & Galappathie, N. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005964.pub2
Cognitive behaviour therapy (brief versus standard duration) for schizophrenia
Naeem, F., Farooq, S., & Kingdon, D. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010646
Anticholinergics for neuroleptic-induced parkinsonism
Lawson, F., Jethwa, K., de Lima, M. S., Soares, B. G., & Galappathie, N. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005964
Carter, K., Ojo, R., & Saczawa, M. E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006720
Aripiprazole versus perphenazine for people with schizophrenia and schizophrenia-like psychoses
Bhattacharjee, J., & El-Sayeh, H. G. G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012074 · Cited by 1
Nidotherapy for people with schizophrenia
Chamberlain, I. J., & Sampson, S. J. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009929 · Cited by 1
Beta-2 agonists for pneumonia in adults
Alkhalil, M., Dakak, A., & Eid, M. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008663.pub2
Matar, H. E., Almerie, M. Q., Makhoul, S., Humphreys, P., & Omori, I. M. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007479
Razzouk, G., Azzouz, M. S., Hawasly, K., & Koudsi, A. Y. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006615.pub2
Different communication strategies for disclosing a diagnosis of schizophrenia and related disorders
Farooq, S., Johal, R. K., & Naeem, F. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011707
Beta-2 agonists for pneumonia in adults
Alkhalil, M., Dakak, A., & Eid, M. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008663
Monetary incentives for schizophrenia
Michalczuk, R., & Mitchell, A. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007626
Preventive interventions for postnatal psychosis
Essali, A., Alabed, S., Guul, A., & Essali, N. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009991
Pharmacological interventions for clozapine-induced hypersalivation
Duggan, L., Cahill, C., & Udu, V. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005579
Antioxidant treatments for schizophrenia
Magalhães, P. V. D. S., Andreazza, A. C., Berk, M., Kapczinski, F. P., & Dean, O. M. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008919 · Cited by 3
Ma, C. F., Chien, W. T., Chan, S. K. W., & Wong, C. L. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014970 · Cited by 1
Abhijnhan, A., Cipriani, A., & Barbui, C. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006571.pub2
Cannabidiol for people with schizophrenia
Buitrago‐García, D., Sánchez, G., Correa, P. A. S., Baracaldo, S. D. P., Gallego, S. F. G., & Baandrup, L. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014602
Antipsychotics for antipsychotic-naïve people with psychosis
Wu, H., Burschinski, A., Schneider‐Thoma, J., Leucht, S., & Siafis, S. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015665
Psychosocial telemedicine interventions for schizophrenia
Kimhy, D., Ospina, L. H., Messer, S. J., Sharma, V., Datta, S. S., & Stroup, T. S. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015260
Plummer, M., & Franceschi, S. (2023) · Springer eBooks · doi:10.1007/978-1-4614-6625-3_9-1
HMG-CoA reductase inhibitors (statins) versus placebo for people with schizophrenia
Saishoji, Y., Kim, S., Banno, M., Kohmura, K., Kataoka, Y., & Tsujimoto, Y. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014565
Feber, L., Peter, N. L., Schneider‐Thoma, J., Siafis, S., Bighelli, I., Hansen, W.-P., Baldez, D. P., Salanti, G., Keefe, R. S. E., Engel, R. R., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26577344
Feber, L., Peter, N. L., Schneider‐Thoma, J., Siafis, S., Bighelli, I., Hansen, W.-P., Baldez, D. P., Salanti, G., Keefe, R. S. E., Engel, R. R., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26577341
Feber, L., Peter, N. L., Schneider‐Thoma, J., Siafis, S., Bighelli, I., Hansen, W.-P., Baldez, D. P., Salanti, G., Keefe, R. S. E., Engel, R. R., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26577338
Zuclopenthixol acetate for acute schizophrenia and similar major mental illnesses
Jayakody, K., Chuang, S., Gunadasa, S., Gibson, R. C., Kumar, A., & Tune, P. (2026) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000525.pub4
Count games not athletes? The problem of pseudoreplication when analysing small-sided team games
Rein, R., Brinkjans, D., & Kempe, M. (2026) · Science and Medicine in Football · doi:10.1080/24733938.2026.2756329
Metadata
- Authors
- Divine, G. W., Brown, J. T., & Frazier, L. M.
- Affiliations
- Duke University (US)
- Venue
- Journal of General Internal Medicine
- Published
- 1992-11
- Volume
- 7
- Issue
- 6
- Pages
- 623-629
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- OpenAlex
- W2058874144
- Cited by
- 749
- References
- 67
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 12 · 2023: 9 · 2022: 16 · 2021: 6 · 2020: 12 · 2019: 27 · 2018: 36 · 2017: 37 · 2016: 47 · 2015: 47 · 2014: 46 · 2013: 50 · 2012: 62
- FWCI
- 5.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Journal of General Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- statistical reporting errors, methodological quality
- MeSH terms
- Data Interpretation, Statistical, Health Services Research, Humans, Medical Audit, Physicians, Retrospective Studies, Subject Headings, MEDLINE, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.