The unit of analysis error in studies about physicians' patient care behavior
The DOI matches its Crossref record; 66 of the 67 references it cites were found in a registry or an index.
Abstract
Objective To estimate the frequency with which patients are incorrectly used as the unit of analysis among statistical calculations in published studies of physicians' patient care behavior. Design Retrospective review of studies published during 1980-1990. ARTICLES: 54 articles retrieved by a computerized search using medical subject headings for physicians and study characteristics. Article selection criteria included the requirement that the physician should have been the correct unit of analysis. Intervention Presence of the error was determined by consensus using published criteria. Main results The error was present in 38 articles (70%). The number of study physicians was reported in 35 articles (65%). The error was found in 57% of articles that reported the number of study physicians and in 95% of those that did not. The error rate was not lower among articles published more recently nor among those published in journals with higher rates of article citations in the medical literature. Conclusion The unit of analysis error occurs frequently and can generate artificially low p values. Failure to report the number of study physicians can be a clue that this type of error has been made.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Authors often fail to account for intraclass correlation in clustered studies, leading to a 'unit of analysis' error (Divine 1992), whereby P values are spuriously low, CIs unduly narrow and statistical significance overestimated.”
From Compulsory community and involuntary outpatient treatment for people with severe mental disorders. (2017) · cites this paper as Divine 1992
Citations
Cites
Applied Regression Analysis and Other Multivariable Methods
Walker, E. (1989) · Technometrics · doi:10.1080/00401706.1989.10488486 · Cited by 8,538
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Some statistical methods useful in circulation research.
Wallenstein, S., Zucker, C. L., & Fleiss, J. L. (1980) · Circulation Research · doi:10.1161/01.res.47.1.1 · Cited by 3,886
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628 · cited 3×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Comparing the Means of Several Groups
Godfrey, K. (1985) · New England Journal of Medicine · doi:10.1056/nejm198512053132305 · Cited by 737
Statistical Problems in the Reporting of Clinical Trials
Pocock, S. J., Hughes, M. D., & Lee, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198708133170706 · Cited by 662 · cited 1×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Statistics with applications to the biological and health sciences
Remington, R. D., & Schork, M. A. (1970) · Medical Entomology and Zoology · Cited by 521
Central Vein Catheterization: Failure and Complication Rates by Three Percutaneous Approaches
Sznajder, J. I. (1986) · Archives of Internal Medicine · doi:10.1001/archinte.1986.00360140065007 · Cited by 496
A Randomized Trial of Continuing Medical Education
Sibley, J. C., Sackett, D. L., Neufeld, V., Gerrard, B., Rudnick, K. V., & Fraser, W. (1982) · New England Journal of Medicine · doi:10.1056/nejm198203043060904 · Cited by 342
A Randomized Trial of a Family Physician Intervention for Smoking Cessation
Wilson, D. M. (1988) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1988.03410110078031 · Cited by 239
The Impact of a Physician as Part of the Aeromedical Prehospital Team in Patients With Blunt Trauma
Baxt, W. G. (1987) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1987.03390230082029 · Cited by 197
Choosing the Correct Unit of Analysis in Medical Care Experiments
Whiting-O??Keefe, Q. E., Henke, C., & Simborg, D. W. (1984) · Medical Care · doi:10.1097/00005650-198412000-00005 · Cited by 193
Encouraging Primary Care Physicians To Help Smokers Quit: A Randomized, Controlled Trial
Cohen, S. J., Stookey, G. K., Katz, B. P., Drook, C. A., & Smith, D. M. (1989) · Annals of Internal Medicine · doi:10.7326/0003-4819-110-8-648 · Cited by 158
Cohen, S. J., Christen, A. G., Katz, B. P., Drook, C. A., Davis, B., Smith, D. M., & Stookey, G. K. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.3.313 · Cited by 142
Effect of a gatekeeper plan on health services use and charges: a randomized trial.
Martin, D. P., Diehr, P. K., Price, K., & Richardson, W. C. (1989) · American Journal of Public Health · doi:10.2105/ajph.79.12.1628 · Cited by 129 · cited 1×
“11 (35) 23 (43) 20 (87) 15 (65) 15 (65) 9 (29) 17 (31) 15 (88) 12 (71) 13 (76) 7 (23) 10 (19) 9 (90) 6 (60) 7 (70) 4 (13) 4 (7) 3 (75) 2 (50) 3 (75)”
Statistics With Applications to the Biological and Health Sciences.
Smith, P. J., Remington, R. D., & Schork, M. A. (1985) · Journal of the American Statistical Association · doi:10.2307/2288602 · Cited by 128
How Good Is Communication Between Primary Care Physicians and Subspecialty Consultants?
McPhee, S. J. (1984) · Archives of Internal Medicine · doi:10.1001/archinte.1984.00350180209029 · Cited by 125 · cited 2×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Improving Drug Prescribing in a Primary Care Practice
Gehlbach, S. H., Wilkinson, W. E., Hammond, W. E., Clapp, N. E., Finn, A. L., Taylor, W. J., & Rodell, M. (1984) · Medical Care · doi:10.1097/00005650-198403000-00002 · Cited by 124 · cited 2×
“11 (35) 23 (43) 20 (87) 15 (65) 15 (65) 9 (29) 17 (31) 15 (88) 12 (71) 13 (76) 7 (23) 10 (19) 9 (90) 6 (60) 7 (70) 4 (13) 4 (7) 3 (75) 2 (50) 3 (75)”
McAuley, R. G., Paul, W. M., Morrison, G. H., Beckett, R., & Goldsmith, C. H. (1984) · Europe PMC (PubMed Central) · Cited by 114
Evaluation of out-patient counselling compared with general practitioner care following overdoses
Hawton, K. E., McKeown, S., Day, A., Martin, P., O'Connor, M. E., & Yule, J. (1987) · Psychological Medicine · doi:10.1017/s0033291700025988 · Cited by 108 · cited 2×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Handwashing Technique in a Pediatric Intensive Care Unit
Donowitz, L. G. (1987) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1987.04460060099044 · Cited by 101 · cited 1×
“1980 2 (4) 2 (100) 2 (100) 2 ( 1 O0 1981 0 - - - 1982 6 ( 11 ) 5 (83) 2 (33) 4 (67) 1983 5 (9) 4 (80) 3 (60) 3 (60) 1984 6 (11) 5 (83) 5 (83) 3 (50) 1985 5 (9) 4 (80) 4 (80) 3 (60) 1986 4 (7) 4 (100) 2 (50) 3 (75) 1987 9 (17) 7 (78) 5 (56) 7 (78) 1988 4 (7) 3 (75) 3 (75) 3 (75) 1989 11 (20) 11 (100) 7 (64) 8 (73) 1990…”
Initiation of warfarin therapy
White, R. H. R., Hong, R., Venook, A. P., Daschbach, M. M., Murray, W., Mungall, D. R., & Coleman, R. W. (1987) · Journal of General Internal Medicine · doi:10.1007/bf02596140 · Cited by 99
A Randomized Controlled Trial of Quality Assurance in Sixteen Ambulatory Care Practices
Palmer, R. H., Louis, T. A., Hsu, L., Peterson, H. F., Rothrock, J. K., Strain, R., Thompson, M. S., & Wright, E. A. (1985) · Medical Care · doi:10.1097/00005650-198506000-00001 · Cited by 97
Foote, A., & Erfurt, J. C. (1983) · New England Journal of Medicine · doi:10.1056/nejm198304073081404 · Cited by 90
Russell, M. A., Stapleton, J., Jackson, P. H., Hájek, P., & Belcher, M. (1987) · BMJ · doi:10.1136/bmj.295.6608.1240 · Cited by 83
A Randomized Trial of Computerized Reminders for Blood Pressure Screening in Primary Care
McDowell, I., Newell, C., & Rosser, W. (1989) · Medical Care · doi:10.1097/00005650-198903000-00008 · Cited by 82 · cited 1×
“Procedure 18 (33) 17 (94) 8 (44) 13 (72) Diagnosis 12 (22) 11 (92) 8 (67) 10 (83) Prescribing or treatment 19 (35) 16 (84) 13 (68) 11 (58) Patient education or counseling 11 (20) 11 (100) 10 (91) 8 (73) Test ordering 7 (13) 7 (100) 5 (71 ) 4 (57) Referral 4 (7) 4 (100) 3 (75) 4 (100) Other 6 (11) 4 (67) 4 (67) 2 (33)”
Clinical diagnostic accuracy of basal cell carcinoma
Presser, S. E., & Taylor, J. R. (1987) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(87)70126-1 · Cited by 80
Freedman, M. A., Jillson, D., Coffin, R., & Lf, N. (1986) · American Journal of Public Health · doi:10.2105/ajph.76.5.550 · Cited by 79
Maximizing Compliance With Hemoccult Screening for Colon Cancer in Clinical Practice
Thompson, R. S., Michnich, M. E., Gray, J., Friedlander, L., & Gilson, B. S. (1986) · Medical Care · doi:10.1097/00005650-198610000-00004 · Cited by 76 · cited 1×
“11 (35) 23 (43) 20 (87) 15 (65) 15 (65) 9 (29) 17 (31) 15 (88) 12 (71) 13 (76) 7 (23) 10 (19) 9 (90) 6 (60) 7 (70) 4 (13) 4 (7) 3 (75) 2 (50) 3 (75)”
The Inexact Use of Fisher's Exact Test in Six Major Medical Journals
McKinney, W. P. (1989) · JAMA · doi:10.1001/jama.1989.03420230084031 · Cited by 75
Improving physician compliance with a health maintenance protocol.
Ps, F., Kowulich, B. A., & Am, L. (1984) · PubMed · Cited by 66
Do family physicians need medical assistants to detect and manage hypertension?
Bass, M. J., McWhinney, I. R., & DONNER, A. P. (1986) · Europe PMC (PubMed Central) · Cited by 66
White, P. T., Pharoah, C. A., ANDERSON, H. R., & FREELING, P. (1989) · Europe PMC (PubMed Central) · Cited by 57
Effects of physician counseling on the smoking behavior of asbestos-exposed workers
Li, V. C., Kim, Y. J., Ewart, C. K., Terry, P. B., Cuthie, J. C., Wood, J. C., Emmett, E. A., & Permutt, S. (1984) · Preventive Medicine · doi:10.1016/0091-7435(84)90015-x · Cited by 53
Improvement in Physicians' Counseling of Patients With Mental Health Problems
Brody, D. S. (1990) · Archives of Internal Medicine · doi:10.1001/archinte.1990.00390170049012 · Cited by 52 · cited 1×
“Procedure 18 (33) 17 (94) 8 (44) 13 (72) Diagnosis 12 (22) 11 (92) 8 (67) 10 (83) Prescribing or treatment 19 (35) 16 (84) 13 (68) 11 (58) Patient education or counseling 11 (20) 11 (100) 10 (91) 8 (73) Test ordering 7 (13) 7 (100) 5 (71 ) 4 (57) Referral 4 (7) 4 (100) 3 (75) 4 (100) Other 6 (11) 4 (67) 4 (67) 2 (33)”
Reid, A. J., Carroll, J. C., Ruderman, J., & Murray, M. (1989) · Europe PMC (PubMed Central) · Cited by 49
Nonmedical Factors Associated With the Prescribing Volume Among Family Practitioners in an HMO
Hartzema, A. G., & Christensen, D. B. (1983) · Medical Care · doi:10.1097/00005650-198310000-00005 · Cited by 49
Impact of patient care appraisal on physician behaviour in the office setting.
Putnam, R. W., & Curry, L. (1985) · PubMed · Cited by 45
McGhan, W. F., Stimmel, G. L., Hall, T. G., & Gilman, T. M. (1983) · Medical Care · doi:10.1097/00005650-198304000-00006 · Cited by 39
Copeman, R. C., Swannell, R. J., Pincus, D. F., & Woodhead, K. A. (1989) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1989.tb101167.x · Cited by 35
Adult immunization: the medical record design as a facilitator for physician compliance.
Rodney, W. M., Chopivsky, P., & Quan, M. (1983) · PubMed · Cited by 31
Study of relation of continuing medical education to quality of family physiciansʼ care
Dunn, E. V., Bass, M. J., Williams, J. I., Borgiel, A. E., MacDonald, P. B., & Spasoff, R. A. (1988) · Academic Medicine · doi:10.1097/00001888-198810000-00005 · Cited by 30
Wm, R., Beaber, R. J., Johnson, R., & Quan, M. A. (1985) · PubMed · Cited by 28
Garfield, E. (1977) · Medical Entomology and Zoology · Cited by 28
The interpretation of office radiographs by family physicians.
Jg, H., Kunian, A., Gjerdingen, D. K., Connolly, J., Koopmeiners, M. B., Cesnik, J., Christenson, C., & Sanderson, O. (1989) · PubMed · Cited by 25
Leduc, D., & Pless, I. B. (1982) · PEDIATRICS · doi:10.1542/peds.70.4.511 · Cited by 24
Krikke, E. H., & Bell, N. R. (1989) · PubMed · Cited by 24
POST-PARTUM TUBAL LIGATION BY NURSE-MIDWIVES AND DOCTORS IN THAILAND
Dusitsin, N., Varakamin, S., Ningsanon, P., Chalapati, S., Boonsiri, B., & Gray, R. (1980) · The Lancet · doi:10.1016/s0140-6736(80)91129-0 · Cited by 22
Influence of site of obstetric care and delivery on pregnancy management and outcome.
Chaska, B. W., Ms, M., Grambsch, P. M., & Nesse, R. E. (1988) · PubMed · Cited by 21
Treatment of diabetic ketoacidosis by internists and family physicians: a comparative study.
HAMBURGER, S. C., Barjenbruch, P., & Soffer, A. (1982) · PubMed · Cited by 17
Sex of physician as a determinant of psychosocial problem recognition.
Bowman, M. A., & Gehlbach, S. H. (1980) · PubMed · Cited by 14
Effect of a medical care evaluation program on physician knowledge and performance
Maxwell, J. A., Sandlow, L. J., & Bashook, P. G. (1984) · Academic Medicine · doi:10.1097/00001888-198401000-00006 · Cited by 13
Jennett, P. A., Tw, W., Rc, H., Mainprize, G. W., & Laxdal, O. E. (1989) · PubMed · Cited by 13
Vandvik, I., Høyeraal, H. M., & Larsen, S. (1988) · Scandinavian Journal of Rheumatology · doi:10.3109/03009748809098807 · Cited by 9
Continuity of care and outcome in nursing home patients transferred to a community hospital.
Susman, J., Nj, Z., & Byerly, B. (1989) · PubMed · Cited by 9
An ambulatory medical education program for internal medicine residents
Wones, R. G., Rouan, G. W., Brody, T. L., Bode, R., & Radack, K. L. (1987) · Academic Medicine · doi:10.1097/00001888-198706000-00003 · Cited by 7
Clinical competence of paediatric primary health care nurses in Soweto.
Irwig, L., Porter, B., Td, W., Ld, S., Wagstaff, L. A., Liesch, N., Reinach, S. G., Ms, M., & Js, G. (1985) · PubMed · Cited by 7
Eisenberg, J. M., & Williams, S. (1983) · Clinical Chemistry · doi:10.1093/clinchem/29.12.2111 · Cited by 6
Outcomes Following Continuing Medical Education on Flexible Sigmoidoscopy
Rodney, W. M., & Ruggiero, C. (1987) · Family Practice · doi:10.1093/fampra/4.4.306 · Cited by 6
Ignoring the obvious: doctors' wives as patients.
Dearlove, J., Bate, T., Dearlove, B., & Newman, P. K. (1982) · BMJ · doi:10.1136/bmj.285.6336.187 · Cited by 5 · cited 1×
“11 (35) 23 (43) 20 (87) 15 (65) 15 (65) 9 (29) 17 (31) 15 (88) 12 (71) 13 (76) 7 (23) 10 (19) 9 (90) 6 (60) 7 (70) 4 (13) 4 (7) 3 (75) 2 (50) 3 (75)”
Binding of Human Renin to Plasma Proteins and Comparison with Plasma Active and Inactive Renin
LECKIE, B. J., & Mclntyre, G. D. (1985) · Journal of Hypertension · doi:10.1097/00004872-198502000-00012 · Cited by 5
Procedures performed by family physicians, internists, and a Medex in a small group practice.
Km, L., & Cr, K. (1982) · PubMed · Cited by 5
Audit of Decision-making Regarding Female Genitourinary Infections in Outpatient Practice
Timpka, T., Bjurulf, P., & Bour, T. (1990) · Scandinavian Journal of Infectious Diseases · doi:10.3109/00365549009023119 · Cited by 4
Is outcome for low risk obstetric patients influenced by parity and intervention?
Tilyard, M., Williams, S., Rj, S., Oakley, M. E., & Murdoch, J. (1989) · PubMed · Cited by 3
Physician compliance in the management of hypertensive patients.
Cohen, D., Berner, U., & Dubach, U. C. (1985) · PubMed · Cited by 2
Sp, O., Glasunov, I. S., & Chazova, L. V. (1982) · PubMed · Cited by 2
Research works printed but not linked: 1
- Snedecor GW, Cochran WG. Statistical methods, 7th ed. Ames, IA: Iowa State University Press, 1980.
Cited by
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
Renders, C. M., Valk, G. D., Griffin, S. J., Wagner, E. H., Eijk van, J. T., & Assendelft, W. J. J. (2001) · Diabetes Care · doi:10.2337/diacare.24.10.1821 · Cited by 1,066
Family intervention for schizophrenia
Pharoah, F., Mari, J., Rathbone, J., & Wong, W. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000088.pub2 · Cited by 737
Psychoeducation for schizophrenia
Xia, J., Merinder, L. B., & Belgamwar, M. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002831.pub2 · Cited by 585
Metadata
- Authors
- Divine, G. W., Brown, J. T., & Frazier, L. M.
- Affiliations
- Duke University (US)
- Venue
- Journal of General Internal Medicine
- Published
- 1992-11
- Volume
- 7
- Issue
- 6
- Pages
- 623-629
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- OpenAlex
- W2058874144
- Cited by
- 749
- References
- 67
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 12 · 2023: 9 · 2022: 16 · 2021: 6 · 2020: 12 · 2019: 27 · 2018: 36 · 2017: 37 · 2016: 47 · 2015: 47 · 2014: 46 · 2013: 50 · 2012: 62
- FWCI
- 5.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Journal of General Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- statistical reporting errors, methodological quality
- MeSH terms
- Data Interpretation, Statistical, Health Services Research, Humans, Medical Audit, Physicians, Retrospective Studies, Subject Headings, MEDLINE, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.