The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Self-Reported Utilization of Health Care Services: Improving Measurement and Accuracy
Abstract
Self-report is often used to estimate health care utilization. However, the accuracy of such data is of paramount concern. The authors conducted a systematic review of 42 studies that evaluated the accuracy of self-report utilization data, where utilization was defined as a visit to a clinical provider or entity. They also present a broad conceptual model that identifies major issues to consider when collecting, analyzing, and reporting such data. The results show that self-report data are of variable accuracy. Factors that affect accuracy include (1) sample population and cognitive abilities, (2) recall time frame, (3) type of utilization, (4) utilization frequency, (5) questionnaire design, (6) mode of data collection, and (7) memory aids and probes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
Pfeiffer, E. (1975) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1975.tb00927.x · Cited by 5,321
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070232 · Cited by 3,219
Regression Analysis of Count Data
Cameron, A. C., & Trivedi, P. K. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511814365 · Cited by 3,147
McKeown, T. (1954) · BMJ · doi:10.1136/bmj.2.4890.741-b · Cited by 2,225
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Answering Autobiographical Questions: The Impact of Memory and Inference on Surveys
Bradburn, N. M., Rips, L. J., & Shevell, S. K. (1987) · Science · doi:10.1126/science.3563494 · Cited by 1,183
Sudha, R. (2017) · Research and Biostatistics for Nurses · doi:10.5005/jp/books/13016_29 · Cited by 934
(2018) · Annals of Behavioral Medicine · doi:10.1007/12160.1532-4796 · Cited by 922
Martin, L. M., Leff, M., Calonge, N., Garrett, C., & Nelson, D. E. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00158-0 · Cited by 587
Truth or consequences: the validity of self‐report data in health services research on addictions
Del Boca, F. K., & Noll, J. A. (2000) · Addiction · doi:10.1046/j.1360-0443.95.11s3.5.x · Cited by 467
Self-reports of health care utilization compared to provider records
Ritter, P. L., Stewart, A. L., Kaymaz, H., Sobel, D. S., Block, D. A., & Lorig, K. R. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00261-4 · Cited by 401
Questions About Questions: Inquiries into the Cognitive Bases of Surveys.
Herting, J. R., & Tanur, J. M. (1993) · Journal of the American Statistical Association · doi:10.2307/2291301 · Cited by 384
Comparison of self-reported and medical record health care utilization measures
Roberts, R. O., Bergstralh, E. J., Schmidt, L., & Jacobsen, S. J. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00143-6 · Cited by 360
RELIABILITY OF RECALL OF DRUG USAGE AND OTHER HEALTH-RELATED INFORMATION1
HILL, A. P., & ROSS, R. K. (1982) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113386 · Cited by 315
(1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.12.s1.3.x · Cited by 290
McPhee, S. J., Nguyen, T. T., Shema, S. J., Nguyen, B., Somkin, C., Vo, P., & Pasick, R. (2002) · Preventive Medicine · doi:10.1006/pmed.2002.1096 · Cited by 237
Accuracy of Self-Reported Health Services Use and Patterns of Care Among Urban Older Adults
Wallihan, D. B., Stump, T. E., & Callahan, C. M. (1999) · Medical Care · doi:10.1097/00005650-199907000-00006 · Cited by 216
Cognitive psychology and self-reports: Models and methods
Jobe, J. B. (2003) · Quality of Life Research · doi:10.1023/a:1023279029852 · Cited by 214
Pill Count, Self-Report, and Pharmacy Claims Data to Measure Medication Adherence in the Elderly
Grymonpre, R. E., Didur, C. D., Montgomery, P. R., & Sitar, D. S. (1998) · Annals of Pharmacotherapy · doi:10.1345/aph.17423 · Cited by 214
Agreement between Self‐reported and Routinely Collected Health‐care Utilization Data among Seniors
Raina, P., Torrance‐Rynard, V., Wong, M., & Woodward, C. (2002) · Health Services Research · doi:10.1111/1475-6773.00047 · Cited by 180
Reijneveld, S. A., & Stronks, K. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.6.1407 · Cited by 174 · cited 2×
“…mixed results (Ritter et al. 2001; Cleary and Jette 1984; Grimmer and Bowman 1997; Marshall et al. 2003; Mathiowetz and Dipko 2000; Raina et al. 2002; Wallihan, Stump, and Callahan 1999; Reijneveld and Stronks 2001; Kashner et al. 1999; Jobe et al. 1990; Schmitz, Russell, and Cutrona 2002).”
ResultThe Validity of Self-reported Physician Utilization Measures
Cleary, P. D., & Jette, A. M. (1984) · Medical Care · doi:10.1097/00005650-198409000-00003 · Cited by 163 · cited 4×
“Underreporting of utilization is exacerbated by increased utilization (Bellon et al. 2000; Kashner et al. 1999; Ritter et al. 2001; Roberts et al. 1996; Cleary and Jette 1984; Schmitz, Russell, and Cutrona 2002; Wallihan, Stump, and Callahan 1999; Weissman et al. 1996).”
BackgroundResultInfluentialTHE ACCURACY OF SELF-REPORTED HEALTHCARE RESOURCE UTILIZATION IN HEALTH ECONOMIC STUDIES
Petrou, S., Murray, L., Cooper, P., & Davidson, L. L. (2002) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230200051x · Cited by 154
Equity in health services: Empirical analyses in social policy
Andersen, R., Kravits, J., & Anderson, O. W. (1975) · Medical Entomology and Zoology · Cited by 138
Patient Self-Reports in Pharmacoeconomic Studies: Their Use and Impact on Study Validity
Evans, C., & Crawford, B. (1999) · PharmacoEconomics · doi:10.2165/00019053-199915030-00004 · Cited by 136
Influence of question structure on the recall of self-reported drug use
Klungel, O. H., de Boer, A., Paes, A. H. P., Herings, R. M. C., Seidell, J. C., & Bakker, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00167-5 · Cited by 131
Self‐reported use of mental health services versus administrative records: care to recall?
Rhodes, A. E., & Fung, K. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.172 · Cited by 120
Using Average Cost Methods to Estimate Encounter-Level Costs for Medical-Surgical Stays in the VA
Wagner, T. H., Chen, S., & Barnett, P. G. (2003) · Medical Care Research and Review · doi:10.1177/1077558703256485 · Cited by 105
Self-citationMeasuring health: Improving the validity of health assessments
Knaüper, B., & Turner, P. A. (2003) · Quality of Life Research · doi:10.1023/a:1023589907955 · Cited by 100
Assessing the reliability of epidemiologic data obtained from medical records
Horwitz, R. I., & Yu, E. (1984) · Journal of Chronic Diseases · doi:10.1016/0021-9681(84)90015-8 · Cited by 98
Recall Strategies and Memory for Health-Care Visits
Jobe, J. B., White, A. A., Kelley, C. L., Mingay, D. J., Sanchez, M. J., & Loftus, E. F. (1990) · Milbank Quarterly · doi:10.2307/3350095 · Cited by 88
Cost Measurement in Economic Evaluations of Health Care: Whom to Ask?
van den Brink, M., van den Hout, W. B., Stiggelbout, A. M., van de Velde, C. J. �., & Kievit, J. (2004) · Medical Care · doi:10.1097/01.mlr.0000132351.78009.a1 · Cited by 84
Accuracy of Homeless Adults' Self-Reports
Gelberg, L., & Siecke, N. (1997) · Medical Care · doi:10.1097/00005650-199703000-00008 · Cited by 83
The cross-cultural validity of self-reported use of health care
Reijneveld, S. A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00138-9 · Cited by 83
Accuracy of patients' recall of Pap and cholesterol screening
Newell, S., Girgis, A., Sanson‐Fisher, R., & Ireland, M. C. (2000) · American Journal of Public Health · doi:10.2105/ajph.90.9.1431 · Cited by 82
Bellón, J. Á., Lardelli, P., Luna, J. D. D., & Delgado, A. (2000) · Journal of Epidemiology & Community Health · doi:10.1136/jech.54.7.544 · Cited by 78
Self‐reported use of mental health services versus administrative records: should we care?
Rhodes, A. E., Lin, E. H. B., & Mustard, C. (2002) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.130 · Cited by 78
Cognitive Aspects of Health Survey Methodology: An Overview
Fienberg, S. E., Loftus, E. F., & Tanur, J. M. (1985) · The Milbank Memorial Fund Quarterly Health and Society · doi:10.2307/3349847 · Cited by 74
A prospective study of the validity of data on self‐reported dental visits
Gilbert, G. H., Rose, J. S., & Shelton, B. J. (2002) · Community Dentistry And Oral Epidemiology · doi:10.1034/j.1600-0528.2002.00062.x · Cited by 72
Killeen, T. K., Brady, K. T., Gold, P. B., Tyson, C., & Simpson, K. N. (2004) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2003.09.006 · Cited by 69 · cited 2×
“There may be motivation to “forget” or underreport visits, such as those ascribable to alcoholism or mental health issues, which are perceived as embarrassing (Killeen et al. 2004).”
BackgroundMeasuring hospital use without claims: a comparison of patient and provider reports.
Clark, R. E., Ricketts, S. K., & McHugo, G. J. (1996) · Europe PMC (PubMed Central) · Cited by 69
Retrieving Multiple Autobiographical Memories
Loftus, E. F., & Fathi, D. C. (1985) · Social Cognition · doi:10.1521/soco.1985.3.3.280 · Cited by 65
Glandon, G. L., Counte, M. A., & Tancredi, D. J. (1992) · Journal of Gerontology · doi:10.1093/geronj/47.5.s245 · Cited by 59
The validity of self-reported health-care utilization by AIDS patients
Weissman, J. S., Levin, K., Chasan-Taber, S., Massagli, M. P., Seage, G. R., & Scampini, L. (1996) · AIDS · doi:10.1097/00002030-199606001-00013 · Cited by 57
Validity of Self-reported Hospital Admission in a Prospective Study
Norrish, A. E., North, D., Kirkman, P., & Jackson, R. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117182 · Cited by 56
Health Services Utilization Reporting in Respiratory Patients
Ungar, W. J., Coyte, P. C., & The (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00117-6 · Cited by 52
Feasibility of validating survey self‐reports of mental health service use
Golding, J. M., Gongla, P. A., & Brownell, A. (1988) · American Journal of Community Psychology · doi:10.1007/bf00906071 · Cited by 50
Patient-reported use of health service resources compared with information from health providers
Richards, S. H., Coast, J., & Peters, T. J. (2003) · Health & Social Care in the Community · doi:10.1046/j.1365-2524.2003.00457.x · Cited by 50
Kashner, T. M., Suppes, T. M., Rush, A. J., & Altshuler, K. Z. (1999) · Evaluation and Program Planning · doi:10.1016/s0149-7189(98)00038-x · Cited by 42
The Validity of Survey Data on Utilization of Health and Social Services Among the Very Old
Carsjö, K., Thorslund, M., & Wärneryd, B. (1994) · Journal of Gerontology · doi:10.1093/geronj/49.3.s156 · Cited by 38
Resource use data by patient report or hospital records: Do they agree?
Kennedy, A. D. M., Brown, A., Torgerson, D. J., Campbell, J., & Grant, A. (2002) · BMC Health Services Research · doi:10.1186/1472-6963-2-2 · Cited by 33
Law, M. G., Hurley, S. F., Carlin, J. B., Chondros, P., Gardiner, S., & Kaldor, J. M. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00141-2 · Cited by 26
Marshall, S. F. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg256 · Cited by 24
A Comparison of Response Error by Adolescents and Adults: Findings From a Health Care Study
Mathiowetz, N. A., & Dipko, S. (2000) · Medical Care · doi:10.1097/00005650-200004000-00004 · Cited by 20
Accuracy of self-reported healthcare use in patients with osteoarthritis.
Cronan, T. A., & Walen, H. R. (2002) · PubMed · Cited by 18
Are survey measures of medical careutilisation misleading?
Marshall, R., Grayson, D. A., Jorm, A. F., & O’Toole, B. I. (2001) · Australian Health Review · doi:10.1071/ah010091 · Cited by 17
Marks, A. S., Lee, D. W., Slezak, J., Berger, J. E., Patel, H., & Johnson, K. E. (2003) · Disease Management · doi:10.1089/109350703322682513 · Cited by 16
Validating Self-Reports of Mental Health Service Use in a Chronic Population
Hennessy, K. D., & Reed, S. K. (1992) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199206000-00011 · Cited by 15
The Validity of Self-Reports of Physician Use Among the Older Population
Schmitz, M. F., Russell, D. W., & Cutrona, C. E. (2002) · Journal of Applied Gerontology · doi:10.1177/07364802021002005 · Cited by 13
The effect of age and chronicity on patient recall of public hospital outpatient clinic use
Grimmer, K. A., & Bowman, P. (1997) · Australian Health Review · doi:10.1071/ah970078 · Cited by 6
Cited by
Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Economic Burden of Childhood Autism Spectrum Disorders
Lavelle, T. A., Weinstein, M. C., Newhouse, J. P., Munir, K., Kuhlthau, K. A., & Prosser, L. A. (2014) · Pediatrics · doi:10.1542/peds.2013-0763 · Cited by 489
González-Bueso, V., Santamaría, J., Fernández, D., Merino, L., Montero, E., & Ribas, J. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15040668 · Cited by 487
Annual Healthcare Spending Attributable to Cigarette Smoking
Xu, X., Bishop, E. E., Kennedy, S. M., Simpson, S. A., & Pechacek, T. F. (2015) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.10.012 · Cited by 435
Short, M. E., Goetzel, R. Z., Pei, X., Tabrizi, M. J., Ozminkowski, R. J., Gibson, T. B., DeJoy, D. M., & Wilson, M. G. (2009) · Journal of Occupational & Environmental Medicine · doi:10.1097/jom.0b013e3181a86671 · Cited by 433
Metadata
- Authors
- Bhandari, A., & Wagner, T.
- Venue
- Medical Care Research and Review
- Publisher
- SAGE Publications
- Published
- 2006-04
- Volume
- 63
- Issue
- 2
- Pages
- 217-235
- ISSN
- 1077-5587 (ISSN-L)
- 1552-6801
- OpenAlex
- W2075240722
- Cited by
- 740
- References
- 61
- FWCI
- 42.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.