How accurate are self-reports? Analysis of self-reported health care utilization and absence when compared with administrative data
Open accessAbstract
OBJECTIVE: To determine the accuracy of self-reported health care utilization and absence reported on health risk assessments against administrative claims and human resource records. METHODS: Self-reported values of health care utilization and absenteeism were analyzed for concordance to administrative claims values. Percent agreement, Pearson's correlations, and multivariate logistic regression models examined the level of agreement and characteristics of participants with concordance. RESULTS: Self-report and administrative data showed greater concordance for monthly compared with yearly health care utilization metrics. Percent agreement ranged from 30% to 99% with annual doctor visits having the lowest percent agreement. Younger people, males, those with higher education, and healthier individuals more accurately reported their health care utilization and absenteeism. CONCLUSIONS: Self-reported health care utilization and absenteeism may be used as a proxy when medical claims and administrative data are unavailable, particularly for shorter recall periods.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Health economic evaluations of ACT and other third-wave cognitive behavioral therapies are remarkably scarce.
“Health economic evaluations of ACT and other third-wave cognitive behavioral therapies are remarkably scarce given the growing body of evidence in support of their clinical effectiveness [49].”
From Cost-effectiveness and cost-utility of an Acceptance and Commitment Therapy intervention vs. a Cognitive Behavioral Therapy intervention for older adults with anxiety symptoms: A randomized controlled trial (2022) · cites this paper as [49]
The Conclusions/Implications for Action discuss the accuracy of self-reported healthcare use and the cost-effectiveness of survey versus administrative data collection. Searches for ACT, third-wave cognitive behavioral therapies, and their economic evaluations found no passage addressing whether such evaluations are scarce. No page numbers are available in our copy. (LLM, conf=0.75)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742 · see citing works
How to measure comorbiditya critical review of available methods
DEGROOT, V, BECKERMAN, H., LANKHORST, G., & BOUTER, L. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00585-1 · Cited by 1,757 · see citing works
The World Health Organization Health and Work Performance Questionnaire (HPQ)
Kessler, R. C., Barber, C., Beck, A. L., Berglund, P. A., Cleary, P. D., McKenas, D. K., Pronk, N., Simon, G. E., Stang, P., Üstün, T. B., et al. (2003) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000052967.43131.51 · Cited by 1,135 · see citing works
Self-Reported Utilization of Health Care Services: Improving Measurement and Accuracy
Bhandari, A., & Wagner, T. H. (2006) · Medical Care Research and Review · doi:10.1177/1077558705285298 · Cited by 732 · see citing works
Self-reports of health care utilization compared to provider records
Ritter, P. L., Stewart, A. L., Kaymaz, H., Sobel, D. S., Block, D. A., & Lorig, K. R. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00261-4 · Cited by 401 · see citing works
Quesenberry, C. P., Caan, B. J., & Jacobson, A. S. (1998) · Archives of Internal Medicine · doi:10.1001/archinte.158.5.466 · Cited by 394 · see citing works
Newell, S. A., Girgis, A., Sanson-Fisher, R. W., & Savolainen, N. J. (1999) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00069-0 · Cited by 379 · see citing works
Comparison of self-reported and medical record health care utilization measures
Roberts, R. O., Bergstralh, E. J., Schmidt, L., & Jacobsen, S. J. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00143-6 · Cited by 358 · see citing works
Mammography use among sociodemographically diverse women: the accuracy of self-report.
Zapka, J. G., Bigelow, C., Hurley, T. G., Ford, L., Egelhofer, J., Cloud, W. M., & Sachsse, E. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.7.1016 · Cited by 249 · see citing works
Health Services Use and Health Care Costs of Obese and Nonobese Individuals
Raebel, M. A., Malone, D. C., Conner, D. A., Xu, S., Porter, J. A., & Lanty, F. A. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.19.2135 · Cited by 237 · see citing works
Accuracy of Self-Reported Health Services Use and Patterns of Care Among Urban Older Adults
Wallihan, D. B., Stump, T. E., & Callahan, C. M. (1999) · Medical Care · doi:10.1097/00005650-199907000-00006 · Cited by 216 · see citing works
A Review of Health-Related Work Outcome Measures and Their Uses, and Recommended Measures
Amick, B. C., Lerner, D., Rogers, W. H., Rooney, T., & Katz, J. N. (2000) · Spine · doi:10.1097/00007632-200012150-00010 · Cited by 212 · see citing works
Agreement between Self‐reported and Routinely Collected Health‐care Utilization Data among Seniors
Raina, P. S., Torrance-Rynard, V., Wong, M., & Woodward, C. A. (2002) · Health Services Research · doi:10.1111/1475-6773.00047 · Cited by 180 · see citing works
Hiatt, R. A., Pérez‐Stable, E. J., Quesenberry, C. P., Sabogal, F., Otero‐Sabogal, R., & McPhee, S. J. (1995) · Preventive Medicine · doi:10.1006/pmed.1995.1045 · Cited by 176 · see citing works
Reijneveld, S. A., & Stronks, K. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.6.1407 · Cited by 174 · see citing works
The Validity of Self-reported Physician Utilization Measures
Cleary, P. D., & Jette, A. M. (1984) · Medical Care · doi:10.1097/00005650-198409000-00003 · Cited by 163 · see citing works
THE ACCURACY OF SELF-REPORTED HEALTHCARE RESOURCE UTILIZATION IN HEALTH ECONOMIC STUDIES
Petrou, S., Murray, L., Cooper, P., & Davidson, L. L. (2002) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230200051x · Cited by 154 · see citing works
The Accuracy of Self-Reported Disability Days
Revicki, D. A., IRWIN, D., Reblando, J. A., & SIMON, G. E. (1994) · Medical Care · doi:10.1097/00005650-199404000-00008 · Cited by 137 · see citing works
Self‐reported use of mental health services versus administrative records: care to recall?
Rhodes, A. E., & Fung, K. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.172 · Cited by 120 · see citing works
The accuracy of self-reported Pap smear utilisation
Bowman, J., Sanson‐Fisher, R., & Redman, S. (1997) · Social Science & Medicine · doi:10.1016/s0277-9536(96)00222-5 · Cited by 108 · see citing works
Using Average Cost Methods to Estimate Encounter-Level Costs for Medical-Surgical Stays in the VA
Wagner, T. H., Chen, S., & Barnett, P. G. (2003) · Medical Care Research and Review · doi:10.1177/1077558703256485 · Cited by 103 · see citing works
Design Characteristics of Worksite Environmental Interventions for Obesity Prevention
PRATT, C. A., Lemon, S. C., Fernandez, I. D., Goetzel, R. Z., Beresford, S. A. A., French, S. A., Stevens, V. J., VOGT, T. M., & Webber, L. S. (2007) · Obesity · doi:10.1038/oby.2007.258 · Cited by 101 · see citing works
Self-citationDisparities in preventive procedures: comparisons of self-report and Medicare claims data
Fiscella, K. A., Holt, K. D., Meldrum, S. C., & Franks, P. J. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-122 · Cited by 94 · see citing works
Comparison of survey and physician claims data for detecting hypertension
Muhajarine, N., Mustard, C., Roos, L. L., Young, T. K., & Gelskey, D. E. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00019-x · Cited by 92 · see citing works
Recall Strategies and Memory for Health-Care Visits
Jobe, J. B., White, A. A., Kelley, C. L., Mingay, D. J., Sanchez, M. J., & Loftus, E. F. (1990) · Milbank Quarterly · doi:10.2307/3350095 · Cited by 86 · see citing works
The cross-cultural validity of self-reported use of health care
Reijneveld, S. A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00138-9 · Cited by 83 · see citing works
The validity of self-reported diabetes quality of care measures
Fowles, J., Rosheim, K., Fowler, E., Craft, C., & Arrichiello, L. (1999) · International Journal for Quality in Health Care · doi:10.1093/intqhc/11.5.407 · Cited by 83 · see citing works
Self‐reported use of mental health services versus administrative records: should we care?
Rhodes, A. E., Lin, E. H. B., & Mustard, C. (2002) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.130 · Cited by 78 · see citing works
Medicare Current Beneficiary Survey
(2016) · Cited by 76 · see citing works
Duration of work disability: A comparison of self-report and administrative data
Pole, J. D., Franche, R., Hogg‐Johnson, S., Vidmar, M., & Krause, N. (2006) · American Journal of Industrial Medicine · doi:10.1002/ajim.20300 · Cited by 55 · see citing works
Beckles, G. L., Williamson, D. F., Brown, A. F., Gregg, E. W., Karter, A. J., Kim, C., Dudley, R. A., Safford, M. M., Stevens, M. R., & Thompson, T. J. (2007) · Medical Care · doi:10.1097/mlr.0b013e3180ca95fa · Cited by 49 · see citing works
Is Disability Underreported Following Work Injury?
Evanoff, B., Abedin, S., Grayson, D., Dale, A. M., Wolf, L., & Bohr, P. C. (2002) · Journal of Occupational Rehabilitation · doi:10.1023/a:1016838510682 · Cited by 46 · see citing works
Wilson, M. G., Goetzel, R. Z., Ozminkowski, R. J., DeJoy, D. M., Della, L. J., Roemer, E. C., Schneider, J., Tully, K. J., White, J. M., & Baase, C. M. (2007) · Obesity · doi:10.1038/oby.2007.386 · Cited by 44 · see citing works
Self-citationCost Implications for the Use of Inhaled Anti-Inflammatory Medications in the Treatment of Asthma
Ozminkowski, R. J., Wang, S. S., Marder, W. D., et al. (2000) · PharmacoEconomics · doi:10.2165/00019053-200018030-00005 · Cited by 24 · see citing works
Self-citationMarshall, S. F. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg256 · Cited by 23 · see citing works
Cláudio, L., Bearer, C. F., & Wallinga, D. B. (1999) · American Journal of Industrial Medicine · doi:10.1002/(sici)1097-0274(199906)35:6 · Cited by 20 · see citing works
Accuracy of self-reported healthcare use in patients with osteoarthritis.
Cronan, T. A., & Walen, H. R. (2002) · PubMed · Cited by 18 · see citing works
Research Note: Reliability of Self-Report Sickness Absence Data in the Health Service
Rees, D., & Cooper, C. L. (1993) · Health Services Management Research · doi:10.1177/095148489300600208 · Cited by 16 · see citing works
Ozminkowski, R. J., Wang, S. S., Marder, W. D., et al. (2000) · Value in Health · doi:10.1046/j.1524-4733.2000.36013.x · Cited by 6 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [13]Dasinger LK Krause N Deegan LJ Brand RJ Rudolph L Duration of work disability after low back injury: a comparison of administrative and self-reported outcomes Am J Ind Med 1999 35 619 631 10332515
Cited by
Sorted by citations
Rayner, L., Hotopf, M., Petkova, H., Matcham, F., Simpson, A., & McCracken, L. M. (2016) · Pain · doi:10.1097/j.pain.0000000000000542 · Cited by 290 · see citing works
KORA Study Group, Hunger, M., Schwarzkopf, L., Heier, M., Peters, A., & Holle, R. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-1 · Cited by 261 · see citing works
Online health research and health anxiety: A systematic review and conceptual integration.
Brown, R. J., Skelly, N., & Chew-Graham, C. A. (2020) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12299 · Cited by 140 · see citing works
Witlox, M., Kraaij, V., Garnefski, N., Bohlmeijer, E., Smit, F., & Spinhoven, P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262220 · Cited by 31 · see citing works
- Authors
- Short, M. E., Goetzel, R. Z., Pei, X., Tabrizi, M. J., Ozminkowski, R. J., Gibson, T. B., DeJoy, D. M., & Wilson, M. G.
- Affiliations
- Emory University (US)
- Corresponding author
- Goetzel, Ron Z.
- Venue
- Journal of Occupational & Environmental Medicine
- Published
- 2009-07
- Volume
- 51
- Issue
- 7
- Pages
- 786-796
- ISSN
- 1076-2752 (ISSN-L)
- PMC
- PMC2745402
- OpenAlex
- W1977234765
- Cited by
- 433
- References
- 39
- Citations by year
- 2026: 18 · 2025: 31 · 2024: 38 · 2023: 42 · 2022: 48 · 2021: 36 · 2020: 40 · 2019: 33 · 2018: 49 · 2017: 16 · 2016: 18 · 2015: 17 · 2014: 12 · 2013: 13 · 2012: 8
- FWCI
- 13.28
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Occupational and Environmental Medicine (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Dow Chemical Company
- National Heart, Lung, and Blood Institute (R01HL079546)
- Topics
- Health Sciences › Health Professions › General Health Professions › Workplace Health and Well-being
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Health Professions › Occupational Therapy › Occupational Health and Safety in Workplaces
- Keywords
- self-report accuracy, health care utilization, absenteeism, health risk assessment, administrative claims data, concordance, recall period, proxy data
- MeSH terms
- Absenteeism, Adult, Cross-Sectional Studies, Delivery of Health Care, Female, Humans, Male, Middle Aged, Self Disclosure, Reproducibility of Results, Confidence Intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
