The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Official statistics and claims data records indicate non-response and recall bias within survey-based estimates of health care utilization in the older population
Open accessAbstract
BACKGROUND: The validity of survey-based health care utilization estimates in the older population has been poorly researched. Owing to data protection legislation and a great number of different health care insurance providers, the assessment of recall and non-response bias is challenging to impossible in many countries. The objective of our study was to compare estimates from a population-based study in older German adults with external secondary data. METHODS: We used data from the German KORA-Age study, which included 4,127 people aged 65-94 years. Self-report questions covered the utilization of long-term care services, inpatient services, outpatient services, and pharmaceuticals. We calculated age- and sex-standardized mean utilization rates in each domain and compared them with the corresponding estimates derived from official statistics and independent statutory health insurance data. RESULTS: The KORA-Age study underestimated the use of long-term care services (-52%), in-hospital days (-21%) and physician visits (-70%). In contrast, the assessment of drug consumption by postal self-report questionnaires yielded similar estimates to the analysis of insurance claims data (-9%). CONCLUSION: Survey estimates based on self-report tend to underestimate true health care utilization in the older population. Direct validation studies are needed to disentangle the impact of recall and non-response bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Existing literature on the benefits of electronic records is largely U.S or primary care based [18–34] and reports ‘potential’ rather than actual benefits; with a large proportion of this evidence reporting the potential for electronic records to improve patient safety [19, 21, 23, 27–30].”
From Exploring the implementation of an electronic record into a maternity unit: a qualitative study using Normalisation Process Theory (2017) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz
(2013) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/103.1437-1588 · Cited by 11,769
A review of uses of health care utilization databases for epidemiologic research on therapeutics
Schneeweiß, S., & Avorn, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.012 · Cited by 1,290
Self-Reported Utilization of Health Care Services: Improving Measurement and Accuracy
Bhandari, A., & Wagner, T. H. (2006) · Medical Care Research and Review · doi:10.1177/1077558705285298 · Cited by 754
KORA - A Research Platform for Population Based Health Research
Holle, R., Happich, M., Löwel, H., & Wichmann, H. ‐. (2005) · Das Gesundheitswesen · doi:10.1055/s-2005-858235 · Cited by 753
Self-citationNon-response and related factors in a nation-wide health survey
Korkeila, K., Suominen, S., Ahvenainen, J., Ojanlatva, A., Rautava, P. T., Helenius, H. Y. M., & Koskenvuo, M. (2001) · European Journal of Epidemiology · doi:10.1023/a:1020016922473 · Cited by 512
Short, M. E., Goetzel, R. Z., Pei, X., Tabrizi, M. J., Ozminkowski, R. J., Gibson, T. B., DeJoy, D. M., & Wilson, M. G. (2009) · Journal of Occupational & Environmental Medicine · doi:10.1097/jom.0b013e3181a86671 · Cited by 433
Self-reports of health care utilization compared to provider records
Ritter, P. L., Stewart, A. L., Kaymaz, H., Sobel, D. S., Block, D. A., & Lorig, K. R. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00261-4 · Cited by 401
Validation of pharmacy records in drug exposure assessment
Lau, H. S., de Boer, A., Beuning, K. S., & Porsius, A. J. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00040-1 · Cited by 371
Comparison of self-reported and medical record health care utilization measures
Roberts, R. O., Bergstralh, E. J., Schmidt, L., & Jacobsen, S. J. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00143-6 · Cited by 358
Hoffmann, F., & Icks, A. (2011) · Das Gesundheitswesen · doi:10.1055/s-0031-1275711 · Cited by 280
Suhrcke, M., Rocco, L., McKee, M., Mazzuco, S., Urban, D., & Steinherr, A. (2007) · UEA Digital Repository (University of East Anglia) · Cited by 254
Accuracy of Self-Reported Health Services Use and Patterns of Care Among Urban Older Adults
Wallihan, D. B., Stump, T. E., & Callahan, C. M. (1999) · Medical Care · doi:10.1097/00005650-199907000-00006 · Cited by 216
Drivsholm, T., Eplov, L. F., Davidsen, M., Jørgensen, T., Ibsen, H., Hollnagel, H., & Borch‐Johnsen, K. (2006) · Scandinavian Journal of Public Health · doi:10.1080/14034940600607616 · Cited by 172
Abbas, S., Ihle, P., Köster, I., & Schübert, I. (2011) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2011.09.041 · Cited by 164
Hunger, M., Thorand, B., Schunk, M., Döring, A., Menn, P., Peters, A., & Holle, R. (2011) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-9-53 · Cited by 154
Self-citationSocial Insurance for Long‐term Care: An Evaluation of the German Model
Rothgang, H. (2010) · Social Policy and Administration · doi:10.1111/j.1467-9515.2010.00722.x · Cited by 151
Patient Self-Reports in Pharmacoeconomic Studies
Evans, C., & Crawford, B. (1999) · PharmacoEconomics · doi:10.2165/00019053-199915030-00004 · Cited by 136
Lorant, V., Demarest, S. S., Miermans, P.-J., & Oyen, H. J. V. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym191 · Cited by 135
Demografischer Wandel und Krankheitshäufigkeiten
Peters, E., Pritzkuleit, R., Beske, F., & Katalinic, A. (2010) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-010-1050-y · Cited by 110
Lamers, L. M., & van Vliet, R. C. J. A. (2003) · Health Policy · doi:10.1016/j.healthpol.2003.09.001 · Cited by 104
Noïze, P., Bazin, F., Dufouil, C., Lechevallier‐Michel, N., Ancelin, M., Dartigues, J., Tzourio, C., Moore, N. D., & Fourrier‐Réglat, A. (2009) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1717 · Cited by 103
Nielsen, M. W., Søndergaard, B., Kjøller, M., & Hansen, E. H. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.021 · Cited by 90
(2010) · Springer eBooks · doi:10.1007/978-3-642-13380-0 · Cited by 86
Schwarzkopf, L., Menn, P., Leidl, R., Wunder, S., Mehlig, H., Marx, P., Graessel, E., & Holle, R. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-165 · Cited by 74
Self-citationSchwabe, U., & Paffrath, D. (2008) · Springer eBooks · doi:10.1007/978-3-540-72548-0 · Cited by 65
Glandon, G. L., Counte, M. A., & Tancredi, D. J. (1992) · Journal of Gerontology · doi:10.1093/geronj/47.5.s245 · Cited by 62
Assessment and Control of Nonresponse Bias in a Survey of Medicine Use by the Elderly
Grotzinger, K. M., Stuart, B., & Ahern, F. M. (1994) · Medical Care · doi:10.1097/00005650-199410000-00002 · Cited by 60
A descriptive review of the methodologies used in household surveys on medicine utilization
Bertoldi, A. D., Barros, A. J. D., Wagner, A. K., Ross‐Degnan, D., & Hallal, P. C. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-222 · Cited by 60
Prolonged Recruitment Efforts in Health Surveys
Holle, R., Hochadel, M., Reitmeir, P., Meisinger, C., & Wichmann, H. ‐. (2006) · Epidemiology · doi:10.1097/01.ede.0000239731.86975.7f · Cited by 59
Self-citationGundgaard, J., Ekholm, O., Hansen, E. H., & Rasmussen, N. K. (2007) · European Journal of Public Health · doi:10.1093/eurpub/ckm103 · Cited by 52
Service Utilization and Health-Care Costs in the Advanced Elderly
Heinrich, S., Luppa, M., Matschinger, H., Angermeyer, M. C., Riedel-Heller, S. G., & König, H. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00285.x · Cited by 51
Lacruz, M. E., Emeny, R. T., Bickel, H., Cramer, B., Kurz, A., Bidlingmaier, M., Huber, D., Klug, G., Peters, A., & Ladwig, K. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-36 · Cited by 48
Self-citationRelationship between multimorbidity and direct healthcare costs in an advanced elderly population
Nagl, A., Witte, J., Hodek, J.-M., & Greiner, W. (2012) · Zeitschrift für Gerontologie und Geriatrie · doi:10.1007/s00391-011-0266-2 · Cited by 44
Knies, G., Burton, J., & Sala, E. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-52 · Cited by 41
Diabetes Epidemic’ in Germany? A Critical Look at Health Insurance Data Sources
Hoffmann, F., & Icks, A. (2012) · Experimental and Clinical Endocrinology & Diabetes · doi:10.1055/s-0032-1306331 · Cited by 34
Erfahrungen mit der Datenverknüpfung von Primär- und Sekundärdaten in einer Interventionsstudie
Swart, E., Thomas, D., March, S., Salomon, T., & Knesebeck, O. V. D. (2011) · Das Gesundheitswesen · doi:10.1055/s-0031-1280754 · Cited by 28
Lacruz, M. E., Emeny, R. T., Häfner, S., Zimmermann, A.-K., Linkohr, B., Holle, R., & Ladwig, K. (2011) · Age and Ageing · doi:10.1093/ageing/afr162 · Cited by 27
Self-citationWerner, A., Reitmeir, P., & John, J. (2005) · Das Gesundheitswesen · doi:10.1055/s-2005-858261 · Cited by 20
Self-reported diabetes is associated with self-management behaviour: a cohort study
Shah, B. R., & Manuel, D. G. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-142 · Cited by 17
Küpper-Nybelen, J., Ihle, P., Deetjen, W., & Schübert, I. (2006) · Zeitschrift für Gerontologie und Geriatrie · doi:10.1007/s00391-006-0369-3 · Cited by 12
Research works printed but not linked: 6
- John J, Holle R: [Problems of buildling up and using statutory health insurance data for population-based economic evaluation studies: Experiences from KORA]. Informatik, Biometrie und Epidemiologie in Medizin und Biologie. 2003, 34 (2): 96-111.
- Busse R, Riesberg A: Health Care Systems in Transition: Germany. 2004, Copenhagen: WHO Regional Office for Europe on behalf of the European Observatory on Health Systems and Policies
- Bavarian Office for Statistics and Data Processing: Statistische Berichte. Pflegeeinrichtungen, ambulante sowie stationäre und Pflegegeldempfänger in Bayern. Ergebnisse der Pflegestatistik 2006. 2007, Munich
- Bavarian Office for Statistics and Data Processing: Statistische Berichte. Pflegeeinrichtungen, ambulante sowie stationäre und Pflegegeldempfänger in Bayern. Ergebnisse der Pflegestatistik 2009. 2010, Munich
- Grobe TG, Dörning H, Schwartz FW: GEK-Report ambulant-ärztliche Versorgung 2007. 2007, St. Augustin: Asgard Verlag
- Bitzer EM, Grobe TG, Dörning H, Schwartz FW: GEK-Report akut-stationäre Versorgung 2007. 2007, St. Augustin: Asgard Verlag
Cited by
Sorted by citations
Noordegraaf, M. (2015) · Journal of Professions and Organization · doi:10.1093/jpo/jov002 · Cited by 525
Santos, S. D., Adams, E. A., Neville, G., Wada, Y., de Sherbinin, A., Bernhardt, E. M., & Adamo, S. B. (2017) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2017.06.157 · Cited by 381
Graessel, E., Berth, H., Lichte, T., & Grau, H. (2014) · BMC Geriatrics · doi:10.1186/1471-2318-14-23 · Cited by 245
El-Hayek, Y. H., Wiley, R. E., Khoury, C. P., Daya, R. P., Ballard, C., Evans, A. R., Karran, M., Molinuevo, J. L., Norton, M., & Atri, A. (2019) · Journal of Alzheimer's Disease · doi:10.3233/jad-190426 · Cited by 216
Status of patient safety culture in Arab countries: a systematic review
Elmontsri, M., Almashrafi, A., Banarsee, R., & Majeed, A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013487 · Cited by 168
Metadata
- Authors
- KORA Study Group, Hunger, M., Schwarzkopf, L., Heier, M., Peters, A., & Holle, R.
- Affiliations
- Helmholtz Munich (DE)
- Venue
- BMC Health Services Research
- Published
- 2013-01-03
- Volume
- 13
- Issue
- 1
- Pages
- 1-1
- ISSN
- 1472-6963 (ISSN-L)
- PMC
- PMC3545728
- OpenAlex
- W2032279019
- Cited by
- 261
- References
- 40
- Citations by year
- 2026: 7 · 2025: 20 · 2024: 27 · 2023: 14 · 2022: 20 · 2021: 30 · 2020: 15 · 2019: 23 · 2018: 23 · 2017: 30 · 2016: 23 · 2015: 15 · 2014: 13 · 2013: 1
- FWCI
- 53.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Health Services Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Site cant be reached (submittedVersion, cc-by)
- Funders
- Bundesministerium für Bildung und Forschung (BMBF FKZ 01ET0713, FKZ 01ET0713, 01ET0713)
- Helmholtz Zentrum München (FKZ 01ET0713)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Studies
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- health care utilization, older adults, recall bias, nonresponse bias, survey validity, self-report questionnaire, long-term care, inpatient services, physician visits, drug use, health insurance claims, KORA-Age study
- MeSH terms
- Aged, Aged, 80 and over, Chronic Disease, Drug Utilization, Female, Germany, Health Services, Humans, Insurance Claim Review, Male, Mental Recall, Bias, Confidence Intervals, Odds Ratio, Sex Distribution, Health Care Surveys, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review