Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium
Open accessAbstract
Background: Health administrative data are frequently used for health services and population health research. Comparative research using these data has been facilitated by the use of a standard system for coding diagnoses, the International Classification of Diseases (ICD). Research using the data must deal with data quality and validity limitations which arise because the data are not created for research purposes. This paper presents a list of high-priority methodological areas for researchers using health administrative data. Methods: A group of researchers and users of health administrative data from Canada, the United States, Switzerland, Australia, China and the United Kingdom came together in June 2005 in Banff, Canada to discuss and identify high-priority methodological research areas. The generation of ideas for research focussed not only on matters relating to the use of administrative data in health services and population health research, but also on the challenges created in transitioning from ICD-9 to ICD-10. After the brain-storming session, voting took place to rank-order the suggested projects. Participants were asked to rate the importance of each project from 1 (low priority) to 10 (high priority). Average ranks were computed to prioritise the projects. Results: Thirteen potential areas of research were identified, some of which represented preparatory work rather than research per se. The three most highly ranked priorities were the documentation of data fields in each country's hospital administrative data (average score 8.4), the translation of patient safety indicators from ICD-9 to ICD-10 (average score 8.0), and the development and validation of algorithms to verify the logic and internal consistency of coding in hospital abstract data (average score 7.0). Conclusion: The group discussions resulted in a list of expert views on critical international priorities for future methodological research relating to health administrative data. The consortium's members welcome contacts from investigators involved in research using health administrative data, especially in cross-jurisdictional collaborative studies or in studies that illustrate the application of ICD-10.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Routinely collected health data are increasingly used for research.
“Routinely collected health data, obtained for administrative and clinical purposes without specific a priori research goals, are increasingly used for research.”
From The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. (2015) · cites this paper as [3]
Governments and funding agencies have prioritized use of routinely collected health data as tools to improve patient care, transform health research, and improve health care efficiency.
“Internationally, governments and funding agencies have prioritized use of routinely collected health data as tools to improve patient care, transform health research, and improve health care efficiency [3].”
From The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. (2015) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669 · see citing works
Self-citationCanadian Institute for Health Information.
Lalonde, A. (1994) · PubMed · Cited by 4,730 · see citing works
New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality
Sundararajan, V., Henderson, T., Perry, C., Muggivan, A., Quan, H., & Ghali, W. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.012 · Cited by 2,439 · see citing works
Self-citationSmall Area Variations in Health Care Delivery
Wennberg, J. E., & Gittelsohn, A. M. (1973) · Science · doi:10.1126/science.182.4117.1102 · Cited by 1,891 · see citing works
Hux, J. E., Ivis, F. J., Flintoft, V. F., & Bica, A. (2002) · Diabetes Care · doi:10.2337/diacare.25.3.512 · Cited by 1,290 · see citing works
Bernstein, C. N., Blanchard, J., Rawsthorne, P. E., & Wajda, A. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009735 · Cited by 661 · see citing works
Imaging Studies for Low Back Pain
Clearingh, N. Q. M., & Agency for Healthcare Research and (2008) · Journal of Pain & Palliative Care Pharmacotherapy · doi:10.1080/15360280802537332 · Cited by 653 · see citing works
Influence of Hospital Procedure Volume on Outcomes Following Surgery for Colon Cancer
Schrag, D. (2000) · JAMA · doi:10.1001/jama.284.23.3028 · Cited by 494 · see citing works
Awareness, Treatment, and Control of Hypertension in Canada
Joffres, M. (1997) · American Journal of Hypertension · doi:10.1016/s0895-7061(97)00224-0 · Cited by 350 · see citing works
Severity-Adjusted Mortality and Length of Stay in Teaching and Nonteaching Hospitals
Rosenthal, G. E. (1997) · JAMA · doi:10.1001/jama.1997.03550060061037 · Cited by 290 · see citing works
Administrative Data for Public Health Surveillance and Planning
Virnig, B. A., & McBean, M. (2001) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.22.1.213 · Cited by 259 · see citing works
Comparison of 2 Methods for Calculating Adjusted Survival Curves From Proportional Hazards Models
Ghali, W. A. (2001) · JAMA · doi:10.1001/jama.286.12.1494 · Cited by 254 · see citing works
Self-citationCongestive Heart Failure in the United States
Goff, D. C., Pandey, D. K., Chan, F. A., Ortiz, C., & Nichaman, M. Z. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.2.197 · Cited by 221 · see citing works
Using Medicare Claims for Outcomes Research
Mitchell, J. B., Bubolz, T. A., Paul, J. E., Pashos, C. L., Escarce, J. J., Muhlbaier, L. H., Wiesman, J., Young, W. W., Epstein, R. M., & Javitt, J. C. (1994) · Medical Care · doi:10.1097/00005650-199407001-00004 · Cited by 175 · see citing works
Asch, S. M. (2000) · JAMA · doi:10.1001/jama.284.18.2325 · Cited by 170 · see citing works
Roos, L. L., Roos, N. P., Cageorge, S. M., & Nicol, J. P. (1982) · Medical Care · doi:10.1097/00005650-198203000-00003 · Cited by 162 · see citing works
Self-citationAnalysis of Automated Administrative and Survey Databases to Study Patterns and Outcomes of Care
Deyo, R. A., Taylor, V. M., Diehr, P. K., Conrad, D. A., Cherkin, D. C., Ciol, M. A., & Kreuter, W. (1994) · Spine · doi:10.1097/00007632-199409151-00011 · Cited by 81 · see citing works
Hamilton, W. T., Round, A., Sharp, D., & Peters, T. J. (2003) · Europe PMC (PubMed Central) · Cited by 47 · see citing works
Surveillance of major causes of hospitalization among the elderly, 1988.
May, D. S., Kelly, J. J., Mendlein, J. M., et al. (1991) · PubMed · Cited by 39 · see citing works
A survey to identify the clinical coding and classification systems currently in use across Europe.
de Lusignan, S., Minmagh, C., Kennedy, J., Zeimet, M., Bommezijn, H., & Bryant, J. (2001) · PubMed · Cited by 39 · see citing works
Brouch, K. L. (2000) · PubMed · Cited by 13 · see citing works
Hamilton, W. T., Round, A., Sharp, D., & Peters, T. J. (2004) · Cited by 5 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Agency for Healthcare Research and Quality 21923316
Cited by
Sorted by citations
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749 · see citing works
Benchimol, E. I., Manuel, D. G., To, T., Griffiths, A. M., Rabeneck, L., & Guttmann, A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.10.006 · Cited by 368 · see citing works
- Authors
- De Coster, C., Quan, H., Finlayson, A., Gao, M., Halfon, P., Humphries, K. H., Johansen, H., Lix, L. M., Luthi, J.-C., Ma, J., Romano, P. S., Roos, L., Sundararajan, V., Tu, J. V., Webster, G., & Ghali, W. A.
- Affiliations
- University of Calgary (CA)
- University of Lausanne (CH)
- University of British Columbia (CA)
- Statistics Canada (CA)
- University of Manitoba (CA)
- University of California, Davis (US)
- Services Australia (AU)
- Sunnybrook Health Science Centre (CA)
- Canadian Institute for Health Information (CA)
- ORCID
- Venue
- BMC Health Services Research
- Published
- 2006-12
- Volume
- 6
- Issue
- 1
- Pages
- 77-77
- ISSN
- 1472-6963 (ISSN-L)
- PMC
- PMC1513221
- OpenAlex
- W1823858897
- Cited by
- 167
- References
- 23
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 7 · 2023: 4 · 2022: 8 · 2021: 11 · 2020: 8 · 2019: 10 · 2018: 12 · 2017: 5 · 2016: 10 · 2015: 10 · 2014: 8 · 2013: 12 · 2012: 12
- FWCI
- 17.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Health Services Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- TSpace (University of Toronto) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- SERVAL (Université de Lausanne) (submittedVersion, other-oa)
- Funders
- Health Canada
- Canadian Institutes of Health Research
- Institute of Health Services and Policy Research
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
- Keywords
- administrative health data, ICD-9-CM, ICD-10, research priorities, patient safety indicators, data quality, international research consortium
- MeSH terms
- Algorithms, Australia, Canada, China, Chronic Disease, Disease, Forms and Records Control, United Kingdom, Health Priorities, Health Services Research, Humans, International Cooperation, Medical Record Administrators, Quality of Health Care, Switzerland, United States, Waiting Lists, Comorbidity, International Classification of Diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
