The DOI matches its Crossref record; 86 of the 88 references it cites were found in a registry or an index; 9 of the 52 sources its claims cite were checked for support.
The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement.
Open accessAbstract
Routinely collected health data, obtained for administrative and clinical purposes without specific a priori research goals, are increasingly used for research. The rapid evolution and availability of these data have revealed issues not addressed by existing reporting guidelines, such as Strengthening the Reporting of Observational Studies in Epidemiology (STROBE). The REporting of studies Conducted using Observational Routinely collected health Data (RECORD) statement was created to fill these gaps. RECORD was created as an extension to the STROBE statement to address reporting items specific to observational studies using routinely collected health data. RECORD consists of a checklist of 13 items related to the title, abstract, introduction, methods, results, and discussion section of articles, and other information required for inclusion in such research reports. This document contains the checklist and explanatory and elaboration information to enhance the use of the checklist. Examples of good reporting for each RECORD checklist item are also included herein. This document, as well as the accompanying website and message board (http://www.record-statement.org), will enhance the implementation and understanding of RECORD. Through implementation of RECORD, authors, journals editors, and peer reviewers can encourage transparency of research reporting.
Overview
CoChat Summary
TL;DR
RECORD is an extension to the STROBE statement created to improve reporting of observational studies using routinely collected health data. It provides a 13-item checklist plus explanatory and elaboration material with examples of good reporting.
Key findings
- RECORD addresses reporting gaps specific to routinely collected health data, including data type and database names in the title/abstract, geographic region and time frame, and whether linkage was performed.
- The checklist adds items on methods of population selection, validation of codes/algorithms, complete code lists for exposures/outcomes/confounders/effect modifiers, data access and cleaning, linkage methods and quality evaluation, study population selection, and accessibility of protocol/raw data/programming code.
- RECORD was developed through an international collaborative process involving more than 100 stakeholders, with two stakeholder surveys and a 19-member working committee that met in person.
- The statement includes explanatory text and examples for each RECORD item, and is intended to supplement, not replace, STROBE.
Methods
- Design: reporting guideline development and explanatory document, created as an extension to STROBE using established methods for developing health research reporting guidelines.
- Data/sample: input from more than 100 international stakeholders comprising researchers, journal editors, and consumers of data; examples of good reporting are drawn from published articles.
- Main analysis: consensus process with two stakeholder surveys to establish and prioritize themes, an in-person working committee to establish wording, stakeholder review and feedback, and final drafting by the steering committee with STROBE steering committee involvement.
Limitations
- The paper states that RECORD applies only to observational research; routinely collected health data are sometimes used in other designs, such as cluster-randomized trials or linkage of randomized trials to administrative data, which RECORD does not cover.
- The paper states that the field is changing rapidly, including mHealth apps and wearable technologies, and that RECORD focused on health data rather than all health-related data sources such as environmental or financial data, so revision may be necessary.
- The paper states that stakeholder representation was predominantly from regions conducting research using routinely collected health data, with only a few representatives from developing nations and non-English-speaking countries, and that statements were crafted by a smaller 19-member working committee.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
7 Valid · 0 Not valid · 30 Not checked · 20 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Routinely collected health data, obtained for administrative and clinical purposes without specific a priori research goals, are increasingly used for research.”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Abstract
What the sources say
- Supportedcites [3] C De Coster, 2006, Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium, BMC Health Serv Res source
The Background (p. 1) states that health administrative data 'are frequently used for health research in Canada and abroad' and that 'in the past two decades, such data have been widely employed by health services and population health researchers', supporting the increasing-use part of the claim; the Abstract Background and the Background (p. 2) state that validity limitations 'arise because the data are not created for research purposes' and that 'the data were created not for research but for other purposes', supporting the qualifier about non-research collection. This is a broad background attribution and our copy treats the topic in exactly that way. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It is important to state whether the validation occurred in a source or database population different from that selected for the present study, as codes may function differently in different populations or databases [36].”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Items in the RECORD Checklist > Methods (Participants)
What the sources say
- Partly supportedcites [36] L Marston, 2014, Smoker, ex-smoker or non-smoker? The validity of routinely recorded smoking status in UK primary care: a cross-sectional study, BMJ open sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) reports that smoking categories differed between the THIN primary-care database and the Health Survey for England, partly because smoking status was defined and ascertained differently. This supports caution about applying a validation across data sources, but the paper does not show that clinical codes function differently across coded databases or study populations. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“For example, the introduction of provider billing incentive codes may change the likelihood of a code being used over time [62,63].”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Items in the RECORD Checklist > Discussion (Limitations)
What the sources say
- Supportedcites [62] K McLintock, 2014, The effects of financial incentives for case finding for depression in patients with diabetes and coronary heart disease: interrupted time series analysis, BMJ open source
The Background (p.1) establishes that the QOF DEP1 indicator tied reimbursement to a designated clinical code ('A designated clinical code indicating the use of these questions was recorded in the patient record... Practices were reimbursed according to the proportion of patients with a record of case finding'), i.e. a provider billing incentive code. The Results (p.~3) then show that 'new coded case finding' rose sharply after initiation of the incentive (0.07 to 7.45/1000 per month in the targeted population, OR 99.76), with 'the exceptional rise in 2006 reflect[ing] first coding in patients with existing diagnoses'. The Methods (Data analysis) state the authors 'recognised that these trends could relate to changes in coding as well as clinical practice', and the Discussion attributes the immediate post-incentivisation spike in diagnoses to 'coding patterns', so the hedged claim that introducing such incentives may change the likelihood of a code being used over time is supported by our copy. (LLM, conf=0.85)
- Not checked yetcites [63] CS Brunt, 2011, CPT fee differentials and visit upcoding under Medicare Part B, Health economics source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A particular type of unmeasured confounding is confounding by indication; this is often an issue when examining effectiveness and safety of (drug) treatments using routinely collected data.”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Items in the RECORD Checklist > Discussion (Limitations)
What the sources say
- Supportedcites [72] N Freemantle, 2013, Making inferences on treatment effects from real world data: propensity scores, confounding by indication, and other perils for the unwary in observational research, BMJ source
The ‘Confounding by indication’ section defines it as an unmeasured process affecting who receives treatment. ‘When is it helpful to use a propensity score analysis?’ explains that this bias can mislead observational assessments of drug effects and potentially lead to patient harm, supporting the claim about effectiveness and safety analyses using routinely collected data. Page numbers are unavailable in our copy. (LLM, conf=0.90)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The REporting of studies Conducted using Observational Routinely collected health Data (RECORD) statement was created to fill these gaps.”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
18 more claims
Create a free account to see all 57 claims and to verify the 43 references still open.
- Probably not a substantial claim. 26
- It may state two separate claims as one. 13
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The study has been reported according to the STrengthening and Reporting of Observational Studies in Epidemiology (STROBE) statement guidelines [15], in accordance with the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) extension statement (S1 Table) [16].”
From Growth standard charts for monitoring bodyweight in dogs of different sizes (2017) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“The reporting is based on the RECORD guidelines for observational studies using routinely collected data [23].”
The cited source says what the claim attributes to it.
In the citing paper
“This study was conducted in line with RECORD (Reporting of Studies Conducted Using Observational Routinely Collected Data) guidelines.24”
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Another ecological study in the UK showed that lower area-level income was associated with greater area-level COVID-19 mortality(19).”
From Social inequalities in COVID-19 death by area-level income in 11.2 million people in Ontario, Canada: patterns over time and the mediating role of vaccination. (2026) · cites this paper as [19]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Our findings further support the potential of effect modification by vaccination on social inequalities in COVID-19 deaths, similar to findings from the previous ecological study in the UK(19).”
From Social inequalities in COVID-19 death by area-level income in 11.2 million people in Ontario, Canada: patterns over time and the mediating role of vaccination. (2026) · cites this paper as [19]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796 · cited 1×
“The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement was developed to enhance the transparency of reporting of observational research [10,11] and has been widely adopted and endorsed by leading medical journals.”
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · cited 2×
“Missing data are problematic for all observational research and have been addressed in Box 6 of the STROBE explanatory article [10].”
BackgroundMethodSterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Self-citationVandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Rothman, K. J., Greenland, S., & Lash, T. L. (1998) · Cited by 2,096
Guidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 2×
“The methodology used to develop the RECORD guidelines is detailed elsewhere [16] and based on the established methods to develop reporting guidelines [17].”
BackgroundMethodSelf-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319 · cited 1×
“By improving the quality of reporting of research using routinely collected health data, we seek to reduce unclear research reports and achieve the tenets of the scientific process: discovery, transparency, and replicability [18].”
BackgroundSelf-citationWeiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 1×
“The description of data cleaning methods at different stages of the study should include those used to screen for erroneous and missing data, including range checks, checks for duplicate records, and handling of repeated measures [47,48].”
MethodValidation and validity of diagnoses in the General Practice Research Database: a systematic review
Herrett, E., Thomas, S. L., Schoonen, W. M., Smeeth, L., & Hall, A. J. (2010) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2009.03537.x · Cited by 1,109 · cited 1×
“Two recent systematic reviews also document poor reporting of studies undertaken to validate data from routine data sources [5,6], which can obscure sources of bias, hamper efforts to undertake meta-analyses, and lead to erroneous conclusions.”
BackgroundSelf-citationPlint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Self-citationStukel, T. A., Fisher, E. S., Wennberg, D. E., Alter, D. A., Gottlieb, D. J., & Vermeulen, M. J. (2007) · JAMA · doi:10.1001/jama.297.3.278 · Cited by 786
Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740 · cited 1×
“The manner in which the guidelines are implemented by researchers, journals, and peer reviewers are of key importance to RECORD having a measurable impact [81].”
BackgroundSelf-citationGuttmann, A., Schull, M. J., Vermeulen, M. J., & Stukel, T. A. (2011) · BMJ · doi:10.1136/bmj.d2983 · Cited by 724
Self-citationLewis, J. D., Schinnar, R., Bilker, W. B., Wang, X., & Strom, B. L. (2007) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1335 · Cited by 602 · cited 1×
“Validation of identification methods has been increasingly emphasized as essential for studies using routinely collected health data, particularly for disease codes in studies using administrative data collected for billing purposes [33].”
MethodA framework for evaluation of secondary data sources for epidemiological research
SØRENSEN, H. T., SABROE, S., & OLSEN, J. (1996) · International Journal of Epidemiology · doi:10.1093/ije/25.2.435 · Cited by 455
Self-citationData cleaning: detecting, diagnosing, and editing data abnormalities
Van den Broeck, J., Argeseanu Cunningham, S., Eeckels, R., & Herbst, K. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020267 · Cited by 446
Data dredging, bias, or confounding: They can all get you into the BMJ and the Friday papers
Smith, G. D., & Ebrahim, S. (2002) · BMJ · doi:10.1136/bmj.325.7378.1437 · Cited by 434 · cited 1×
“Because the strengths and limitations of methods used to conduct research with routinely collected data may be contentious, a clear description of a study’s objectives is essential [23,24].”
BackgroundObservational research, randomised trials, and two views of medical science
Vandenbroucke, J. P. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050067 · Cited by 416 · cited 2×
“For studies using routinely collected data, authors should further clarify whether the analyses were exploratory with the purpose of finding new relationships in the data (examples are data mining or hypothesis-generating studies [21,22]) or confirmatory with the purpose of testing one or more hypotheses [23].”
BackgroundMethodHerrett, E., Shah, A. D., Boggon, R., Denaxas, S., Smeeth, L., van Staa, T., Timmis, A., & Hemingway, H. (2013) · BMJ · doi:10.1136/bmj.f2350 · Cited by 369 · cited 1×
“[28] on our website: http://record-statement.”
Self-citationBenchimol, E. I., Manuel, D. G., To, T., Griffiths, A. M., Rabeneck, L., & Guttmann, A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.10.006 · Cited by 368 · cited 4×
“Measures of accuracy are similar to those reported in diagnostic test studies, including sensitivity, specificity, positive and negative predictive values, or kappa coefficients [5,34].”
BackgroundMethodResultInfluentialSelf-citationBerry, J. G., Hall, M., Hall, D. E., Kuo, D. Z., Cohen, E., Agrawal, R., Mandl, K. D., Clifton, H., & Neff, J. (2013) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2013.432 · Cited by 293 · cited 1×
“For example, some comorbidity adjustment indices have been created by for-profit companies and sold to researchers for use in academic research settings [39,40].”
BackgroundCobo, E., Cortes, J., Ribera, J. M., Cardellach, F., Selva-O'Callaghan, A., Kostov, B., Garcia, L., Cirugeda, L., Altman, D. G., Gonzalez, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d6783 · Cited by 290 · cited 1×
“It has been demonstrated to improve the quality of research reporting when implemented in the editorial process [12,13].”
Prokosch, H. (2009) · doi:10.3414/me9132 · Cited by 262
Data linkage: a powerful research tool with potential problems
Bohensky, M. A., Jolley, D., Sundararajan, V., Evans, S., Pilcher, D. V., Scott, I., & Brand, C. A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-346 · Cited by 234 · cited 1×
“Data describing linkage methods and evaluating their success are critical to permit the reader to assess the impact of any linkage error and related bias [51].”
BackgroundNicholls, S. G., Quach, P., von Elm, E., Guttmann, A., Moher, D., Petersen, I., Sørensen, H. T., Smeeth, L., Langan, S. M., & Benchimol, E. I. (2015) · PLOS ONE · doi:10.1371/journal.pone.0125620 · Cited by 217 · cited 2×
“We recruited stakeholders through open calls and targeted invitations using a variety of channels [16].”
MethodSelf-citationVariability in the Measurement of Hospital-wide Mortality Rates
Shahian, D. M., Wolf, R. E., Iezzoni, L. I., Kirle, L., & Normand, S.-L. T. (2010) · New England Journal of Medicine · doi:10.1056/nejmsa1006396 · Cited by 213 · cited 1×
“For example, some comorbidity adjustment indices have been created by for-profit companies and sold to researchers for use in academic research settings [39,40].”
BackgroundFreemantle, N., Marston, L., Walters, K., Wood, J., Reynolds, M. R., & Petersen, I. (2013) · BMJ · doi:10.1136/bmj.f6409 · Cited by 211 · cited 1×
“Hence, the prognosis of those receiving the (drug) treatment may be better or worse than those who are not, but information on prognosis and/or severity of the underlying illness may not be available in the data [72].”
BackgroundSelf-citationGross, C. P., Andersen, M. S., Krumholz, H. M., McAvay, G. J., Proctor, D., & Tinetti, M. E. (2006) · JAMA · doi:10.1001/jama.296.23.2815 · Cited by 206
Benchimol, E. I., Manuel, D. G., Guttmann, A., Nguyen, G. C., Mojaverian, N., Quach, P., & Mack, D. R. (2014) · Inflammatory Bowel Diseases · doi:10.1097/mib.0000000000000103 · Cited by 202 · cited 1×
“Details of diagnostic accuracy of identification algorithm codes were described [26].”
MethodSelf-citationMurray, J., Bottle, A., Sharland, M., Modi, N., Aylin, P., Majeed, A., Saxena, S., & on behalf of the Medicines for Neonates Investigator Group (2014) · PLoS ONE · doi:10.1371/journal.pone.0089186 · Cited by 200
Springate, D. A., Kontopantelis, E., Ashcroft, D. M., Olier, I., Parisi, R., Chamapiwa, E., & Reeves, D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099825 · Cited by 179 · cited 1×
“org hold great promise for the documentation and transparency of codes used in research based on health data [41].”
BackgroundImproving the reporting of public health intervention research: advancing TREND and CONSORT
Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P., & Hawe, P. (2008) · Journal of Public Health · doi:10.1093/pubmed/fdm082 · Cited by 171
Recent trends in the incidence of recorded depression in primary care
Rait, G., Walters, K., Griffin, M., Buszewicz, M., Petersen, I., & Nazareth, I. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.058636 · Cited by 168 · cited 1×
“1), and different use of codes over time may impact the study population [58,59].”
BackgroundSelf-citationDe Coster, C., Quan, H., Finlayson, A., Gao, M., Halfon, P., Humphries, K. H., Johansen, H., Lix, L. M., Luthi, J.-C., Ma, J., et al. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-77 · Cited by 167
Loehrer, P. J. (2008) · Yearbook of Oncology · doi:10.1016/s1040-1741(08)79015-8 · Cited by 165 · cited 1×
“For studies using routinely collected data, authors should further clarify whether the analyses were exploratory with the purpose of finding new relationships in the data (examples are data mining or hypothesis-generating studies [21,22]) or confirmatory with the purpose of testing one or more hypotheses [23].”
MethodAutism spectrum disorders in young children: effect of changes in diagnostic practices
Nassar, N., Dixon, G., Bourke, J., Bower, C., Glasson, E., de Klerk, N., & Leonard, H. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyp260 · Cited by 162
Importance of accurately identifying disease in studies using electronic health records
Manuel, D. G., Rosella, L. C., & Stukel, T. A. (2010) · BMJ · doi:10.1136/bmj.c4226 · Cited by 159 · cited 2×
“Considering the risk of misclassification bias in all research, including research conducted using routine health data [31], authors should provide sufficient detail to make their research reproducible and to make the risk of bias apparent.”
BackgroundIdentifying periods of acceptable computer usage in primary care research databases
Horsfall, L., Walters, K., & Petersen, I. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3368 · Cited by 148 · cited 1×
“Studies may exclude medical practices with inconsistent electronic health record entry or wait for those practices to become consistent [38,55].”
BackgroundSelf-citationPrady, S. L., Richmond, S. J., Morton, V. M., & MacPherson, H. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001577 · Cited by 145
Issues in multiple imputation of missing data for large general practice clinical databases
Marston, L., Carpenter, J. R., Walters, K. R., Morris, R. W., Nazareth, I., & Petersen, I. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1934 · Cited by 132 · cited 1×
“Missing data are a particular issue for routinely collected data, as researchers cannot control data collection [73].”
BackgroundSelf-citationHardelid, P., Dattani, N., & Gilbert, R. E. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005331 · Cited by 119
van Herk‐Sukel, M. P. P., van de Poll-Franse, L. V., Lemmens, V. E. P. P., Vreugdenhil, G., Pruijt, H., Coebergh, J. W. W., & Herings, R. M. C. (2009) · European Journal of Cancer · doi:10.1016/j.ejca.2009.09.010 · Cited by 117
Impact of Prior Cancer on Eligibility for Lung Cancer Clinical Trials
Gerber, D. E., Laccetti, A. L., Xuan, L., Halm, E. A., & Pruitt, S. L. (2014) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dju302 · Cited by 112 · cited 1×
“For example, in studies utilising United States Medicare data, beneficiaries currently registered in a health maintenance organisation are frequently excluded because of lack of records of clinical events [54,56].”
MethodInternal validation of Medicare claims data.
Baron, J. A., Lu‐Yao, G. L., BARRETT, J. A., McLerran, D., & Fisher, E. S. (1994) · PubMed · Cited by 107
Wijlaars, L. P. M. M., Nazareth, I., & Petersen, I. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033181 · Cited by 105 · cited 1×
“1), and different use of codes over time may impact the study population [58,59].”
BackgroundSelf-citationMarston, L., Carpenter, J. R., Walters, K. R., Morris, R. W., Nazareth, I., White, I. R., & Petersen, I. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-004958 · Cited by 105 · cited 1×
“It is important to state whether the validation occurred in a source or database population different from that selected for the present study, as codes may function differently in different populations or databases [36].”
BackgroundSelf-citationThe international EQUATOR network: enhancing the quality and transparency of health care research
Pandis, N., & Fedorowicz, Z. (2011) · Journal of Applied Oral Science · doi:10.1590/s1678-77572011000500001 · Cited by 104
Benchimol, E. I., To, T. M., Griffiths, A. M., Rabeneck, L., & Guttmann, A. (2011) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2010.11.039 · Cited by 95 · cited 1×
“In a study assessing the association between socioeconomic status and Crohn’s disease outcomes, smoking status was discussed as a potential unmeasured confounding factor [74].”
BackgroundSelf-citationToh, S., Rodríguez, L. A. G., & Hernán, M. Á. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2152 · Cited by 94
Epidemiologic Methods for Health Policy
Cohen, J. E., & Spasoff, R. A. (2000) · Journal of Public Health Policy · doi:10.2307/3343346 · Cited by 94
Differential Record Linkage by Hispanic Ethnicity and Age in Linked Mortality Studies
Lariscy, J. T. (2011) · Journal of Aging and Health · doi:10.1177/0898264311421369 · Cited by 88 · cited 1×
“Authors should report linkage error using standard approaches including comparisons with gold standards or reference datasets, sensitivity analyses, and comparing characteristics of linked and unlinked data [53].”
Ford, J. B., Roberts, C. L., & Taylor, L. K. (2006) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2006.00715.x · Cited by 76 · cited 1×
“Selected variables that were available on both data sets were compared across three groups—ISC residuals, MDC residuals and matched records” [46].”
MethodJeon, C. Y., Pandol, S. J., Wu, B. U., Cook‐Wiens, G., Gottlieb, R. A., Merz, C. N. B., & Goodman, M. T. (2015) · PLoS ONE · doi:10.1371/journal.pone.0121783 · Cited by 76 · cited 1×
“We also lacked more granular data on cancer progression, which could have confounded the association between statin use and death, given that statin treatment may be withheld or discontinued in patients with short expected survival time” [60].”
BackgroundThe reporting of studies using routinely collected health data was often insufficient
Hemkens, L. G., Benchimol, E. I., Langan, S., Briel, M., Kasenda, B., Januel, J., Herrett, E. L., & von Elm, E. B. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.06.005 · Cited by 75
Self-citationMorrato, E. H., Elias, M., & Gericke, C. A. (2007) · Journal of Public Health · doi:10.1093/pubmed/fdm065 · Cited by 66 · cited 1×
“These data, generated in various health care settings and geographic locations, present opportunities for innovative, efficient, and cost-effective research to inform decisions in clinical medicine, health services planning, and public health [2].”
BackgroundRecent trends in the incidence of anxiety diagnoses and symptoms in primary care
Walters, K., Rait, G., Griffin, M., Buszewicz, M., & Nazareth, I. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041670 · Cited by 65 · cited 1×
“Other codes may be avoided because of patient stigmatization or provider penalties [64].”
BackgroundINTERNAL VALIDATION OF MEDICARE CLAIMS DATA
Lauderdale, D. S., & Goldberg, J. (1995) · Epidemiology · doi:10.1097/00001648-199505000-00037 · Cited by 63 · cited 1×
“In addition, internal validation of databases may be undertaken to compare overlapping data sources within a single database [35].”
BackgroundSandall, J., Murrells, T., Dodwell, M., Gibson, R., Bewley, S., Coxon, K., Bick, D., Cookson, G., Warwick, C., & Hamilton-Fairley, D. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02380 · Cited by 62 · cited 1×
“The description of data cleaning methods at different stages of the study should include those used to screen for erroneous and missing data, including range checks, checks for duplicate records, and handling of repeated measures [47,48].”
MethodCPT fee differentials and visit upcoding under Medicare Part B
Brunt, C. S. (2011) · Health Economics · doi:10.1002/hec.1649 · Cited by 59
Features of childhood cancer in primary care: a population-based nested case–control study
Dommett, R. M., Redaniel, M. T., Stevens, M. C. G., Hamilton, W. T., & Martin, R. M. (2012) · British Journal of Cancer · doi:10.1038/bjc.2011.600 · Cited by 56
Sorensen, A. A., Wojahn, R. D., Manske, M. C., & Calfee, R. P. (2013) · The Journal of Hand Surgery · doi:10.1016/j.jhsa.2013.05.008 · Cited by 55
Sørensen, H. T., Langan, S., Benchimol, E. I., Guttmann, Moher, D., Petersen, I., Smeeth, L. L., Stanley, & von Elm, E. B. (2013) · Clinical Epidemiology · doi:10.2147/clep.s36885 · Cited by 54 · cited 1×
“An international group of scientists with a specific interest in using routinely collected health data and representatives of the STROBE group met following the Primary Care Database Symposium in London in 2012 to discuss STROBE in the context of studies using routinely collected health data [14,15].”
MethodInfluentialSelf-citationConstructing Reproductive Histories by Linking Vital Records
Adams, M. M., Wilson, H. G., Casto, D. L., Berg, C. J., McDermott, J. M., Gaudino, J. A., & McCarthy, B. J. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009111 · Cited by 49
Carrara, G., Scirè, C. A., Zambon, A., Cimmino, M. A., Cerra, C., Caprioli, M., Cagnotto, G., Nicotra, F., Arfè, A., Migliazza, S., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006029 · Cited by 48 · cited 1×
“If a study utilises linked routine data, the study population is frequently reduced through restriction to individuals for whom linked data are available [57].”
Tsang, C., Bottle, A., Majeed, A., & Aylin, P. P. (2013) · British Journal of General Practice · doi:10.3399/bjgp13x670660 · Cited by 47 · cited 1×
“was obtained under a Medical Research Council licence for academic institutions [43].”
MethodFuller, T., Pearson, M., Peters, J., & Anderson, R. (2015) · PLOS ONE · doi:10.1371/journal.pone.0121585 · Cited by 47 · cited 1×
“Publication of a reporting guideline and endorsement by journals are not sufficient to improve research reporting [80].”
BackgroundBlotière, P., Weill, A., Ricordeau, P., Alla, F., & Allemand, H. (2013) · Clinics and Research in Hepatology and Gastroenterology · doi:10.1016/j.clinre.2013.10.005 · Cited by 46 · cited 2×
““Perforations and Haemorrhages after Colonoscopy in 2010: A Study Based on Comprehensive French Health Insurance Data (SNIIRAM)” [19].”
BackgroundInfluentialHarron, K. L., Goldstein, H., Wade, A. M., Müller‐Pebody, B., Parslow, R. C., & Gilbert, R. E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0085278 · Cited by 45 · cited 4×
“Two articles contain excellent descriptions of linkage undertaken specifically for the study being reported [44,45].”
BackgroundMethodInfluentialSelf-citationMcLintock, K., Russell, A. M., Alderson, S. L., West, R., House, A., Westerman, K., & Foy, R. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005178 · Cited by 44 · cited 1×
“For example, the introduction of provider billing incentive codes may change the likelihood of a code being used over time [62,63].”
Taljaard, M., Tuna, M., Bennett, C. L., Perez, R., Rosella, L. C., Tu, J. V., Sanmartin, C., Hennessy, D. A., Tanuseputro, P., Lebenbaum, M., et al. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-006701 · Cited by 40 · cited 1×
“The article by Taljaard and colleagues represents the full research protocol for a study using the Canadian Community Health Survey [77].”
MethodDucharme, R., Benchimol, E. I., Deeks, S. L., Hawken, S., Fergusson, D. A., & Wilson, K. R. (2013) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2013.05.034 · Cited by 39 · cited 1×
“The codes involved in the validation study were listed in figure 2 of the article [27].”
MethodSelf-citationCall to RECORD: the need for complete reporting of research using routinely collected health data
Benchimol, E. I., Langan, S., & Guttmann, A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.006 · Cited by 39 · cited 1×
“An international group of scientists with a specific interest in using routinely collected health data and representatives of the STROBE group met following the Primary Care Database Symposium in London in 2012 to discuss STROBE in the context of studies using routinely collected health data [14,15].”
MethodInfluentialSelf-citationOpening the black box of record linkage
Harron, K., Wade, A., Muller-Pebody, B., Goldstein, H., & Gilbert, R. (2012) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2012-201376 · Cited by 32 · cited 1×
“Even small errors in the linkage process can introduce bias and lead to results that can overestimate or underestimate the associations under study [52].”
BackgroundSelf-citationFosbøl, E. L., Granger, C. B., Peterson, E. D., Li, L., Lytle, B. L., Shofer, F. S., Lohmeier, C., Mears, G. D., Garvey, J. L., Corbett, C. C., et al. (2013) · American Heart Journal · doi:10.1016/j.ahj.2012.11.003 · Cited by 31
Welch, C. A., Petersen, I., Walters, K. R., Morris, R. W., Nazareth, I., Kalaitzaki, E., White, I. R., Marston, L., & Carpenter, J. R. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2270 · Cited by 30
Self-citationSiregar, S., Pouw, M. E., Moons, K. G. M., Versteegh, M. I. M., Bots, M. L., van der Graaf, Y., Kalkman, C. J., van Herwerden, L. A., & Groenwold, R. H. H. (2013) · Heart · doi:10.1136/heartjnl-2013-304645 · Cited by 28 · cited 2×
“The linkage was performed by Statistics Netherlands and is described in previous publications” [20].”
MethodJagai, J. S., Smith, G. S., Schmid, J. E., & Wade, T. J. (2014) · BMC Gastroenterology · doi:10.1186/s12876-014-0211-0 · Cited by 25
Variations in Use of PET among Medicare Beneficiaries with Non–Small Cell Lung Cancer, 1998–2007
Dinan, M. A., Curtis, L. H., Carpenter, W. R., Biddle, A. K., Abernethy, A. P., Patz, E. F., Schulman, K. A., & Weinberger, M. (2013) · Radiology · doi:10.1148/radiol.12120174 · Cited by 20
The Will Rogers phenomenon in the staging of breast cancer—does it matter?
Tan, G. H., Bhoo-Pathy, N., Taib, N. A., See, M. H., Jamaris, S., & Yip, C. H. (2015) · Cancer Epidemiology · doi:10.1016/j.canep.2014.11.005 · Cited by 18
Price, S. D., Holman, C. D. J., Sanfilippo, F. M., & Emery, J. D. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3469 · Cited by 15 · cited 1×
“For studies using routinely collected data, authors should further clarify whether the analyses were exploratory with the purpose of finding new relationships in the data (examples are data mining or hypothesis-generating studies [21,22]) or confirmatory with the purpose of testing one or more hypotheses [23].”
MethodNilson, F., Bonander, C., & Andersson, R. (2015) · Injury Prevention · doi:10.1136/injuryprev-2014-041337 · Cited by 14
Upcoding emergency admissions for non-life-threatening injuries to children.
Pruitt, Z., & Pracht, E. (2013) · PubMed · Cited by 10
Epidemiologic methods for health policy
Spasoff, R. A. (1999) · Cited by 3
Research works printed but not linked: 1
- Hemkens LG, Benchimol EI, Langan SM, Briel M, Kasenda B, Januel JM, et al., editors. Reporting of studies using routinely collected health data: systematic literature analysis (oral abstract presentation). REWARD / EQUATOR Conference 2015; 2015 September 28–30; Edinburgh, UK.
Cited by
Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 23,868
The Danish National Patient Registry: a review of content, data quality, and research potential
Schmidt, M., Schmidt, S. A. J., Sandegaard, J. L., Ehrenstein, V., Pedersen, L., & Sørensen, H. T. (2015) · Clinical Epidemiology · doi:10.2147/clep.s91125 · Cited by 4,769
“Keywords: epidemiological methods, medical record linkage, registries, research design, validation studies Introduction As the role of routine computerized health data in epidemiological research is growing,(1) there is a need to examine their strengths and limitations.(2,3) Typical shortcomings of such data include l…”
MethodSelf-citationInternational guidelines for groin hernia management
The HerniaSurge Group (2018) · Hernia · doi:10.1007/s10029-017-1668-x · Cited by 2,296
Langan, S. M., Irvine, A. D., & Weidinger, S. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31286-1 · Cited by 1,852
Self-citationAcute kidney injury in patients hospitalized with COVID-19
Hirsch, J. S., Ng, J. H., Ross, D. W., Sharma, P., Shah, H. H., Barnett, R. L., Hazzan, A. D., Fishbane, S., Jhaveri, K. D., Abate, M., et al. (2020) · Kidney International · doi:10.1016/j.kint.2020.05.006 · Cited by 1,523
“guidelines, Reporting of Studies Conducted Using Observational Routinely Collected Health Data (RECORD).(34,35)”
Metadata
- Authors
- Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee
- Affiliations
- University of Ottawa (CA)
- London School of Hygiene & Tropical Medicine (GB)
- University of Toronto (CA)
- University College London (GB)
- Aarhus University (DK)
- Corresponding author
- Benchimol, Eric I.
- Langan, Sinéad M.
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-06
- Volume
- 12
- Issue
- 10
- Pages
- e1001885
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4595218
- OpenAlex
- W2163278718
- Semantic Scholar
- 99c4dc4a2c291224bbfd604a3cd80e0910ea9c39
- Cited by
- 5,749
- References
- 88
- Citations by year
- 2026: 1174 · 2025: 803 · 2024: 764 · 2023: 625 · 2022: 636 · 2021: 522 · 2020: 409 · 2019: 312 · 2018: 245 · 2017: 172 · 2016: 67 · 2015: 9
- FWCI
- 148.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- IRIS (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- SERVAL (Université de Lausanne) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Aarhus Universitet
- Wellcome Trust (098504, 103975/A/14/Z)
- Cancer Research UK (16895)
- National Institute for Health and Care Research (NIHR/CS/010/014, NF-SI-0510-10090)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (IZ32Z0_147388 / 1, 147388, 130512)
- Lundbeckfonden (R155-2014-2647)
- Novo Nordisk Fonden (NNF14SA0015794)
- Canadian Institutes of Health Research (130512)
- Medical Research Council (MR/K006584/1, MR/J00488X/1)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- reporting guidelines, routinely collected health data, observational studies, STROBE, research transparency, reporting checklist, reporting quality
- MeSH terms
- Routinely Collected Health Data, Research Design, Guidelines as Topic, Biomedical Research, Checklist, Research Report, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
