The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement.
Open accessThe DOI matches its Crossref record; 86 of the 88 references it cites were found in a registry or an index; 9 of the 52 sources its claims cite were checked for support.
Abstract
Routinely collected health data, obtained for administrative and clinical purposes without specific a priori research goals, are increasingly used for research. The rapid evolution and availability of these data have revealed issues not addressed by existing reporting guidelines, such as Strengthening the Reporting of Observational Studies in Epidemiology (STROBE). The REporting of studies Conducted using Observational Routinely collected health Data (RECORD) statement was created to fill these gaps. RECORD was created as an extension to the STROBE statement to address reporting items specific to observational studies using routinely collected health data. RECORD consists of a checklist of 13 items related to the title, abstract, introduction, methods, results, and discussion section of articles, and other information required for inclusion in such research reports. This document contains the checklist and explanatory and elaboration information to enhance the use of the checklist. Examples of good reporting for each RECORD checklist item are also included herein. This document, as well as the accompanying website and message board (http://www.record-statement.org), will enhance the implementation and understanding of RECORD. Through implementation of RECORD, authors, journals editors, and peer reviewers can encourage transparency of research reporting.
Overview
CoChat Summary
TL;DR
RECORD is an extension to the STROBE statement created to improve reporting of observational studies using routinely collected health data. It provides a 13-item checklist plus explanatory and elaboration material with examples of good reporting.
Key findings
- RECORD addresses reporting gaps specific to routinely collected health data, including data type and database names in the title/abstract, geographic region and time frame, and whether linkage was performed.
- The checklist adds items on methods of population selection, validation of codes/algorithms, complete code lists for exposures/outcomes/confounders/effect modifiers, data access and cleaning, linkage methods and quality evaluation, study population selection, and accessibility of protocol/raw data/programming code.
- RECORD was developed through an international collaborative process involving more than 100 stakeholders, with two stakeholder surveys and a 19-member working committee that met in person.
- The statement includes explanatory text and examples for each RECORD item, and is intended to supplement, not replace, STROBE.
Methods
- Design: reporting guideline development and explanatory document, created as an extension to STROBE using established methods for developing health research reporting guidelines.
- Data/sample: input from more than 100 international stakeholders comprising researchers, journal editors, and consumers of data; examples of good reporting are drawn from published articles.
- Main analysis: consensus process with two stakeholder surveys to establish and prioritize themes, an in-person working committee to establish wording, stakeholder review and feedback, and final drafting by the steering committee with STROBE steering committee involvement.
Limitations
- The paper states that RECORD applies only to observational research; routinely collected health data are sometimes used in other designs, such as cluster-randomized trials or linkage of randomized trials to administrative data, which RECORD does not cover.
- The paper states that the field is changing rapidly, including mHealth apps and wearable technologies, and that RECORD focused on health data rather than all health-related data sources such as environmental or financial data, so revision may be necessary.
- The paper states that stakeholder representation was predominantly from regions conducting research using routinely collected health data, with only a few representatives from developing nations and non-English-speaking countries, and that statements were crafted by a smaller 19-member working committee.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
7 Valid · 0 Not valid · 30 Not checked · 20 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Routinely collected health data, obtained for administrative and clinical purposes without specific a priori research goals, are increasingly used for research.”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Abstract
What the sources say
- Supportedcites [3] C De Coster, 2006, Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium, BMC Health Serv Res source
The Background (p. 1) states that health administrative data 'are frequently used for health research in Canada and abroad' and that 'in the past two decades, such data have been widely employed by health services and population health researchers', supporting the increasing-use part of the claim; the Abstract Background and the Background (p. 2) state that validity limitations 'arise because the data are not created for research purposes' and that 'the data were created not for research but for other purposes', supporting the qualifier about non-research collection. This is a broad background attribution and our copy treats the topic in exactly that way. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It is important to state whether the validation occurred in a source or database population different from that selected for the present study, as codes may function differently in different populations or databases [36].”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Items in the RECORD Checklist > Methods (Participants)
What the sources say
- Partly supportedcites [36] L Marston, 2014, Smoker, ex-smoker or non-smoker? The validity of routinely recorded smoking status in UK primary care: a cross-sectional study, BMJ open sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) reports that smoking categories differed between the THIN primary-care database and the Health Survey for England, partly because smoking status was defined and ascertained differently. This supports caution about applying a validation across data sources, but the paper does not show that clinical codes function differently across coded databases or study populations. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“For example, the introduction of provider billing incentive codes may change the likelihood of a code being used over time [62,63].”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Items in the RECORD Checklist > Discussion (Limitations)
What the sources say
- Supportedcites [62] K McLintock, 2014, The effects of financial incentives for case finding for depression in patients with diabetes and coronary heart disease: interrupted time series analysis, BMJ open source
The Background (p.1) establishes that the QOF DEP1 indicator tied reimbursement to a designated clinical code ('A designated clinical code indicating the use of these questions was recorded in the patient record... Practices were reimbursed according to the proportion of patients with a record of case finding'), i.e. a provider billing incentive code. The Results (p.~3) then show that 'new coded case finding' rose sharply after initiation of the incentive (0.07 to 7.45/1000 per month in the targeted population, OR 99.76), with 'the exceptional rise in 2006 reflect[ing] first coding in patients with existing diagnoses'. The Methods (Data analysis) state the authors 'recognised that these trends could relate to changes in coding as well as clinical practice', and the Discussion attributes the immediate post-incentivisation spike in diagnoses to 'coding patterns', so the hedged claim that introducing such incentives may change the likelihood of a code being used over time is supported by our copy. (LLM, conf=0.85)
- Not checked yetcites [63] CS Brunt, 2011, CPT fee differentials and visit upcoding under Medicare Part B, Health economics source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A particular type of unmeasured confounding is confounding by indication; this is often an issue when examining effectiveness and safety of (drug) treatments using routinely collected data.”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Items in the RECORD Checklist > Discussion (Limitations)
What the sources say
- Supportedcites [72] N Freemantle, 2013, Making inferences on treatment effects from real world data: propensity scores, confounding by indication, and other perils for the unwary in observational research, BMJ source
The ‘Confounding by indication’ section defines it as an unmeasured process affecting who receives treatment. ‘When is it helpful to use a propensity score analysis?’ explains that this bias can mislead observational assessments of drug effects and potentially lead to patient harm, supporting the claim about effectiveness and safety analyses using routinely collected data. Page numbers are unavailable in our copy. (LLM, conf=0.90)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The REporting of studies Conducted using Observational Routinely collected health Data (RECORD) statement was created to fill these gaps.”
§ The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
18 more claims
Create a free account to see all 57 claims and to verify the 43 references still open.
- Probably not a substantial claim. 26
- It may state two separate claims as one. 13
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The study has been reported according to the STrengthening and Reporting of Observational Studies in Epidemiology (STROBE) statement guidelines [15], in accordance with the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) extension statement (S1 Table) [16].”
From Growth standard charts for monitoring bodyweight in dogs of different sizes (2017) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“The reporting is based on the RECORD guidelines for observational studies using routinely collected data [23].”
The cited source says what the claim attributes to it.
In the citing paper
“This study was conducted in line with RECORD (Reporting of Studies Conducted Using Observational Routinely Collected Data) guidelines.24”
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Another ecological study in the UK showed that lower area-level income was associated with greater area-level COVID-19 mortality(19).”
From Social inequalities in COVID-19 death by area-level income in 11.2 million people in Ontario, Canada: patterns over time and the mediating role of vaccination. (2026) · cites this paper as [19]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Our findings further support the potential of effect modification by vaccination on social inequalities in COVID-19 deaths, similar to findings from the previous ecological study in the UK(19).”
From Social inequalities in COVID-19 death by area-level income in 11.2 million people in Ontario, Canada: patterns over time and the mediating role of vaccination. (2026) · cites this paper as [19]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796 · cited 1×
“The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement was developed to enhance the transparency of reporting of observational research [10,11] and has been widely adopted and endorsed by leading medical journals.”
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · cited 2×
“Missing data are problematic for all observational research and have been addressed in Box 6 of the STROBE explanatory article [10].”
BackgroundMethodSterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Self-citationVandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Rothman, K. J., Greenland, S., & Lash, T. L. (1998) · Cited by 2,096
Guidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 2×
“The methodology used to develop the RECORD guidelines is detailed elsewhere [16] and based on the established methods to develop reporting guidelines [17].”
BackgroundMethodSelf-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319 · cited 1×
“By improving the quality of reporting of research using routinely collected health data, we seek to reduce unclear research reports and achieve the tenets of the scientific process: discovery, transparency, and replicability [18].”
BackgroundSelf-citation
Research works printed but not linked: 1
- Hemkens LG, Benchimol EI, Langan SM, Briel M, Kasenda B, Januel JM, et al., editors. Reporting of studies using routinely collected health data: systematic literature analysis (oral abstract presentation). REWARD / EQUATOR Conference 2015; 2015 September 28–30; Edinburgh, UK.
Cited by
Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 23,868
The Danish National Patient Registry: a review of content, data quality, and research potential
Schmidt, M., Schmidt, S. A. J., Sandegaard, J. L., Ehrenstein, V., Pedersen, L., & Sørensen, H. T. (2015) · Clinical Epidemiology · doi:10.2147/clep.s91125 · Cited by 4,769
“Keywords: epidemiological methods, medical record linkage, registries, research design, validation studies Introduction As the role of routine computerized health data in epidemiological research is growing,(1) there is a need to examine their strengths and limitations.(2,3) Typical shortcomings of such data include l…”
MethodSelf-citationInternational guidelines for groin hernia management
The HerniaSurge Group (2018) · Hernia · doi:10.1007/s10029-017-1668-x · Cited by 2,296
Langan, S. M., Irvine, A. D., & Weidinger, S. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31286-1 · Cited by 1,852
Self-citationAcute kidney injury in patients hospitalized with COVID-19
Hirsch, J. S., Ng, J. H., Ross, D. W., Sharma, P., Shah, H. H., Barnett, R. L., Hazzan, A. D., Fishbane, S., Jhaveri, K. D., Abate, M., et al. (2020) · Kidney International · doi:10.1016/j.kint.2020.05.006 · Cited by 1,523
“guidelines, Reporting of Studies Conducted Using Observational Routinely Collected Health Data (RECORD).(34,35)”
Metadata
- Authors
- Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee
- Affiliations
- University of Ottawa (CA)
- London School of Hygiene & Tropical Medicine (GB)
- University of Toronto (CA)
- University College London (GB)
- Aarhus University (DK)
- Corresponding author
- Benchimol, Eric I.
- Langan, Sinéad M.
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-06
- Volume
- 12
- Issue
- 10
- Pages
- e1001885
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4595218
- OpenAlex
- W2163278718
- Semantic Scholar
- 99c4dc4a2c291224bbfd604a3cd80e0910ea9c39
- Cited by
- 5,749
- References
- 88
- Citations by year
- 2026: 1174 · 2025: 803 · 2024: 764 · 2023: 625 · 2022: 636 · 2021: 522 · 2020: 409 · 2019: 312 · 2018: 245 · 2017: 172 · 2016: 67 · 2015: 9
- FWCI
- 148.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- IRIS (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- SERVAL (Université de Lausanne) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Aarhus Universitet
- Wellcome Trust (098504, 103975/A/14/Z)
- Cancer Research UK (16895)
- National Institute for Health and Care Research (NIHR/CS/010/014, NF-SI-0510-10090)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (IZ32Z0_147388 / 1, 147388, 130512)
- Lundbeckfonden (R155-2014-2647)
- Novo Nordisk Fonden (NNF14SA0015794)
- Canadian Institutes of Health Research (130512)
- Medical Research Council (MR/K006584/1, MR/J00488X/1)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- reporting guidelines, routinely collected health data, observational studies, STROBE, research transparency, reporting checklist, reporting quality
- MeSH terms
- Routinely Collected Health Data, Research Design, Guidelines as Topic, Biomedical Research, Checklist, Research Report, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. https://app.cochat.ai/papers/10.1371/journal.pmed.1001885
- The paper
- Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee. (2015). The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. PLOS Medicine. https://doi.org/10.1371/journal.pmed.1001885
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
