The DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.
The REporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) Statement: Methods for Arriving at Consensus and Developing Reporting Guidelines
Open accessAbstract
OBJECTIVE: Routinely collected health data, collected for administrative and clinical purposes, without specific a priori research questions, are increasingly used for observational, comparative effectiveness, health services research, and clinical trials. The rapid evolution and availability of routinely collected data for research has brought to light specific issues not addressed by existing reporting guidelines. The aim of the present project was to determine the priorities of stakeholders in order to guide the development of the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. METHODS: Two modified electronic Delphi surveys were sent to stakeholders. The first determined themes deemed important to include in the RECORD statement, and was analyzed using qualitative methods. The second determined quantitative prioritization of the themes based on categorization of manuscript headings. The surveys were followed by a meeting of RECORD working committee, and re-engagement with stakeholders via an online commentary period. RESULTS: The qualitative survey (76 responses of 123 surveys sent) generated 10 overarching themes and 13 themes derived from existing STROBE categories. Highest-rated overall items for inclusion were: Disease/exposure identification algorithms; Characteristics of the population included in databases; and Characteristics of the data. In the quantitative survey (71 responses of 135 sent), the importance assigned to each of the compiled themes varied depending on the manuscript section to which they were assigned. Following the working committee meeting, online ranking by stakeholders provided feedback and resulted in revision of the final checklist. CONCLUSIONS: The RECORD statement incorporated the suggestions provided by a large, diverse group of stakeholders to create a reporting checklist specific to observational research using routinely collected health data. Our findings point to unique aspects of studies conducted with routinely collected health data and the perceived need for better reporting of methodological issues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Extensive efforts were made to include a broad representation of stakeholders in the creation of these guidelines.”
From The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. (2015) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Self-citationvon Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Hillestad, R., Bigelow, J., Bower, A., Girosi, F., Meili, R., Scoville, R., & Taylor, R. (2005) · Health Affairs · doi:10.1377/hlthaff.24.5.1103 · Cited by 1,675
Bowling, A. (1998) · Journal of Psychophysiology · doi:10.1027//0269-8803.14.2.126 · Cited by 1,443 · cited 1×
“Additional participants were recruited through snowball sampling[10], in which the initially invited participants were asked to identify others.”
BackgroundGuidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 2×
“[9] Such an exercise can be conducted using web and social media technologies to allow for the creation of a document that incorporates a large and diverse group of stakeholders.”
BackgroundSelf-citationPolicy: NIH plans to enhance reproducibility
Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247 · cited 1×
“Transparent reporting facilitates decision making by all readers and reproducibility of methods by interested researchers.[8] However, the rapid evolution and availability of routinely collected data for research has brought to light specific issues not addressed by STROBE.”
BackgroundTurner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740 · cited 1×
“They may also improve the completeness of reporting research.[16] Reporting guidelines have been demonstrated to improve reporting of studies when they are adopted by the research community and relevant journals, [17–20] although their effectiveness varies[20, 21] and may depend on implementation by journals rather th…”
BackgroundSelf-citationBenchimol, E. I., Manuel, D. G., To, T., Griffiths, A. M., Rabeneck, L., & Guttmann, A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.10.006 · Cited by 368
Self-citationThe 1% rule in four digital health social networks: An observational study
van Mierlo, T. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2966 · Cited by 339 · cited 1×
“, that 1% of internet users create content, 9% of users modify or comment on that content, and 90% of users consume or observe internet activity.[26] Despite this, the contributions to the message board led to valuable pre-publication discussion and revision.”
Backgroundde Lusignan, S., & van Weel, C. (2005) · Family Practice · doi:10.1093/fampra/cmi106 · Cited by 329 · cited 1×
“Discussion The quality of reporting of research based on routinely collected health data has been suboptimal [14, 15], potentially resulting in misinterpretation or misapplication of research findings.”
BackgroundCan Electronic Clinical Documentation Help Prevent Diagnostic Errors?
Schiff, G. D., & Bates, D. W. (2010) · New England Journal of Medicine · doi:10.1056/nejmp0911734 · Cited by 239
Benchimol, E. I., Guttmann, A., Mack, D. R., Nguyen, G. C., Marshall, J. K., Gregor, J. C., Wong, J., Forster, A. J., & Manuel, D. G. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.02.019 · Cited by 224 · cited 1×
“linkage methods and code validation reflects the activity of the research community in these fields, including work performed by members of the RECORD group[24, 25].”
MethodSelf-citationReview: Use of Electronic Medical Records for Health Outcomes Research
Dean, B. B., Lam, J. W. K., Natoli, J. L., Butler, Q. R., Aguilar, D., & Nordyke, R. J. (2009) · Medical Care Research and Review · doi:10.1177/1077558709332440 · Cited by 177 · cited 2×
“These are defined as data collected for administrative and clinical purposes, without specific a priori research questions[3, 4].”
Improving the reporting of public health intervention research: advancing TREND and CONSORT
Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P., & Hawe, P. (2008) · Journal of Public Health · doi:10.1093/pubmed/fdm082 · Cited by 171
Prady, S. L., Richmond, S. J., Morton, V. M., & MacPherson, H. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001577 · Cited by 145 · cited 1×
“[16] Reporting guidelines have been demonstrated to improve reporting of studies when they are adopted by the research community and relevant journals, [17–20] although their effectiveness varies[20, 21] and may depend on implementation by journals rather than simple endorsement.”
BackgroundMæng, M., Tilsted, H. H., Jensen, L. O., Krusell, L. R., Kaltoft, A., Kelbæk, H., Villadsen, A. B., Ravkilde, J., Hansen, K. N., Christiansen, E. H., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(14)60405-0 · Cited by 114 · cited 1×
“Routinely collected data now are being used for observational, comparative effectiveness and health services research, and clinical trials[3, 5].”
MethodSelf-citationBastuji‐Garin, S., Sbidian, É., Gaudy‐Marqueste, C., Ferrat, É., Roujeau, J., Richard, M. A., Canouï‐Poitrine, F., & on behalf of the European Dermatology Network (EDEN) (2013) · PLoS ONE · doi:10.1371/journal.pone.0064733 · Cited by 104 · cited 1×
“[16] Reporting guidelines have been demonstrated to improve reporting of studies when they are adopted by the research community and relevant journals, [17–20] although their effectiveness varies[20, 21] and may depend on implementation by journals rather than simple endorsement.”
BackgroundSimera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2009) · Maturitas · doi:10.1016/j.maturitas.2009.03.011 · Cited by 97 · cited 1×
“[12] Creation of guidelines typically involves consensus to determine a minimum set of criteria for reporting research [22, 23].”
BackgroundSelf-citationUsing Secondary Data Sources for Pharmacoepidemiology and Outcomes Research
Harpe, S. E. (2009) · Pharmacotherapy The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.29.2.138 · Cited by 79 · cited 2×
“These are defined as data collected for administrative and clinical purposes, without specific a priori research questions[3, 4].”
BackgroundSorensen, A. A., Wojahn, R. D., Manske, M. C., & Calfee, R. P. (2013) · The Journal of Hand Surgery · doi:10.1016/j.jhsa.2013.05.008 · Cited by 55
Sørensen, H. T., Langan, S., Benchimol, E. I., Guttmann, Moher, D., Petersen, I., Smeeth, L. L., Stanley, & von Elm, E. B. (2013) · Clinical Epidemiology · doi:10.2147/clep.s36885 · Cited by 54 · cited 4×
“Interest was also garnered through editorials in the Journal of Clinical Epidemiology[11] and Clinical Epidemiology[12].”
BackgroundMethodInfluentialSelf-citationCall to RECORD: the need for complete reporting of research using routinely collected health data
Benchimol, E. I., Langan, S., & Guttmann, A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.006 · Cited by 39 · cited 3×
“Interest was also garnered through editorials in the Journal of Clinical Epidemiology[11] and Clinical Epidemiology[12].”
MethodSelf-citationOpening the black box of record linkage
Harron, K., Wade, A., Muller-Pebody, B., Goldstein, H., & Gilbert, R. (2012) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2012-201376 · Cited by 32 · cited 1×
“linkage methods and code validation reflects the activity of the research community in these fields, including work performed by members of the RECORD group[24, 25].”
MethodGershon, A. S., Wang, L., To, T. M., Luo, J., & Upshur, R. E. G. (2008) · COPD Journal of Chronic Obstructive Pulmonary Disease · doi:10.1080/15412550802237507 · Cited by 22 · cited 1×
“Comments provided by respondents under each section of the STROBE checklist were coded using a process of qualitative description.[13] In this lowinference approach to coding qualitative data, the focus was a descriptive account of the text, as opposed to generation of theory.”
Method
Flagged first, then by citations
1 of the 26 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- D Moher, 2010, Guidance for developers of health research reporting guidelines, PLoS Medicine, 7, e1000217, 10.1371/journal.pmed.1000217 · DOI · Paper page
Cited by
Sorted by citations
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749
“We recruited stakeholders through open calls and targeted invitations using a variety of channels [16].”
MethodSelf-citationLangan, S., Schmidt, S. A. J., Wing, K., Ehrenstein, V., Nicholls, S. G., Filion, K. B., Klungel, O. H., Petersen, I., Sørensen, H. T., Dixon, W. G., et al. (2018) · BMJ · doi:10.1136/bmj.k3532 · Cited by 673
Self-citationNwaru, B. I., Ekström, M. P., Hasvold, P., Wiklund, F., Telg, G., & Janson, C. (2020) · European Respiratory Journal · doi:10.1183/13993003.01872-2019 · Cited by 472
Long-term Cognitive, Psychological, and Health Outcomes Associated With Child Abuse and Neglect
Strathearn, L., Giannotti, M., Mills, R., Kisely, S., Najman, J., & Abajobir, A. (2020) · Pediatrics · doi:10.1542/peds.2020-0438 · Cited by 401
“Each of the reviewed articles followed Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines for the conduct of cohort studies.(41) The quality of the studies was also evaluated by using a modified version of the Newcastle-Ottawa Scale, which is used to assess the following domains:…”
MethodStandards for Reporting Implementation Studies (StaRI): explanation and elaboration document
Pinnock, H., Barwick, M. A., Carpenter, C. R., Eldridge, S. M., Grandes, G., Griffiths, C., Rycroft‐Malone, J., Meißner, P., Murray, E., Patel, A. K., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013318 · Cited by 355
“A description should be provided of the provenance of the data (data source/purpose and process of collection/data completeness) and validity of coding.(30)”
Background
Metadata
- Authors
- Nicholls, S. G., Quach, P., von Elm, E., Guttmann, A., Moher, D., Petersen, I., Sørensen, H. T., Smeeth, L., Langan, S. M., & Benchimol, E. I.
- Affiliations
- University of Ottawa (CA)
- Institute for Clinical Evaluative Sciences (CA)
- University of Toronto (CA)
- University College London (GB)
- Aarhus University (DK)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Benchimol, Eric I.
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-05-12
- Volume
- 10
- Issue
- 5
- Pages
- e0125620
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4428635
- OpenAlex
- W1866803133
- Cited by
- 217
- References
- 26
- Citations by year
- 2026: 22 · 2025: 23 · 2024: 24 · 2023: 23 · 2022: 21 · 2021: 18 · 2020: 22 · 2019: 18 · 2018: 11 · 2017: 14 · 2016: 14 · 2015: 7
- FWCI
- 13.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- IRIS (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- SERVAL (Université de Lausanne) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Aarhus Universitet
- University of Ottawa
- Wellcome Trust (098504)
- Canadian Child Health Clinician Scientist Program
- National Institute for Health and Care Research (NIHR/CS/010/014, NF-SI-0510-10090)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (130512)
- Lundbeckfonden (R155-2014-2647)
- Novo Nordisk
- Novo Nordisk Fonden (NNF14SA0015794)
- H. Lundbeck A/S
- Canadian Institutes of Health Research (130512)
- Medical Research Council (MR/K006584/1)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- routinely collected health data, reporting guidelines, stakeholder consensus, Delphi method, observational studies, data characteristics, STROBE
- MeSH terms
- Adolescent, Adult, Aged, Database Management Systems, Female, Humans, Male, Medical Records, Middle Aged, Surveys and Questionnaires, Guidelines as Topic, Consensus, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
