Quality of reporting of observational longitudinal research.
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Observational longitudinal research is particularly useful for assessing etiology and prognosis and for providing evidence for clinical decision making. However, there are no structured reporting requirements for studies of this design to assist authors, editors, and readers. The authors developed and tested a checklist of criteria related to threats to the internal and external validity of observational longitudinal studies. The checklist criteria concerned recruitment, data collection, biases, and data analysis and descriptive issues relevant to study rationale, study population, and generalizability. Two raters independently assessed 49 randomly selected articles describing stroke research published from 1999 to 2003 in six journals: American Journal of Epidemiology, Journal of Epidemiology and Community Health, Stroke, Annals of Neurology, Archives of Physical Medicine and Rehabilitation, and American Journal of Physical Medicine and Rehabilitation. On average, 17 of the 33 checklist criteria were reported. Criteria describing the study design were better reported than those related to internal validity. No relation was found between study type (etiologic or prognostic) or word count and quality of reporting. A flow diagram for summarizing participant flow through a study was developed. Editors and authors should consider using a checklist and flow diagram when reporting on observational longitudinal research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Reporting of observational research is often not detailed and clear enough to assess the strengths and weaknesses of the investigation [ 4 , 5 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [5]
In the citing paper
“A survey of cohort studies in stroke research found that 14 of 49 (28%) articles published from 1999 to 2003 addressed potential selection bias in the recruitment of study participants and 35 (71%) mentioned the possibility that any type of bias may have affected results [ 5 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [5]
In the citing paper
“In a survey of observational stroke research, 17 of 49 reports (35%) did not specify eligibility criteria [ 5 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [5]
In the citing paper
“Despite their importance, eligibility criteria often are not reported adequately.”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [5]
In the citing paper
“Few epidemiological studies explain or report deliberations about sample size [ 4 , 5 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [5]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634 · cited 1×
“The movement toward standardized reporting has arisen from the recognition that inadequate reporting, for example, of concealed allocation, can lead to biased interpretation ( 4 ).”
BackgroundMoher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
Hennekens, C. H., Buring, J. E., & Mayrent, S. L. (1987) · Medical Entomology and Zoology · Cited by 2,319
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Bias and causal associations in observational research
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07451-2 · Cited by 1,553
Applied Longitudinal Data Analysis for Epidemiology: A Practical Guide
Twisk, J. W. R. (2003) · Cited by 1,464
Zapf, D., Dormann, C., & Frese, M. (1996) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.1.2.145 · Cited by 1,174
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027
More informative abstracts revisited.
Haynes, R. B., Mulrow, C. D., Huth, E. J., Altman, D. G., & Gardner, M. J. (1990) · Annals of Internal Medicine · doi:10.7326/0003-4819-113-1-69 · Cited by 526
Reporting on Methods in Clinical Trials
DerSimonian, R., Charette, L. J., McPeek, B., & Mosteller, F. (1982) · New England Journal of Medicine · doi:10.1056/nejm198206033062204 · Cited by 499
Cohort studies: marching towards outcomes
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07500-1 · Cited by 494
McKee, M., Britton, A., Black, N., McPherson, K., Sanderson, C., & Bain, C. (1999) · BMJ · doi:10.1136/bmj.319.7205.312 · Cited by 399
Assessing the quality of research.
Glasziou, P., Vandenbroucke, J., & Chalmers, I. (2004) · BMJ · doi:10.1136/bmj.328.7430.39 · Cited by 391
Sackett, D. L., & Wennberg, J. E. (1997) · BMJ · doi:10.1136/bmj.315.7123.1636 · Cited by 368
Issues in the reporting of epidemiological studies: a survey of recent practice.
Pocock, S. J., Collier, T. J., Dandreo, K. J., de Stavola, B. L., Goldman, M. B., Kalish, L. A., Kasten, L. E., & McCormack, V. A. (2004) · BMJ · doi:10.1136/bmj.38250.571088.55 · Cited by 313
CONSORT Revised—Improving the Reporting of Randomized Trials
Rennie, D. (2001) · JAMA · doi:10.1001/jama.285.15.2006 · Cited by 294
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284 · cited 1×
“Higher journal quality indicators, such as impact factors, have been linked to better overall reporting in randomized and nonrandomized studies ( 45 ); however, we failed to show a clear trend in this study.”
BackgroundRESPONSE AND FOLLOW-UP BIAS IN COHORT STUDIES
GREENLAND, S. (1977) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112451 · Cited by 255
A prospective study of reproductive factors and risk of epithelial ovarian cancer
Hankinson, S. E., Colditz, G. A., Hunter, D. J., Willett, W. C., Stampfer, M. J., ROSNER, B. A., Hennekens, C. H., & Speizer, F. E. (1995) · Cancer · doi:10.1002/1097-0142(19950715)76:2<284::aid-cncr2820760219>3.0.co;2-5 · Cited by 231
Patterns of Consent in Epidemiologic Research: Evidence from Over 25,000 Responders
Dunn, K. M. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh141 · Cited by 212
Instruments for Assessing the Quality of Drug Studies Published in the Medical Literature
Cho, M. K. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020027007 · Cited by 180
Devereaux, P. J., Manns, B. J., Ghali, W. A., Quan, H., & Guyatt, G. H. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00214-3 · Cited by 166
SELECTION BIAS IN EPIDEMIOLOGIC STUDIES12
KLEINBAUM, D. G., MORGENSTERN, H., & KUPPER, L. L. (1981) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113113 · Cited by 151
The scandal of poor epidemiological research: ***
von Elm, E. B., & Egger, M. (2004) · BMJ · doi:10.1136/bmj.329.7471.868 · Cited by 144
Wolfe, F., Lassere, M. N., van der Heijde, D. M. F. M., Stucki, G., Suarez-Almazor, M. E., Pincus, T., Eberhardt, K., Kvien, T. K., Symmons, D. P. M., Silman, A. J., et al. (1999) · PubMed · Cited by 139
Any casualties in the clash of randomised and observational evidence?
Ioannidis, J. P. A., Haidich, A., & Lau, J. (2001) · BMJ · doi:10.1136/bmj.322.7291.879 · Cited by 107
Reijneveld, S. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.6.1134 · Cited by 104
Scott, C., Nelson, J. S., Farnan, N. C., Curran, W. J., Murray, K. J., Fischbach, A. J., Gaspar, L. E., & Nelson, D. F. (1995) · Cancer · doi:10.1002/1097-0142(19950715)76:2<296::aid-cncr2820760221>3.0.co;2-l · Cited by 84
How to assess epidemiological studies
Zaccai, J. H. (2004) · Postgraduate Medical Journal · doi:10.1136/pgmj.2003.012633 · Cited by 66
Reporting on reliability and validity of outcome measures in medical rehabilitation research
Dijkers, M. P. J. M., Kropp, G. C., Esper, R. M., Yavuzer, G., Cullen, N. K., & Bakdalieh, Y. (2002) · Disability and Rehabilitation · doi:10.1080/09638280210148585 · Cited by 61
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · American Journal of Roentgenology · doi:10.2214/ajr.181.1.1810051 · Cited by 60
Delgado-Rodriguez, M., Ruiz-Canela, M., De Irala-Estevez, J., Llorca, J., & Martinez-Gonzalez, M. A. (2001) · Journal of Epidemiology and Community Health · doi:10.1136/jech.55.8.569 · Cited by 57
Vandenbroucke, J. P. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00025-0 · Cited by 51
The Effect of Patient Attrition on Estimates of the Frequency of Dementia Following Stroke
Desmond, D. W., Bagiella, E., Moroney, J. T., & Stern, Y. (1998) · Archives of Neurology · doi:10.1001/archneur.55.3.390 · Cited by 44
Methodologic Issues in Observational Studies
Hartz, A. J., & Marsh, J. L. (2003) · Clinical Orthopaedics and Related Research · doi:10.1097/01.blo.0000079325.41006.95 · Cited by 39
LOOMIS, D. P. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.1.63 · Cited by 39
Current standards in reported drug trials.
Reiffenstein, R. J., Schiltroth, A. J., & Todd, D. M. (1968) · PubMed · Cited by 25
Wolfe, F. (1999) · PubMed · Cited by 16
Quality of Clinical Reports on Behavioral Interventions for Hypertension
Boulware, L. E., Daumit, G. L., Frick, K. D., Minkovitz, C. S., Lawrence, R. S., & Powe, N. R. (2002) · Preventive Medicine · doi:10.1006/pmed.2002.1011 · Cited by 6
Cited by
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.008 · Cited by 17,893
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796
Elm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766
Metadata
- Authors
- Tooth, L.
- Affiliations
- The University of Queensland (AU)
- Corresponding author
- Tooth, L.
- ORCID
- Tooth, L.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-02-01
- Volume
- 161
- Issue
- 3
- Pages
- 280-288
- ISSN
- 0002-9262 (ISSN-L)
- OpenAlex
- W2141555509
- Cited by
- 363
- References
- 44
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 18 · 2023: 15 · 2022: 12 · 2021: 14 · 2020: 26 · 2019: 9 · 2018: 17 · 2017: 27 · 2016: 29 · 2015: 18 · 2014: 23 · 2013: 22 · 2012: 10
- FWCI
- 20.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- reporting quality, reporting checklist, internal validity, generalizability, bias, recruitment (clinical trials), data collection, data analysis, stroke research
- MeSH terms
- Epidemiology, Humans, Longitudinal Studies, Publishing, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.