The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Maelstrom Research guidelines for rigorous retrospective data harmonization
Open accessAbstract
Background: It is widely accepted and acknowledged that data harmonization is crucial: in its absence, the co-analysis of major tranches of high quality extant data is liable to inefficiency or error. However, despite its widespread practice, no formalized/systematic guidelines exist to ensure high quality retrospective data harmonization. Methods: To better understand real-world harmonization practices and facilitate development of formal guidelines, three interrelated initiatives were undertaken between 2006 and 2015. They included a phone survey with 34 major international research initiatives, a series of workshops with experts, and case studies applying the proposed guidelines. Results: A wide range of projects use retrospective harmonization to support their research activities but even when appropriate approaches are used, the terminologies, procedures, technologies and methods adopted vary markedly. The generic guidelines outlined in this article delineate the essentials required and describe an interdependent step-by-step approach to harmonization: 0) define the research question, objectives and protocol; 1) assemble pre-existing knowledge and select studies; 2) define targeted variables and evaluate harmonization potential; 3) process data; 4) estimate quality of the harmonized dataset(s) generated; and 5) disseminate and preserve final harmonization products. Conclusions: This manuscript provides guidelines aiming to encourage rigorous and effective approaches to harmonization which are comprehensively and transparently documented and straightforward to interpret and implement. This can be seen as a key step towards implementing guiding principles analogous to those that are well recognised as being essential in securing the foundational underpinning of systematic reviews and the meta-analysis of clinical trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Riboli, E., Hunt, K., Slimani, N., Ferrari, P., Norat, T., Fahey, M., Charrondière, U., Hémon, B., Casagrande, C., Vignat, J., et al. (2002) · Public Health Nutrition · doi:10.1079/phn2002394 · Cited by 1,866
Subclinical Hypothyroidism and the Risk of Coronary Heart Disease and Mortality
Rodondi, N., den Elzen, W. P. J., Bauer, D. C., Cappola, A. R., Razvi, S., Walsh, J. P., Åsvold, B. O., Iervasi, G., Imaizumi, M., Collet, T.-H., et al. (2010) · JAMA · doi:10.1001/jama.2010.1361 · Cited by 1,216
Hashibe, M., Brennan, P., Benhamou, S., Castellsague, X., Chen, C., Curado, M. P., Maso, L. D., Daudt, A. W., Fabianova, E., Wunsch-Filho, V., et al. (2007) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djk179 · Cited by 1,098
Meta-analysis Global Group in Chronic Heart Failure (MAGGIC) (2012) · European Heart Journal · doi:10.1093/eurheartj/ehr254 · Cited by 758
Lorenz, M. W., Polak, J. F., Kavousi, M., Mathiesen, E. B., Völzke, H., Tuomainen, T.-P., Sander, D., Plichart, M., Catapano, A. L., Robertson, C. M., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60441-3 · Cited by 598
Young adult sequelae of adolescent cannabis use: an integrative analysis.
Silins, E., Horwood, L. J., Patton, G. C., Fergusson, D. M., Olsson, C. A., Hutchinson, D. M., Spry, E., Toumbourou, J. W., Degenhardt, L., Swift, W., et al. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70307-4 · Cited by 443
Principles of evidence based medicine
Akobeng, A. K. (2005) · Archives of Disease in Childhood · doi:10.1136/adc.2005.071761 · Cited by 413
Boffetta, P., McLerran, D., Chen, Y., Inoue, M., Sinha, R., He, J., Gupta, P. C., Tsugane, S., Irie, F., Tamakoshi, A., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019930 · Cited by 348
Methods for Pooling Results of Epidemiologic Studies
Smith-Warner, S. A., Spiegelman, D., Ritz, J., Albanes, D., Beeson, W. L., Bernstein, L., Berrino, F., van den Brandt, P. A., Buring, J. E., Cho, E., et al. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj127 · Cited by 328
DataSHIELD: taking the analysis to the data, not the data to the analysis
Gaye, A., Marcon, Y., Isaeva, J., LaFlamme, P., Turner, A., Jones, E. M., Minion, J., Boyd, A. W., Newby, C. J., Nuotio, M.-L., et al. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu188 · Cited by 284
Self-citationLeroy, V., Newell, M.-L., Dabis, F., Peckham, C., Van de Perre, P., Bulterys, M., Kind, C., Simonds, R., Wiktor, S., & Msellati, P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01419-6 · Cited by 259
Hofer, S. M., & Piccinin, A. M. (2009) · Psychological Methods · doi:10.1037/a0015566 · Cited by 248
Wong, M., Day, N., Luan, J., Chan, K., & Wareham, N. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg002 · Cited by 238
The Role of Adiposity in Cardiometabolic Traits: A Mendelian Randomization Analysis
Fall, T., Hägg, S., Mägi, R., Ploner, A., Fischer, K., Horikoshi, M., Sarin, A.-P., Thorleifsson, G., Ladenvall, C., Kals, M., et al. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001474 · Cited by 203
Cooper, R., Hardy, R., Aihie Sayer, A., Ben-Shlomo, Y., Birnie, K., Cooper, C., Craig, L., Deary, I. J., Demakakos, P., Gallacher, J., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027899 · Cited by 199
The Emerging Risk Factors Collaboration (2007) · European Journal of Epidemiology · doi:10.1007/s10654-007-9165-7 · Cited by 188
Cannabis and depression: An integrative data analysis of four Australasian cohorts
Horwood, L. J., Fergusson, D. M., Coffey, C., Patton, G. C., Tait, R. J., Smart, D., Letcher, P., Silins, E., & Hutchinson, D. M. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.06.002 · Cited by 181
Data harmonization and federated analysis of population-based studies: the BioSHaRE project
Doiron, D., Burton, P. R., Marcon, Y., Gaye, A., Wolffenbuttel, B. H. R., Perola, M., Stolk, R. P., Foco, L., Minelli, C., Waldenberger, M., et al. (2013) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-10-12 · Cited by 178
Self-citationWolfson, M., Wallace, S. E., Masca, N., Rowe, G., Sheehan, N. A., Ferretti, V., LaFlamme, P., Tobin, M. D., Macleod, J., Little, J., et al. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyq111 · Cited by 178
Self-citationFortier, I., Burton, P. R., Robson, P. J., Ferretti, V., Little, J., L'Heureux, F., Deschenes, M., Knoppers, B. M., Doiron, D., Keers, J. C., et al. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyq139 · Cited by 176
Self-citationMatise, T. C., Ambite, J. L., Buyske, S., Carlson, C. S., Cole, S. A., Crawford, D. C., Haiman, C. A., Heiss, G., Kooperberg, C., Marchand, L. L., et al. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr160 · Cited by 168
Żaba, B., Calvert, C., Marston, M., Isingo, R., Nakiyingi‐Miiro, J., Lutalo, T., Crampin, A. C., Robertson, L., Herbst, K., Newell, M., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60803-x · Cited by 128
MORGAM (an international pooling of cardiovascular cohorts)
Evans, A. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh327 · Cited by 126
Fortier, I., Doiron, D., Little, J., Ferretti, V., L’Heureux, F., Stolk, R. P., Knoppers, B. M., Hudson, T. J., & Burton, P. R. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyr106 · Cited by 101
Self-citationCohort profile: the Asia Pacific Cohort Studies Collaboration
Woodward, M., Barzi, F., Martiniuk, A. L. C., Fang, X., Gu, D., Imai, Y., Lam, T., Pan, W. H., Rodgers, A., Suh, I., et al. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl222 · Cited by 98
Kern, M. L., Hampson, S. E., Goldberg, L. R., & Friedman, H. S. (2012) · Developmental Psychology · doi:10.1037/a0030874 · Cited by 97
klaguia (2009) · Cited by 92
Invited Commentary: Consolidating Data Harmonization--How to Obtain Quality and Applicability?
Fortier, I., Doiron, D., Burton, P. R., & Raina, P. S. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr194 · Cited by 90
Self-citationPopulation Genomics: The Public Population Project in Genomics (P3G): a proof of concept?
Knoppers, B. M., Fortier, I., Legault, D., & Burton, P. R. (2008) · European Journal of Human Genetics · doi:10.1038/ejhg.2008.55 · Cited by 84
Self-citationCOSMIC, Sachdev, P. S., Lipnicki, D. M., Kochan, N. A., Crawford, J. D., Rockwood, K. J., Xiao, S., Li, J., Li, X., Brayne, C., et al. (2013) · BMC Neurology · doi:10.1186/1471-2377-13-165 · Cited by 77
Toward Rigorous Data Harmonization in Cancer Epidemiology Research: One Approach
Rolland, B., Reid, S., Stelling, D. L., Warnick, G. S., Thornquist, M. D., Feng, Z., & Potter, J. D. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv133 · Cited by 74
Pigeot, I., Barba, G., Chadjigeorgiou, C., Henauw, S. D., Kourides, Y. A., Lissner, L., Mårild, S., Pohlabeln, H., Russo, P., Tornaritis, M. J., et al. (2009) · International Journal of Obesity · doi:10.1038/ijo.2009.142 · Cited by 71
French, D. J., Browning, C. J., Kendig, H. L., Luszcz, M. A., Saito, Y., Sargent‐Cox, K. A., & Anstey, K. J. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-649 · Cited by 71
Schaap, L. S., Peeters, G. M. E. E., Dennison, E. M., Zambon, S., Nikolaus, T., Sánchez-Martínez, M., Musacchio, E., van Schoor, N. M., & Deeg, D. J. H. (2011) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-12-272 · Cited by 69
Cohort profile: The Dynamic Analyses to Optimize Ageing (DYNOPTA) project
Anstey, K. J., Byles, J., Luszcz, M. A., Mitchell, P. L. R., Steel, D. G., Booth, H., Browning, C. J., Butterworth, P., Cumming, R. G., Healy, J., et al. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn276 · Cited by 67
Boffetta, P., Bobák, M., Borsch-Supan, A. H., Brenner, H., Eriksson, S., Grodstein, F., Jansen, E. H. J. M., Jenab, M., Juerges, H., Kampman, E., et al. (2014) · European Journal of Epidemiology · doi:10.1007/s10654-014-9977-1 · Cited by 62
Phenotype harmonization and cross-study collaboration in GWAS consortia: the GENEVA experience
Bennett, S., Caporaso, N. E., Fitzpatrick, A. L., Arpana Agrawal, A., Barnes, K. C., Boyd, H. A., Cornelis, M. C., Hansel, N. N., HEISS, G. M., Heit, J. A., et al. (2011) · Genetic Epidemiology · doi:10.1002/gepi.20564 · Cited by 60
Environmental exposure assessment in European birth cohorts: results from the ENRIECO project
Gehring, U., Casas, M., Brunekreef, B., Bergström, A., Bonde, J. P., Botton, J., Chevrier, C., Cordier, S., Heinrich, J., Hohmann, C., et al. (2013) · Environmental Health · doi:10.1186/1476-069x-12-8 · Cited by 59
Muilu, J., Peltonen, L., & Litton, J. (2007) · European Journal of Human Genetics · doi:10.1038/sj.ejhg.5201850 · Cited by 51
the CLESA Working Group, Minicuci, N., Noale, M., Bardage, C., Blumstein, T., Deeg, D. J. H., Gindin, J., Jylhä, M. K., Nikula, S., Otero, Á., et al. (2003) · Aging Clinical and Experimental Research · doi:10.1007/bf03324499 · Cited by 46
BATH, P. A., DEEG, D., & POPPELAARS, J. (2010) · Ageing and Society · doi:10.1017/s0144686x1000070x · Cited by 38
Allen, J., Inder, K., Lewin, T. J., Attia, J., KAY‐LAMBKIN, F. J., Baker, A., Hazell, T., & Kelly, B. J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-122 · Cited by 30
Hutchinson, D. M., Silins, E., Mattick, R. P., Patton, G. C., Fergusson, D. M., Hayatbakhsh, M. R., Toumbourou, J. W., Olsson, C. A., Najman, J. M., Spry, E., et al. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867415571169 · Cited by 29
The case for large scale fungible cohorts
Gallacher, J. (2007) · European Journal of Public Health · doi:10.1093/eurpub/ckm086 · Cited by 15
Generating Large-Scale Longitudinal Data Resources for Aging Research
Gallacher, J., & Hofer, S. M. (2011) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbr047 · Cited by 15
Cited by
Hartwig, F. P., Davies, N. M., Hemani, G., & Davey Smith, G. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyx028 · Cited by 860
Validation of biomarkers of aging
Moqri, M., Herzog, C., Poganik, J. R., Ying, K., Justice, J. N., Belsky, D. W., Higgins-Chen, A. T., Chen, B. H., Cohen, A. A., Fuellen, G., et al. (2024) · Nature Medicine · doi:10.1038/s41591-023-02784-9 · Cited by 361
Mc Dowell, C. P., Carlin, A., Capranica, L., Dillon, C., Harrington, J. M., Lakerveld, J., Loyen, A., Ling, F. C. M., Brug, J., MacDonncha, C., et al. (2018) · BMC Public Health · doi:10.1186/s12889-018-5702-4 · Cited by 41
“The iterative steps for effective retrospective data harmonisation published by Fortier and colleagues (2017) [24] underpinned the harmonisation process within this study (e.”
Metadata
- Authors
- Fortier, I., Raina, P., Van den Heuvel, E. R., Griffith, L. E., Craig, C., Saliba, M., Doiron, D., Stolk, R. P., Knoppers, B. M., Ferretti, V., Granda, P., & Burton, P.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-06-06
- Volume
- 46
- Issue
- 1
- Pages
- dyw075
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2413622533
- Cited by
- 263
- References
- 51
- FWCI
- 23.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.