Cited by 157Advanced Biosensing Techniques and ApplicationsAdvanced Proteomics Techniques and ApplicationsClinical Laboratory Practices and Quality Control

Stability and reproducibility of proteomic profiles in epidemiological studies: comparing the Olink and SOMAscan platforms

Open access
Haslam, Danielle E., Li, Jun, Dillon, Simon T., Gu, Xuesong, Cao, Yin, Zeleznik, Oana A., Sasamoto, Naoko, Zhang, Xuehong +11 more·2022·PROTEOMICS

Abstract

Limited data exist on the performance of high‐throughput proteomics profiling in epidemiological settings, including the impact of specimen collection and within‐person variability over time. Thus, the Olink (972 proteins) and SOMAscan7Kv4.1 (7322 proteoforms of 6596 proteins) assays were utilized to measure protein concentrations in archived plasma samples from the Nurses’ Health Studies and Health Professionals Follow‐Up Study. Spearman's correlation coefficients ( r ) and intraclass correlation coefficients (ICCs) were used to assess agreement between (1) 42 triplicate samples processed immediately, 24‐h or 48‐h after blood collection from 14 participants; and (2) 80 plasma samples from 40 participants collected 1‐year apart. When comparing samples processed immediately, 24‐h, and 48‐h later, 55% of assays had an ICC/ r ≥ 0.75 and 87% had an ICC/ r ≥ 0.40 in Olink compared to 44% with an ICC/ r ≥ 0.75 and 72% with an ICC/ r ≥ 0.40 in SOMAscan7K. For both platforms, >90% of the assays were stable (ICC/ r ≥ 0.40) in samples collected 1‐year apart. Among 817 proteins measured with both platforms, Spearman's correlations were high ( r > 0.75) for 14.7% and poor ( r < 0.40) for 44.8% of proteins. High‐throughput proteomics profiling demonstrated reproducibility in archived plasma samples and stability after delayed processing in epidemiological studies, yet correlations between proteins measured with the Olink and SOMAscan7K platforms were highly variable.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/pmic.202100170

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Existing comparisons of SomaScan and Olink platforms have shown that some protein measures are not concordant, with median inter-platform correlation = 0.38-0.50, which challenges the accuracy of protein associations observed.

    “However, existing comparisons of SomaScan and Olink platforms have shown that some protein measures are not concordant (median inter-platform correlation = 0.38–0.50)11–16, which challenges the accuracy of protein associations observed, especially as there is no “gold-standard” reference measure for most proteins.”
  • The modest overlap between our findings and aptamer-based studies is unsurprising because correlations between proteins measured by both platforms are highly variable and shared genetic signals can be masked by extreme, assay-specific binding affinities.

    “This modest overlap is unsurprising, given that correlations between proteins measured by both platforms are highly variable 52,53 , and shared genetic signals can be masked by extreme, assay-specific binding affinities 51 .”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 28

  1. [1]Smith JG, & Gerszten RE (2017). Emerging affinity-based proteomic technologies for large scale plasma profiling in cardiovascular disease. Circulation, 135, 1651– 1664. 28438806 PMC5555416
  2. [2]Candia J, Cheung F, Kotliarov Y, Fantoni G, Sellers B, Griesman T, Huang J, Stuccio S, Zingone A, Ryan BM, Tsang JS, & Biancotto A. (2017). Assessment of variability in the SOMAscan assay. Science Reports, 7, 14248. PMC5660188 29079756
  3. [4]Mallick P, & Kuster B. (2010). Proteomics: A pragmatic perspective. Nature Biotechnology, 28, 695– 709. 20622844
  4. [5]Geyer PE, Holdt LM, Teupser D, & Mann M. (2017). Revisiting biomarker discovery by plasma proteomics. Molecular Systems Biology, 13, 942. 28951502 PMC5615924
  5. [6]Lindholm D, James SK, Gabrysch K, Storey RF, Himmelmann A, Cannon CP, Mahaffey KW, Steg PG, Held C, Siegbahn A, & Wallentin L. (2018). Association of multiple biomarkers with risk of all-cause and cause-specific mortality after acute coronary syndromes. JAMA Cardiology, 3, 1160– 1166. 30427997 PMC6583102
  6. [7]Wallentin L, Eriksson N, Olszowka M, Grammer TB, Hagström E, Held C, Kleber ME, Koenig W, März W, Stewart RAH, White HD, Åberg M, & Siegbahn A. (2021). Plasma proteins associated with cardiovascular death in patients with chronic coronary heart disease: A retrospective study. PLoS Medicine, 18, e1003513. PMC7817029 33439866
  7. [8]Katz DH, Tahir UA, Bick AG, Pampana A, Ngo D, Benson MD, Yu Z, Robbins JM, Chen ZZ, Cruz DE, Deng S, Farrell L, Sinha S, Schmaier AA, Shen D, Gao Y, Hall ME, Correa A, Tracy RP, & Blood Institute TOPMed (Trans-Omics for Precision Medicine) Consortium. (2022). Whole genome sequence analysis of the plasma proteome in black adults provides novel insights into cardiovascular disease. Circulation, 145, 357– 370. 34814699 PMC9158509
  8. [9]Walker ME, Song RJ, Xu X, Gerszten RE, Ngo D, Clish CB, Corlin L, Ma J, Xanthakis V, Jacques PF, & Vasan RS (2020). Proteomic and metabolomic correlates of healthy dietary patterns: The Framingham Heart Study. Nutrients, 12, 1476. 32438708 PMC7284467
  9. [10]Vasunilashorn SM, Dillon ST, Chan NY, & Fong TG (2021). Proteome-wide analysis using SOMAscan identifies and validates chitinase-3-like protein 1 as a risk and disease marker of delirium among older adults undergoing major elective surgery. The Journals of Gerontology: Series A, glaa326. PMC8893174 35239952
  10. [11]Chaturvedi AK, Kemp TJ, Pfeiffer RM, Biancotto A, Williams M, Munuo S, Purdue MP, Hsing AW, Pinto L, Mccoy JP, & Hildesheim A. (2011). Evaluation of multiplexed cytokine and inflammation marker measurements: A Methodologic Study. Cancer Epidemiology and Prevention Biomarkers, 20, 1902– 1911. PMC3400264 21715603
  11. [13]Mayeux R. (2004). Biomarkers: Potential uses and limitations. NeuroRx, 1, 182– 188. 15717018 PMC534923
  12. [14]White E. (2011). Measurement error in biomarkers: Sources, assessment, and impact on studies. IARC Scientific Publications, 143– 161. 22997860
  13. [15]Kim CH, Tworoger SS, Stampfer MJ, Dillon ST, Gu X, Sawyer SJ, Chan AT, Libermann TA, & Eliassen HA (2018). Stability and reproducibility of proteomic profiles measured with an aptamer-based platform. Scientific Reports, 8, 8382. 29849057 PMC5976624
  14. [16]Bao Y, Bertoia ML, Lenart EB, Stampfer MJ, Willett WC, Speizer FE, & Chavarro JE (2016). Origin, methods, and evolution of the three nurses health studies. American Journal of Public Health, 106, 1573– 1581. 27459450 PMC4981810
  15. [17]Huang T, Trudel-Fitzgerald C, Poole EM, Sawyer S, Kubzansky LD, Hankinson SE, Okereke OI, & Tworoger SS (2019). The Mind–Body Study: Study design and reproducibility and interrelationships of psychosocial factors in the Nurses’ Health Study II. Cancer Causes & Control, 30, 779– 790. 31049751 PMC6631300
  16. [18]Rimm EB, Giovannucci EL, Willett WC, Colditz GA, Ascherio A, Rosner B, & Stampfer MJ (1991). Prospective study of alcohol consumption and risk of coronary disease in men. Lancet, 338, 464– 468. 1678444
  17. [19]Hankinson SE, Willett WC, Manson JE, Hunter DJ, Colditz GA, Stampfer MJ, Longcope C, & Speizer FE (1995). Alcohol, height, and adiposity in relation to estrogen and prolactin levels in postmenopausal women. JNCI: Journal of the National Cancer Institute, 87, 1297– 1302. 7658481
  18. [20]Hankinson SE, Willett WC, Manson JE, Colditz GA, Hunter DJ, Spiegelman D, Barbieri RL, & Speizer FE (1998). Plasma sex steroid hormone levels and risk of breast cancer in postmenopausal women. JNCI: Journal of the National Cancer Institute, 90, 1292– 1299. 9731736
  19. [21]Townsend MK, Clish CB, Kraft P, Wu C, Souza AL, Deik AA, Tworoger SS, & Wolpin BM (2013). Reproducibility of metabolomic profiles among men and women in two large cohort studies. Clinical Chemistry, 59, 1657– 1667. 23897902 PMC3812240
  20. [22]Bland JM, & Altman DG (1996). Statistics notes: Measurement error proportional to the mean. BMJ, 313, 106. 8688716 PMC2351517
  21. [23]Rosner B, Willett WC, & Spiegelman D. (1989). Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Statistics in Medicine, 8, 1051– 1069. discussion 1071–1073. 2799131
  22. [24]Al-Delaimy,WK, Natarajan L, Sun X, Rock CL, & Pierce JJ (2008). Reliability of plasma carotenoid biomarkers and its relation to study power. Epidemiology, 19, 338– 344. 18300693 PMC2574518
  23. [25]Assarsson E, Lundberg M, Holmquist G, Björkesten J, Thorsen SB, Ekman D, Eriksson A, Dickens ER, Ohlsson S, Edfeldt G, Andersson A-C, Lindstedt P, Stenvang J, Gullberg M, & Fredriksson S. (2014). Homogenous 96-Plex PEA immunoassay exhibiting high sensitivity, specificity, and excellent scalability. PLoS ONE, 9, e95192. PMC3995906 24755770
  24. [27]The Gene Ontology Consortium. (2019). The gene ontology resource: 20 years and still going strong. Nucleic Acids Research, 47, D330– D338. 30395331 PMC6323945
  25. [28]Consortium TU, UniProt: A worldwide hub of protein knowledge. Nucleic Acids Research, 47, D506– D515. 30395287 PMC6323992
  26. [29]Rosner B. (2005). Fundamentals of biostatistics. Duxbury Press.
  27. [30]Ngo D, Sinha S, Shen D, Kuhn EW, Keyes MJ, Shi X, Benson MD, O’sullivan JF, Keshishian H, Farrell LA, Fifer MA, Vasan RS, Sabatine MS, Larson MG, Carr SA, Wang TJ, & Gerszten RE (2016). Aptamer-based proteomic profiling reveals novel candidate biomarkers and pathways in cardiovascular disease. Circulation, 134, 270– 285. 27444932 PMC4963294
  28. [31]Shekelle RB, Shryock AM, Paul O, Lepper M, Stamler J, Liu S, & Raynor WJ Jr. (1981). Diet, serum cholesterol, and death from coronary heart disease. New England Journal of Medicine, 304, 65– 70. 7442730

Cited by

Sorted by citations

Authors
Haslam, D. E., Li, J., Dillon, S. T., Gu, X., Cao, Y., Zeleznik, O. A., Sasamoto, N., Zhang, X., Eliassen, A. H., Liang, L., Stampfer, M. J., Mora, S., Chen, Z., Terry, K. L., Gerszten, R. E., Hu, F. B., Chan, A. T., Libermann, T. A., & Bhupathiraju, S. N.
Affiliations
  • Brigham and Women's Hospital (US)
  • Harvard University (US)
  • Beth Israel Deaconess Medical Center (US)
  • Washington University in St. Louis (US)
  • Broad Institute (US)
Corresponding author
Bhupathiraju, Shilpa N.
Venue
PROTEOMICS
Publisher
Wiley
Published
2022-05-31
Volume
22
Issue
13-14
Pages
e2100170-e2100170
ISSN
  • 1615-9853 (ISSN-L)
  • 1615-9861
OpenAlex
W4281252748
Cited by
157
References
2
Citations by year
2026: 48 · 2025: 48 · 2024: 33 · 2023: 26 · 2022: 2
FWCI
8.90
Type
journal article
Language
en
Open access
Locations
  • PROTEOMICS (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • Cancer Research UK
  • National Institutes of Health (P30 CA006516, R01 CA49449, R01 CA67262, T32 CA009001, U01 CA167552, U01 CA176726, UM1 CA186107)
  • U.S. Department of Defense (OCRP W81XWH2110320)
  • J. Willard and Alice S. Marriott Foundation
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Advanced Biosensing Techniques and Applications
  • Physical Sciences › Chemistry › Spectroscopy › Advanced Proteomics Techniques and Applications
  • Health Sciences › Medicine › Physiology › Clinical Laboratory Practices and Quality Control
Keywords
Olink, SomaScan, high-throughput proteomics, plasma proteome, delayed sample processing, within-person variability, reproducibility, protein stability, Nurses' Health Study, Health Professionals Follow-up Study, proteoforms
MeSH terms
Follow-Up Studies, Humans, Specimen Handling, Reproducibility of Results, Epidemiologic Studies, Proteomics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review