CoChat
Sign Up
Cited by 24Lung Cancer Diagnosis and TreatmentMedical Imaging Techniques and ApplicationsRadiomics and Machine Learning in Medical Imaging

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Inter-observer agreement improves with PERCIST 1.0 as opposed to qualitative evaluation in non-small cell lung cancer patients evaluated with F-18-FDG PET/CT early in the course of chemo-radiotherapy

Open access
Fledelius, Joan, Khalil, Azza, Hjorthaug, Karin, Frøkiær, Jørgen·2016·EJNMMI Research
DOI 10.1186/s13550-016-0223-6PMC PMC5031580
Open this paper in CoChat — free accountOpen PDF

Abstract

BACKGROUND: The purpose of this study is to determine whether a qualitative approach or a semi-quantitative approach provides the most robust method for early response evaluation with 2'-deoxy-2'-[(18)F]fluoro-D-glucose (F-18-FDG) positron emission tomography combined with whole body computed tomography (PET/CT) in non-small cell lung cancer (NSCLC). In this study eight Nuclear Medicine consultants analyzed F-18-FDG PET/CT scans from 35 patients with locally advanced NSCLC. Scans were performed at baseline and after 2 cycles of chemotherapy. Each observer used two different methods for evaluation: (1) PET response criteria in solid tumors (PERCIST) 1.0 and (2) a qualitative approach. Both methods allocate patients into one of four response categories (complete and partial metabolic response (CMR and PMR) and stable and progressive metabolic disease (SMD and PMD)). The inter-observer agreement was evaluated using Fleiss' kappa for multiple raters, Cohens kappa for comparison of the two methods, and intraclass correlation coefficients (ICC) for comparison of lean body mass corrected standardized uptake value (SUL) peak measurements. RESULTS: The agreement between observers when determining the percentage change in SULpeak was "almost perfect", with ICC = 0.959. There was a strong agreement among observers allocating patients to the different response categories with a Fleiss kappa of 0.76 (0.71-0.81). In 22 of the 35 patients, complete agreement was observed with PERCIST 1.0. The agreement was lower when using the qualitative method, moderate, having a Fleiss kappa of 0.60 (0.55-0.64). Complete agreement was achieved in only 10 of the 35 patients. The difference between the two methods was statistically significant (p < 0.005) (chi-squared). Comparing the two methods for each individual observer showed Cohen's kappa values ranging from 0.64 to 0.79, translating into a strong agreement between the two methods. CONCLUSIONS: PERCIST 1.0 provides a higher overall agreement between observers than the qualitative approach in categorizing early treatment response in NSCLC patients. The inter-observer agreement is in fact strong when using PERCIST 1.0 even when the level of instruction is purposely kept to a minimum in order to mimic the everyday situation. The variability is largely owing to the subjective elements of the method.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13550-016-0223-6

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 2 references

Research works printed but not linked: 38

  1. Therasse P, Arbuck SG, Eisenhauer EA, Wanders J, Kaplan RS, Rubinstein L, et al. New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst. 2000;92:205–16. · DOI · Paper page
  2. Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, et al. New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer. 2009;45:228–47. · DOI · Paper page
  3. Monsky WL, Raptopoulos V, Keogan MT, Doty D, Kamel I, Yam CS, et al. Reproducibility of linear tumor measurements using PACS: comparison of caliper method with edge-tracing method. Eur Radiol. 2004;14:519–25. · DOI
  4. Huang YE, Chen CF, Huang YJ, Konda SD, Appelbaum DE, Pu Y. Interobserver variability among measurements of the maximum and mean standardized uptake values on (18) F-FDG PET/CT and measurements of tumor size on diagnostic CT in patients with pulmonary tumors. Acta Radiol. 2010;51:782–8. · DOI
  5. Wormanns D, Diederich S, Lentschig MG, Winter F, Heindel W. Spiral CT of pulmonary nodules: interobserver variation in assessment of lesion size. Eur Radiol. 2000;10:710–3. · DOI
  6. Schwartz LH, Ginsberg MS, DeCorato D, Rothenburg LN, Einstein S, Kijewski P, et al. Evaluation of tumor measurements in oncology: use of film-based and electronic techniques. J Clin Oncol. 2000;18:2179–84. · DOI
  7. Jacene HA, Leboulleux S, Baba S, Chatzifotiadis D, Goudarzi B, Teytelbaum O, et al. Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy. J Nucl Med. 2009;50:1760–9. · DOI
  8. Erasmus JJ, Gladish GW, Broemeling L, Sabloff BS, Truong MT, Herbst RS, et al. Interobserver and intraobserver variability in measurement of non-small-cell carcinoma lung lesions: implications for assessment of tumor response. J Clin Oncol. 2003;21:2574–82. · DOI
  9. Hicks RJ, Kalff V, MacManus MP, Ware RE, McKenzie AF, Matthews JP, et al. The utility of (18)F-FDG PET for suspected recurrent non-small cell lung cancer after potentially curative therapy: impact on management and prognostic stratification. J Nucl Med. 2001;42:1605–13.
  10. Fischer BM, Lassen U, Højgaard L. PET-CT in preoperative staging of lung cancer. N Engl J Med. 2011;364:980–1. · DOI
  11. Cerfolio RJ, Bryant AS, Winokur TS, Ohja B, Bartolucci AA. Repeat FDG-PET after neoadjuvant therapy is a predictor of pathologic response in patients with non-small cell lung cancer. Ann Thorac Surg. 2004;78:1903–9. · DOI
  12. Choi NC, Fischman AJ, Niemierko A, Ryu JS, Lynch T, Wain J, et al. Dose-response relationship between probability of pathologic tumor control and glucose metabolic rate measured with FDG PET after preoperative chemoradiotherapy in locally advanced non-small-cell lung cancer. Int J Radiat Oncol Biol Phys. 2002;54:1024–35. · DOI
  13. Hellwig D, Graeter TP, Ukena D, Georg T, Kirsch C-M, Schäfers H-J. Value of F-18-fluorodeoxyglucose positron emission tomography after induction therapy of locally advanced bronchogenic carcinoma. J Thorac Cardiovasc Surg. 2004;128:892–9. · DOI
  14. Yamamoto Y, Nishiyama Y, Monden T, Sasakawa Y, Ohkawa M, Gotoh M, et al. Correlation of FDG-PET findings with histopathology in the assessment of response to induction chemoradiotherapy in non-small cell lung cancer. Eur J Nucl Med Mol Imaging. 2006;33:140–7. · DOI
  15. Vansteenkiste JF, Stroobants SG, De Leyn PR, Dupont PJ, Verbeken EK. Potential use of FDG-PET scan after induction chemotherapy in surgically staged IIIa-N2 non-small-cell lung cancer: a prospective pilot study. The Leuven Lung Cancer Group. Ann Oncol. 1998;9:1193–8. · DOI
  16. Dooms C, Verbeken E, Stroobants S, Vansteenkiste J. Biological correlates of the maximum 18-fluoro-2-deoxy-glucose uptake on positron emission tomography in non-small cell lung carcinoma after induction chemotherapy. J Thorac Oncol. 2009;4:1221–5. · DOI
  17. Pöttgen C, Levegrün S, Theegarten D, Marnitz S, Grehl S, Pink R, et al. Value of 18F-fluoro-2-deoxy-D-glucose-positron emission tomography/computed tomography in non-small-cell lung cancer for prediction of pathologic response and times to relapse after neoadjuvant chemoradiotherapy. Clin Cancer Res. 2006;12:97–106. · DOI
  18. Zander T, Scheffler M, Nogova L, Kobe C, Engel-Riedel W, Hellmich M, et al. Early prediction of nonprogression in advanced non-small-cell lung cancer treated with erlotinib by using [(18)F]fluorodeoxyglucose and [(18)F]fluorothymidine positron emission tomography. J Clin Oncol. 2011;29:1701–8. · DOI
  19. Lee DH, Kim SK, Lee HY, Lee SY, Park SH, Kim HY, et al. Early prediction of response to first-line therapy using integrated 18F-FDG PET/CT for patients with advanced/metastatic non-small cell lung cancer. J Thorac Oncol. 2009;4(7):816–21. · DOI
  20. Kobe C, Scheffler M, Holstein A, Zander T, Nogova L, Lammertsmaa AA, et al. Predictive value of early and late residual 18F-fluorodeoxyglucose and 18F-fluorothymidine uptake using different SUV measurements in patients with non-small-cell lung cancer treated with erlotinib. Eur J Nucl Med Mol Imaging. 2012;39:1117–27. · DOI
  21. Van Elmpt W, Ollers M, Dingemans A-MC, Lambin P, De Ruysscher D. Response assessment using 18F-FDG PET early in the course of radiotherapy correlates with survival in advanced-stage non-small cell lung cancer. J Nucl Med. 2012;53:1514–20. · DOI
  22. Wahl RL, Jacene H, Kasamon Y, Lodge MA. From RECIST to PERCIST: evolving considerations for PET response criteria in solid tumors. J Nucl Med. 2009;50:122S–50S. · DOI · Paper page
  23. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74. · DOI · Paper page
  24. Smulders SA, Gundy CM, Van Lingen A, Comans EF, Smeenk FWJM, Hoekstra OS. Observer variation of 2-deoxy-2-[F-18]fluoro-D-glucose-positron emission tomography in mediastinal staging of non-small cell lung cancer as a function of experience, and its potential clinical impact. Mol Imaging Biol. 2007;9:318–22. · DOI
  25. Wahl RL, Siegel BA, Coleman RE, Gatsonis CG. Prospective multicenter study of axillary nodal staging by positron emission tomography in breast cancer: a report of the staging breast cancer with PET Study Group. J Clin Oncol. 2004;22:277–85. · DOI
  26. Fakhry N, Lussato D, Jacob T, Giorgi R, Giovanni A, Zanaret M. Comparison between PET and PET/CT in recurrent head and neck cancer and clinical implications. Eur Arch Otorhinolaryngol. 2007;264:531–8. · DOI
  27. Van der Putten L, Hoekstra OS, De Bree R, Van den Brekel MW, Balm AJ, Hoebers FJ, et al. 2-Deoxy-2[F-18]FDG-PET for detection of recurrent laryngeal carcinoma after radiotherapy: interobserver variability in reporting. Mol Imaging Biol. 2008;10:294–303. · DOI
  28. Goh V, Shastry M, Engledow A, Kozarski P, Peck J, Endozo R, et al. Integrated (18)F-FDG PET/CT and perfusion CT of primary colorectal cancer: effect of inter- and intraobserver agreement on metabolic-vascular parameters. AJR Am J Roentgenol. 2012;199:1003–9. · DOI
  29. Marom EM, Munden RF, Truong MT, Gladish GW, Podoloff DA, Mawlawi O, et al. Interobserver and intraobserver variability of standardized uptake value measurements in non-small-cell lung cancer. J Thorac Imaging. 2006;200621(3):205–12. · DOI
  30. Jackson T, Chung MK, Mercier G, Ozonoff A, Subramaniam RM. FDG PET/CT interobserver agreement in head and neck cancer: FDG and CT measurements of the primary tumor site. Nucl Med Commun. 2012;33:305–12. · DOI
  31. Benz MR, Allen-Auerbach MS, Eilber FC, Chen HJ, Dry S, Phelps ME, et al. Combined assessment of metabolic and volumetric changes for assessment of tumor response in patients with soft-tissue sarcomas. J Nucl Med. 2008;49:1579–84. · DOI
  32. Weber WA, Ziegler SI, Thödtmann R, Hanauske AR, Schwaiger M. Reproducibility of metabolic measurements in malignant tumors using FDG PET. J Nucl Med. 1999;40:1771–7.
  33. Nakamoto Y, Zasadny KR, Minn H, Wahl RL. Reproducibility of common semi-quantitative parameters for evaluating lung cancer glucose metabolism with positron emission tomography using 2-deoxy-2-[18F]fluoro-D-glucose. Mol Imaging Biol. 2002;4:171–8. · DOI
  34. Krak NC, Boellaard R, Hoekstra OS, Twisk JWR, Hoekstra CJ, Lammertsma AA. Effects of ROI definition and reconstruction method on quantitative outcome and applicability in a response monitoring trial. Eur J Nucl Med Mol Imaging. 2005;32:294–301. · DOI
  35. Nahmias C, Wahl LM. Reproducibility of standardized uptake value measurements determined by 18F-FDG PET in malignant tumors. J Nucl Med. 2008;49:1804–8. · DOI
  36. Zijlstra JM, Comans EF, Van Lingen A, Hoekstra OS, Gundy CM, Willem Coebergh J, et al. FDG PET in lymphoma: the need for standardization of interpretation. An observer variation study. Nucl Med Commun. 2007;28:798–803. · DOI
  37. Itti E, Meignan M, Berriolo-Reidinger A, Biggi A, Cashen AF, Véra P, et al. An international confirmatory study of the prognostic value of early PET/CT in diffuse large B-cell lymphoma: comparison between Deauvill criteria and ∆SUVmax. EJNMMI. 2013;40:1312–20.
  38. Fledelius J, Khalil AA, Hjorthaug K, Frøkiær J. Using positron emission tomography (PET) response criteria in solid tumours (PERCIST) 1.0 for evaluation of 2′-deoxy-2′-[18F] fluoro-D-glucose-PET/CT scans to predict survival early during treatment of locally advanced non-small cell lung cancer (NSCLC). J Med Imaging Radiat Oncol. 2016;60:231–8. · DOI

Cited by

Sorted by citations

See all 24

Metadata

Authors
Fledelius, J., Khalil, A., Hjorthaug, K., & Frøkiær, J.
Affiliations
  • Regionshospitalet Herning (DK)
  • Aarhus University Hospital (DK)
Corresponding author
Fledelius, Joan
ORCID
Venue
EJNMMI Research
Publisher
Springer Science and Business Media LLC
Published
2016-09-22
Volume
6
Issue
1
Pages
71-71
ISSN
2191-219X (ISSN-L)
DOI
10.1186/s13550-016-0223-6
PMC
PMC5031580
OpenAlex
W2523033325
Cited by
24
References
2
Citations by year
2025: 1 · 2023: 6 · 2022: 3 · 2021: 1 · 2020: 3 · 2019: 3 · 2018: 4 · 2017: 3
FWCI
2.98
Type
journal article
Language
en
Open access
Licence
Locations
  • EJNMMI Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Aarhus Universitet
  • Aarhus Universitetshospital
Topics
  • Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Diagnosis and Treatment
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Medical Imaging Techniques and Applications
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
non-small cell lung cancer, PERCIST 1.0, F-18 FDG PET/CT, tumor response assessment, interobserver agreement, standardized uptake value, chemoradiotherapy, early treatment response, locally advanced non-small cell lung cancer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review