Observer variation in the application of the Pheochromocytoma of the Adrenal Gland Scaled Score
Abstract
Morphologic determination of the malignant potential of adrenal pheochromocytoma is a challenging problem in surgical pathology. A multiparameter Pheochromocytoma of the Adrenal Gland Scaled Score (PASS) was recently developed based on a comprehensive study of a single institutional cohort of 100 cases. Assignment of a PASS was proposed to be useful for identifying pheochromocytomas with potential to metastasize, which defines malignancy according to the current World Health Organization terminology. A PASS is derived by evaluating multiple morphologic parameters to obtain a scaled score based on the summed weighted importance of each. Despite the proposal of this system several years ago, few studies have since examined its robustness and, in particular, the potential for observer variation inherent in the interpretation and assessment of these morphologic criteria. We further examined the utility of PASS by reviewing an independent single institutional cohort of adrenal pheochromocytomas as evaluated by 5 multi-institutional pathologists with at least 10 years experience in endocrine pathology. We found significant interobserver and intraobserver variation in assignment of PASS with variable interpretation of the underlying components. We consequently suggest that PASS requires further refinement and validation. We cannot currently recommend its use for clinical prognostication.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Subsequent validation by a panel of experienced pathologists concluded that due to significant inter- and intraobserver variation, PASS was not recommended for clinical prognostication.
“Subsequent validation by a panel of experienced pathologists concluded that due to significant inter- and intraobserver variation PASS was not recommended for clinical prognostication (120).”
From Adrenal incidentaloma (2020) · cites this paper as [120]
Cites
Thompson, L. D. R. (2002) · The American Journal of Surgical Pathology · doi:10.1097/00000478-200205000-00002 · Cited by 715 · see citing works
Linnoila, R. I., Keiser, H. R., Steinberg, S. M., & Lack, E. E. (1990) · Human Pathology · doi:10.1016/0046-8177(90)90155-x · Cited by 373 · see citing works
Nucleolar size indicates the rapidity of cell proliferation in cancer tissues
Derenzini, M., Treré, D., Pession, A., Govoni, M., Sirri, V., & Chieco, P. (2000) · The Journal of Pathology · doi:10.1002/(sici)1096-9896(200006)191:2 · Cited by 253 · see citing works
Pheochromocytomas: can malignant potential be predicted?
John, H., Ziegler, W. H., HAURI, D., et al. (1999) · Urology · doi:10.1016/s0090-4295(98)00612-8 · Cited by 251 · see citing works
Kaste, S. C., Pratt, C. B., Cain, A. M., Jones-Wallace, D., & Rao, B. N. (1999) · Cancer · doi:10.1002/(sici)1097-0142(19991015)86:8 · Cited by 212 · see citing works
Pheochromocytoma and functional paraganglioma syndrome: No longer the 10% tumor
Elder, E. E., Elder, G. J., & Larsson, C. (2005) · Journal of Surgical Oncology · doi:10.1002/jso.20177 · Cited by 171 · see citing works
Kimura, N., Watanabe, T., Noshiro, T., Shizawa, S., & Miura, Y. (2005) · Endocrine Pathology · doi:10.1385/ep:16:1:023 · Cited by 162 · see citing works
Prognostic markers in pheochromocytoma
Clarke, M. R., Weyant, R. J., Watson, C. G., & Carty, S. E. (1998) · Human Pathology · doi:10.1016/s0046-8177(98)90070-3 · Cited by 131 · see citing works
Elder, E. E., Xu, D., Höög, A., Enberg, U., Hou, M., Pisa, P., Gruber, A., Larsson, C., & Bäckdahl, M. (2003) · Modern Pathology · doi:10.1097/01.mp.0000056982.07160.e3 · Cited by 126 · see citing works
Palmqvist, R., Stenling, R., �berg, �., & Landberg, G. (1999) · The Journal of Pathology · doi:10.1002/(sici)1096-9896(199905)188:1 · Cited by 100 · see citing works
August, C., August, K., Schroeder, S., Bahn, H., Hinze, R., Baba, H., Kersting, C., & Buerger, H. (2004) · Modern Pathology · doi:10.1038/modpathol.3800160 · Cited by 78 · see citing works
Kumaki, N., Kajiwara, H., Kameyama, K., et al. (2002) · Endocrine Pathology · doi:10.1385/ep:13:2:149 · Cited by 45 · see citing works
GUPTA, D. K. D., Shidham, V. B., Holden, J. A., et al. (2000) · Applied Immunohistochemistry · doi:10.1097/00022744-200012000-00003 · Cited by 45 · see citing works
Gao, B., Meng, F., Bian, W., et al. (2006) · Urology · doi:10.1016/j.urology.2006.02.019 · Cited by 40 · see citing works
Khorram‐Manesh, A., Ahlman, H., Jansson, S. K. G., et al. (2002) · Endocrine Pathology · doi:10.1385/ep:13:2:099 · Cited by 39 · see citing works
Increased Expression of Tenascin in Pheochromocytomas Correlates With Malignancy
Salmenkivi, K., Haglund, C., Arola, J. T., & Heikkilä, P. (2001) · The American Journal of Surgical Pathology · doi:10.1097/00000478-200111000-00010 · Cited by 36 · see citing works
Pheochromocytoma-associated syndromes: genes, proteins and functions of RET, VHL and SDHx
Gimm, O. (2005) · Familial Cancer · doi:10.1007/s10689-004-5740-1 · Cited by 26 · see citing works
Expression and prognostic value of c‐erbB‐2 oncogene product in human phaeochromocytomas
Castilla‐Guerra, L., MORENO, A. M., Fernández-Moreno, M. C., Utrilla, J. C., FERNÁNDEZ, E., & GALERA‐DAVISON, H. (1997) · Histopathology · doi:10.1046/j.1365-2559.1997.2240838.x · Cited by 26 · see citing works
New Developments in the Detection of the Clinical Behavior of Pheochromocytomas and Paragangliomas
de Krijger, R. R., van Nederveen, F. H., Korpershoek, E., et al. (2006) · Endocrine Pathology · doi:10.1385/ep:17:2:137 · Cited by 18 · see citing works
Differential Heparanase-1 Expression in Malignant and Benign Pheochromocytomas
Quiros, R. M., Kim, A. W., Maxhimer, J. B., et al. (2002) · Journal of Surgical Research · doi:10.1006/jsre.2002.6451 · Cited by 15 · see citing works
Shah, M., Karelia, N. H., Patel, S. M., et al. (2003) · Annals of Surgical Oncology · doi:10.1245/aso.2003.04.007 · Cited by 10 · see citing works
PROGNOSTIC SIGNIFICANCE OF NUCLEAR DNA CONTENT IN PHAEOCHROMOCYTOMA
Cope, C., Delbridge, L., Philips, E., et al. (1991) · Australian and New Zealand Journal of Surgery · doi:10.1111/j.1445-2197.1991.tb00323.x · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Pathological grading for predicting metastasis in phaeochromocytoma and paraganglioma
Kimura, N., Takayanagi, R., Takizawa, N., Itagaki, E., Katabami, T., Kakoi, N., Rakugi, H., Ikeda, Y., Tanabe, A., Nigawara, T., et al. (2014) · Endocrine Related Cancer · doi:10.1530/erc-13-0494 · Cited by 393 · see citing works
Sherlock, M., Scarsbrook, A., Abbas, A., Fraser, S., Limumpornpetch, P., Dineen, R., & Stewart, P. M. (2020) · Endocrine Reviews · doi:10.1210/endrev/bnaa008 · Cited by 347 · see citing works
“Subsequent validation by a panel of experienced pathologists concluded that due to significant inter- and intraobserver variation PASS was not recommended for clinical prognostication (120).”
BackgroundKoh, J.-M., Ahn, S. H., Kim, H., Kim, B.-J., Sung, T.-Y., Kim, Y. H., Hong, S. J., Song, D. E., & Lee, S. H. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187398 · Cited by 114 · see citing works
- Authors
- Wu, D., Tischler, A. S., Lloyd, R. V., DeLellis, R. A., de Krijger, R., van Nederveen, F., & Nosé, V.
- Affiliations
- Brigham and Women's Hospital (US)
- Tufts University (US)
- Mayo Clinic (US)
- Brown University (US)
- Corresponding author
- Wu, David
- Nosé, Vânia
- Venue
- American Journal of Surgical Pathology
- Published
- 2009-04
- Volume
- 33
- Issue
- 4
- Pages
- 599-608
- ISSN
- 0147-5185 (ISSN-L)
- OpenAlex
- W2032929999
- Cited by
- 175
- References
- 22
- Citations by year
- 2026: 7 · 2025: 5 · 2024: 15 · 2023: 10 · 2022: 9 · 2021: 11 · 2020: 11 · 2019: 13 · 2018: 15 · 2017: 12 · 2016: 13 · 2015: 12 · 2014: 8 · 2013: 10 · 2012: 8
- FWCI
- 8.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Journal of Surgical Pathology (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Topics
- Health Sciences › Medicine › Surgery › Adrenal and Paraganglionic Tumors
- Health Sciences › Medicine › Epidemiology › Neuroendocrine Tumor Research Advances
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Renal cell carcinoma treatment
- Keywords
- pheochromocytoma, adrenal gland, observer variability, interobserver variability, intraobserver variability, metastatic potential, prognostic scoring
- MeSH terms
- Adolescent, Adrenal Gland Neoplasms, Adult, Aged, Child, Child, Preschool, Female, Humans, Male, Middle Aged, Neoplasm Recurrence, Local, Pheochromocytoma, Predictive Value of Tests, Prognosis, Severity of Illness Index, Observer Variation, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review