Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

Chen, Richard J.; Chen, Chengkuan; Li, Yicong; Chen, Tiffany Y.; Trister, Andrew D.; Krishnan, Rahul G.; Mahmood, Faisal

doi:10.1109/cvpr52688.2022.01567

Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. 256 × 256, 384 × 384). For gigapixel whole-slide imaging (WSI) in computational pathology, …