The DOI matches its DataCite record; 37 of the 37 references it cites were found in a registry or an index.
Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks
Open accessAbstract
Many machine learning tasks such as multiple instance learning, 3D shape recognition, and few-shot image classification are defined on sets of instances. Since solutions to such problems do not depend on the order of elements of the set, models used to address them should be permutation invariant. We present an attention-based neural network module, the Set Transformer, specifically designed to model interactions among elements in the input set. The model consists of an encoder and a decoder, both of which rely on attention mechanisms. In an effort to reduce computational complexity, we introduce an attention scheme inspired by inducing point methods from sparse Gaussian process literature. It reduces the computation time of self-attention from quadratic to linear in the number of elements in the set. We show that our model is theoretically attractive and we evaluate it on a range of tasks, demonstrating the state-of-the-art performance compared to recent methods for set-structured data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This is not surprising, given that self-attention is an equivariant transformation capable of performing pooling operations like max-pooling [12].”
From Exploring Length Generalization in Large Language Models (2022) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R., Su, H., Mo, K., & Guibas, L. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.16 · Cited by 10,029
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Prototypical Networks for Few-shot LearningPreprint
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 6,245
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298801 · Cited by 5,413
Research works printed but not linked: 5
- Garnelo, M., Rosenbaum, D., Maddison, C. J., Ramalho, T., Saxton, D., Shanahan, M., Teh, Y. W., Rezende, D. J., and Eslami, S. M. A. Conditional neural processes. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
- Lee, Y. and Choi, S. Gradient-based meta-learning with learned layerwise metric and subspace. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
- Oliva, J., Póczos, B., and Schneider, J. Distribution to dis- tribution regression. In Proceedings of the International Conference on Machine Learning (ICML), 2013.
- Schmidhuber, J. Evolutionary Principles in Self-Referential Learning. PhD thesis, Technical University of Munich, 1987.
- Zaheer, M., Kottur, S., Ravanbakhsh, S., Poczos, B., Salakhutdinov, R. R., and Smola, A. J. Deep sets. In Advances in Neural Information Processing Systems (NeurIPS), 2017.
Cited by
Sorted by citations
Items 101–200 of 694
Scalable, Detailed and Mask-Free Universal Photometric Stereo
Ikehata, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01268 · Cited by 55
Predicting Temporal Sets with Deep Neural Networks
Yu, L., Sun, L., Du, B., Liu, C., Xiong, H., & Lv, W. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403152 · Cited by 58
Cai, H., Feng, X., Yin, R., Zhao, Y., Guo, L., Fan, X., & Liao, J. (2022) · The Journal of Pathology · doi:10.1002/path.6027 · Cited by 53
Online portfolio management via deep reinforcement learning with high-frequency data
Li, J., Zhang, Y., Yang, X., & Chen, L. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103247 · Cited by 56
CellFlow enables generative single-cell phenotype modeling with flow matchingPreprint
Klein, D., Fleck, J. S., Bobrovskiy, D. M., Zimmermann, L., Becker, S., Palma, A., Dony, L., Tejada-Lapuerta, A., Huguet, G., Lin, H., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.04.11.648220 · Cited by 65
CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification
Chikontwe, P., Kim, S., & Park, S. H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01415 · Cited by 52
I’m Me, We’re Us, and I’m Us: Tri-directional Contrastive Learning on Hypergraphs
Lee, D., & Shin, K. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26019 · Cited by 55
CLIPPO: Image-and-Language Understanding from Pixels Only
Tschannen, M., Mustafa, B., & Houlsby, N. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01059 · Cited by 65
Guo, S., Lin, Y., Gong, L., Wang, C., Zhou, Z., Shen, Z., Huang, Y., & Wan, H. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00125 · Cited by 51
Prediction of Natural Product Classes Using Machine Learning and 13C NMR Spectroscopic Data
Martínez-Treviño, S. H., Uc-Cetina, V., Fernández‐Herrera, M. A., & Merino, G. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00293 · Cited by 50
UCSG-Net -- Unsupervised Discovering of Constructive Solid Geometry TreePreprint
Kania, K., Zięba, M., & Kajdanowicz, T. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09102 · Cited by 52
A Deformable Attention Network for High-Resolution Remote Sensing Images Semantic Segmentation
Zuo, R., Zhang, G., Zhang, R., & Jia, X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3119537 · Cited by 48
An end-to-end attention-based approach for learning on graphs
Buterez, D., Janet, J. P., Oglić, D., & Lió, P. (2025) · Nature Communications · doi:10.1038/s41467-025-60252-z · Cited by 57
Advanced Feature Learning on Point Clouds Using Multi-Resolution Features and Learnable Pooling
Wijaya, K. T., Paek, D.-H., & Kong, S.-H. (2024) · Remote Sensing · doi:10.3390/rs16111835 · Cited by 48
CHGNN: A Semi-Supervised Contrastive Hypergraph Learning Network
Song, Y., Gu, Y., Li, T., Qi, J., Liu, Z., Jensen, C. S., & Yu, G. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3380643 · Cited by 47
LieTransformer: Equivariant self-attention for Lie GroupsPreprint
Hutchinson, M., Lan, C. L., Zaidi, S., Dupont, E., Teh, Y. W., & Kim, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10885 · Cited by 51
Self-citationSolving 3D packing problem using Transformer network and reinforcement learning
Que, Q., Yang, F. C., & Zhang, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119153 · Cited by 46
Vargas, S., Gee, W., & Alexandrova, A. N. (2024) · Digital Discovery · doi:10.1039/d4dd00057a · Cited by 49
RecipeRec: A Heterogeneous Graph Learning Model for Recipe Recommendation
Tian, Y., Zhang, C., Guo, Z., Huang, C., Metoyer, R., & Chawla, N. V. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/481 · Cited by 53
Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving
Bronstein, E., Palatucci, M., Notz, D., White, B., Kuefler, A., Lu, Y., Paul, S., Nikdel, P., Mougin, P., Chen, H., et al. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981695 · Cited by 46
Contrastively enforcing distinctiveness for multi-label image classification
Dao, S. D., Zhao, H., Phung, D., & Cai, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126605 · Cited by 53
Exploring Length Generalization in Large Language Models
Anil, C., Wu, Y., Andreassen, A., Lewkowycz, A., Misra, V., Ramasesh, V., Slone, A., Gur-Ari, G., Dyer, E., & Neyshabur, B. (2022) · arXiv · doi:10.48550/arxiv.2207.04901 · Cited by 44
Permutationless many-jet event reconstruction with symmetry preserving attention networks
Fenton, M. J., Shmakov, A., Ho, T.-W., Hsu, S.-C., Whiteson, D., & Baldi, P. (2022) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.105.112008 · Cited by 56
Personalized Outfit Recommendation with Learnable Anchors
Lu, Z. P., Hu, Y., Chen, Y., & Zeng, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01253 · Cited by 44
V2VFormer: Vehicle-to-Vehicle Cooperative Perception With Spatial-Channel Transformer
Lin, C., Tian, D., Duan, X., Zhou, J., Zhao, D., & Cao, D. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3353254 · Cited by 42
NRTSI: Non-Recurrent Time Series Imputation
Shan, S., Li, Y., & Oliva, J. B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095054 · Cited by 47
MetaFun: Meta-Learning with Iterative Functional UpdatesPreprint
Xu, J., Ton, J.-F., Kim, H., Kosiorek, A. R., & Teh, Y. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02738 · Cited by 42
Self-citationPoints to Patches: Enabling the Use of Self-Attention for 3D Shape Recognition
Berg, A., Oskarsson, M., & O'Connor, M. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956172 · Cited by 42
Improved Brain Age Estimation With Slice-Based Set Networks
Gupta, U., Lam, P., Steeg, G. V., & Thompson, P. M. (2021) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9434081 · Cited by 41
Randomized Entity-wise Factorization for Multi-Agent Reinforcement LearningPreprint
Iqbal, S., de Witt, C. A. S., Peng, B., Böhmer, W., Whiteson, S., & Sha, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04222 · Cited by 49
Tang, Y., & Ha, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02869 · Cited by 44
Tutorial on Amortized Optimization
Amos, B. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000102 · Cited by 100
PointConvFormer: Revenge of the Point-based Convolution
Wu, W., Li, F., & Shan, Q. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02088 · Cited by 40
Ge, L., Singh, P., & Sadhu, A. (2024) · Structural Health Monitoring · doi:10.1177/14759217241235637 · Cited by 41
Molecular set representation learning
Boulougouri, M., Vandergheynst, P., & Probst, D. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00856-0 · Cited by 42
Building powerful and equivariant graph neural networks with structural message-passingPreprint
Vignac, C., Loukas, A., & Frossard, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15107 · Cited by 41
Jing, Y., Sheil, B. B., & Acikgoz, S. (2024) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.13201 · Cited by 41
Generative Models as Distributions of Functions
Dupont, E., Teh, Y. W., & Arnaud Doucet, B. (2021) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2102.04776 · Cited by 73
Self-citationReinforcement Learning in Manufacturing Control: Baselines, challenges and ways forward
Самсонов, В., Hicham, K. B., & Meisen, T. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104868 · Cited by 38
Tripathy, R. K., Frohock, Z., Wang, H., Cary, G. A., Keegan, S., Carter, G. W., & Li, Y. (2025) · npj Systems Biology and Applications · doi:10.1038/s41540-025-00519-9 · Cited by 36
RECIPTOR: An Effective Pretrained Model for Recipe Representation Learning
Li, D., & Zaki, M. J. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403223 · Cited by 36
Universal pooling – A new pooling method for convolutional neural networks
Hyun, J., Seong, H., & Kim, E. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115084 · Cited by 36
Tang, H., Zhu, X., Chen, K., Jia, K., & Chen, C. L. P. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3087830 · Cited by 37
Deep generative models for detector signature simulation: A taxonomic review
Hashemi, H., & Krause, C. (2024) · Reviews in Physics · doi:10.1016/j.revip.2024.100092 · Cited by 56
Multi-Person 3D Motion Prediction with Multi-Range TransformersPreprint
Wang, J., Xu, H., Narasimhan, M., & Wang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.12073 · Cited by 37
Learning GNSS Positioning Corrections for Smartphones Using Graph Convolution Neural Networks
Mohanty, A., & Gao, G. (2023) · NAVIGATION Journal of the Institute of Navigation · doi:10.33012/navi.622 · Cited by 34
Weijler, L., Kowarsch, F., Wödlinger, M., Reiter, M., Maurer‐Granofszky, M., Schumich, A., & Dworzak, M. N. (2022) · Cancers · doi:10.3390/cancers14040898 · Cited by 34
Rep the Set: Neural Networks for Learning Set RepresentationsPreprint
Skianis, K., Nikolentzos, G., Limnios, S., & Vazirgiannis, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01962 · Cited by 35
Robots That Can See: Leveraging Human Pose for Trajectory Prediction
Salzmann, T., Chiang, H.-T. L., Ryll, M., Sadigh, D., Parada, C., & Bewley, A. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3312035 · Cited by 33
SHAPE: A Sample-Adaptive Hierarchical Prediction Network for Medication Recommendation
Liu, S., Wang, X., Du, J., Hou, Y., Zhao, X., Xu, H., Wang, H., Xiang, Y., & Tang, B. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3320139 · Cited by 37
Learned Queries for Efficient Local Attention
Arar, M., Shamir, A., & Bermano, A. H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01057 · Cited by 37
Automated identification of cell populations in flow cytometry data with transformers
Wödlinger, M., Reiter, M., Weijler, L., Maurer‐Granofszky, M., Schumich, A., Sajaroff, E. O., Groeneveld‐Krentz, S., Rossi, J. G., Karawajew, L., Ratei, R., et al. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105314 · Cited by 32
Scalable SoftGroup for 3D Instance Segmentation on Point Clouds
Vu, T., Kim, K., Nguyen, T., Luu, T. M., Kim, J., & Yoo, C. D. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3326189 · Cited by 32
Self-citationA functional approach to rotation equivariant non-linearities for Tensor Field Networks
Poulenard, A., & Guibas, L. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01297 · Cited by 32
Universal Photometric Stereo Network using Global Lighting Contexts
Ikehata, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01226 · Cited by 32
Position-Aware Relational Transformer for Knowledge Graph Embedding
Li, G., Sun, Z., Hu, W. P., Cheng, G., & Qu, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3262937 · Cited by 33
MBPTrack: Improving 3D Point Cloud Tracking with Memory networks and Box Priors
Xu, T.-X., Guo, Y.-C., Lai, Y., & Zhang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00909 · Cited by 32
Hang, C. N., Tsai, Y.-Z., Yu, P.-D., Chen, J., & Tan, C. W. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7020108 · Cited by 31
Explainable AI for trustworthy intelligent process monitoring
Johannssen, A., Qiu, P., Yeganeh, A., & Chukhrova, N. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.111407 · Cited by 31
Few-Shot and Continual Learning with Attentive Independent Mechanisms
Lee, E., Huang, C., & Lee, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00932 · Cited by 32
Wang, Z., Peng, D., Shang, Y., & Gao, J. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.756868 · Cited by 31
3DInAction: Understanding Human Actions in 3D Point Clouds
Ben-Shabat, Y., Shrout, O., & Gould, S. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01888 · Cited by 30
An End-to-End Deep RL Framework for Task Arrangement in Crowdsourcing Platforms
Shan, C., Mamoulis, N., Cheng, R. C. K., Li, G., Li, X., & Qian, Y. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00012 · Cited by 30
Finetuning Pretrained Transformers into RNNs
Kasai, J., Peng, H., Zhang, Y., Yogatama, D., Ilharco, G., Pappas, N., Mao, Y., Chen, W., & Smith, N. A. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.830 · Cited by 79
Zhu, W., Khademi, W., Charalampidis, E. G., & Kevrekidis, P. G. (2022) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2022.133264 · Cited by 30
Evolving modular soft robots without explicit inter-module communication using local self-attention
Pigozzi, F., Tang, Y., Medvet, E., & Ha, D. (2022) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3512290.3528762 · Cited by 32
Keyword decisions in sponsored search advertising: A literature review and research agenda
Yang, Y., & Li, H. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103142 · Cited by 30
SceneTrilogy: On Human Scene-Sketch and its Complementarity with Photo and Text
Chowdhury, P. N., Bhunia, A. K., Sain, A., Koley, S., Xiang, T., & Song, Y.-Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01056 · Cited by 31
Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers
Wei, C., Duke, B., Jiang, R., Aarabi, P., Taylor, G. W., & Shkurti, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02172 · Cited by 32
PReFormer: A memory-efficient transformer for point cloud semantic segmentation
Akwensi, P. H., Wang, R., & Guo, B. (2024) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2024.103730 · Cited by 29
Zhu, M., Gong, Y., Tian, C., & Zhu, Z. (2024) · Drones · doi:10.3390/drones8080412 · Cited by 30
Machine Learning in Small-Molecule Mass Spectrometry
Hong, Y., Ye, Y., & Tang, H. (2025) · Annual Review of Analytical Chemistry · doi:10.1146/annurev-anchem-071224-082157 · Cited by 29
FIORA: Local neighborhood-based prediction of compound mass spectra from single fragmentation events
Nowatzky, Y., Russo, F. F., Lisec, J., Kister, A., Reinert, K., Muth, T., & Benner, P. (2025) · Nature Communications · doi:10.1038/s41467-025-57422-4 · Cited by 29
MSST-RT: Multi-Stream Spatial-Temporal Relative Transformer for Skeleton-Based Action Recognition
Sun, Y., Shen, Y., & Ma, L. (2021) · Sensors · doi:10.3390/s21165339 · Cited by 29
RecipeBowl: A Cooking Recommender for Ingredients and Recipes Using Set Transformer
Gim, M., Park, D., Spranger, M., Maruyama, K., & Kang, J. (2021) · IEEE Access · doi:10.1109/access.2021.3120265 · Cited by 29
Fast, Accurate, and Simple Models for Tabular Data via Augmented DistillationPreprint
Fakoor, R., Mueller, J. W., Erickson, N., Chaudhari, P., & Smola, A. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14284 · Cited by 29
Unfolding Explainable AI for Brain Tumor Segmentation
Hassan, M. A., Fateh, A. A., Lin, J., Zhuang, Y., Lin, G., Xiong, H., You, Z., Qin, P., & Zeng, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128058 · Cited by 28
Chikontwe, P., Kim, M., Jeong, J., Sung, H. J., Go, H., Nam, S. J., & Park, S. H. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3446716 · Cited by 31
Du, K.-L., Zhang, R., Jiang, B., Zeng, J., & Lu, J. (2025) · Mathematics · doi:10.3390/math13030451 · Cited by 35
Amortized Variational Inference: A Systematic Review
Ganguly, A., Jain, S., & Watchareeruetai, U. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14258 · Cited by 35
Pre-Training General Trajectory Embeddings With Maximum Multi-View Entropy Coding
Lin, Y. D., Wan, H., Guo, S., Hu, J., Jensen, C. S., & Lin, Y. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3347513 · Cited by 32
You Never Cluster AlonePreprint
Shen, Y., Shen, Z., Wang, M., Qin, J., Torr, P. H. S., & Shao, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01908 · Cited by 29
Frozen Feature Augmentation for Few-Shot Image Classification
Bär, A., Houlsby, N., Dehghani, M., & Kumar, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01519 · Cited by 28
Bag Graph: Multiple Instance Learning Using Bayesian Graph Neural Networks
Pal, S., Valkanas, A., Regol, F., & Coates, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20762 · Cited by 27
VecFusion: Vector Font Generation with Diffusion
Thamizharasan, V., Liu, D., Agarwal, S., Fisher, M., Gharbi, M., Wang, O., Jacobson, A., & Kalogerakis, E. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00759 · Cited by 27
Counterfactual Data Augmentation using Locally Factored Dynamics
Pitis, S., Creager, E., & Garg, A. (2020) · arXiv · doi:10.48550/arxiv.2007.02863 · Cited by 26
State-Augmented Learnable Algorithms for Resource Management in Wireless Networks
Naderializadeh, N., Eisen, M., & Ribeiro, A. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3229948 · Cited by 26
Yin, P., Zhang, D., Han, W., Li, J., & Cheng, J. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3214889 · Cited by 29
Deep Multi-Instance Learning with Induced Self-Attention for Medical Image Classification
Li, Z., Yuan, L., Xu, H., Cheng, R., & Wen, X. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313518 · Cited by 26
Positional Artefacts Propagate Through Masked Language Model Embeddings
Luo, Z., Kulmizev, A., & Mao, X. (2021) · doi:10.18653/v1/2021.acl-long.413 · Cited by 25
Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics
Li, C., Zhu, X., Yao, J., & Huang, J. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956296 · Cited by 25
Learning Molecular Mixture Property Using Chemistry-Aware Graph Neural Network
Zhang, H., Lai, T., Chen, J., Manthiram, A., Rondinelli, J. M., & Chen, W. (2024) · PRX Energy · doi:10.1103/prxenergy.3.023006 · Cited by 29
Cluster-Former: Clustering-based Sparse Transformer for Question Answering
Wang, S., Zhou, L., Gan, Z., Chen, Y.-C., Fang, Y., Sun, S., Cheng, Y., & Liu, J. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.346 · Cited by 27
A Full Transformer-based Framework for Automatic Pain Estimation using Videos
Gkikas, S., & Tsiknakis, M. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10340872 · Cited by 24
Deep anomaly detection on set data: Survey and comparison
Mašková, M., Zorek, M., Pevný, T., & Šmídl, V. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110381 · Cited by 25
Zeng, K., Yang, B., Zhao, X. J., Zhang, Y., Nie, F., Yang, X., Jin, Y., & Xu, Y. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00877-2 · Cited by 26
Saranti, A., Pfeifer, B., Gollob, C., Stampfer, K., & Holzinger, A. (2024) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1554 · Cited by 24
Conditional Set Generation with TransformersPreprint
Kosiorek, A. R., Kim, H., & Rezende, D. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16841 · Cited by 24
Self-citationRapid Neural Architecture Search by Learning to Generate Graphs from DatasetsPreprint
Lee, H., Hyung, E., & Hwang, S. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.00860 · Cited by 31
Centroid Transformers: Learning to Abstract with AttentionPreprint
Wu, L., Liu, X., & Liu, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08606 · Cited by 28
Metadata
- Authors
- Lee, J., Lee, Y., Kim, J., Kosiorek, A. R., Choi, S., & Teh, Y. W.
- Affiliations
- University of Oxford (GB)
- Pohang University of Science and Technology (KR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.00825
- OpenAlex
- W2894384847
- Cited by
- 691
- References
- 37
- Citations by year
- 2026: 20 · 2025: 84 · 2024: 116 · 2023: 137 · 2022: 96 · 2021: 145 · 2020: 76 · 2019: 16 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Oxford University Research Archive (ORA) (University of Oxford) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- European Commission (2007–2013, FP7 2007-2013, FP7/2007)
- Ministry of Science and ICT, South Korea (2017-0-01779)
- Samsung
- Engineering and Physical Sciences Research Council (EP/P026753/1)
- Institute for Information and Communications Technology Promotion (2017‐0‐01779, No.2017-0-01779)
- FP7 Ideas: European Research Council (617071)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- Set Transformer, permutation invariance, attention mechanism, multiple instance learning, 3D shape recognition, few-shot image classification, inducing points, sparse Gaussian processes, self-attention complexity, encoder-decoder architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
