The DOI matches its DataCite record; 37 of the 37 references it cites were found in a registry or an index.
Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks
Open accessAbstract
Many machine learning tasks such as multiple instance learning, 3D shape recognition, and few-shot image classification are defined on sets of instances. Since solutions to such problems do not depend on the order of elements of the set, models used to address them should be permutation invariant. We present an attention-based neural network module, the Set Transformer, specifically designed to model interactions among elements in the input set. The model consists of an encoder and a decoder, both of which rely on attention mechanisms. In an effort to reduce computational complexity, we introduce an attention scheme inspired by inducing point methods from sparse Gaussian process literature. It reduces the computation time of self-attention from quadratic to linear in the number of elements in the set. We show that our model is theoretically attractive and we evaluate it on a range of tasks, demonstrating the state-of-the-art performance compared to recent methods for set-structured data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This is not surprising, given that self-attention is an equivariant transformation capable of performing pooling operations like max-pooling [12].”
From Exploring Length Generalization in Large Language Models (2022) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R., Su, H., Mo, K., & Guibas, L. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.16 · Cited by 10,029
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Prototypical Networks for Few-shot LearningPreprint
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 6,245
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298801 · Cited by 5,413
Research works printed but not linked: 5
- Garnelo, M., Rosenbaum, D., Maddison, C. J., Ramalho, T., Saxton, D., Shanahan, M., Teh, Y. W., Rezende, D. J., and Eslami, S. M. A. Conditional neural processes. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
- Lee, Y. and Choi, S. Gradient-based meta-learning with learned layerwise metric and subspace. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
- Oliva, J., Póczos, B., and Schneider, J. Distribution to dis- tribution regression. In Proceedings of the International Conference on Machine Learning (ICML), 2013.
- Schmidhuber, J. Evolutionary Principles in Self-Referential Learning. PhD thesis, Technical University of Munich, 1987.
- Zaheer, M., Kottur, S., Ravanbakhsh, S., Poczos, B., Salakhutdinov, R. R., and Smola, A. J. Deep sets. In Advances in Neural Information Processing Systems (NeurIPS), 2017.
Cited by
Sorted by citations
Items 201–300 of 694
Multi-View Stereo with TransformerPreprint
Zhu, J., Peng, B., Li, W., Shen, H., Zhang, Z., & Lei, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00336 · Cited by 28
Graph Attention Networks with Positional Embeddings
Ma, L., Rabbany, R., & Romero, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75762-5_41 · Cited by 26
Jointly Learning Sentimental Clues and Context Incongruity for Sarcasm Detection
Chen, W., Lin, F., Zhang, X., Li, G., & Liu, B. (2022) · IEEE Access · doi:10.1109/access.2022.3169864 · Cited by 23
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Zheng, N., Jiang, H., Zhang, Q., Han, Z., Ma, L., Yang, Y., Yang, F., Zhang, C., Qiu, L., Yang, M., et al. (2023) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3600006.3613139 · Cited by 30
Knowledge Guided Evolutionary Transformer for Remote Sensing Scene Classification
Zhao, J., Jiao, L., Wang, C., Liu, X., Liu, F., Li, L., Ma, M., & Yang, S. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3407138 · Cited by 23
Diagnostic Prediction with Sequence-of-sets Representation Learning for Clinical Events
Zhang, T., Chen, M., & Bui, A. A. T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59137-3_31 · Cited by 23
Interpretable part-whole hierarchies and conceptual-semantic relationships in neural networks
Garau, N., Bisagno, N., Sambugaro, Z., & Conci, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01332 · Cited by 23
Towards Differentiable ResamplingPreprint
Zhu, M., Murphy, K. D., & Jonschkowski, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.11938 · Cited by 23
Meta-Black-Box optimization for evolutionary algorithms: Review and perspective
Yang, X., Wang, R., Li, K., & Ishibuchi, H. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101838 · Cited by 27
Revisiting One-Stage Deep Uncalibrated Photometric Stereo via Fourier Embedding
Ju, Y., Shi, B., Wen, B., Lam, K., Jiang, X., & Kot, A. C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3557245 · Cited by 22
Papillon, M., Sanborn, S., Mathe, J., Cornelis, L., Bertics, A., Buracas, D., Lillemark, H. J., Shewmake, C., Dinç, F., Xavier Pennec, B., et al. (2025) · Machine Learning Science and Technology · doi:10.1088/2632-2153/adf375 · Cited by 44
Set-to-Sequence Ranking-Based Concept-Aware Learning Path Recommendation
Chen, X., Shen, J., Xia, W., Jin, J., Song, Y., Zhang, W., Liu, W., Zhu, M., Tang, R., Dong, K., et al. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25630 · Cited by 26
Yu, S. C. L., He, J., Gutiérrez-Basulto, V., & Pan, J. Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.594 · Cited by 24
HAMIL: Hierarchical aggregation-based multi-instance learning for microscopy image classification
Yang, Y., Tu, Y., Lei, H., & Long, W. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109245 · Cited by 22
Zheng, Q., Wu, S., & Wei, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104155 · Cited by 22
$$\alpha$$ILP: thinking visual scenes as differentiable logic programs
Shindo, H., Pfanschilling, V., Dhami, D. S., & Kersting, K. (2023) · Machine Learning · doi:10.1007/s10994-023-06320-1 · Cited by 21
Tian, C., Zhang, Z., Yao, F., Guo, Z. M., Yan, S., & Sun, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.07.006 · Cited by 21
Postprocessing of Ensemble Weather Forecasts Using Permutation-Invariant Neural Networks
Höhlein, K., Schulz, B., Westermann, R., & Lerch, S. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-23-0070.1 · Cited by 21
Hao, F., Li, X., & Zheng, C. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102550 · Cited by 21
Medication recommendation via dual molecular modalities and multi-step enhancement
Mu, S., Li, C., Li, X., & Liang, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127163 · Cited by 20
Automatic Charge Identification from Facts: A Few Sentence-Level Charge Annotations is All You Need
Paul, S., Goyal, P., & Ghosh, S. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.88 · Cited by 20
Tackling the Challenges in Scene Graph Generation With Local-to-Global Interactions
Woo, S., Noh, J., & Kim, K. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3159990 · Cited by 20
Semi-supervised Graph Instance Transformer for Mental Health Inference
Dong, G., Tang, M., Cai, L., Barnes, L. E., & Boukhechba, M. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00198 · Cited by 20
Bodyformer: Semantics-guided 3D Body Gesture Synthesis with Transformer
Pang, K., Qin, D., Fan, Y., Habekost, J., Shiratori, T., Yamagishi, J., & Komura, T. (2023) · ACM Transactions on Graphics · doi:10.1145/3592456 · Cited by 24
Mahapatra, D., Bozorgtabar, B., Ge, Z., & Reyes, M. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103075 · Cited by 20
Deep Learning for Histopathological Assessment of Esophageal Adenocarcinoma Precursor Lesions
Botros, M., de Boer, O. J., Guevara, B. C., Bekkers, E. J., Jansen, M., van der Wel, M. J., Sánchez, C. I., & Meijer, S. L. (2024) · Modern Pathology · doi:10.1016/j.modpat.2024.100531 · Cited by 20
Permutation Equivariance of Transformers and its Applications
Xu, H., Xiang, L., Ye, H., Yao, D., Chu, P., & Li, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00572 · Cited by 27
DuPlissis, A., Medewar, A., Hegarty, E., Laing, A., Shen, A., Gomez, S., Mondal, S., & Ben‐Yakar, A. (2025) · Scientific Reports · doi:10.1038/s41598-024-84842-x · Cited by 20
Huang, R., & Wong, V. W. S. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3159187 · Cited by 20
Transferable Neural WAN TE for Changing Topologies
AlQiam, A. A., Yao, Y., Wang, Z., Ahuja, S. S., Zhang, Y., Rao, S., Ribeiro, B., & Tawarmalani, M. (2024) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3651890.3672237 · Cited by 19
Towards highly sensitive deep learning-based end-to-end database search for tandem mass spectrometry
Yu, Y., & Li, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00960-1 · Cited by 19
Yu, L., Li, Z., Ansari, N., & Sun, X. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3532204 · Cited by 20
Neural Relational Inference with Efficient Message Passing Mechanisms
Chen, S., Wang, J., & Li, G. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16868 · Cited by 21
Deep Permutation Equivariant Structure from Motion
Moran, D., Koslowsky, H., Kasten, Y., Maron, H., Galun, M., & Basri, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00592 · Cited by 19
Wu, J., Liu, X., & Chen, S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110160 · Cited by 19
Material symmetry recognition and property prediction accomplished by crystal capsule representation
Liang, C., Rouzhahong, Y., Ye, C., Li, C., Wang, B., & Li, H. (2023) · Nature Communications · doi:10.1038/s41467-023-40756-2 · Cited by 19
Chemical complexity challenge: Is multi‐instance machine learning a solution?
Zankov, D. V., Madzhidov, T., Varnek, A. A., & Полищук, П. Г. (2023) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1698 · Cited by 19
Cacophony: An Improved Contrastive Audio-Text Model
Zhu, G., Darefsky, J., & Duan, Z. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3485170 · Cited by 27
Qiu, M., Li, P., Wang, C., Fang, T., Wang, A., Chen, C., Jia, X., Li, Y., Huang, J., Cai, D., et al. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3481911 · Cited by 21
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency EncodingPreprint
Wang, S., Zhou, L., Gan, Z., Chen, Y.-C., Fang, Y., Sun, S., Cheng, Y., & Liu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.06097 · Cited by 27
Global Attention Improves Graph Networks GeneralizationPreprint
Puny, O., Ben-Hamu, H., & Lipman, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07846 · Cited by 19
Exchangeable Neural ODE for Set ModelingPreprint
Li, Y., Yi, H., Bender, C. M., Shan, S., & Oliva, J. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.02676 · Cited by 19
Wang, Z., Zhan, W., Duan, H., & Huang, H. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110337 · Cited by 18
Learning interpretable network dynamics via universal neural symbolic regression
Hu, J., Cui, J., & Yang, B. X. (2025) · Nature Communications · doi:10.1038/s41467-025-61575-7 · Cited by 22
Gadjimuradov, F., Benkert, T., Nickel, D. M., & Maier, A. (2021) · Magnetic Resonance in Medicine · doi:10.1002/mrm.29100 · Cited by 18
multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning
Saha, S., Yadav, P., & Bansal, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.287 · Cited by 19
Transformer Uncertainty Estimation with Hierarchical Stochastic Attention
Pei, J., Wang, C., & Szarvas, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21364 · Cited by 19
Graph-Segmenter: graph transformer with boundary-aware attention for semantic segmentation
Wu, Z., Gan, Y., Xu, T., & Wang, F. (2023) · Frontiers of Computer Science · doi:10.1007/s11704-023-2563-5 · Cited by 20
MMSR: Symbolic regression is a multi-modal information fusion task
Li, Y., Liu, J., Wu, M., Yu, L., Li, W., Ning, X., Li, W., Hao, M., Deng, Y., & Wei, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102681 · Cited by 27
On Deep Set Learning and the Choice of Aggregations
Soelch, M., Akhundov, A., van der Smagt, P., & Bayer, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30487-4_35 · Cited by 20
Attention-Based Transformation from Latent Features to Point Clouds
Zhang, K., Yang, X., Wu, Y., & Jin, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20238 · Cited by 19
A Media-Guided Attentive Graphical Network for Personality Recognition Using Physiology
Yang, H.-C., & Lee, C.-C. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3090040 · Cited by 17
Hawkins‐Hooker, A., Visonà, G., Narendra, T., Rojas-Carulla, M., Schölkopf, B., & Schweikert, G. (2023) · Nature Communications · doi:10.1038/s41467-023-40211-2 · Cited by 19
Similarity Metric Learning For RGB-Infrared Group Re-Identification
Xiong, J., & Lai, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01313 · Cited by 17
The Wisdom of Crowds: Temporal Progressive Attention for Early Action Prediction
Stergiou, A., & Damen, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01413 · Cited by 17
Transformers and their application to medical image processing: A review
Zhu, D., & Wang, D. (2023) · Journal of Radiation Research and Applied Sciences · doi:10.1016/j.jrras.2023.100680 · Cited by 17
Towards human-like perception: Learning structural causal model in heterogeneous graph
Lin, T., Song, K., Jiang, Z., Kang, Y., Yuan, W., Li, X., Sun, C., Huang, C., & Liu, X. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103600 · Cited by 17
Mirasol3B: A Multimodal Autoregressive Model for Time-Aligned and Contextual Modalities
Piergiovanni, A., Noble, I., Kim, D., Ryoo, M. S., Gomes, V., & Angelova, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02531 · Cited by 17
Aggregating residue-level protein language model embeddings with optimal transport
Naderializadeh, N., & Singh, R. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf060 · Cited by 17
Sehanobish, A., Ravindra, N. G., & van Dijk, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16619 · Cited by 17
Exchangeable Deep Neural Networks for Set-to-Set Matching and Learning
Saito, Y., Nakamura, T., Hachiya, H., & Fukumizu, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_37 · Cited by 17
GECCO: Geometrically-Conditioned Point Diffusion Models
Tyszkiewicz, M. J., Fua, P., & Trulls, E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00203 · Cited by 24
Sinkformers: Transformers with Doubly Stochastic AttentionPreprint
Sander, M. E., Ablin, P., Blondel, M., & Gabriel Peyré, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.11773 · Cited by 24
Meltzer, P., Lambourne, J. G., & Grandi, D. (2023) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4062454 · Cited by 18
Datasets, tasks, and training methods for large-scale hypergraph learning
Kim, S., Lee, D., Kim, Y., Park, J., Hwang, T., & Shin, K. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00952-6 · Cited by 18
Learning differentiable logic programs for abstract visual reasoning
Shindo, H., Pfanschilling, V., Dhami, D. S., & Kersting, K. (2024) · Machine Learning · doi:10.1007/s10994-024-06610-2 · Cited by 16
Normalizing Flow-Based Differentiable Particle Filters
Chen, X., & Li, Y. (2024) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2024.3521338 · Cited by 16
Attention-Guided Semantic Hashing for Unsupervised Cross-Modal Retrieval
Shen, X. X., Zhang, H., Li, L., & Liu, L. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428330 · Cited by 16
PERCEIVER-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention
Tang, Z., Cho, J., Lei, J., & Bansal, M. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00439 · Cited by 17
PCTN: Point cloud data transformation network
Wang, G., Yu, L., Tian, S., Zhang, H., Xue, Y., Sang, M., Guo, J., Yu, X., & Si, S. (2023) · Displays · doi:10.1016/j.displa.2023.102610 · Cited by 16
A Mathematical Theory of AttentionPreprint
Vuckovic, J., Baratin, A., & Combes, R. T. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02876 · Cited by 68
Neural Spectral Prediction for Structure Elucidation with Tandem Mass SpectrometryPreprint
Wang, R., Manjrekar, M., Mahjour, B. A., Ávila-Pacheco, J., Provenzano, J., Reynolds, E. E., Lederbauer, M., Mashin, E., Goldman, S., Wang, M., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.28.656653 · Cited by 16
About Time: Advances, Challenges, and Outlooks of Action Understanding
Stergiou, A., & Poppe, R. W. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02478-4 · Cited by 17
IPC prediction of patent documents using neural network with attention for hierarchical structure
Hoshino, Y., Utsumi, Y., Matsuda, Y., Tanaka, Y., & Nakata, K. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282361 · Cited by 15
Cai, K., Zhang, X., Zhang, M., Ge, Q., Li, S., Qiao, B., & Liu, Y. (2023) · Sustainable Environment Research · doi:10.1186/s42834-023-00175-w · Cited by 15
Set-Transformer BeamsNet for AUV Velocity Forecasting in Complete DVL Outage Scenarios
Cohen, N., Yampolsky, Z., & Klein, I. (2023) · IEEE Underwater Technology (UT) · doi:10.1109/ut49729.2023.10103453 · Cited by 15
Latent diffusion transformer for point cloud generation
Ji, J., Zhao, R., & Lei, M. (2024) · The Visual Computer · doi:10.1007/s00371-024-03396-1 · Cited by 16
Unveiling quantum phase transitions from traps in variational quantum algorithms
Cao, C., Gambetta, F. M., Montanaro, A., & Santos, R. A. (2025) · npj Quantum Information · doi:10.1038/s41534-025-01038-5 · Cited by 18
Deep Neural Networks for Multicomponent Molecular Systems
Hanaoka, K. (2020) · ACS Omega · doi:10.1021/acsomega.0c02599 · Cited by 16
Geometric Transformer for End-to-End Molecule Properties Prediction
Choukroun, Y., & Wolf, L. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/401 · Cited by 15
The quarks of attention: Structure and capacity of neural attention building blocks
Baldi, P., & Vershynin, R. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103901 · Cited by 15
Geometric Capsule Autoencoders for 3D Point CloudsPreprint
Srivastava, N., Goh, H., & Salakhutdinov, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.03310 · Cited by 15
Neural Clustering ProcessesPreprint
Pakman, A., Wang, Y., Mitelut, C., Lee, J., & Paninski, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00409 · Cited by 15
Self-citationUni MS-PS: A multi-scale encoder-decoder transformer for universal photometric stereo
Hardy, C., Quéau, Y., & Tschumperlé, D. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104093 · Cited by 14
Sparse agent transformer for unified voxel and image feature extraction and fusion
Zhang, H., Wan, J., He, Z., Song, J., Yang, Y. F., & Yuan, D. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102455 · Cited by 14
Full Point Encoding for Local Feature Aggregation in 3-D Point Clouds
He, Y., Yu, H., Yang, Z., Liu, X., Sun, W., & Mian, A. S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3409891 · Cited by 14
Joint Modeling of Arguments for Event Understanding
Chen, Y., Chen, T., & Durme, B. V. (2020) · Workshop on Computational Approaches to Discourse (CODI) · doi:10.18653/v1/2020.codi-1.10 · Cited by 14
Adversarial Permutation Guided Node Representations for Link Prediction
Roy, I., De, A., & Chakrabarti, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17138 · Cited by 15
Fuchs, F. B., Wagstaff, E., Dauparas, J., & Posner, I. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-80209-7_63 · Cited by 16
Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistry
Klus, S., Gelß, P., Nüske, F., & Noé, F. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac14ad · Cited by 14
Survey and Evaluation of Neural 3D Shape Classification Approaches
Mirbauer, M., Krabec, M., Křivánek, J., & Šikudová, E. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3102676 · Cited by 15
CASPNet++: Joint Multi-Agent Motion Prediction
Schäfer, M., Zhao, K., & Kummert, A. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588873 · Cited by 14
Predicting Infectiousness for Proactive Contact TracingPreprint
Bengio, Y., Gupta, P., Maharaj, T., Rahaman, N., Weiß, M., Deleu, T., Muller, E. B., Qu, M., Schmidt, V. M., St-Charles, P.-L., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12536 · Cited by 15
Kim, H., Choi, H.-J., Kim, C., Yoon, J., & Ko, S. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599779 · Cited by 19
IMP: Iterative Matching and Pose Estimation with Adaptive Pooling
Xue, F., Budvytis, I., & Cipolla, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02042 · Cited by 13
Modelling local and general quantum mechanical properties with attention-based pooling
Buterez, D., Janet, J. P., Kiddle, S. J., Oglić, D., & Lió, P. (2023) · Communications Chemistry · doi:10.1038/s42004-023-01045-7 · Cited by 15
Rashtian, H., Torbaghan, S. S., Rahili, S., Snyder, M. P., & Aghaeepour, N. (2021) · IEEE Access · doi:10.1109/access.2021.3085544 · Cited by 13
Graph based emotion recognition with attention pooling for variable-length utterances
Liu, J., Wang, H., Sun, M., & Wei, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.007 · Cited by 13
Full Contextual Attention for Multi-resolution Transformers in Semantic Segmentation
Themyr, L., Rambour, C., Thome, N., Collins, T., & Hostettler, A. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00324 · Cited by 13
AMatFormer: Efficient Feature Matching via Anchor Matching Transformer
Jiang, B., Luo, S., Wang, X., Li, C., & Tang, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3282546 · Cited by 13
Metadata
- Authors
- Lee, J., Lee, Y., Kim, J., Kosiorek, A. R., Choi, S., & Teh, Y. W.
- Affiliations
- University of Oxford (GB)
- Pohang University of Science and Technology (KR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.00825
- OpenAlex
- W2894384847
- Cited by
- 691
- References
- 37
- Citations by year
- 2026: 20 · 2025: 84 · 2024: 116 · 2023: 137 · 2022: 96 · 2021: 145 · 2020: 76 · 2019: 16 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Oxford University Research Archive (ORA) (University of Oxford) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- European Commission (2007–2013, FP7 2007-2013, FP7/2007)
- Ministry of Science and ICT, South Korea (2017-0-01779)
- Samsung
- Engineering and Physical Sciences Research Council (EP/P026753/1)
- Institute for Information and Communications Technology Promotion (2017‐0‐01779, No.2017-0-01779)
- FP7 Ideas: European Research Council (617071)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- Set Transformer, permutation invariance, attention mechanism, multiple instance learning, 3D shape recognition, few-shot image classification, inducing points, sparse Gaussian processes, self-attention complexity, encoder-decoder architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
