The DOI matches its DataCite record; 37 of the 37 references it cites were found in a registry or an index.
Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks
Open accessAbstract
Many machine learning tasks such as multiple instance learning, 3D shape recognition, and few-shot image classification are defined on sets of instances. Since solutions to such problems do not depend on the order of elements of the set, models used to address them should be permutation invariant. We present an attention-based neural network module, the Set Transformer, specifically designed to model interactions among elements in the input set. The model consists of an encoder and a decoder, both of which rely on attention mechanisms. In an effort to reduce computational complexity, we introduce an attention scheme inspired by inducing point methods from sparse Gaussian process literature. It reduces the computation time of self-attention from quadratic to linear in the number of elements in the set. We show that our model is theoretically attractive and we evaluate it on a range of tasks, demonstrating the state-of-the-art performance compared to recent methods for set-structured data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This is not surprising, given that self-attention is an equivariant transformation capable of performing pooling operations like max-pooling [12].”
From Exploring Length Generalization in Large Language Models (2022) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R., Su, H., Mo, K., & Guibas, L. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.16 · Cited by 10,029
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Prototypical Networks for Few-shot LearningPreprint
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 6,245
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298801 · Cited by 5,413
Research works printed but not linked: 5
- Garnelo, M., Rosenbaum, D., Maddison, C. J., Ramalho, T., Saxton, D., Shanahan, M., Teh, Y. W., Rezende, D. J., and Eslami, S. M. A. Conditional neural processes. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
- Lee, Y. and Choi, S. Gradient-based meta-learning with learned layerwise metric and subspace. In Proceedings of the International Conference on Machine Learning (ICML), 2018.
- Oliva, J., Póczos, B., and Schneider, J. Distribution to dis- tribution regression. In Proceedings of the International Conference on Machine Learning (ICML), 2013.
- Schmidhuber, J. Evolutionary Principles in Self-Referential Learning. PhD thesis, Technical University of Munich, 1987.
- Zaheer, M., Kottur, S., Ravanbakhsh, S., Poczos, B., Salakhutdinov, R. R., and Smola, A. J. Deep sets. In Advances in Neural Information Processing Systems (NeurIPS), 2017.
Cited by
Sorted by citations
Items 401–500 of 694
Regularizing Towards Permutation Invariance in Recurrent ModelsPreprint
Cohen-Karlik, E., David, A. B., & Globerson, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13055 · Cited by 10
Learning Prototype-oriented Set Representations for Meta-LearningPreprint
Guo, D., Tian, L., Zhang, M., Zhou, M., & Hongyuan Zha, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09140 · Cited by 8
Multistation seismic location via machine learning: application to Oklahoma and Southern California
Zhang, J., Zhu, H., Li, Z., Wu, X., & Zhang, J. (2025) · Geophysical Journal International · doi:10.1093/gji/ggaf135 · Cited by 7
Augmented geometry assurance digital twin with physics-based incremental learning
Tabar, R. S., Söderberg, R. C., Ceglarek, D. J., Franciosa, P., & Lindkvist, L. (2025) · CIRP Annals · doi:10.1016/j.cirp.2025.03.008 · Cited by 6
Table representation learning using heterogeneous graph embedding
Tchuitcheu, W. C., Lu, T., & Dooms, A. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110734 · Cited by 6
Adaptive parameters identification for nonlinear dynamics using deep permutation invariant networks
Elaarabi, M., Borzacchiello, D., Bot, P. L., Guennec, Y. L., & Comas-Cardona, S. (2025) · Machine Learning · doi:10.1007/s10994-024-06732-7 · Cited by 6
Yang, H., Liu, Y., Zhang, L., Cai, H., Che, K., & Xing, L. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104785 · Cited by 6
A road lane detection approach based on reformer model
Li, D., Yang, Z., Nai, W., Xing, Y. Y., & Chen, Z. (2025) · Egyptian Informatics Journal · doi:10.1016/j.eij.2025.100625 · Cited by 6
Visual analytics of set data for knowledge discovery and member selection support
Watanabe, R., Ishibashi, H., & Furukawa, T. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113635 · Cited by 6
Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interaction
Bianchi, F., Greco, C., & Tagliabue, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.348 · Cited by 6
Towards Pointsets Representation Learning via Self-Supervised Learning and Set Augmentation
Arsomngern, P., Long, C., Suwajanakorn, S., & Nutanong, S. Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3139113 · Cited by 6
Ling, X., Wu, Y., Ali, R., & Zhu, H. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/3003810 · Cited by 6
RetractedTransferable prediction of intermolecular coupling achieved by hierarchical material representation
Li, C., Liang, C., Rouzhahong, Y., Wang, B., & Li, H. (2022) · Science China Materials · doi:10.1007/s40843-022-2198-5 · Cited by 6
Meta‐Learning‐Based Spatial‐Temporal Adaption for Coldstart Air Pollution Prediction
Zhi-yuan, W., Liu, N., Li, G., Liu, X., Wang, Y., & Zhang, L. (2023) · International Journal of Intelligent Systems · doi:10.1155/2023/3734557 · Cited by 10
Graph-Level Representations Using Ensemble-Based Readout Functions
Binkowski, J., Sawczyn, A., Janiak, D., Bielak, P., & Kajdanowicz, T. J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35995-8_28 · Cited by 6
End-to-end neural speaker diarization with an iterative adaptive attractor estimation
Hao, F., Li, X., & Zheng, C. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.07.043 · Cited by 6
Wu, M., Li, W., Yu, L., Sun, L., Liu, J., & Li, W. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3332400 · Cited by 8
SparseSoftDECA — Efficient high-resolution physics-based facial animation from sparse landmarks
Wagner, N., Schwanecke, U., & Botsch, M. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.103903 · Cited by 6
Shi, Y., Oliva, J. B., & Niethammer, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6031 · Cited by 6
Learning Wasserstein Isometric Embedding for Point Clouds
Kawano, K., Koide, S., & Kutsuna, T. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00057 · Cited by 6
Set-to-Sequence Methods in Machine Learning: A Review
Jurewicz, M., & Derczynski, L. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12839 · Cited by 8
Electricity Consumption Forecasting for Out-of-Distribution Time-of-Use Tariffs
Narwariya, J., Verma, C. K., Malhotra, P., Vig, L., Subramanian, E., & Bhat, S. P. (2022) · doi:10.3390/cmsf2022003001 · Cited by 7
Analysis of Multivariate Scoring Functions for Automatic Unbiased Learning to Rank
Yang, T., Fang, S., Li, S., Wang, Y., & Ai, Q. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3412128 · Cited by 6
TabSim: A Siamese Neural Network for Accurate Estimation of Table Similarity
Habibi, M., Starlinger, J., & Leser, U. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378077 · Cited by 10
MxML: Mixture of Meta-Learners for Few-Shot ClassificationPreprint
Park, M., Kim, J., Kim, S., Liu, Y., & Choi, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05658 · Cited by 6
Self-citationStudying The Effect of MIL Pooling Filters on MIL TasksPreprint
Öner, M. Ü., Kye-Jet, J. M. S., Lee, H. K., & Sung, W.-K. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01561 · Cited by 6
Self-supervised edge features for improved Graph Neural Network trainingPreprint
Sehanobish, A., Ravindra, N. G., & van Dijk, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04777 · Cited by 6
SCHA-VAE: Hierarchical Context Aggregation for Few-Shot GenerationPreprint
Giannone, G., & Winther, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12279 · Cited by 9
Zhou, S., Wang, Z., Zhang, Z., Wang, W., Zhao, Y., & Zhang, Y. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3524573 · Cited by 5
Wijaya, K. T., Paek, D.-H., & Kong, S.-H. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129387 · Cited by 5
Corrupted point cloud classification based on feature compensation and cross attention mechanism
He, Y., Yang, H., Li, Z., Wu, M., Liu, J., & Zhang, Z. (2024) · Measurement · doi:10.1016/j.measurement.2024.115721 · Cited by 5
Unsupervised Speaker Diarization in Distributed IoT Networks Using Federated Learning
Bhuyan, A. K., Dutta, H., & Biswas, S. K. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3482855 · Cited by 5
Tang, P., Wang, J., & Liu, M. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109776 · Cited by 5
Weird-Net: Weighted Relative Distance Attention for Efficient and Robust Sequence Processing
Hu, L., Zhan, F., Huang, W., Gan, W., Hu, H., He, H., & Han, K. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3513912 · Cited by 5
LGCANet:Local geometry-aware cross-attention networks for point cloud semantic segmentation
Luo, L., Lu, J., Chen, X., Zhang, K., & Zhou, J. (2025) · Measurement · doi:10.1016/j.measurement.2025.116860 · Cited by 5
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks
Luo, Z., Xi, Y., Ma, J., Yang, Z., Mao, X., Fan, C., & Zhang, R. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.89 · Cited by 5
SLoSH: Set Locality Sensitive Hashing via Sliced-Wasserstein Embeddings
Lu, Y., Liu, X., Soltoggio, A., & Kolouri, S. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00255 · Cited by 6
SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shifts
Kimura, M., Nakamura, T. K. M., & Saito, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00355 · Cited by 13
SetQuence & SetOmic: Deep set transformers for whole genome and exome tumour analysis
Jurenaite, N., León-Periñán, D., Donath, V., Torge, S., & Jäkel, R. (2023) · Biosystems · doi:10.1016/j.biosystems.2023.105095 · Cited by 5
Deep CAD Shape Recognition for Carbon Footprint Estimation at the Design Stage
HASEBE, T., Katayama, E., & Yoshiteru, K. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.01.080 · Cited by 5
A Generative Approach for Wikipedia-Scale Visual Entity Recognition
Caron, M., İşcen, A., Fathi, A., & Schmid, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01639 · Cited by 5
On Train-Test Class Overlap and Detection for Image Retrieval
Song, C. H., Yoon, J.-Y., Hwang, T., Choi, S., Gu, Y. H., & Avrithis, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01645 · Cited by 5
Self-citationDS&STM-Net: A novel hybrid network of feature mutual fusion for medical image segmentation
Chen, Q., Wang, W., Wang, Z., Jia, H., & Zhao, M. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106977 · Cited by 5
Chen, J., Lin, J., Zhong, G., Yao, Y., & Li, Z. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3522698 · Cited by 5
Zhou, F., Yang, X., Fang, C., Chen, L., Jiang, Z., Zhu, H., Heckel, R., Wang, H., Fei, M., & Zhou, H. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3528218 · Cited by 5
Missing data as augmentation in the Earth Observation domain: A multi-view learning approach
Mena, F., Arenas, D., & Dengel, A. R. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130175 · Cited by 6
Goal-Conditioned Q-learning as Knowledge Distillation
Levine, A., & Feizi, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26024 · Cited by 5
Evolving masked low-rank transformer for long text understanding
Liu, C., Chen, X., Lin, J., Hu, P., Wang, J., & Geng, X. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.111207 · Cited by 5
Efficient Federated Learning Method for Cloud-Edge Network Communication
Duan, J., Duan, J., Wan, X., & Li, Y. (2023) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce58541.2023.10142819 · Cited by 5
Building powerful and equivariant graph neural networks with message-passingPreprint
Vignac, C., Loukas, A., & Frossard, P. (2020) · arXiv (Cornell University) · Cited by 5
Equivariant Normalizing Flows for Point Processes and SetsPreprint
Biloš, M., & Günnemann, S. (2021) · arXiv (Cornell University) · Cited by 5
Set Prediction without Imposing Structure as Conditional Density EstimationPreprint
Zhang, D. W., Burghouts, G. J., & Snoek, C. G. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04109 · Cited by 5
Attention-Based Learning on Molecular EnsemblesPreprint
Chuang, K. V., & Keiser, M. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12820 · Cited by 8
Neural Online Graph ExplorationPreprint
Chiotellis, I., & Cremers, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03345 · Cited by 5
Set Representation Learning with Generalized Sliced-Wasserstein EmbeddingsPreprint
Naderializadeh, N., Kolouri, S., Comer, J. F., Andrews, R. W., & Hoffmann, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03892 · Cited by 6
Autobots: Latent Variable Sequential Set TransformersPreprint
Girgis, R., Golemo, F., Codevilla, F., D'Souza, J. A., Weiß, M., Kahou, S. E., Heide, F., & Pal, C. (2021) · arXiv (Cornell University) · Cited by 5
Meta-Learning for Relative Density-Ratio EstimationPreprint
Kumagai, A., Iwata, T., & Fujiwara, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.00801 · Cited by 5
CpT: Convolutional Point Transformer for 3D Point Cloud ProcessingPreprint
Kaul, C., Mitton, J., Dai, H., & Murray‐Smith, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.10866 · Cited by 5
Rethinking Transformers for Efficiency and ScalabilityPreprint
Huang, J., & Bao, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5161897 · Cited by 5
Transformer Masked Autoencoders for RF Device Fingerprinting
Parpart, G., Tu, J. H., Clymer, B., Lee, J. H., & Babcock, J. (2024) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom61039.2024.10773654 · Cited by 4
Self-citationUnsupervised solution operator learning for mean-field games
Huang, H., & Lai, R. (2025) · Journal of Computational Physics · doi:10.1016/j.jcp.2025.114057 · Cited by 4
Permutation Invariant Strategy Using Transformer Encoders for Table Understanding
Dash, S., Bagchi, S., Mihindukulasooriya, N., & Gliozzo, A. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.59 · Cited by 4
Hybrid Attention-based Transformer for Long-range Document Classification
Qin, R., Huang, M., Liu, J., & Miao, Q. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891918 · Cited by 4
Collective Intelligence for 2D Push Manipulations With Mobile Robots
Kuroki, S., Matsushima, T., Arima, J., Furuta, H., Matsuo, Y., Gu, S., & Tang, Y. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3261751 · Cited by 4
Audioslots: A Slot-Centric Generative Model For Audio Separation
Reddy, P., Wisdom, S., Greff, K., Hershey, J. R., & Kipf, T. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193208 · Cited by 4
Kang, J., Jia, W., & He, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126882 · Cited by 4
Subramani, K., & Smaragdis, P. (2021) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa52581.2021.9632668 · Cited by 4
Inference and Learning for Generative Capsule Models
Nazábal, A., Tsagkas, N., & Williams, C. K. I. (2023) · Neural Computation · doi:10.1162/neco_a_01564 · Cited by 4
Zhang, J., Zang, X., Chen, H., & Tang, B. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385280 · Cited by 4
Improving Speech Recognition for African American English with Audio Classification
Garg, S., Huo, Z., Sim, K. C., Schwartz, S., Chua, M., Aksënova, A., Munkhdalai, T., King, L., Wright, D., Mengesha, Z., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447116 · Cited by 4
GraSTNet: Graph Neural Networks and Set Transformer for Machining Feature Recognition
Kesler, S., & Slama, D. (2024) · International Conference on Control, Automation and Diagnosis (ICCAD) · doi:10.1109/iccad60883.2024.10553906 · Cited by 4
Structure-Aware Parameter-Free Group Query via Heterogeneous Information Network Transformer
Chen, H.-W., Shuai, H.-H., Yang, D.-N., Lee, W.-C., Shi, C., Yu, P. S., & Chen⋆, M.-S. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00203 · Cited by 4
Hwang, S., Heo, M., Oh, S. W., & Kim, S. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01654 · Cited by 4
Conditional set generation using Seq2seq models
Madaan, A., Rajagopal, D., Tandon, N., Yang, Y., & Bosselut, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.324 · Cited by 5
Cluster-wise Hierarchical Generative Model for Deep Amortized Clustering
Liu, H., Wang, J., & Jing, L. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01486 · Cited by 4
A Trainable Optimal Transport Embedding for Feature AggregationPreprint
Mialon, G., Chen, D., d’Aspremont, A., & Mairal, J. (2020) · HAL · Cited by 4
IOT: Instance-wise Layer Reordering for Transformer StructuresPreprint
Zhu, J., Wu, L., Xia, Y., Xie, S., Qin, T., Zhou, W., Li, H., & Liu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03457 · Cited by 4
On the Regularity of AttentionPreprint
Vuckovic, J., Baratin, A., & Combes, R. T. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05628 · Cited by 15
Neural Networks for Learning Counterfactual G-Invariances from Single EnvironmentsPreprint
Mouli, S. C., & Ribeiro, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10105 · Cited by 5
Learning to Pool in Graph Neural Networks for ExtrapolationPreprint
Ko, J., Kwon, T., Shin, K., & Lee, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06210 · Cited by 6
Self-citationPICASO: Permutation-Invariant Cascaded Attentional Set OperatorPreprint
Zare, S., & Nguyen, H. V. (2021) · arXiv (Cornell University) · doi:10.13140/rg.2.2.31327.38568 · Cited by 4
Semantic-Guided Multi-Feature Attention Aggregation Network for LiDAR-Based 3D Object Detection
Zhao, J., Huang, Z., Zheng, Z., Long, Y., & Hu, H. (2025) · Electronics · doi:10.3390/electronics14112154 · Cited by 3
Li, Y., Yin, F., Zheng, Y., Xu, W., Kim, J., & Peng, Z. (2025) · Computer Communications · doi:10.1016/j.comcom.2025.108283 · Cited by 3
Self-citationWu, Z., Wu, Y., Miao, G., Chen, R., Ma, L., Xi, H., & Xiao, J. (2025) · Chinese Journal of Chemical Engineering · doi:10.1016/j.cjche.2025.09.012 · Cited by 3
Xiao, D., Wang, S.-R., Liu, X., Fang, W., & Cui, G. (2026) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.5c03616 · Cited by 3
Liu, J., Jiang, Y., Wang, C., Ding, W., & Gao, Y. (2026) · GPS Solutions · doi:10.1007/s10291-026-02082-0 · Cited by 3
LatentDR: Improving Model Generalization Through Sample-Aware Latent Degradation and Restoration
Liu, R., Khose, S., Xiao, J., Sathidevi, L., Ramnath, K., Kira, Z., & Dyer, E. L. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00265 · Cited by 3
Multi-scale synchronous contextual network for fine-grained urban flow inference
Pan, L., Ren, Q., Li, Z., & Zhao, C. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121459 · Cited by 3
Improving Sequential Recommender Systems with Online and In-store User Behavior
Ma, L., Padmanabhan, A., Ganesh, A. S., Tang, S., Chen, J., Li, X., Morishetti, L., Nag, K., Patel, M., Cho, J. H. D., et al. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825717 · Cited by 3
Latency Adjustable Transformer Encoder for Language Understanding
Kachuee, S., & Sharifkhani, M. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3539727 · Cited by 4
Mitigating impacts of hyperedge heterogeneity on semi-supervised hypergraph contrastive learning
Yin, K., Jing, X., Yang, G., & Chu, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130863 · Cited by 3
Learning to Generalize With Object-Centric Agents in the Open World Survival Game Crafter
Stanić, A., Tang, Y., Ha, D., & Schmidhuber, J. (2023) · IEEE Transactions on Games · doi:10.1109/tg.2023.3276849 · Cited by 9
GRIP: Graph Representation of Immune Repertoire Using Graph Neural Network and Transformer
Lee, Y., Lee, H., Shin, K., & Kwon, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25645 · Cited by 3
Self-citationEfficient model selection for predictive pattern mining model by safe pattern pruning
Yoshida, T., Hanada, H., Nakagawa, K., Taji, K., Tsuda, K., & Takeuchi, I. (2023) · Patterns · doi:10.1016/j.patter.2023.100890 · Cited by 3
Tripletformer for Probabilistic Interpolation of Irregularly sampled Time Series
Yalavarthi, V. K., Burchert, J., & Schmidt-Thieme, L. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386325 · Cited by 5
Tsuruta, H., Katsura, Y., & Kumagai, M. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00029 · Cited by 3
IKEA Ego 3D Dataset: Understanding furniture assembly actions from ego-view 3D Point Clouds
Ben-Shabat, Y., Paul, J., Segev, E., Shrout, O., & Gould, S. J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00430 · Cited by 3
Zhao, B., Wang, Y., Su, K., Ren, H., & Sun, H. (2021) · Sensors · doi:10.3390/s21062217 · Cited by 3
Multi-Scale Enhanced Active Learning for Skeleton-Based Action Recognition
Zhang, Y., Zhao, Z., Li, W., & Duan, L. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428467 · Cited by 3
Don’t Let Discourse Confine Your Model: Sequence Perturbations for Improved Event Language Models
Koupaee, M., Durrett, G., Chambers, N., & Balasubramanian, N. (2021) · doi:10.18653/v1/2021.acl-short.76 · Cited by 3
Metadata
- Authors
- Lee, J., Lee, Y., Kim, J., Kosiorek, A. R., Choi, S., & Teh, Y. W.
- Affiliations
- University of Oxford (GB)
- Pohang University of Science and Technology (KR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.00825
- OpenAlex
- W2894384847
- Cited by
- 691
- References
- 37
- Citations by year
- 2026: 20 · 2025: 84 · 2024: 116 · 2023: 137 · 2022: 96 · 2021: 145 · 2020: 76 · 2019: 16 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Oxford University Research Archive (ORA) (University of Oxford) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- European Commission (2007–2013, FP7 2007-2013, FP7/2007)
- Ministry of Science and ICT, South Korea (2017-0-01779)
- Samsung
- Engineering and Physical Sciences Research Council (EP/P026753/1)
- Institute for Information and Communications Technology Promotion (2017‐0‐01779, No.2017-0-01779)
- FP7 Ideas: European Research Council (617071)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- Set Transformer, permutation invariance, attention mechanism, multiple instance learning, 3D shape recognition, few-shot image classification, inducing points, sparse Gaussian processes, self-attention complexity, encoder-decoder architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
