What Would You Expect? Anticipating Egocentric Actions With Rolling-Unrolling LSTMs and Modality Attention

Furnari, Antonino, Farinella, Giovanni·2019·2019 IEEE/CVF International Conference on Computer Vision (ICCV)
DOI 10.1109/iccv.2019.00635

Cited by (182)

Items 101–182 of 182

  1. Video Action Understanding: A Tutorial.
    Matthew Hutchinson, Vijay N. Gadepally · 2020 · arXiv (Cornell University)
  2. 4D Human Body Capture from Egocentric Video via 3D Scene Grounding
    Miao Liu, Dexin Yang, Yan Zhang, Zhaopeng Cui, James Matthew Rehg, Siyu Tang · 2020 · arXiv (Cornell University)
  3. Cross-modal Contrastive Distillation for Instructional Activity Anticipation
    Zhengyuan Yang, Jingen Liu, Jing Li Huang, Xiaodong He, Tao Mei, Chenliang Xu, Jiebo Luo · 2022 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  4. Graphing the Future: Activity and Next Active Object Prediction Using Graph-Based Activity Representations
    Victoria Manousaki, Konstantinos E. Papoutsakis, Antonis Argyros · 2022 · Lecture notes in computer science
  5. Intention action anticipation model with guide-feedback loop mechanism
    Zongnan Ma, Fuchun Zhang, Zhixiong Nan, Yao Ge · 2024 · Knowledge-Based Systems
  6. Anticipating Next Active Objects for Egocentric Videos
    Sanket Kumar Thakur, Cigdem Beyan, Pietro Morerio, Vittorio Murino, Alessio Del Bue · 2024 · IEEE Access
  7. A Holistic Approach for Role Inference and Action Anticipation in Human Teams
    Junyi Dong, Qingze Huo, Silvio Ferrari · 2022 · ACM Transactions on Intelligent Systems and Technology
  8. Hybrid approach for anticipating human activities in Ambient Intelligence environments
    Koussaila Moulouel, Abdelghani Chibani, Hazem Abdelkawy, Yacine Amirat · 2022 · IEEE International Conference on Automation Science and Engineering (CASE)
  9. GePSAn: Generative Procedure Step Anticipation in Cooking Videos
    Mohamed A. Abdelslam, Samrudhdhi B. Rangrej, Isma Hadji, Nikita Dvornik, Konstantinos G. Derpanis, Afsaneh Fazly · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  10. Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos
    Yanghao Li, Tushar Nagarajan, Bo Xiong, Kristen Lorraine Grauman · 2021 · arXiv (Cornell University)
  11. Technical Report: Temporal Aggregate Representations
    Fadime Şener, Dibyadip Chatterjee, Angela Yao · 2021 · arXiv (Cornell University)
  12. Shaping embodied agent behavior with activity-context priors from egocentric video
    Tushar Nagarajan, Kristen Lorraine Grauman · 2021 · arXiv (Cornell University)
  13. A Recurrent Neural Network Optimization Method for Anticipation of Hierarchical Human Activity
    Khodabandelou, Ghazaleh, Chibani, Abdelghani, Amirat, Yacine, Tanimoto, Steven · 2024 · IEEE Transactions on Automation Science and Engineering
  14. FutureHuman3D: Forecasting Complex Long-Term 3D Human Behavior from Video Observations
    Christian Diller, Thomas A. Funkhouser, Angela Dai · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  15. EGOFALLS: A Visual-Audio Dataset and Benchmark for Fall Detection Using Egocentric Cameras
    Xueyi Wang · 2024 · Lecture notes in computer science
  16. From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation
    Xin Liu, Chao Hao, Zitong Yu, Huanjing Yue, Jingyu Yang · 2024 · ACM Transactions on Multimedia Computing Communications and Applications
  17. Bidirectional Progressive Transformer for Interaction Intention Anticipation
    Zichen Zhang, Hongchen Luo, Wei Zhai, Yang Hua Cao, Yu Kang · 2024 · Lecture notes in computer science
  18. Transferable Unintentional Action Localization With Language-Guided Intention Translation
    Jinglin Xu, Yongming Rao, Jie Zhou, Jiwen Lu · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  19. Robust Multi-Frame Future Prediction By Leveraging View Synthesis
    Kenan E. Ak, Ying Sun, Joo‐Hwee Lim · 2021 · Proceedings - International Conference on Image Processing
  20. Higher Order Recurrent Space-Time Transformer for Video Action Prediction
    Tsung‐Ming Tai, Giuseppe Fiameni, Cheng‐Kuang Lee, Oswald Lanz · 2021 · arXiv (Cornell University)
  21. A multivariate Markov chain model for interpretable dense action anticipation
    Yihui Qiu, Deepu Rajan · 2024 · Neurocomputing
  22. Throughout Procedural Transformer for Online Action Detection and Anticipation
    Haomiao Yuan, Yi Chen, Zheyan Ji, Zhichao Zheng, Yanhui Gu, Junsheng Zhou · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
  23. Generating 6DoF Object Manipulation Trajectories from Action Description in Egocentric Vision
    Tomoya Yoshida, Shuhei Kurita, Taichi Nishimura, Shinsuke Mori · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  24. Optimizing Multitask Industrial Processes With Predictive Action Guidance
    Naval Kishore Mehta, Arvind, Shyam Sunder Prasad, Sumeet Saurav, Sanjay Kr. Singh · 2025 · IEEE Transactions on Automation Science and Engineering
  25. Knowledge Distillation-Based Spiking Neural Network for Online Video Action Understanding
    Houlin Wang, Shihui Zhang, Xueqiang Han, Kuo Pang, Qixian Zhang · 2025 · IEEE Transactions on Industrial Informatics
  26. Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision
    Yuping He, Yifei Huang, Chen Guo, Lidong Lü, Baoqi Pei, Jilan Xu, Tong Lu, Yoichi Sato · 2026 · International Journal of Computer Vision
  27. Streaming Videollms for Real-Time Procedural Video Understanding
    Dibyadip Chatterjee, Edoardo Remelli, Yale Song, Bugra Tekin, Abhay Mittal, Bharat Bhatnagar, Necati Cihan Camgöz, Shreyas Hampali, Eric L. Sauser, Shugao Ma et al. · 2025 · IEEE/CVF International Conference on Computer Vision (ICCV)
  28. Tragedy Plus Time: Capturing Unintended Human Activities from Weakly-labeled Videos
    Arnav Chakravarthy, Zhiyuan Fang, Yezhou Yang · 2022 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  29. Egocentric Action Anticipation for Personal Health
    Ivan Rodin, Antonino Furnari, Dimitrios Mavroeidis, Giovanni Maria Farinella · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
  30. Toward Egocentric Compositional Action Anticipation with Adaptive Semantic Debiasing
    Tianyu Zhang, Weiqing Min, Tao Liu, Shuqiang Jiang, Yong Rui · 2023 · ACM Transactions on Multimedia Computing Communications and Applications
  31. Let Me Help You! Neuro-Symbolic Short-Context Action Anticipation
    Sarthak Bhagat, Samuel Li, Joseph Campbell, Yaqi Xie, Katia P. Sycara, Simon Stepputtis · 2024 · IEEE Robotics and Automation Letters
  32. Towards Open-Set Egocentric Action Recognition with Uncertainty Estimation
    Yishan Zou, Chris Nugent, Matthew Burns, Xiaoming Xi, Meng Liu · 2024 · Lecture notes in computer science
  33. Inferring Past Human Actions in Homes with Abductive Reasoning
    Clement Tan, Chai Kiat Yeo, Cheston Tan, Basura Fernando · 2025 · IEEE Winter Conference on Applications of Computer Vision
  34. Uncertainty-Aware Mixture of Experts for Video Action Anticipation
    Zhaobo Qi, Shuhui Wang, Weigang Zhang, Qingming Huang · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
  35. Higher-Order Recurrent Network with Space-Time Attention for Video Early Action Recognition
    Tsung‐Ming Tai, Giuseppe Fiameni, Cheng‐Kuang Lee, Oswald Lanz · 2022 · Proceedings - International Conference on Image Processing
  36. ConTra: (Con)text (Tra)nsformer for Cross-Modal Video Retrieval
    Adriano Fragomeni, Michael Wray, Dima Damen · 2023 · Lecture notes in computer science
  37. Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation
    Sayontan Ghosh, Tanvi Aggarwal, Minh Hoai, Niranjan Balasubramanian · 2023 · Findings of the Association for Computational Linguistics: EACL
  38. Enhancing Next Active Object-Based Egocentric Action Anticipation with Guided Attention
    Sanket Kumar Thakur, Cigdem Beyan, Pietro Morerio, Vittorio Murino, Alessio Del Bue · 2023 · Proceedings - International Conference on Image Processing
  39. Egocentric activity recognition using two-stage decision fusion
    Mehmet Ali Arabacı, Elif Sürer, Alptekin Temizel · 2024 · Neural Computing and Applications
  40. Future Moment Assessment for Action Query
    Qiuhong Ke, Mario Fritz, Bernt Schiele · 2021 · IEEE Winter Conference on Applications of Computer Vision
  41. Anticipating Activity from Multimodal Signals
    Tiziana Rotondo, Giovanni Maria Farinella, Davide Giacalone, Sebastiano Mauro Strano, Valeria Tomaselli, Sebastiano Battiato · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  42. Learning Video Models from Text: Zero-Shot Anticipation for Procedural Actions.
    Fadime Şener, Rishabh Saraf, Angela Yao · 2021 · arXiv (Cornell University)
  43. Anticipating Next Active Objects for Egocentric Videos
    Sanket Kumar Thakur, Cigdem Beyan, Pietro Morerio, Vittorio Murino, Alessio Del Bue · 2023 · SSRN Electronic Journal
  44. Large Language Model for Action Anticipation
    Wei Li, Dezhao Luo, Dongbao Yang, Weiping Wang · 2024 · Lecture notes in computer science
  45. Text Descriptions of Actions and Objects Improve Action Anticipation
    Apoorva Beedu, Harish Haresamudram, Irfan A. Essa · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
  46. Cross-View Correspondence Modeling for Joint Representation Learning Between Egocentric and Exocentric Videos
    Zhehao Zhu, Yoichi Sato · 2025 · IEEE Access
  47. Multimodal adaptive fusion for enhanced long-term action anticipation
    Yaoyao Jing, Yilong Xiao, Haoming Fang, Keming Mao, Jianzhe Zhao, Xinlu Xiao · 2025 · Machine Vision and Applications
  48. Goal-Guided Prompting With Adaptive Modality Selection for Efficient Assembly Activity Anticipation in Egocentric Videos
    Tianshan Liu, Bing‐Kun Bao · 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  49. Scalable Video Action Anticipation with Cross Linear Attentive Memory
    Zeyun Zhong, Manuel Martín, David Schneider, David J. Lerch, Chengzhi Wu, Frederik Diederichs, Jüergen Gall, Jürgen Beyerer · 2026 · IEEE Winter Conference on Applications of Computer Vision
  50. Uncertainty-aware and generalizable task prediction for human–robot collaboration in on-site timber assembly
    Yiqing Wang, Zhengyi Chen, Jack C.P. Cheng, Xingyu Tao · 2026 · Advanced Engineering Informatics
  51. Temporal modelling of first-person actions using hand-centric verb and object streams
    Zeynep Gökçe, Selen Pehlivan · 2021 · Signal Processing Image Communication
  52. Weakly-Supervised Action Detection Guided by Audio Narration
    Keren Ye, Adriana Kovashka · 2022 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  53. Weakly supervised action anticipation without object annotations
    Yi Zhong, Jiahui Pan, Haoxin Li, Wei‐Shi Zheng · 2022 · Frontiers of Computer Science
  54. A Non Local Multi-Fiber Network For Action Anticipation In Videos
    Noureldin Elmadany, Lei Gao, Ling Guan · 2022 · Conference proceedings - Canadian Conference on Electrical and Computer Engineering
  55. Early Anticipation of Driving Maneuvers
    Abdul Wasi, Shankar Gangisetty, Shyam Nandan Rai, C. V. Jawahar · 2024 · Lecture notes in computer science
  56. Disentangled adaptive fusion transformer using adversarial perturbation for egocentric action anticipation
    Min Hyuk Kim, Jong Won Jung, Eun-Gi Lee, Seok Bong Yoo · 2025 · Expert Systems with Applications
  57. Inside-out Vision for Procedure Recognition in Dental Environment
    Shaheena Noor, Humera Noor Minhas, Muhammad Imran Saleem, Vali Uddin, Najma Ismat · 2020 · Global Conference on Wireless and Optical Technologies (GCWOT)
  58. A Comprehensive Study on Temporal Modeling for Online Action Detection
    Wen Wang, Xiaojiang Peng, Yu Qiao, Jian Cheng · 2020 · arXiv (Cornell University)
  59. Fall detection by egocentric vision
    Xueyi Wang · 2024
  60. Localizing Visitors in Natural Sites Exploiting Modality Attention on Egocentric Images and GPS Data
    Giovanni Pasqualino, Stefano Scafiti, Antonino Furnari, Giovanni Maria Farinella · 2020 · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP)
  61. PLAN-B: Predicting Likely Alternative Next Best Sequences for Action Prediction
    Daniel Scarafoni, Irfan A. Essa, Thomas Ploetz · 2021 · arXiv (Cornell University)
  62. Inside-out Vision for Treatment Identification in Dental Setup using Machine Learning
    Shaheena Noor, Humera Noor Minhas, Muhammad Imran Saleem, Vali Uddin, Najma Ismat · 2021 · Research Square
  63. A Modular Approach for the Detection and Interconnection of Objects, Hands, Locations, and Actions for Egocentric Video Understanding
    Georgios Kapidis · 2021
  64. Understanding Manipulation Contexts by Vision and Language for Robotic Vision
    Chen Jiang · 2021 · ERA: Education and Research Archive (University of Alberta)
  65. Two-Stream Retentive Long Short-Term Memory Network for Dense Action Anticipation
    Fengda Zhao, Jiuhan Zhao, Xianshan Li, Yinghui Zhang, Dingding Guo, Wenbai Chen · 2022 · Computational Intelligence and Neuroscience
  66. Comparative Techniques Using Hierarchical Modelling and Machine Learning for Procedure Recognition in Smart Hospitals
    Shaheena Noor, Muhammad Aamir, Najma Ismat, Muhammad Imran Saleem · 2022 · Journal of ICT Standardization
  67. Action Anticipation in First-Person Videos with Self-Attention Based Multi-Modal Network
    Jie Shao, Chen Mo · 2022 · Pattern Recognition and Image Analysis
  68. Deep-learning Based Egocentric Action Anticipation: A Survey
    Richard Wardle, Sareh Rowlands · 2023 · Research Square
  69. Pattern4Ego: Learning Egocentric Video Representation Using Cross-video Activity Patterns
    Ruihai Wu, Yourong Zhang, Yu Qi, Andy Guanhong Chen, Hao Dong · 2024 · International Conference on Multimedia Retrieval
  70. Revisiting Subject-Action Relevance for Egocentric Activity Recognition
    Manav Prabhakar, Kovvuri Sai Gopal Reddy, Snehasis Mukherjee · 2025 · National Conference on Communications
  71. DIV-FF: Dynamic Image-Video Feature Fields For Environment Understanding in Egocentric Videos
    Lorenzo Mur-Labadia, Josechu Guerrero, Rubén Martínez-Cantín · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  72. Cross-modal spatiotemporal fusion with frequency-aware for action anticipation
    Jingru Gui, Yang Lü, Zongnan Ma, Migang Zhang, Fuchun Zhang · 2025 · Signal Image and Video Processing
  73. Superclass-Guided Hierarchical Learning for Action Anticipation
    Shin Suzuki, Naoshi Kaneko, Kazuhiko Sumi · 2025 · Communications in computer and information science
  74. Toward Accurate Procedure Planning in Instructional Videos: Visual State Generation Helps Task-Selective Diffusion
    Fen Fang, Muli Yang, Min Wu, Yanhua Yang, Qianli Xu, Joo‐Hwee Lim, Xulei Yang, Hongyuan Zhu · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  75. Chirality-Aware Grammar-Guided Surgical Action Anticipation from Video
    Md Rezowan Shuvo, M.S. Mekala, Eyad Elyan · 2026 · ACM/IEEE International Conference on Human-Robot Interaction (HRI)
  76. Hybrid AI approaches for context recognition : application to activity recognition and anticipation and context abnormalities handling in Ambient Intelligence environments
    Koussaila Moulouel · 2023
  77. EgoShift: Domain-Adaptive Egocentric Action Anticipation with Human Feedback
    Dimitrios Koutrintzes, Alexandros Mitsou, Evaggelos Spyrou A · 2026 · Communications in computer and information science
  78. EgoHAnG: Graph-Enhanced Horizon Aware Egocentric Action Anticipation
    Pawanesh Kumar Vishwakarma, Ananda Shankar Chowdhury, Abhimanyu Sahu · 2026 · Lecture notes in computer science
  79. PAL: Predictive Action Logic for online action segmentation
    Tongjie Xu, Rongxuan Zhang, Xudong Tian, Yi Chen, Zhichao Zheng, Junsheng Zhou · 2026 · Computer Vision and Image Understanding
  80. Residual Diffusion in FLUX Latent Space for Short-Horizon Egocentric Future Prediction
    Hamed Abdollahzadeh, Giovanni De Gasperis · 2026 · Lecture notes in computer science
  81. SeeIntent: A Real-Time Multimodal Intent Recognition System in XR Using Spatio-Temporal LLM
    Gathik Jindal, Jayant Sharma, Beryl Gnanaraj, Jaya Sreevalsan‐Nair · 2026 · Lecture notes in computer science
  82. Adaptive Query-Conditional Fusion for Egocentric Natural Language Query Grounding
    Enmin Zhong, Carlos R. del‐Blanco, Fernando Jaureguizar, Narciso García · 2026 · Lecture notes in computer science