MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
Open accessAbstract
Human motion modeling is important for many modern graphics applications, which typically require professional skills. In order to remove the skill barriers for laymen, recent motion generation methods can directly generate human motions conditioned on natural languages. However, it remains challenging to achieve diverse and fine-grained motion generation with various text inputs. To address this problem, we propose MotionDiffuse, the first diffusion model-based text-driven motion generation framework, which demonstrates several desired properties over existing methods. 1) Probabilistic Mapping. Instead of a deterministic language-motion mapping, MotionDiffuse generates motions through a series of denoising steps in which variations are injected. 2) Realistic Synthesis. MotionDiffuse excels at modeling complicated data distribution and generating vivid motion sequences. 3) Multi-Level Manipulation. MotionDiffuse responds to fine-grained instructions on body parts, and arbitrary-length motion synthesis with time-varied text prompts. Our experiments show MotionDiffuse outperforms existing SoTA methods by convincing margins on text-driven motion generation and action-conditioned motion generation. A qualitative analysis further demonstrates MotionDiffuse's controllability for comprehensive motion generation. Homepage: https://mingyuan-zhang.github.io/projects/MotionDiffuse.html
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Systems exist that directly generate physical representations from texts (T2M-GPT, MotionGPT, MotionDiffuse, and ReMoDiffuse).
“Systems exist that directly generate physical representations from texts (T2M-GPT [216], MotionGPT [96], MotionDiffuse [217], and ReMoDiffuse [218]).”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [217]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · see citing works
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · see citing works
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712 · see citing works
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354 · see citing works
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_24 · Cited by 5,351 · see citing works
Ucf101: A dataset of 101 human actions classes from videos in the wild
Soomro, K., Zamir, A. R., & Shah, M. (2012) · arXiv · doi:10.48550/arxiv.1212.0402 · Cited by 4,575 · see citing works
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965 · see citing works
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734 · see citing works
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653 · see citing works
Gaussian Error Linear Units (GELUs)
Hendrycks, D., & Gimpel, K. (2016) · arXiv · doi:10.48550/arxiv.1606.08415 · Cited by 3,537 · see citing works
Diffusion Models Beat GANs on Image Synthesis
Dhariwal, P., & Nichol, A. (2021) · arXiv · doi:10.48550/arxiv.2105.05233 · Cited by 3,362 · see citing works
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · see citing works
Density estimation using Real NVP
Dinh, L., Sohl-Dickstein, J., & Bengio, S. (2016) · arXiv · Cited by 2,067 · see citing works
NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
Liu, J., Shahroudy, A., Pérez, M., Wang, G., Duan, L., & Kot, A. C. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2916873 · Cited by 1,841 · see citing works
The Visual Analysis of Human Movement: A Survey
Gavrila, D. M. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0716 · Cited by 1,789 · see citing works
Improved Denoising Diffusion Probabilistic Models
Nichol, A., & Dhariwal, P. (2021) · arXiv · doi:10.48550/arxiv.2102.09672 · Cited by 1,550 · see citing works
NICE: Non-linear Independent Components Estimation
Dinh, L., Krueger, D., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1410.8516 · Cited by 1,493 · see citing works
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
Nichol, A., Dhariwal, P., Ramesh, A., Shyam, P., Mishkin, P., McGrew, B., Sutskever, I., & Chen, M. (2021) · arXiv · doi:10.48550/arxiv.2112.10741 · Cited by 1,357 · see citing works
AMASS: Archive of Motion Capture As Surface Shapes
Mahmood, N., Ghorbani, N., Troje, N. F., Pons-Moll, G., & Black, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00554 · Cited by 1,323 · see citing works
On the Continuity of Rotation Representations in Neural Networks
Zhou, Y., Barnes, C., Lu, J., Yang, J., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00589 · Cited by 1,255 · see citing works
Generalizing motion edits with Gaussian processes
Ikemoto, L., Arıkan, O., & Forsyth, D. A. (2009) · ACM Transactions on Graphics · doi:10.1145/1477926.1477927 · Cited by 1,225 · see citing works
Training Generative Adversarial Networks with Limited Data
Karras, T., Aittala, M., Hellsten, J., Laine, S., Lehtinen, J., & Aila, T. (2020) · arXiv · doi:10.48550/arxiv.2006.06676 · Cited by 1,170 · see citing works
Monocular 3D Human Pose Estimation in the Wild Using Improved CNN Supervision
Mehta, D., Rhodin, H., Casas, D., Fua, P., Sotnychenko, O., Xu, W., & Theobalt, C. (2017) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00064 · Cited by 1,149 · see citing works
MoCoGAN: Decomposing Motion and Content for Video Generation
Tulyakov, S., Liu, M.-Y., Yang, X., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00165 · Cited by 1,076 · see citing works
VIBE: Video Inference for Human Body Pose and Shape Estimation
Kocabas, M., Athanasiou, N., & Black, M. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00530 · Cited by 1,065 · see citing works
AVA: A Video Dataset of Spatio-Temporally Localized Atomic Visual Actions
Gu, C., Sun, C., Ross, D. A., Vondrick, C., Pantofaru, C., Li, Y., Vijayanarasimhan, S., Toderici, G. D., Ricco, S., Sukthankar, R., et al. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00633 · Cited by 1,029 · see citing works
Towards Understanding Action Recognition
Jhuang, H., Gall, J., Zuffi, S., Schmid, C., & Black, M. J. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.396 · Cited by 906 · see citing works
Generative Adversarial Networks (GANs)
Saxena, D., & Cao, J. (2021) · ACM Computing Surveys · doi:10.1145/3446374 · Cited by 798 · see citing works
Verbs and adverbs: multidimensional motion interpolation
Rose, C., Cohen, M. F., & Bodenheimer, B. (1998) · IEEE Computer Graphics and Applications · doi:10.1109/38.708559 · Cited by 734 · see citing works
Generating Diverse and Natural 3D Human Motions from Text
Guo, C., Zou, S., Zuo, X., Wang, S., Ji, W., Li, X., & Cheng, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00509 · Cited by 582 · see citing works
Panoptic Studio: A Massively Multiview System for Social Motion Capture
Joo, H., Liu, H., Tan, L., Gui, L., Nabbe, B. C., Matthews, I. A., Takeo Kanade, A., Nobuhara, S., & Sheikh, Y. A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.381 · Cited by 567 · see citing works
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++
Li, R., Yang, S., Ross, D. A., & Kanazawa, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01315 · Cited by 553 · see citing works
Moments in Time Dataset: One Million Videos for Event Understanding
Monfort, M., Vondrick, C., Oliva, A., Andonian, A., Zhou, B., Ramakrishnan, K., Bargal, S. A., Yan, T., Brown, L., Fan, Q., et al. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2901464 · Cited by 537 · see citing works
Action-Conditioned 3D Human Motion Synthesis with Transformer VAE
Petrovich, M., Black, M. J., & Varol, G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01080 · Cited by 506 · see citing works
PoseTrack: A Benchmark for Human Pose Estimation and Tracking
Andriluka, M., Iqbal, U., Insafutdinov, E., Pishchulin, L., Milan, A., Gall, J., & Schiele, B. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00542 · Cited by 501 · see citing works
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis
Jain, A., Tancik, M., & Abbeel, P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00583 · Cited by 477 · see citing works
Model-based image analysis of human motion using constraint propagation
O’Rourke, J., & Badler, N. I. (1980) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1980.6447699 · Cited by 436 · see citing works
Guo, C., Zuo, X., Wang, S., Zou, S., Sun, Q., Deng, A., Gong, M., & Cheng, L. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413635 · Cited by 400 · see citing works
FineGym: A Hierarchical Video Dataset for Fine-Grained Action Understanding
Shao, D., Zhao, Y., Dai, B., & Lin, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00269 · Cited by 369 · see citing works
TEMOS: Generating Diverse Human Motions from Textual Descriptions
Petrovich, M., Black, M. J., & Varol, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20047-2_28 · Cited by 366 · see citing works
A Short Note on the Kinetics-700-2020 Human Action Dataset
Smaira, L., Carreira, J., Noland, E., Clancy, E., Wu, A., & Zisserman, A. (2020) · arXiv · doi:10.48550/arxiv.2010.10864 · Cited by 334 · see citing works
MotionCLIP: Exposing Human Motion Generation to CLIP Space
Tevet, G., Gordon, B., Hertz, A., Bermano, A. H., & Cohen‐Or, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20047-2_21 · Cited by 331 · see citing works
HP-GAN: Probabilistic 3D Human Motion Prediction via GAN
Barsoum, E., Kender, J. R., & Liu, Z. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00191 · Cited by 327 · see citing works
Self-citationTotal Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors
Trumble, M., Gilbert, A., Malleson, C., Hilton, A., & Collomosse, J. P. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.14 · Cited by 301 · see citing works
The KIT Motion-Language Dataset
Plappert, M., Mandery, C., & Asfour, T. (2016) · Big Data · doi:10.1089/big.2016.0028 · Cited by 294 · see citing works
Tevet, G., Raab, S., Gordon, B., Shafir, Y., Cohen-Or, D., & Bermano, A. H. (2022) · arXiv · doi:10.48550/arxiv.2209.14916 · Cited by 290 · see citing works
Language2Pose: Natural Language Grounded Pose Forecasting
Ahuja, C., & Morency, L. (2019) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2019.00084 · Cited by 271 · see citing works
Harvey, F. G., Yurick, M., Nowrouzezahrai, D., & Pal, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392480 · Cited by 269 · see citing works
HACS: Human Action Clips and Segments Dataset for Recognition and Temporal Localization
Zhao, H., Torralba, A. B., Torresani, L., & Yan, Z. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00876 · Cited by 261 · see citing works
Long-Term Human Motion Prediction with Scene Context
Cao, Z., Gao, H., Mangalam, K., Cai, Q.-Z., Vo, M., & Malik, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_23 · Cited by 227 · see citing works
Hong, F., Zhang, M., Pan, L., Cai, Z., Yang, L., & Liu, Z. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530094 · Cited by 218 · see citing works
Self-citationBailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory
Li, S., Yu, W., Gu, T., Lin, C., Wang, Q., Qian, C., Loy, C. C., & Liu, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01077 · Cited by 208 · see citing works
Self-citationAGORA: Avatars in Geography Optimized for Regression Analysis
Patel, P., Huang, C.-H. P., Tesch, J., Hoffmann, D. T., Tripathi, S., & Black, M. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01326 · Cited by 199 · see citing works
Min, J., & Chai, J. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366172 · Cited by 197 · see citing works
BABEL: Bodies, Action and Behavior with English Labels
Punnakkal, A. R., Chandrasekaran, A., Athanasiou, N., Quirós-Ramírez, M. A., & Black, M. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00078 · Cited by 191 · see citing works
Henter, G. E., Alexanderson, S., & Beskow, J. (2020) · ACM Transactions on Graphics · doi:10.1145/3414685.3417836 · Cited by 187 · see citing works
Efficient Attention: Attention with Linear ComplexitiesPreprint
Shen, Z., Zhang, M., Zhao, H., Yi, S., & Li, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01243 · Cited by 184 · see citing works
Self-citationSynthesis of Compositional Animations from Textual Descriptions
Ghosh, A., Cheema, N., Oguz, C., Theobalt, C., & Slusallek, P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00143 · Cited by 172 · see citing works
FLAME: Free-Form Language-Based Motion Synthesis & Editing
Kim, J.-H., Kim, J., & Choi, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25996 · Cited by 152 · see citing works
MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics
Yan, X., Rastogi, A., Villegas, R., Sunkavalli, K., Shechtman, E., Hadap, S., Yumer, E., & Lee, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_17 · Cited by 147 · see citing works
Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents
Bhattacharya, U., Rewkowski, N., Banerjee, A., Guhan, P., Bera, A., & Manocha, D. (2021) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr50410.2021.00037 · Cited by 144 · see citing works
TEACH: Temporal Action Composition for 3D Humans
Athanasiou, N., Petrovich, M., Black, M. J., & Varol, G. (2022) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv57658.2022.00053 · Cited by 141 · see citing works
DeepDance: Music-to-Dance Motion Choreography With Adversarial Learning
Sun, G., Wong, Y., Cheng, Z., Kankanhalli, M., Geng, W., & Li, X. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2981989 · Cited by 140 · see citing works
Music2Dance: DanceNet for Music-Driven Dance Generation
Zhuang, W., Wang, C., Chai, J., Wang, Y., Shao, M., & Xia, S. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3485664 · Cited by 134 · see citing works
A Stochastic Conditioning Scheme for Diverse Human Motion Prediction
Aliakbarian, S., Saleh, F. S., Salzmann, M., Petersson, L., & Gould, S. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00527 · Cited by 110 · see citing works
HuMMan: Multi-modal 4D Human Dataset for Versatile Sensing and Modeling
Cai, Z., Ren, D., Zeng, A., Lin, Z., Yu, T., Wang, W., Fan, X., Gao, Y., Yu, Y., Pan, L., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20071-7_33 · Cited by 96 · see citing works
Self-citationDance Revolution: Long-Term Dance Generation with Music via Curriculum LearningPreprint
Huang, R., Huang, H., Wu, W., Sawada, K. B., Zhang, M., & Jiang, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06119 · Cited by 92 · see citing works
Self-citationHUMBI: A Large Multiview Dataset of Human Body Expressions
Yu, Z., Yoon, J. S., Lee, I. K., Venkatesh, P., Park, J., Yu, J., & Park, H. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00306 · Cited by 88 · see citing works
A Large-scale RGB-D Database for Arbitrary-view Human Action Recognition
Ji, Y., Xu, F., Yang, Y., Shen, F., Shen, H. T., & Zheng, W. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240675 · Cited by 86 · see citing works
Learning to Generate Diverse Dance Motions with TransformerPreprint
Li, J., Yin, Y., Chu, H., Zhou, Y., Wang, T., Fidler, S., & Li, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.08171 · Cited by 75 · see citing works
Representing cyclic human motion using functional analysis
Ormoneit, D., Black, M. J., Hastie, T. J., & Kjellström, H. (2005) · Image and Vision Computing · doi:10.1016/j.imavis.2005.09.004 · Cited by 70 · see citing works
Geostatistical motion interpolation
Mukai, T., & Kuriyama, S. (2005) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186822.1073313 · Cited by 64 · see citing works
Implicit Neural Representations for Variable Length Human Motion Generation
Cervantes, P., Sekikawa, Y., Sato, I., & Shinoda, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19790-1_22 · Cited by 62 · see citing works
Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitions
Wang, Z., Yu, P., Zhao, Y., Zhang, R., Zhou, Y., Yuan, J., & Chen, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6911 · Cited by 50 · see citing works
Generating Animated Videos of Human Activities from Natural Language Descriptions
Lin, A. S., Wu, L., Corona, R., Tai, K., Qi-xing Huang, A., & Mooney, R. J. (2018) · Cited by 47 · see citing works
Brabazon, T. (2012) · SAGE Publications Ltd eBooks · doi:10.4135/9781446251409.n4 · Cited by 47 · see citing works
3D Human Shape Reconstruction from a Polarization Image
Zou, S., Zuo, X., Qian, Y., Wang, S., Xu, C., Gong, M., & Cheng, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_21 · Cited by 44 · see citing works
HAA500: Human-Centric Atomic Action Dataset with Curated Videos
Chung, J., Wuu, C.-H., Yang, H.-R., Tai, Y., & Tang, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01321 · Cited by 43 · see citing works
Cai, Z., Zhang, M., Ren, J., Wei, C., Ren, D., Lin, Z., Zhao, H., Yang, L., Loy, C. C., & Liu, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3450537 · Cited by 36 · see citing works
Self-citationKinematic dataset of actors expressing emotions
Zhang, M., Yu, L., Zhang, K., Du, B., Zhan, B., Chen, S., Jiang, X., Guo, S., Zhao, J., Wang, Y., et al. (2020) · Scientific Data · doi:10.1038/s41597-020-00635-7 · Cited by 28 · see citing works
Self-citation
Flagged first, then by citations
3 of the 85 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- Futrelle R, Speckert G (1978) Extraction of motion data by interactive processing. In: Proc. 1978 IEEE Conf. Pattern Recog. and Image Processing, Chicago, IL, pp 405-408
- Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde- Farley D, Ozair S, Courville A, Bengio Y (2014) Gen- erative adversarial nets. Advances in neural informa- tion processing systems 27
- Henter GE, Alexanderson S, Beskow J (2020) Moglow: Probabilistic and controllable motion synthesis us- ing normalising flows. ACM Transactions on Graph- ics (TOG) 39(6):1-14
- Hong F, Zhang M, Pan L, Cai Z, Yang L, Liu Z (2022) Avatarclip: Zero-shot text-driven generation and ani- mation of 3d avatars. arXiv preprint arXiv:220508535
- Kingma DP, Dhariwal P (2018) Glow: Generative flow with invertible 1x1 convolutions. Advances in neural information processing systems 31
- Kingma DP, Welling M (2013) Auto-encoding varia- tional bayes. arXiv preprint arXiv:13126114
- Mukai T, Kuriyama S (2005) Geostatistical motion in- terpolation. In: ACM SIGGRAPH 2005 Papers, pp 1062-1070
- Petrovich M, Black MJ, Varol G (2022) Temos: Gen- erating diverse human motions from textual descrip- tions. arXiv preprint arXiv:220414109
- Tulyakov S, Liu MY, Yang X, Kautz J (2018) Moco- gan: Decomposing motion and content for video gen- eration. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1526- 1535
Cited by
Sorted by citations
DiffusionDet: Diffusion Model for Object Detection
Chen, S., Sun, P., Song, Y., & Luo, P. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01816 · Cited by 657 · see citing works
Executing your Commands via Motion Diffusion in Latent Space
Chen, X., Jiang, B., Liu, W., Huang, Z., Fu, B., Chen, T., & Yu, G. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01726 · Cited by 370 · see citing works
Generating Human Motion from Textual Descriptions with Discrete Representations
Zhang, J., Zhang, Y., Cun, X., Zhang, Y., Zhao, H., Lu, H., Shen, X., & Ying, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01415 · Cited by 328 · see citing works
EDGE: Editable Dance Generation From Music
Tseng, J., Castellon, R., & Liu, C. K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00051 · Cited by 275 · see citing works
PhysDiff: Physics-Guided Human Motion Diffusion Model
Yuan, Y., Song, J., Iqbal, U., Vahdat, A., & Kautz, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01467 · Cited by 246 · see citing works
MoMask: Generative Masked Modeling of 3D Human Motions
Guo, C., Mu, Y., Javed, M. G., Wang, S., & Cheng, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00186 · Cited by 201 · see citing works
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
Huang, S., Wang, Z., Li, P., Jia, B., Liu, T., Zhu, Y., Liang, W., & Zhu, S.-C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01607 · Cited by 192 · see citing works
GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents
Ao, T., Zhang, Z., & Liu, L. (2023) · ACM Transactions on Graphics · doi:10.1145/3592097 · Cited by 175 · see citing works
MoFusion: A Framework for Denoising-Diffusion-Based Motion Synthesis
Dabral, R., Mughal, M. H., Golyanik, V., & Theobalt, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00941 · Cited by 174 · see citing works
MotionDiffuser: Controllable Multi-Agent Motion Prediction Using Diffusion
Jiang, C. M., Cornman, A., Park, C., Sapp, B., Zhou, Y., & Anguelov, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00930 · Cited by 172 · see citing works
ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model
Zhang, M., Guo, X., Pan, L., Cai, Z., Hong, F., Li, H., Yang, L., & Liu, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00040 · Cited by 166 · see citing works
Self-citationDiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation
Shen, S., Zhao, W., Meng, Z., Li, W., Zhu, Z., Zhou, J., & Lu, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00197 · Cited by 133 · see citing works
InterGen: Diffusion-Based Multi-human Motion Generation Under Complex Interactions
Liang, H., Zhang, W., Li, W., Jingyi Yu, A., & Xu, L. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02042-6 · Cited by 128 · see citing works
DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models
Yang, S., Wu, Z., Li, M., Zhang, Z., Lei, H., Bao, W., Cheng, M., & Xiao, L. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/650 · Cited by 114 · see citing works
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis
Petrovich, M., Black, M. J., & Varol, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00870 · Cited by 108 · see citing works
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion
Xu, S., Li, Z., Wang, Y.-X., & Gui, L.-Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01371 · Cited by 107 · see citing works
Expressive 3D Facial Animation Generation Based on Local-to-Global Latent Diffusion
Song, W., Wang, X., Jiang, Y., Li, S., Hao, A., Hou, X., & Qin, H. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456213 · Cited by 107 · see citing works
HumanMAC: Masked Motion Completion for Human Motion Prediction
Chen, L.-H., Zhang, J., Li, Y., Pang, Y., Xia, X., & Liu, T. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00875 · Cited by 104 · see citing works
Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model
Du, Y., Kips, R., Pumarola, A., Starke, S., Thabet, A., & Sanakoyeu, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00054 · Cited by 103 · see citing works
ZeroEGGS: Zero‐shot Example‐based Gesture Generation from Speech
Ghorbani, S., Ferstl, Y., Holden, D., Troje, N. F., & Carbonneau, M. (2023) · Computer Graphics Forum · doi:10.1111/cgf.14734 · Cited by 100 · see citing works
Ego-Body Pose Estimation via Ego-Head Pose Estimation
Li, J., Liu, C. K., & Wu, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01644 · Cited by 93 · see citing works
MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators
Zhang, Y., Huang, D., Liu, B., Tang, S., Lu, Y., Chen, L., Bai, L., Chu, Q., Yu, N., & Ouyang, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28567 · Cited by 89 · see citing works
Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuning
Feng, C.-M., Yu, K., Liu, Y., Khan, S. H., & Zuo, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00255 · Cited by 88 · see citing works
FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generation
Li, R., Zhao, J., Zhang, Y., Su, M., Ren, Z., Zhang, H., Tang, Y., & Li, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00939 · Cited by 82 · see citing works
Object Motion Guided Human Motion Synthesis
Li, J., Wu, J., & Liu, C. K. (2023) · ACM Transactions on Graphics · doi:10.1145/3618333 · Cited by 75 · see citing works
MMM: Generative Masked Motion Model
Pinyoanuntapong, E., Wang, P., Lee, M., & Chen, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00153 · Cited by 77 · see citing works
AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanism
Zhong, C., Hu, L., Zhang, Z., & Xia, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00053 · Cited by 74 · see citing works
Motion Mamba: Efficient and Long Sequence Motion Generation
Zhang, Z., Liu, A., Reid, I. D., Hartley, R. I., Zhuang, B., & Tang, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73232-4_15 · Cited by 71 · see citing works
ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generation
Xu, L., Song, Z., Wang, D., Su, J., Fang, Z., Ding, C., Gan, W., Yan, Y., Jin, X., Yang, X., et al. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00212 · Cited by 67 · see citing works
NetDiffus: Network traffic generation by diffusion models through time-series imaging
Sivaroopan, N., Bandara, D., Madarasingha, C., Jourjon, G., Jayasumana, A. P., & Thilakarathna, K. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110616 · Cited by 65 · see citing works
Li, R., Zhang, Y.-X., Zhang, Y., Zhang, H., Guo, J., Zhang, Y. T., Liu, Y., & Li, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00151 · Cited by 64 · see citing works
FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models
Xu, J., Guo, Y., & Peng, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00060 · Cited by 62 · see citing works
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition
Leng, Z., Bhattacharjee, A., Rajasekhar, H., Zhang, L., Bruda, E., Kwon, H., & Plötz, T. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3678545 · Cited by 61 · see citing works
MotionLCM: Real-Time Controllable Motion Generation via Latent Consistency Model
Dai, W., Chen, L.-H., Wang, J., Liu, J., Dai, B., & Tang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72640-8_22 · Cited by 61 · see citing works
UDE: A Unified Driving Engine for Human Motion Generation
Zhou, Z., & Wang, B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00545 · Cited by 57 · see citing works
Chen, J., Liu, Y., Wang, J., Zeng, A., Li, Y., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00702 · Cited by 56 · see citing works
CIRCLE: Capture In Rich Contextual Environments
Araújo, J. P., Li, J., Vetrivel, K., Agarwal, R., Wu, J., Gopinath, D., Clegg, A., & Liu, C. K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02032 · Cited by 51 · see citing works
SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation
Athanasiou, N., Petrovich, M., Black, M. J., & Varol, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00916 · Cited by 50 · see citing works
Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation
Azadi, S., Shah, A., Hayes, T., Parikh, D., & Gupta, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01381 · Cited by 49 · see citing works
Flexible Motion In-betweening with Diffusion Models
Cohan, S., Tevet, G., Reda, D., Peng, X. B., & van de Panne, M. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657414 · Cited by 49 · see citing works
Priority-Centric Human Motion Generation in Discrete Latent Space
Kong, H., Gong, K., Lian, D., Mi, M. B., & Wang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01360 · Cited by 48 · see citing works
Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Model
Wang, Y., Leng, Z., Li, F. W. B., Wu, S., & Liang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02014 · Cited by 48 · see citing works
Move as you Say, Interact as you can: Language-Guided Human Motion Generation with Scene Affordance
Wang, Z., Chen, Y., Jia, B., Li, P., Zhang, J., Zhang, J., Liu, T., Zhu, Y., Liang, W., & Huang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00049 · Cited by 48 · see citing works
DiffusionTrack: Point Set Diffusion Model for Visual Object Tracking
Xie, F., Wang, Z., & Ma, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01808 · Cited by 47 · see citing works
EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation
Zhou, W., Dou, Z., Cao, Z., Liao, Z., Wang, J., Wang, W., Liu, Y., Komura, T., Wang, W., & Liu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72627-9_2 · Cited by 47 · see citing works
MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representations
Yao, H., Song, Z., Zhou, Y., Ao, T., Chen, B., & Liu, L. (2024) · ACM Transactions on Graphics · doi:10.1145/3658137 · Cited by 46 · see citing works
BiFSMNv2: Pushing Binary Neural Networks for Keyword Spotting to Real-Network Performance
Qin, H., Ma, X., Ding, Y., Li, X., Zhang, Y., Ma, Z., Wang, J., Luo, J., & Liu, X. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3243259 · Cited by 45 · see citing works
TLControl: Trajectory and Language Control for Human Motion Synthesis
Wan, W., Dou, Z., Komura, T., Wang, W., Jayaraman, D., & Liu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72913-3_3 · Cited by 45 · see citing works
NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis
Kulkarni, N. V., Rempe, D., Genova, K., Kundu, A., Johnson, J., Fouhey, D. F., & Guibas, L. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00096 · Cited by 44 · see citing works
Controllable Human-Object Interaction Synthesis
Li, J., Clegg, A., Mottaghi, R., Wu, J., Puig, X., & Liu, C. K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_4 · Cited by 43 · see citing works
Speech driven video editing via an audio-conditioned diffusion model
Bigioi, D., Basak, S., Stypułkowski, M., Zięba, M., Jordan, H., McDonnell, R., & Corcoran, P. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.104911 · Cited by 42 · see citing works
Text2HOI: Text-Guided 3D Motion Generation for Hand-Object Interaction
Cha, J., Kim, J., Yoon, J. S., & Baek, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00156 · Cited by 42 · see citing works
Optimizing Diffusion Noise Can Serve As Universal Motion Priors
Karunratanakul, K., Preechakul, K., Aksan, E., Beeler, T., Suwajanakorn, S., & Tang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00133 · Cited by 42 · see citing works
DiffTAD: Temporal Action Detection with Proposal Denoising Diffusion
Nag, S., Zhu, X., Deng, J., Song, Y.-Z., & Xiang, T. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00951 · Cited by 40 · see citing works
HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models
Peng, X., Xie, Y., Wu, Z., Jampani, V., Sun, D., & Jiang, H. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00271 · Cited by 40 · see citing works
Leng, Z., Kwon, H., & Ploetz, T. (2023) · Proceedings of the 2023 International Symposium on Wearable Computers · doi:10.1145/3594738.3611361 · Cited by 39 · see citing works
Being Comes from Not-Being: Open-Vocabulary Text-to-Motion Generation with Wordless Training
Lin, J., Chang, J., Liu, L., Li, G., Lin, L., Tian, Q. C., & Chen, C. W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02224 · Cited by 38 · see citing works
SMooDi: Stylized Motion Diffusion Model
Zhong, L., Xie, Y., Jampani, V., Sun, D., & Jiang, H. W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73232-4_23 · Cited by 38 · see citing works
Fg-T2M++: LLMs-Augmented Fine-Grained Text Driven Human Motion Generation
Wang, Y., Mu, L., Liu, J., Leng, Z., Li, F. W. B., Zhang, Z., & Liang, X. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02392-9 · Cited by 36 · see citing works
Role-aware Interaction Generation from Textual Description
Tanaka, M., & Fujiwara, K. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01466 · Cited by 35 · see citing works
LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
Zhi, Y., Cun, X., Chen, X., Shen, X., Guo, W. Q., Huang, S., & Gao, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01902 · Cited by 34 · see citing works
PACE: Human and Camera Motion Estimation from in-the-wild Videos
Kocabas, M., Yuan, Y., Molchanov, P. A., Guo, Y., Black, M. J., Hilliges, O., Kautz, J., & Iqbal, U. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00103 · Cited by 34 · see citing works
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Plötz, T. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729467 · Cited by 33 · see citing works
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models
Pi, H., Peng, S., Yang, M., Zhou, X., & Bao, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01383 · Cited by 33 · see citing works
Seamless Human Motion Composition with Blended Positional Encodings
Barquero, G., Escalera, S., & Palmero, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00051 · Cited by 33 · see citing works
REMOS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions
Ghosh, A., Dabral, R., Golyanik, V., Theobalt, C., & Slusallek, P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72764-1_24 · Cited by 33 · see citing works
Wu, D., Zheng, P., Zhao, Q., Zhang, S., Qi, J., Hu, J., Zhu, G., & Wang, L. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103064 · Cited by 35 · see citing works
Bailando ++: 3D Dance GPT With Choreographic Memory
Li, S., Yu, W., Gu, T., Lin, C., Wang, Q., Qian, C., Loy, C. C., & Liu, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3319435 · Cited by 32 · see citing works
Self-citationTaming Diffusion Probabilistic Models for Character Control
Chen, R., Shi, M., Huang, S., Tan, P., Komura, T., & Chen, X. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657440 · Cited by 32 · see citing works
Wouwe, T. V., Lee, S., Falisse, A. M. D., Delp, S. L., & Liu, C. K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00243 · Cited by 32 · see citing works
CoMo: Controllable Motion Generation Through Language Guided Pose Code Editing
Huang, Y., Wan, W., Yang, Y. S., Callison-Burch, C., Yatskar, M., & Liu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73397-0_11 · Cited by 32 · see citing works
Digital Life Project: Autonomous 3D Characters with Social Intelligence
Cai, Z., Jiang, J.-D., Qing, Z.-F., Guo, X.-Y., Zhang, M., Lin, Z., Mei, H., Wei, C., Wang, R.-S., Yin, W.-Q., et al. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.00062 · Cited by 65 · see citing works
Self-citationFineStyle: Semantic-Aware Fine-Grained Motion Style Transfer with Dual Interactive-Flow Fusion
Song, W., Jin, X., Li, S., Chen, C., Hao, A., & Hou, X. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3320216 · Cited by 30 · see citing works
DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation
Qi, Q., Zhuo, L., Zhang, A., Liao, Y., Fang, F., Liu, S., & Yan, S. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612307 · Cited by 30 · see citing works
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis
Castillo, A., Escobar, M., Jeanneret, G., Pumarola, A., Arbeláez, P., Thabet, A., & Sanakoyeu, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00456 · Cited by 30 · see citing works
Dance with You: The Diversity Controllable Dancer Generation via Diffusion Models
Yao, S., Sun, M., Li, B., Yang, F., Wang, J., & Zhang, R. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612046 · Cited by 29 · see citing works
A Survey of Cross-Modal Visual Content Generation
Nazarieh, F., Feng, Z., Awais, M., Wang, W., & Kittler, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3351601 · Cited by 29 · see citing works
StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Framework
Huang, Y., Yang, H., Luo, C., Wang, Y., Xu, S., Zhang, Z., Zhang, M., & Peng, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681657 · Cited by 29 · see citing works
Self-citationFLAG3D: A 3D Fitness Activity Dataset with Language Instruction
Tang, Y., Liu, J., Liu, A., Yang, B., Dai, W., Rao, Y., Lu, J., Zhou, J., & Li, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02117 · Cited by 29 · see citing works
The DiffuseStyleGesture+ entry to the GENEA Challenge 2023
Yang, S., Xue, H., Zhang, Z., Li, M., Wu, Z., Wu, X., Xu, S., & Dai, Z. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3577190.3616114 · Cited by 29 · see citing works
Social Diffusion: Long-term Multiple Human Motion Anticipation
Tanke, J., Zhang, L., Zhao, A. T., Tang, C., Cai, Y., Wang, L., Wu, P.-C., Gall, J., & Keskin, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00880 · Cited by 28 · see citing works
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers
Liang, H., Bao, J., Zhang, R., Ren, S., Xu, Y., Yang, S., Chen, X., Jingyi Yu, A., & Xu, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00053 · Cited by 27 · see citing works
Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation
Chen, B., Li, Y., Ding, Y.-X., Shao, T., & Zhou, K. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680847 · Cited by 27 · see citing works
Iterative Motion Editing with Natural Language
Goel, P., Wang, K.-C. J., Liu, C. K., & Fatahalian, K. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657447 · Cited by 27 · see citing works
Towards Variable and Coordinated Holistic Co-Speech Motion Generation
Liu, Y., Cao, Q., Wen, Y., Jiang, H., & Ding, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00155 · Cited by 26 · see citing works
BeautyDiffusion: Generative latent decomposition for makeup transfer via diffusion models
Feng, H., Li, H., Ning, X., & Li, Q. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103241 · Cited by 25 · see citing works
Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?
Ahn, H., Mascaro, E. V., & Lee, D. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160722 · Cited by 25 · see citing works
Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views
Zhang, S., Ma, Q., Zhang, Y., Aliakbarian, S., Cosker, D. P., & Tang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00734 · Cited by 25 · see citing works
FreeMotion: A Unified Framework for Number-Free Text-to-Motion Synthesis
Fan, K., Tang, J., Cao, W., Yi, R., Li, M., Gong, J., Zhang, J., Wang, Y., Wang, C., & Ma, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73242-3_6 · Cited by 25 · see citing works
HanDiffuser: Text-to-Image Generation with Realistic Hand Appearances
Narasimhaswamy, S., Bhattacharya, U., Chen, X., Dasgupta, I., Mitra, S., & Hoai, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00239 · Cited by 24 · see citing works
ParCo: Part-Coordinating Text-to-Motion Synthesis
Zou, Q., Yuan, S., Du, S., Wang, Y., Liu, C., Xu, Y., Chen, J., & Ji, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72992-8_8 · Cited by 24 · see citing works
4D Facial Expression Diffusion Model
Zou, K., Faisan, S., Yu, B., Valette, S., & Seo, H. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3653455 · Cited by 22 · see citing works
TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis
Zhang, Z., Liu, R., Hanocka, R., & Aberman, K. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657515 · Cited by 22 · see citing works
MagicTime: Time-Lapse Video Generation Models as Metamorphic Simulators
Yuan, S., Huang, J., Shi, Y., Xu, Y., Zhu, R., Lin, B., Cheng, X., Yuan, L., & Luo, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3558507 · Cited by 22 · see citing works
POPDG: Popular 3D Dance Generation with PopDanceSet
Luo, Z., Ren, M., Hu, X., Huang, Y., & Li, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02548 · Cited by 21 · see citing works
Large Motion Model for Unified Multi-modal Motion Generation
Zhang, M., Jin, D., Gu, C., Hong, F., Cai, Z., Huang, J., Zhang, C., Guo, X., Yang, L., He, Y., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72624-8_23 · Cited by 21 · see citing works
Self-citationDiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions
Christen, S., Hampali, S., Şener, F., Remelli, E., Hodaň, T., Sauser, E. L., Ma, S., & Tekin, B. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687563 · Cited by 19 · see citing works
Xiao, L., Lu, S., Pi, H., Fan, K., Pan, L., Zhou, Y., Feng, Z., Zhou, X., Peng, S., & Wang, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00940 · Cited by 19 · see citing works
Self-citationSATO: Stable Text-to-Motion Framework
Chen, W., Xiao, H., Zhang, E., Hu, L., Wang, L., Liu, M., & Chen, C. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681034 · Cited by 19 · see citing works
MAS: Multi-view Ancestral Sampling for 3D Motion Generation Using 2D Diffusion
Kapon, R., Tevet, G., Cohen-Or, D., & Bermano, A. H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00192 · Cited by 19 · see citing works
- Authors
- Zhang, M., Cai, Z., Pan, L., Hong, F., Guo, X., Yang, L., & Liu, Z.
- Affiliations
- Nanyang Technological University (SG)
- Shanghai Artificial Intelligence Laboratory (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Volume
- 46
- Issue
- 6
- Pages
- 4115-4128
- ISSN
- 0162-8828 (ISSN-L)
- arXiv
- 2208.15001
- OpenAlex
- W4391305822
- Cited by
- 437
- References
- 85
- Citations by year
- 2026: 118 · 2025: 148 · 2024: 118 · 2023: 53
- FWCI
- 60.01
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Ministry of Education, India
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Human Motion and Animation
- Physical Sciences › Engineering › Computational Mechanics › 3D Shape Modeling and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- human motion modeling, diffusion models, probabilistic mapping, motion synthesis
- MeSH terms
- Algorithms, Computer Graphics, Humans, Image Processing, Computer-Assisted, Motion, Movement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
