HuMoR: 3D Human Motion Model for Robust Pose Estimation
Open accessThe DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Abstract
We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose and shape. Though substantial progress has been made in estimating 3D human motion and shape from dynamic observations, recovering plausible pose sequences in the presence of noise and occlusions remains a challenge. For this purpose, we propose an expressive generative model in the form of a conditional variational autoencoder, which learns a distribution of the change in pose at each step of a motion sequence. Furthermore, we introduce a flexible optimization-based approach that leverages HuMoR as a motion prior to robustly estimate plausible pose and shape from ambiguous observations. Through extensive evaluations, we demonstrate that our model generalizes to diverse motions and body shapes after training on a large motion capture dataset, and enables motion reconstruction from multiple input modalities including 3D keypoints and RGB(-D) videos. See the project page at geometry.stanford.edu/projects/humor.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
(2017) · Cited by 11,625
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
(2017) · International Conference on Learning Representations · Cited by 3,248
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061 · cited 2×
“In addition to linearly annealing wKL [11], we found the conditional prior important to combat collapse.”
BackgroundEnd-to-End Recovery of Human Shape and Pose
Kanazawa, A., Black, M. J., Jacobs, D. W., & Malik, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00744 · Cited by 1,870
Expressive Body Capture: 3D Hands, Face, and Body From a Single Image
Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A. A., Tzionas, D., & Black, M. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01123 · Cited by 1,781 · cited 13×
“The PROX-D baseline uses the fittings provided with the PROX dataset, which are on the known gendered SMPL-X body model and use face/hand 2D keypoints for fitting.”
MethodInfluentialScheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Bengio, S., Vinyals, O., Jaitly, N., & Shazeer, N. (2015) · arXiv · doi:10.48550/arxiv.1506.03099 · Cited by 1,621
Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
Bogo, F., Kanazawa, A., Lassner, C., Gehler, P., Romero, J., & Black, M. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_34 · Cited by 1,498
DensePose: Dense Human Pose Estimation in the Wild.
Güler, R. A., Neverova, N., & Kokkinos, I. (2018) · UCL Discovery (University College London) · Cited by 1,421
AMASS: Archive of Motion Capture As Surface Shapes
Mahmood, N., Ghorbani, N., Troje, N. F., Pons-Moll, G., & Black, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00554 · Cited by 1,323
3D Human Pose Estimation in Video With Temporal Convolutions and Semi-Supervised Training
Pavllo, D., Feichtenhofer, C., Grangier, D., & Auli, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00794 · Cited by 1,297
Normalizing Flows: An Introduction and Review of Current Methods
Kobyzev, I., Prince, S. J. D., & Brubaker, M. A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992934 · Cited by 1,235
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Saito, S., Huang, Z., Natsume, R., Morishima, S., Li, H., & Kanazawa, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00239 · Cited by 1,228
Sigal, L., Balan, A. O., & Black, M. J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0273-6 · Cited by 1,164
VNect: real-time 3D human pose estimation with a single RGB camera
Mehta, D., Sridhar, S., Sotnychenko, O., Rhodin, H., Shafiei, M., Seidel, H.-P., Xu, W., Casas, D., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073596 · Cited by 1,113
Self-citationRomero (2017) · doi:10.1145/3130800.3130883 · Cited by 1,056
Kovar, L., Gleicher, M., & Pighin, F. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401202 · Cited by 1,052
Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the Loop
Kolotouros, N., Pavlakos, G., Black, M., & Daniilidis, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00234 · Cited by 1,039
VIBE: Video Inference for Human Body Pose and Shape Estimation
Kocabas, M., Athanasiou, N., & Black, M. J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00530 · Cited by 1,031
Gaussian Process Dynamical Models for Human Motion
Wang, J. M., Fleet, D. J., & Hertzmann, A. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1167 · Cited by 1,020
Self-citationDecomposing biological motion: A framework for analysis and synthesis of human gait patterns
Troje, N. F. (2002) · Journal of Vision · doi:10.1167/2.5.2 · Cited by 1,016
The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data
Beaton, A. E., & Tukey, J. W. (1974) · Technometrics · doi:10.1080/00401706.1974.10489171 · Cited by 1,010
Learning from Synthetic Humans
Varol, G., Romero, J., Martin, X., Mahmood, N., Black, M. J., Laptev, I., & Schmid, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.492 · Cited by 908
Verbs and adverbs: multidimensional motion interpolation
Rose, C., Cohen, M. F., & Bodenheimer, B. (1998) · IEEE Computer Graphics and Applications · doi:10.1109/38.708559 · Cited by 730
Brand, M., & Hertzmann, A. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344865 · Cited by 705
Self-citationStochastic Tracking of 3D Human Figures Using 2D Image Motion
Sidenbladh, H., Black, M. J., & Fleet, D. J. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_45 · Cited by 700
Modeling Human Motion Using Binary Latent Variables
Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0173 · Cited by 689
Learning to Estimate 3D Human Pose and Shape from a Single Color Image
Pavlakos, G., Zhu, L., Zhou, X., & Daniilidis, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00055 · Cited by 607
Statistical methods for tomographic image reconstruction
Geman, S., & McClure, D. E. (1987) · Medical Entomology and Zoology · Cited by 579
Phase-functioned neural networks for character control
Holden, D., Komura, T., & Saito, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073663 · Cited by 546
Unite the People: Closing the Loop Between 3D and 2D Human Representations
Lassner, C., Romero, J., Kiefel, M., Bogo, F., Black, M. J., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.500 · Cited by 541
Learning 3D Human Dynamics From Video
Kanazawa, A., Zhang, J. Y., Felsen, P., & Malik, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00576 · Cited by 531
3D People Tracking with Gaussian Process Dynamical Models
Urtasun, R., Fleet, D. J., & Fua, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.15 · Cited by 439
Pose-conditioned joint angle limits for 3D human pose reconstruction
Akhter, I., & Black, M. J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298751 · Cited by 418
Motion texture: a two-level statistical model for character motion synthesis
Li, Y., Wang, T., & Shum, H.-Y. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566604 · Cited by 392
BodyNet: Volumetric Inference of 3D Human Body Shapes
Varol, G., Ceylan, D., Russell, B., Yang, J., Yumer, E., Laptev, I., & Schmid, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_2 · Cited by 385
Self-citationDocumentation Mocap Database HDM05
Müller, M., Röder, T., Clausen, M. V., Eberhardt, B., Krüger, B., & Weber⋆, A. (2007) · Cited by 378
Kovar, L., Gleicher, M., & Pighin, F. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566605 · Cited by 374
Real time motion capture using a single time-of-flight camera
Ganapathi, V., Plagemann, C., Koller, D., & Thrun, S. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540141 · Cited by 368
MoSh: motion and shape capture from sparse markers
Loper, M., Mahmood, N., & Black, M. J. (2014) · ACM Transactions on Graphics · doi:10.1145/2661229.2661273 · Cited by 344
Learning physics-based motion style with nonlinear inverse optimization
Liu, C. K., Hertzmann, A., & Popović, Z. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073314 · Cited by 341
Self-citationMonocular Total Capture: Posing Face, Body, and Hands in the Wild
Xiang, D., Joo, H., & Sheikh, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01122 · Cited by 335
Learning Switching Linear Models of Human Motion
Pavlović, V., Rehg, J. M., & MacCormick, J. (2000) · Cited by 331
Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors
Trumble, M., Gilbert, A., Malleson, C., Hilton, A., & Collomosse, J. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.14 · Cited by 299
Zanfir, A., Marinoiu, E., & Sminchisescu, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00229 · Cited by 292
DensePose: Dense Human Pose Estimation in the Wild
Guler, R. A., Neverova, N., & Kokkinos, I. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00762 · Cited by 290
Neural state machine for character-scene interactions
Starke, S., Zhang, H., Komura, T., & Saito, J. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356505 · Cited by 290
Resolving 3D Human Pose Ambiguities With 3D Scene Constraints
Hassan, M., Choutas, V., Tzionas, D., & Black, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00237 · Cited by 274
XNect: real-time multi-person 3D motion capture with a single RGB camera
Mehta, D., Sotnychenko, O., Mueller, F., Xu, W., Elgharib, M., Fua, P., Seidel, H.-P., Rhodin, H., Pons-Moll, G., & Theobalt, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392410 · Cited by 274
Bayesian Reconstruction of 3D Human Motion from Single-Camera Video
Howe, N. R., Leventon, M. E., & Freeman, W. T. (1999) · Smith ScholarWorks (Smith College) · Cited by 255
DLow: Diversifying Latent Flows for Diverse Human Motion Prediction
Yuan, Y., & Kitani, K. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_20 · Cited by 249
PlaneRCNN: 3D Plane Detection and Reconstruction From a Single Image
Liu, C., Kim, K., Gu, J., Furukawa, Y., & Kautz, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00458 · Cited by 242
Monocular Expressive Body Regression Through Body-Driven Attention
Choutas, V., Pavlakos, G., Bolkart, T., Tzionas, D., & Black, M. J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58607-2_2 · Cited by 238
Populating 3D Scenes by Learning Human-Scene Interaction
Hassan, M. S., Ghosh, P. S., Tesch, J., Tzionas, D., & Black, M. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01447 · Cited by 229
HoloPose: Holistic 3D Human Reconstruction In-The-Wild
Guler, R. A., & Kokkinos, I. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01114 · Cited by 221
DeepCap: Monocular Human Performance Capture Using Weak Supervision
Habermann, M., Xu, W., Zollhofer, M., Pons-Moll, G., & Theobalt, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00510 · Cited by 214
The KIT whole-body human motion database
Mandery, C., Terlemez, O., Do, M., Vahrenkamp, N., & Asfour, T. (2015) · 2015 International Conference on Advanced Robotics (ICAR) · doi:10.1109/icar.2015.7251476 · Cited by 208
Towards Accurate Marker-Less Human Shape and Pose Estimation over Time
Huang, Y., Bogo, F., Lassner, C., Kanazawa, A., Gehler, P. V., Romero, J., Akhter, I., & Black, M. J. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00055 · Cited by 207
SFV: reinforcement learning of physical skills from videos
Peng, X. B., Kanazawa, A., Malik, J., Abbeel, P., & Levine, S. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275014 · Cited by 195
Structured Prediction Helps 3D Human Motion Modelling
Aksan, E., Kaufmann, M., & Hilliges, O. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00724 · Cited by 193
Human Mesh Recovery From Monocular Images via a Skeleton-Disentangled Representation
Sun, Y., Ye, Y., Liu, W., Gao, W., Fu, Y., & Mei, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00545 · Cited by 189
We are More than Our Joints: Predicting how 3D Bodies Move
Zhang, Y., Black, M. J., & Tang, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00338 · Cited by 186
Separating style and content on a nonlinear manifold
Elgammal, A., & Lee, C.-S. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315070 · Cited by 182
MoGlow: probabilistic and controllable motion synthesis using normalising flows
Henter, G. E., Alexanderson, S., & Beskow, J. (2020) · ACM Transactions on Graphics · doi:10.1145/3414685.3417836 · Cited by 176
PhysCap: physically plausible monocular 3D motion capture in real time
Shimada, S., Golyanik, V., Xu, W., & Theobalt, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3414685.3417877 · Cited by 165
Object-Occluded Human Shape and Pose Estimation From a Single Color Image
Zhang, T., Huang, B., & Wang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00740 · Cited by 163
A Recurrent Variational Autoencoder for Human Motion Synthesis
Habibie, I., Holden, D., Schwarz, J., Yearsley, J., & Komura, T. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.119 · Cited by 162
Context-Aware Human Motion Prediction
Corona, E., Pumarola, A., Alenya, G., & Moreno-Noguer, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00702 · Cited by 159
A Stochastic Conditioning Scheme for Diverse Human Motion Prediction
Aliakbarian, S., Saleh, F. S., Salzmann, M., Petersson, L., & Gould, S. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00527 · Cited by 159
Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows
Zanfir, A., Băzăvan, E. G., Xu, H., Freeman, W. T., Sukthankar, R., & Sminchisescu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_28 · Cited by 158
3D Human Motion Estimation via Motion Compression and Refinement
Luo, Z., Golestaneh, S. A., & Kitani, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69541-5_20 · Cited by 157
Modeling Human Motion with Quaternion-Based Neural Networks
Pavllo, D., Feichtenhofer, C., Auli, M., & Grangier, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01245-6 · Cited by 152
MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency
Shi, M., Aberman, K., Aristidou, A., Komura, T., Lischinski, D., Cohen‐Or, D., & Chen, B. (2020) · ACM Transactions on Graphics · doi:10.1145/3407659 · Cited by 146
SimPoE: Simulated Character Control for 3D Human Pose Estimation
Yuan, Y., Wei, S.-E., Simon, T., Kitani, K., & Saragih, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00708 · Cited by 141
Hierarchical Kinematic Human Mesh Recovery
Georgakis, G., Li, R., Karanam, S., Chen, T., Košecká, J., & Wu, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_45 · Cited by 132
Contact and Human Dynamics from Monocular Video
Rempe, D., Guibas, L. J., Hertzmann, A., Russell, B. C., Villegas, R., & Yang, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_5 · Cited by 131
Self-citationSynthetic Humans for Action Recognition from Unseen Viewpoints
Varol, G., Laptev, I., Schmid, C., & Zisserman, A. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01467-7 · Cited by 129
Brubaker, M. A., Sigal, L., & Fleet, D. J. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459407 · Cited by 126
Chen, Y., Huang, S., Yuan, T., Zhu, Y., Qi, S., & Zhu, S.-C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00874 · Cited by 119
Temporal motion models for monocular and multiview 3D human body tracking
Urtasun, R., Fleet, D. J., & Fua, P. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.006 · Cited by 115
Predicting 3D Human Dynamics From Video
Zhang, J. Y., Felsen, P., Kanazawa, A., & Malik, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00721 · Cited by 112
Sim2real transfer learning for 3D human pose estimation: motion to the rescue
Doersch, C., & Zisserman, A. (2020) · Oxford University Research Archive (ORA) (University of Oxford) · Cited by 106
Estimating 3D Motion and Forces of Person-Object Interactions From Monocular Video
Li, Z., Sedlář, J., Carpentier, J., Laptev, I., Mansard, N., & Šivic, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00884 · Cited by 101
A Data-Driven Approach for Real-Time Full Body Pose Reconstruction from a Depth Camera
Baak, A., Müller, M., Bharaj, G., Seidel, H., & Theobalt, C. (2012) · Advances in computer vision and pattern recognition · doi:10.1007/978-1-4471-4640-7_5 · Cited by 100
Aristidou, A., Shamir, A., & Chrysanthou, Y. (2019) · Journal on Computing and Cultural Heritage · doi:10.1145/3344383 · Cited by 75
LoBSTr: Real‐time Lower‐body Pose Prediction from Sparse Upper‐body Tracking Signals
Yang, D., Kim, D., & Lee, S. (2021) · Computer Graphics Forum · doi:10.1111/cgf.142631 · Cited by 75
iMapper: interaction-guided scene mapping from monocular videos
Monszpart, Á., Guerrero, P., Ceylan, D., Yumer, E., & Mitra, N. J. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322961 · Cited by 66
Sleight of hand: perception of finger motion from reduced marker sets
Hoyet, L., Ryall, K., McDonnell, R., & O’Sullivan, C. (2012) · ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D) · doi:10.1145/2159616.2159630 · Cited by 60
Full-Body Awareness from Partial Observations
Rockwell, C., & Fouhey, D. F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_31 · Cited by 56
Probabilistic Character Motion Synthesis using a Hierarchical Deep Latent Variable Model
Ghorbani, S., Wloka, C., Etemad, A., Brubaker, M. A., & Troje, N. F. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14116 · Cited by 29
4D Human Body Capture from Egocentric Video via 3D Scene GroundingPreprint
Liu, M., Yang, D., Zhang, Y., Cui, Z., Rehg, J. M., & Tang, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13341 · Cited by 6
Cited by
Executing your Commands via Motion Diffusion in Latent Space
Chen, X., Jiang, B., Liu, W., Huang, Z., Fu, B., Chen, T., & Yu, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01726 · Cited by 356
Humans in 4D: Reconstructing and Tracking Humans with Transformers
Goel, S., Pavlakos, G., Rajasegaran, J., Kanazawa, A., & Malik, J. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01358 · Cited by 272
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
Huang, S., Wang, Z., Li, P., Jia, B., Liu, T., Zhu, Y., Liang, W., & Zhu, S.-C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01607 · Cited by 192
Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion
Rempe, D., Luo, Z., Peng, X. B., Yuan, Y., Kitani, K., Kreis, K., Fidler, S., & Litany, O. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01322 · Cited by 97
“Planning can be done with traditional A* [12], using learned trajectory prediction [5], searching in a pre-trained latent space [30, 44, 48, 65], or using hierarchical RL [13, 43, 44, 46, 65].”
BackgroundMethodSelf-citationLi, T., Won, J., Clegg, A., Kim, J., Rai, A., & Ha, S. (2023) · SIGGRAPH Asia 2023 Conference Papers · doi:10.1145/3610548.3618255 · Cited by 18
Metadata
- Authors
- Rempe, D., Birdal, T., Hertzmann, A., Yang, J., Sridhar, S., & Guibas, L. J.
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 11468-11479
- OpenAlex
- W3161438449
- Cited by
- 304
- References
- 97
- FWCI
- 18.45
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.