The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Multimodal Deep Autoencoder for Human Pose Recovery
Abstract
Video-based human pose recovery is usually conducted by retrieving relevant poses using image features. In the retrieving process, the mapping between 2D images and 3D poses is assumed to be linear in most of the traditional methods. However, their relationships are inherently non-linear, which limits recovery performance of these methods. In this paper, we propose a novel pose recovery method using non-linear mapping with multi-layered deep neural network. It is based on feature extraction with multimodal fusion and back-propagation deep learning. In multimodal fusion, we construct hypergraph Laplacian with low-rank representation. In this way, we obtain a unified feature description by standard eigen-decomposition of the hypergraph Laplacian matrix. In back-propagation deep learning, we learn a non-linear mapping from 2D images to 3D poses with parameter fine-tuning. The experimental results on three data sets show that the recovery error has been reduced by 20%-25%, which demonstrates the effectiveness of the proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
(2014) · Cited by 33,419
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185
(2011) · Cited by 2,752
Online dictionary learning for sparse coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553463 · Cited by 2,114
Robust Subspace Segmentation by Low-Rank Representation
Liu, G., Lin, Z., & Yu, Y. H. (2010) · Cited by 1,534
Learning with Hypergraphs: Clustering, Classification, and Embedding
Zhou, D., Huang, J., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0205 · Cited by 1,283
Sigal, L., Balan, A. O., & Black, M. J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0273-6 · Cited by 1,164
Articulated pose estimation with flexible mixtures-of-parts
Yang, Y., & Ramanan, D. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995741 · Cited by 990
Fast pose estimation with parameter-sensitive hashing
Shakhnarovich, Viola, & Darrell (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238424 · Cited by 758
Recovering 3D human pose from monocular images
Agarwal, A., & Triggs, B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.21 · Cited by 727
Stochastic Tracking of 3D Human Figures Using 2D Image Motion
Sidenbladh, H., Black, M. J., & Fleet, D. J. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_45 · Cited by 700
Xia, T., Tao, D., Mei, T., & Zhang, Y. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2039566 · Cited by 508
Self-citationEfficient shape matching using shape contexts
Mori, G., Belongie, S., & Malik, J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.220 · Cited by 458
Prediction as a candidate for learning deep hierarchical models of data
Palm, R. (2012) · Cited by 444
3D Human Pose Estimation from Monocular Images with Deep Convolutional Neural Network
Li, S., & Chan, A. B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16808-1_23 · Cited by 443
MODEC: Multimodal Decomposable Models for Human Pose Estimation
Sapp, B., & Taskar, B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.471 · Cited by 423
Estimating Human Body Configurations Using Shape Context Matching
Mori, G., & Malik, J. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47977-5_44 · Cited by 353
Multi-source Deep Learning for Human Pose Estimation
Ouyang, W., Chu, X., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.299 · Cited by 262
Bayesian Reconstruction of 3D Human Motion from Single-Camera Video
Howe, N. R., Leventon, M. E., & Freeman, W. T. (1999) · Smith ScholarWorks (Smith College) · Cited by 255
Twin Gaussian Processes for Structured Prediction
Bo, L., & Sminchisescu, C. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0204-y · Cited by 250
Brand, M. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790422 · Cited by 202
Multi-task low-rank affinity pursuit for image segmentation
Cheng, B., Liu, G., Wang, J., Huang, Z., & Yan, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126528 · Cited by 189
Inferring body pose without tracking body parts
Rosales, R., & Sclaroff, S. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854946 · Cited by 170
Enhancing Low-Rank Subspace Clustering by Manifold Regularization
Liu, J., Chen, Y., Zhang, J., & Xu, Z. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2343458 · Cited by 125
Principal Component 2-D Long Short-Term Memory for Font Recognition on Single Chinese Characters
Tao, D., Xu, L. H., Jin, L., & Li, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2414920 · Cited by 105
Self-citationHuman Pose Tracking in Monocular Sequence Using Multilevel Structured Models
Lee, M. W., & Nevatia, R. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.35 · Cited by 103
Multifeature-Based Surround Inhibition Improves Contour Detection in Natural Images
Yang, K.-F., Li, C.-Y., & Li, Y. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2361210 · Cited by 86
Evaluation of Color Spatio-Temporal Interest Points for Human Action Recognition
Everts, I., van Gemert, J. C., & Gevers, T. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2302677 · Cited by 69
Latent Gaussian Mixture Regression for Human Pose Estimation
Tian, Y. T., Sigal, L., Badino, H., la Torre, F. D., & Liu, Y. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19318-7_53 · Cited by 44
Yang, M., Qiu, G., Huang, J., et al. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.851 · Cited by 28
A Robust Likelihood Function for 3D Human Pose Tracking
Zhang, W., Shang, L., & Chan, A. B. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2364113 · Cited by 27
Vision-Based Pose Estimation From Points With Unknown Correspondences
Zhou, H., Zhang, T., & Lu, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2329765 · Cited by 23
Shen, J., Liu, G., Chen, J., Fang, Y., Xie, J., Yu, Y. H., & Yan, S. (2016) · Cited by 19
Shen, J., Liu, G., Chen, J., Fang, Y., Xie, J., Yu, Y., & Yan, S. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2358082 · Cited by 18
Cited by
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
A survey on deep learning for multimodal data fusion
Gao, J., Li, P., Chen, Z., & Zhang, J. (2020) · Neural Computation · doi:10.1162/neco_a_01273 · Cited by 821
Deep Multimodal Representation Learning: A Survey
Guo, W., Wang, J., & Wang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2916887 · Cited by 535
Abdeljaber, O., Avci, O., Kiranyaz, M. S., Boashash, B., Sodano, H., & Inman, D. J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.09.069 · Cited by 521
A model-based gait recognition method with body pose and human prior knowledge
Liao, R., Yu, S., An, W., & Huang, Y. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2019.107069 · Cited by 509
Metadata
- Authors
- Hong, C., Yu, J., Wan, J., Tao, D., & Wang, M.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2015-12
- Volume
- 24
- Issue
- 12
- Pages
- 5659-5670
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1925417509
- Cited by
- 568
- References
- 42
- FWCI
- 52.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.