The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Tracking people with twists and exponential maps
Abstract
This paper demonstrates a new visual motion estimation technique that is able to recover high degree-of-freedom articulated human body configurations in complex video sequences. We introduce the use of a novel mathematical technique, the product of exponential maps and twist motions, and its integration into a differential motion estimation. This results in solving simple linear systems, and enables us to recover robustly the kinematic degrees-of-freedom in noise and complex self occluded configurations. We demonstrate this on several image sequences of people doing articulated full body movements, and visualize the results in re-animating an artificial 3D human model. We are also able to recover and re-animate the famous movements of Eadweard Muybridge's motion studies from the last century. To the best of our knowledge, this is the first computer vision based system that is able to process such challenging footage and recover complex motions with such high accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724
A Mathematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. S. (2017) · CRC Press eBooks · doi:10.1201/9781315136370 · Cited by 6,694
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Pfinder: real-time tracking of the human body
Wren, C. R., Azarbayejani, A., Darrell, T., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598236 · Cited by 4,169
A Mathmematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. (1994) · Cited by 2,676
The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields
Black, M. J., & Anandan, P. (1996) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0006 · Cited by 1,570
Walking Patterns of Normal Men
MURRAY, M. P., DROUGHT, A. B., & KORY, R. C. (1964) · The Journal of Bone & Joint Surgery · doi:10.2106/00004623-196446020-00009 · Cited by 1,169
Hierarchical model-based motion estimation
Bergen, J. R., Anandan, P., Hanna, K. J., & Hingorani, R. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_27 · Cited by 1,154
Cited by
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
W/sup 4/: real-time surveillance of people and their activities
Haritaoglu, I., Harwood, D., & Davis, L. S. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868683 · Cited by 2,523
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
Real-time human pose recognition in parts from single depth images
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., & Moore, R. (2013) · Communications of the ACM · doi:10.1145/2398356.2398381 · Cited by 2,044
A Survey of Computer Vision-Based Human Motion Capture
Moeslund, T. B., & Granum, E. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0897 · Cited by 1,768
Laptev, & Lindeberg (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238378 · Cited by 1,300
Sigal, L., Balan, A. O., & Black, M. J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0273-6 · Cited by 1,164
VNect: real-time 3D human pose estimation with a single RGB camera
Mehta, D., Sridhar, S., Sotnychenko, O., Rhodin, H., Shafiei, M., Seidel, H.-P., Xu, W., Casas, D., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073596 · Cited by 1,113
Recent developments in human motion analysis
Wang, L., Hu, W., & Tan, T. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00100-0 · Cited by 962
Articulated body motion capture by annealed particle filtering
Deutscher, J., Blake, A., & Reid, I. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854758 · Cited by 868
Gait analysis for recognition and classification
Lee, L., & Grimson, W. E. L. (2003) · Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition · doi:10.1109/afgr.2002.1004148 · Cited by 734
Recovering 3D human pose from monocular images
Agarwal, A., & Triggs, B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.21 · Cited by 727
Stochastic Tracking of 3D Human Figures Using 2D Image Motion
Sidenbladh, H., Black, M. J., & Fleet, D. J. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_45 · Cited by 700
McKenna, S. J., Jabri, S., Duric, Z., Rosenfeld, A., & Wechsler, H. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0870 · Cited by 660
Real-time visual tracking of complex structures
Drummond, T., & Cipolla, R. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017620 · Cited by 598
Efficient Human Pose Estimation from Single Depth Images
Shotton, J., Girshick, R., Fitzgibbon, A., Sharp, T., Cook, M., Finocchio, M., Moore, R., Kohli, P., Criminisi, A., Kipman, A., et al. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.241 · Cited by 576
Toward a Science of Computational Ethology
Anderson, D. J., & Perona, P. (2014) · Neuron · doi:10.1016/j.neuron.2014.09.005 · Cited by 508
Free-viewpoint video of human actors
Carranza, J., Theobalt, C., Magnor, M. A., & Seidel, H.-P. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882309 · Cited by 482
Survey on Emotional Body Gesture Recognition
Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2874986 · Cited by 455
Model-based hand tracking using a hierarchical Bayesian filter
Stenger, B., Thayananthan, A., Torr, P. H. S., & Cipolla, R. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.189 · Cited by 415
Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video
Zhou, X., Zhu, M., Leonardos, S., Derpanis, K. G., & Daniilidis, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.537 · Cited by 413
Looking at people: sensing for ubiquitous and wearable computing
Pentland, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824823 · Cited by 403
Free-viewpoint video of human actors
Carranza, J., Theobalt, C., Magnor, M. A., & Seidel, H.-P. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882309 · Cited by 403
Sigal, L., Bhatia, S., Roth, S., Black, M. J., & Isard, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315063 · Cited by 391
A Statistical Model of Human Pose and Body Shape
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., & Seidel, H. ‐. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01373.x · Cited by 390
Mündermann, L., Corazza, S., & Andriacchi, T. P. (2006) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-3-6 · Cited by 387
3D human pose from silhouettes by relevance vector regression
Agarwal, A., & Triggs, B. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315258 · Cited by 386
Probabilistic data association methods for tracking complex visual objects
Rasmussen, C., & Hager, G. D. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927458 · Cited by 376
A real time system for robust 3D voxel reconstruction of human motions
Cheung, G. K. M., Kanade, T., Bouguet, J.-Y., & Holler, M. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854944 · Cited by 376
Real time motion capture using a single time-of-flight camera
Ganapathi, V., Plagemann, C., Koller, D., & Thrun, S. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540141 · Cited by 368
Estimating Human Body Configurations Using Shape Context Matching
Mori, G., & Malik, J. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47977-5_44 · Cited by 353
Self-citationHuang, Y., Kaufmann, M., Aksan, E., Black, M. J., Hilliges, O., & Pons-Moll, G. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275108 · Cited by 342
Corazza, S., Mündermann, L., Chaudhari, A. M., Demattio, T., Cobelli, C., & Andriacchi, T. P. (2006) · Annals of Biomedical Engineering · doi:10.1007/s10439-006-9122-8 · Cited by 325
Tracking People by Learning Their Appearance
Ramanan, D., Forsyth, D. A., & Zisserman, A. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.250600 · Cited by 316
Strike a Pose: Tracking People by Finding Stylized Poses
Ramanan, D., Forsyth, D. A., & Zisserman, A. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.335 · Cited by 299
Human Body Model Acquisition and Tracking Using Voxel Data
Mikić, I., Trivedi, M., Hunter, E., & Cosman, P. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023012723347 · Cited by 291
Covariance scaled sampling for monocular 3D body tracking
Sminchisescu, C., & Triggs, B. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990509 · Cited by 290
Practical motion capture in everyday surroundings
Vlasic, D., Adelsberger, R., Vannucci, G., Barnwell, J., Gross, M., Matusik, W., & Popović, J. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276421 · Cited by 269
Finding and tracking people from the bottom up
Ramanan, D., & Forsyth, D. A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211504 · Cited by 268
Model-based 3D tracking of an articulated hand
Stenger, B., Mendonca, P. R. S., & Cipolla, R. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990976 · Cited by 263
3D Pictorial Structures for Multiple Human Pose Estimation
Belagiannis, V., Amin, S., Andriluka, M., Schiele, B., Navab, N., & Ilic, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.216 · Cited by 258
Duric, Z., Gray, W. D., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M. J., Schunn, C., & Wechsler, H. (2002) · Proceedings of the IEEE · doi:10.1109/jproc.2002.801449 · Cited by 185
Exploiting uncertainty in regression forests for accurate camera relocalization
Valentin, J., Niebner, M., Shotton, J., Fitzgibbon, A., Izadi, S., & Torr, P. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299069 · Cited by 156
MoDeep: A Deep Learning Framework Using Motion Features for Human Pose Estimation
Jain, A., Tompson, J., LeCun, Y., & Bregler, C. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16808-1_21 · Cited by 142
Self-citationRecovering articulated object models from 3D range data
(2012) · arXiv (Cornell University) · doi:10.5555/1036843.1036846 · Cited by 79
Metadata
- Authors
- Bregler, C., & Malik, J.
- Venue
- Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231)
- Publisher
- IEEE Comput. Soc
- Published
- 2002-11-27
- Pages
- 8-15
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2118025528
- Cited by
- 719
- References
- 25
- FWCI
- 54.09
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.