W/sup 4/: real-time surveillance of people and their activities
Abstract
W/sup 4/ is a real time visual surveillance system for detecting and tracking multiple people and monitoring their activities in an outdoor environment. It operates on monocular gray-scale video imagery, or on video imagery from an infrared camera. W/sup 4/ employs a combination of shape analysis and tracking to locate people and their parts (head, hands, feet, torso) and to create models of people's appearance so that they can be tracked through interactions such as occlusions. It can determine whether a foreground region contains multiple people and can segment the region into its constituent people and track them. W/sup 4/ can also determine whether people are carrying objects, and can segment objects from their silhouettes, and construct appearance models for them so they can be identified in subsequent frames. W/sup 4/ can recognize events between people and objects, such as depositing an object, exchanging bags, or removing an object. It runs at 25 Hz for 320/spl times/240 resolution images on a 400 MHz dual-Pentium II PC.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1999.784637 · Cited by 6,925 · see citing works
Pfinder: real-time tracking of the human body
Wren, C. R., Azarbayejani, A. J., Darrell, T., & Pentland, A. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598236 · Cited by 4,169 · see citing works
Non-parametric Model for Background Subtraction
Elgammal, A., Harwood, D., & Davis, L. S. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45053-x_48 · Cited by 2,129 · see citing works
Self-citationThe Visual Analysis of Human Movement: A Survey
Gavrila, D. M. (1999) · Computer Vision and Image Understanding · doi:10.1006/cviu.1998.0716 · Cited by 1,789 · see citing works
Moving target classification and tracking from real-time video
Lipton, A. J., Fujiyoshi, H., & Patil, R. (2002) · Proceedings · doi:10.1109/acv.1998.732851 · Cited by 1,110 · see citing works
Image Segmentation in Video Sequences: A Probabilistic ApproachPreprint
Friedman, N., & Russell, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.1539 · Cited by 833 · see citing works
Tracking people with twists and exponential maps
Bregler, C., & Malik, J. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698581 · Cited by 719 · see citing works
W/sup 4/: Who? When? Where? What? A real time system for detecting and tracking people
Haritaoğlu, I., Harwood, D., & Davis, L. S. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670952 · Cited by 591 · see citing works
Self-citationUsing adaptive tracking to classify and monitor activities in a site
Grimson, W. E. L., Stauffer, C., Romano, R., et al. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698583 · Cited by 504 · see citing works
Small Vision Systems: Hardware and Implementation
Konolige, K. (1998) · Springer eBooks · doi:10.1007/978-1-4471-1580-9_19 · Cited by 458 · see citing works
Cardboard people: a parameterized model of articulated image motion
Ju, S. X., Black, M. J., & Yacoob, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1996.557241 · Cited by 438 · see citing works
Model-based image analysis of human motion using constraint propagation
O’Rourke, J., & Badler, N. I. (1980) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1980.6447699 · Cited by 436 · see citing works
W4S: A real-time system for detecting and tracking people in 2 1/2D
Haritaoğlu, I., Harwood, D., & Davis, L. S. (1998) · Lecture notes in computer science · doi:10.1007/bfb0055710 · Cited by 258 · see citing works
Self-citationIntegrated person tracking using stereo, color, and pattern detection
Darrell, T., Gordon, G. G., Harville, M. L., & Woodfill, J. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698667 · Cited by 258 · see citing works
Real-time closed-world tracking
INTILLE, S. S., Davis, J. W., & Bobick, A. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609402 · Cited by 256 · see citing works
Real-time recognition of activity using temporal templates
Bobick, A., & Davis, J. W. (2002) · Proceedings · doi:10.1109/acv.1996.571995 · Cited by 181 · see citing works
Image sequence analysis of real world human motion
Akita, K. (1984) · Pattern Recognition · doi:10.1016/0031-3203(84)90036-0 · Cited by 178 · see citing works
Ghost: a human body part labeling system using silhouettes
Haritaoğlu, I., Harwood, D., & Davis, L. S. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1998.711084 · Cited by 174 · see citing works
Self-citationA Robust Background Subtraction and Shadow Detection
Horprasert, T., Harwood, D., & Davis, L. S. (1999) · Cited by 173 · see citing works
Self-citationA camera-based system for tracking people in real time
Segen, J. (1996) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1996.546795 · Cited by 154 · see citing works
Dynamic models of human motion
Wren, C. R., & Pentland, A. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670920 · Cited by 129 · see citing works
View-based detection and analysis of periodic motion
Cutler, R., & Davis, L. S. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1998.711189 · Cited by 108 · see citing works
Self-citationRehg, J. M., Loughlin, M., & Waters, K. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609401 · Cited by 93 · see citing works
Real-time estimation of human body posture from monocular thermal images
Iwasawa, S., Ebihara, K., Ohya, J., et al. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609290 · Cited by 90 · see citing works
Backpack: detection of people carrying objects using silhouettes
Haritaoğlu, I., Cutler, R., Harwood, D., et al. (1999) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1999.791204 · Cited by 81 · see citing works
Self-citationStatistical Models of Object Interaction
Morris, R. J., & Hogg, D. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008159822101 · Cited by 47 · see citing works
Pentland, A., Wren, C. R., Harwood, D., Haritaoğlu, I., Davis, L. S., & Horprasert, T. (1998) · Cited by 43 · see citing works
Self-citationFrame-rate Multi-body Tracking for Surveillance
Boult, T. E., Micheals, R. J., Erkan, A. N., et al. (1998) · Cited by 43 · see citing works
Statistical models of object interaction
Morris, R. J., & Hogg, D. (2002) · doi:10.1109/wvs.1998.646024 · Cited by 15 · see citing works
A model based approach to labelling human body outlines
Leung, M. K. H., & Yang, Y. (2002) · doi:10.1109/mnrao.1994.346254 · Cited by 4 · see citing works
W(4): A real-time system for detection and tracking of people and monitoring their activities
Haritaoğlu, I. (1999) · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Soft-NMS — Improving Object Detection with One Line of Code
Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.593 · Cited by 2,274 · see citing works
Self-citationA survey of appearance models in visual object tracking
Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., & Hengel, A. V. D. (2013) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2508037.2508039 · Cited by 705 · see citing works
Moving object detection based on frame difference and W4
Sengar, S. S., & Mukhopadhyay, S. (2017) · Signal Image and Video Processing · doi:10.1007/s11760-017-1093-8 · Cited by 78 · see citing works
Nguyen, M. T., Truong, L. H., Tran, T. T., & Chien, C.-F. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106671 · Cited by 59 · see citing works
Visual-Based Human Crowds Behavior Analysis Based on Graph Modeling and Matching
Chen, D.-Y., & Huang, P.-C. (2013) · IEEE Sensors Journal · doi:10.1109/jsen.2013.2245889 · Cited by 31 · see citing works
- Authors
- Haritaoglu, I., Harwood, D., & Davis, L. S.
- Affiliations
- University of Maryland, College Park (US)
- ORCID
- Davis, L.S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2000
- Volume
- 22
- Issue
- 8
- Pages
- 809-830
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2114701396
- Cited by
- 2,523
- References
- 31
- Citations by year
- 2026: 4 · 2025: 9 · 2024: 14 · 2023: 16 · 2022: 18 · 2021: 42 · 2020: 44 · 2019: 48 · 2018: 43 · 2017: 88 · 2016: 83 · 2015: 99 · 2014: 145 · 2013: 149 · 2012: 150
- FWCI
- 61.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- human tracking, multi-person detection, activity monitoring, shape analysis, appearance model, occlusion handling, object segmentation, event recognition, infrared video, outdoor surveillance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
