The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video
Abstract
We investigate the problem of automatically labelling appearances of characters in TV or film material. This is tremendously challenging due to the huge variation in imaged appearance of each character and the weakness and ambiguity of available annotation. However, we demonstrate that high precision can be achieved by combining multiple sources of information, both visual and textual. The principal novelties that we introduce are: (i) automatic generation of time stamped character annotation by aligning subtitles and transcripts; (ii) strengthening the supervisory information by identifying when characters are speaking; (iii) using complementary cues of face matching and clothing matching to propose common annotations for face tracks. Results are presented on episodes of the TV series “Buffy the Vampire Slayer”. 1
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
Human Detection Based on a Probabilistic Assembly of Robust Part Detectors
Mikolajczyk, K., Schmid, C., & Zisserman, A. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_6 · Cited by 608
Self-citationFloatBoost learning and statistical face detection
Li, S. Z., & Zhang, Z. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.68 · Cited by 525
A Comparative Study of Several Dynamic Time-Warping Algorithms for Connected-Word Recognition
Myers, C. S., & Rabiner, L. R. (1981) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1981.tb00272.x · Cited by 415
Face recognition: component-based versus global approaches
Heisele, B., Ho, P., Wu, J., & Poggio, T. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00073-0 · Cited by 392
Berg, T. L., Berg, A. C., Edwards, J., Maire, M., White, R., Teh, Y.-W., Learned-Miller, E., & Forsyth, D. A. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315253 · Cited by 339
Cited by
Learning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Face recognition in unconstrained videos with matched background similarity
Wolf, L., Hassner, T., & Maoz, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995566 · Cited by 1,382
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Marszalek, M., Laptev, I., & Schmid, C. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206557 · Cited by 1,168
BabyTalk: Understanding and Generating Simple Image Descriptions
Kulkarni, G., Premraj, V., Ordonez, V., Dhar, S., Li, S., Choi, Y., Berg, A. C., & Berg, T. L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.162 · Cited by 839
Robust Face Landmark Estimation under Occlusion
Burgos-Artizzu, X. P., Perona, P., & Dollar, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.191 · Cited by 775
Is that you? Metric learning approaches for face identification
Guillaumin, M., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459197 · Cited by 757
Kostinger, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130513 · Cited by 715
Random Forests for Real Time 3D Face Analysis
Fanelli, G., Dantone, M., Gall, J., Fossati, A., & Van Gool, L. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0549-0 · Cited by 566
Chung, J. S., & Zisserman, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54184-6_6 · Cited by 537
Self-citationLocalizing Parts of Faces Using a Consensus of Exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.23 · Cited by 522
Baby talk: Understanding and generating simple image descriptions
Kulkarni, G., Premraj, V., Dhar, S., Li, S., Choi, Y., Berg, A. C., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995466 · Cited by 521
Localizing parts of faces using a consensus of exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995602 · Cited by 518
Labeled Faces in the Wild: A Survey
Learned-Miller, E., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Advances in Face Detection and Facial Image Analysis · doi:10.1007/978-3-319-25958-1_8 · Cited by 457
A dataset for Movie Description
Rohrbach, A., Rohrbach, M., Tandon, N., & Schiele, B. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298940 · Cited by 435
Describable Visual Attributes for Face Verification and Image Search
Kumar, N., Berg, A., Belhumeur, P. N., & Nayar, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.48 · Cited by 434
Non-contact video-based vital sign monitoring using ambient light and auto-regressive models
Tarassenko, L., Villarroel, M., Guazzi, A., Jorge, J., Clifton, D. A., & Pugh, C. (2014) · Physiological Measurement · doi:10.1088/0967-3334/35/5/807 · Cited by 423
Real-time facial feature detection using conditional regression forests
Dantone, M., Gall, J., Fanelli, G., & Van Gool, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247976 · Cited by 368
Density-aware person detection and tracking in crowds
Rodriguez, M., Laptev, I., Sivic, J., & Audibert, J.-Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126526 · Cited by 341
Self-citationRohrbach, A., Torabi, A., Rohrbach, M., Tandon, N., Pal, C., Larochelle, H., Courville, A., & Schiele, B. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0987-1 · Cited by 300
Large-Scale Weakly-Supervised Pre-Training for Video Action Recognition
Ghadiyaram, D., Tran, D., & Mahajan, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01232 · Cited by 281
Automatic annotation of human actions in video
Duchenne, O., Laptev, I., Sivic, J., Bach, F., & Ponce, J. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459279 · Cited by 275
Self-citationMulti-channel Correlation Filters
Galoogahi, H. K., Sim, T., & Lucey, S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.381 · Cited by 266
SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and Plot Summaries
Pavel, A., Goldman, D. B., Hartmann, B., & Agrawala, M. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807502 · Cited by 67
AutoAD: Movie Description in Context
Han, T., Bain, M., Nagrani, A., Varol, G., Xie, W., & Zisserman, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01815 · Cited by 43
Self-citationAligning Subtitles in Sign Language Videos
Bull, H., Afouras, T., Varol, G., Albanie, S., Momeni, L., & Zisserman, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01135 · Cited by 30
Self-citationHybrid constraint SVR for facial age estimation
Liu, J., Ma, Y., Duan, L., Wang, F., & Liu, Y. (2014) · Signal Processing · doi:10.1016/j.sigpro.2013.07.025 · Cited by 26
Speech2Action: Cross-Modal Supervision for Action Recognition
Nagrani, A., Sun, C., Ross, D., Sukthankar, R., Schmid, C., & Zisserman, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01033 · Cited by 12
Self-citation
Metadata
- Authors
- Everingham, M. R., Sivic, J., & Zisserman, A.
- Venue
- Procedings of the British Machine Vision Conference 2006
- Publisher
- British Machine Vision Association
- Published
- 2006
- Pages
- 92.1-92.10
- OpenAlex
- W2168996682
- Cited by
- 552
- References
- 15
- FWCI
- 18.10
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.