The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
How do humans sketch objects?
Abstract
Humans have used sketching to depict our visual world since prehistoric times. Even today, sketching is possibly the only rendering technique readily available to all humans. This paper is the first large scale exploration of human sketches. We analyze the distribution of non-expert sketches of everyday objects such as 'teapot' or 'car'. We ask humans to sketch objects of a given category and gather 20,000 unique sketches evenly distributed over 250 object categories. With this dataset we perform a perceptual study and find that humans can correctly identify the object category of a sketch 73% of the time. We compare human performance against computational recognition methods. We develop a bag-of-features sketch representation and use multi-class support vector machines, trained on our sketch dataset, to classify sketches. The resulting recognition method is able to identify unknown sketches with 56% accuracy (chance is 0.4%). Based on the computational model, we demonstrate an interactive sketch recognition system. We release the complete crowd-sourced dataset of sketches to the community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
(2008) · Journal of Machine Learning Research · Cited by 33,051
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367 · cited 3×
“As a baseline we use a standard histogram of visual words using a ‘hard’ assignment of local features to visual words [Sivic and Zisserman 2003].”
MethodInfluentialLabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Surface simplification using quadric error metrics
Garland, M., & Heckbert, P. S. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258849 · Cited by 3,412
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
Self-citationImage retrieval: Ideas, influences, and trends of the new age
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2008) · ACM Computing Surveys · doi:10.1145/1348246.1348248 · Cited by 3,040
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
Sketchpad: a man-machine graphical communication system
Sutherland, I. E. (1963) · Proceedings of the May 21-23, 1963, spring joint computer conference on - AFIPS '63 (Spring) · doi:10.1145/1461551.1461591 · Cited by 1,821
Foundations of Multidimensional and Metric Data Structures
Samet, H., & Gray, J. (2006) · Cited by 1,612
Lost in quantization: Improving particular object retrieval in large scale image databases
Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587635 · Cited by 1,478
Shilane, P., Min, P., Kazhdan, M., & Funkhouser, T. (2004) · Proceedings Shape Modeling Applications, 2004. · doi:10.1109/smi.2004.1314504 · Cited by 1,419
Sketch2Photo: internet image montage
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., & Hu, S.-M. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618470 · Cited by 574
Sketch pad a man-machine graphical communication system
Sutherland, I. E. (1964) · Proceedings of the SHARE design automation workshop on - DAC '64 · doi:10.1145/800265.810742 · Cited by 546
~ " " " ' l I ~ " " -" . : -· " J
Cox, G., & Langford, B. (2006) · doi:10.4324/9780203973493-196 · Cited by 501
Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors
Eitz, M., Hildebrand, K., Boubekeur, T., & Alexa, M. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.266 · Cited by 413
Self-citationMean shift based clustering in high dimensions: a texture classification example
Georgescu, Shimshoni, & Meer (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238382 · Cited by 412
Eitz, M., Richter, R., Boubekeur, T., Hildebrand, K., & Alexa, M. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185527 · Cited by 287
Self-citationSimple line drawings suffice for functional MRI decoding of natural scene categories
Walther, D. B., Chai, B., Caddigan, E., Beck, D. M., & Fei-Fei, L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1015666108 · Cited by 233
Data-driven visual similarity for cross-domain image matching
Shrivastava, A., Malisiewicz, T., Gupta, A., & Efros, A. A. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024188 · Cited by 209
MathPad 2: a system for the creation and exploration of mathematical sketches
LaViola, J. J., & Zeleznik, R. C. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015741 · Cited by 199
LADDER, a sketching language for user interface developers
Hammond, T., & Davis, R. (2005) · Computers & Graphics · doi:10.1016/j.cag.2005.05.005 · Cited by 185
ShadowDraw: real-time user guidance for freehand drawing
Lee, Y. J., Zitnick, C. L., & Cohen, M. F. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964922 · Cited by 181
ShadowDraw: real-time user guidance for freehand drawing
Lee, Y. J., Zitnick, C. L., & Cohen, M. F. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964922 · Cited by 164
Data-driven visual similarity for cross-domain image matching
Shrivastava, A., Malisiewicz, T., Gupta, A. K., & Efros, A. A. (2011) · ACM Transactions on Graphics · doi:10.1145/2070781.2024188 · Cited by 155
Sketch-Based Image Matching Using Angular Partitioning
Chalechale, A., Naghdy, G. A., & Mertins, A. (2004) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2004.838464 · Cited by 148
Sezgin, T. M., Stahovich, T. F., & Davis, R. (2001) · Workshop on Perceptive User Interfaces · doi:10.1145/971478.971487 · Cited by 129
Sezgin, T. M., Stahovich, T. F., & Davis, R. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1185657.1185783 · Cited by 110
Dixon, D., Prasad, M., & Hammond, T. (2010) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1753326.1753459 · Cited by 106
Photosketcher: Interactive Sketch-Based Image Synthesis
Eitz, M., Richter, R., Hildebrand, K., Boubekeur, T., & Alexa, M. (2011) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2011.67 · Cited by 106
Self-citationOuyang, T. Y., & Davis, R. (2011) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1943403.1943444 · Cited by 68
Cited by
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
“• Sketch→photo: tests edges→photo models on human-drawn sketches from [17].”
BackgroundMethodMulti-view Convolutional Neural Networks for 3D Shape Recognition
Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.114 · Cited by 3,480
Edge Boxes: Locating Object Proposals from Edges
Zitnick, C. L., & Dollár, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_26 · Cited by 2,656
Sketch-based manga retrieval using manga109 dataset
Matsui, Y., Ito, K., Aramaki, Y., Fujimoto, A., Ogawa, T., Yamasaki, T., & Aizawa, K. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4020-z · Cited by 1,432
Deeper, Broader and Artier Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.591 · Cited by 1,237
Metadata
- Authors
- Eitz, M., Hays, J., & Alexa, M.
- Venue
- ACM Transactions on Graphics
- Published
- 2012-07
- Volume
- 31
- Issue
- 4
- Pages
- 1-10
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W1972420097
- Cited by
- 868
- References
- 34
- FWCI
- 36.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.