The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Labeling images with a computer game
Abstract
We introduce a new interactive system: a game that is fun and can be used to create valuable output. When people play the game they help determine the contents of images by providing meaningful labels for them. If the game is played as much as popular online games, we estimate that most images on the Web can be labeled in a few months. Having proper labels associated with each image on the Web would allow for more accurate image search, improve the accessibility of sites (by providing descriptions of images to visually impaired individuals), and help users block inappropriate images. Our system makes a significant contribution because of its valuable output and because of the way it addresses the image-labeling problem. Rather than using computer vision techniques, which don't work well enough, we encourage people to do the work by taking advantage of their desire to be entertained.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
Duygulu, P., Barnard, K., de Freitas, J. F. G., & Forsyth, D. A. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47979-1_7 · Cited by 1,608
Learning the semantics of words and pictures
Barnard, K., & Forsyth, D. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937654 · Cited by 524
Fleck, M. M., Forsyth, D. A., & Bregler, C. (1996) · Lecture Notes in Computer Science · doi:10.1007/3-540-61123-1_173 · Cited by 447
Object Detection Using the Statistics of Parts
Schneiderman, H., & Kanade, T. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011202.85607.00 · Cited by 349
Cited by
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Image retrieval: Ideas, influences, and trends of the new age
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2008) · ACM Computing Surveys · doi:10.1145/1348246.1348248 · Cited by 3,040
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
Modeling the World from Internet Photo Collections
Snavely, N., Seitz, S. M., & Szeliski, R. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0107-3 · Cited by 2,155
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887
Introduction to Semi-Supervised Learning
Zhu, X., & Goldberg, A. B. (2009) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01548-9 · Cited by 1,766
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
Predicting protein structures with a multiplayer online game
Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., Leaver-Fay, A., Baker, D., Popović, Z., & players, F. (2010) · Nature · doi:10.1038/nature09304 · Cited by 1,368
Crowdsourcing systems on the World-Wide Web
Doan, A., Ramakrishnan, R., & Halevy, A. Y. (2011) · Communications of the ACM · doi:10.1145/1924421.1924442 · Cited by 1,338
Designing games with a purpose
von Ahn, L., & Dabbish, L. (2008) · Communications of the ACM · doi:10.1145/1378704.1378719 · Cited by 1,155
Self-citationReferItGame: Referring to Objects in Photographs of Natural Scenes
Kazemzadeh, S., Ordonez, V., Matten, M., & Berg, T. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1086 · Cited by 1,048
Human-in-the-loop machine learning: a state of the art
Mosqueira-Rey, E., Hernández-Pereira, E., Alonso-Ríos, D., Bobes-Bascarán, J., & Fernández-Leal, Á. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10246-w · Cited by 1,025
Introduction to Semi-Supervised Learning
Zhu, X., & Goldberg, A. B. (2009) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00196ed1v01y200906aim006 · Cited by 1,022
Deriving the Pricing Power of Product Features by Mining Consumer Reviews
Archak, N., Ghose, A., & Ipeirotis, P. G. (2011) · Management Science · doi:10.1287/mnsc.1110.1370 · Cited by 1,007
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034
Flickr tag recommendation based on collective knowledge
Sigurbjörnsson, B., & van Zwol, R. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367542 · Cited by 922
Multimodal Distributional Semantics
Bruni, E., Tran, N. K., & Baroni, M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4135 · Cited by 908
HT06, tagging paper, taxonomy, Flickr, academic article, to read
Marlow, C., Naaman, M., Boyd, D., & Davis, M. (2006) · Proceedings of the seventeenth conference on Hypertext and hypermedia · doi:10.1145/1149941.1149949 · Cited by 877
Why we tag: motivations for annotation in mobile and online media
Ames, M., & Naaman, M. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240772 · Cited by 833
Human computation: a survey and taxonomy of a growing field
Quinn, A. J., & Bederson, B. B. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979148 · Cited by 801
Massive Online Crowdsourced Study of Subjective and Objective Picture Quality
Ghadiyaram, D., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2500021 · Cited by 782
SurroundSense: mobile phone localization via ambience fingerprinting
Azizyan, M., Constandache, I., & Roy Choudhury, R. (2009) · Proceedings of the 15th annual international conference on Mobile computing and networking · doi:10.1145/1614320.1614350 · Cited by 723
Challenges in representation learning: A report on three machine learning contests
Goodfellow, I. J., Erhan, D., Luc Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.005 · Cited by 697
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM SIGGRAPH 2006 Papers on - SIGGRAPH '06 · doi:10.1145/1179352.1141964 · Cited by 696
Soylent: a word processor with a crowd inside
Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., & Panovich, K. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866078 · Cited by 686
“For example, the ESP Game [27] collects descriptions of objects in images for use in object recognition.”
BackgroundTagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation
Guillaumin, M., Mensink, T., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459266 · Cited by 673
CrowdDB: answering queries with crowdsourcing
Franklin, M. J., Kossmann, D., Kraska, T., Ramesh, S., & Xin, R. (2011) · Proceedings of the 2011 ACM SIGMOD International Conference on Management of data · doi:10.1145/1989323.1989331 · Cited by 623
Driving in the Matrix: Can virtual worlds replace human-generated annotations for real world tasks?
Johnson-Roberson, M., Barto, C., Mehta, R., Sridhar, S. N., Rosaen, K., & Vasudevan, R. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989092 · Cited by 622
Utility data annotation with Amazon Mechanical Turk
Sorokin, A., & Forsyth, D. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562953 · Cited by 616
VizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., et al. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866080 · Cited by 601
(2006) · doi:10.5555/1182635.1164130 · Cited by 553
The Role of Artificial Intelligence and Data Network Effects for Creating User Value
Gregory, R. W., Henfridsson, O., Kaganer, E., & Kyriakou, H. (2021) · Academy of Management Review · doi:10.5465/amr.2019.0178 · Cited by 540
A Multi-View Embedding Space for Modeling Internet Images, Tags, and Their Semantics
Gong, Y., Ke, Q., Isard, M., & Lazebnik, S. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0658-4 · Cited by 540
VizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Tatarowicz, A., White, B., White, S., & Yeh, T. (2010) · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806020 · Cited by 536
Peekaboom: a game for locating objects in images
von Ahn, L., Liu, R., & Blum, M. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124782 · Cited by 509
Self-citationTest Collection Based Evaluation of Information Retrieval Systems
Sanderson, M. (2010) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000009 · Cited by 485
“A number of IR researchers were inspired by von Ahn’s ESP game [266], where users label images as part of their activities while playing a multi-user game.”
MethodGrounding Action Descriptions in Videos
Regneri, M., Rohrbach, M., Wetzel, D., Thater, S., Schiele, B., & Pinkal, M. (2013) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00207 · Cited by 467
Space–time wiring specificity supports direction selectivity in the retina
EyeWirers, T., Kim, J. S., Greene, M. J., Zlateski, A., Lee, K., Richardson, M., Turaga, S. C., Purcaro, M., Balkam, M., Robinson, A., et al. (2014) · Nature · doi:10.1038/nature13240 · Cited by 450
Vondrick, C., Patterson, D., & Ramanan, D. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0564-1 · Cited by 448
A New Baseline for Image Annotation
Makadia, A., Pavlovic, V., & Kumar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88690-7_24 · Cited by 436
Content-based image retrieval: approaches and trends of the new age
Datta, R., Li, J., & Wang, J. Z. (2005) · Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval · doi:10.1145/1101826.1101866 · Cited by 435
LabelMe: Online Image Annotation and Applications
Torralba, A., Russell, B. C., & Yuen, J. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2050290 · Cited by 431
NEIL: Extracting Visual Knowledge from Web Data
Chen, X., Shrivastava, A., & Gupta, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.178 · Cited by 408
Micro-Blog: sharing and querying content through mobile phones and social participation
Gaonkar, S., Li, J., Choudhury, R. R., Cox, L., & Schmidt, A. (2008) · Proceedings of the 6th international conference on Mobile systems, applications, and services · doi:10.1145/1378600.1378620 · Cited by 405
The segmented and annotated IAPR TC-12 benchmark
Escalante, H. J., Hernández, C. A., Gonzalez, J. A., López-López, A., Montes, M., Morales, E. F., Enrique Sucar, L., Villaseñor, L., & Grubinger, M. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2009.03.008 · Cited by 399
tagging, communities, vocabulary, evolution
Sen, S., Lam, S. K., Rashid, A. M., Cosley, D., Frankowski, D., Osterhouse, J., Harper, F. M., & Riedl, J. (2006) · Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work · doi:10.1145/1180875.1180904 · Cited by 395
A Survey of Crowdsourcing Systems
Yuen, M.-C., King, I., & Leung, K.-S. (2011) · 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing · doi:10.1109/passat/socialcom.2011.203 · Cited by 392
Why rankings of biomedical image analysis competitions should be interpreted with care
Maier-Hein, L., Eisenmann, M., Reinke, A., Onogur, S., Stankovic, M., Scholz, P., Arbel, T., Bogunovic, H., Bradley, A. P., Carass, A., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07619-7 · Cited by 380
GuessWhat?! Visual Object Discovery through Multi-modal Dialogue
De Vries, H., Strub, F., Chandar, S., Pietquin, O., Larochelle, H., & Courville, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.475 · Cited by 369
Principles of dataspace systems
Halevy, A., Franklin, M., & Maier, D. (2006) · Proceedings of the twenty-fifth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems · doi:10.1145/1142351.1142352 · Cited by 346
Quantification of YouTube QoE via Crowdsourcing
Hoßfeld, T., Seufert, M., Hirth, M., Zinner, T., Tran-Gia, P., & Schatz, R. (2011) · 2011 IEEE International Symposium on Multimedia · doi:10.1109/ism.2011.87 · Cited by 338
New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative
Huiskes, M. J., Thomee, B., & Lew, M. S. (2010) · Proceedings of the international conference on Multimedia information retrieval · doi:10.1145/1743384.1743475 · Cited by 336
Active Learning with Gaussian Processes for Object Categorization
Kapoor, A., Grauman, K., Urtasun, R., & Darrell, T. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408844 · Cited by 322
Online crowdsourcing: Rating annotators and obtaining cost-effective labels
Welinder, P., & Perona, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543189 · Cited by 314
Verbosity: a game for collecting common-sense facts
von Ahn, L., Kedia, M., & Blum, M. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124784 · Cited by 309
Self-citationTurKit: human computation algorithms on mechanical turk
Little, G., Chilton, L. B., Goldman, M., & Miller, R. C. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866040 · Cited by 307
Crowds in two seconds: enabling realtime crowd-powered interfaces
Bernstein, M. S., Brandt, J., Miller, R. C., & Karger, D. R. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047201 · Cited by 302
Towards Mobile Phone Localization without War-Driving
Constandache, I., Choudhury, R. R., & Rhee, I. (2010) · 2010 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2010.5462058 · Cited by 302
Gamification and Serious Games for Personalized Health
Simon, M. (2012) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-069-7-85 · Cited by 301
Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing
Hossfeld, T., Keimel, C., Hirth, M., Gardlo, B., Habigt, J., Diepold, K., & Tran-Gia, P. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2291663 · Cited by 283
Combining Language and Vision with a Multimodal Skip-gram Model
Lazaridou, A., Pham, N. T., & Baroni, M. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1016 · Cited by 280
Social Tagging and Music Information Retrieval
Lamere, P. (2008) · Journal of New Music Research · doi:10.1080/09298210802479284 · Cited by 280
A Survey of Incentive Techniques for Mobile Crowd Sensing
Jaimes, L. G., Vergara-Laurens, I. J., & Raij, A. (2015) · IEEE Internet of Things Journal · doi:10.1109/jiot.2015.2409151 · Cited by 269
Music Information Retrieval: Recent Developments and Applications
Schedl, M., Gómez, E., & Urbano, J. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000042 · Cited by 267
A location-based incentive mechanism for participatory sensing systems with budget constraints
Jaimes, L. G., Vergara-Laurens, I., & Labrador, M. A. (2012) · 2012 IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2012.6199855 · Cited by 256
CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones
Yan, T., Kumar, V., & Ganesan, D. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814443 · Cited by 255
Law, E., & von Ahn, L. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518881 · Cited by 248
Sharing Knowledge and Expertise: The CSCW View of Knowledge Management
Ackerman, M. S., Dachtera, J., Pipek, V., & Wulf, V. (2013) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-013-9192-8 · Cited by 229
Learning from crowdsourced labeled data: a survey
Zhang, J., Wu, X., & Sheng, V. S. (2016) · Artificial Intelligence Review · doi:10.1007/s10462-016-9491-9 · Cited by 203
WebInSight: making web images accessible
Bigham, J. P., Kaminsky, R. S., Ladner, R. E., Danielsson, O. M., & Hempton, G. L. (2006) · Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1168987.1169018 · Cited by 161
Towards human-like spoken dialogue systems
Edlund, J., Gustafson, J., Heldner, M., & Hjalmarsson, A. (2008) · Speech Communication · doi:10.1016/j.specom.2008.04.002 · Cited by 135
How Useful Is Photo-Realistic Rendering for Visual Learning?
Movshovitz-Attias, Y., Kanade, T., & Sheikh, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_18 · Cited by 118
Working Together Apart: Collaboration over the Internet
Olson, J. S., & Olson, G. M. (2014) · Synthesis Lectures on Human-Centered Informatics · doi:10.2200/s00542ed1v01y201310hci020 · Cited by 95
Stangl, A., Verma, N., Fleischmann, K. R., Morris, M. R., & Gurari, D. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471233 · Cited by 81
Guiding Novice Web Workers in Making Image Descriptions Using Templates
Morash, V. S., Siu, Y.-T., Miele, J. A., Hasty, L., & Landau, S. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2764916 · Cited by 69
BrowseWithMe: An Online Clothes Shopping Assistant for People with Visual Impairments
Stangl, A. J., Kothari, E., Jain, S. D., Yeh, T., Grauman, K., & Gurari, D. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236337 · Cited by 66
Competing or aiming to be average?: normification as a means of engaging digital volunteers
Preist, C., Massung, E., & Coyle, D. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531615 · Cited by 65
Utility of human-computer interactions: toward a science of preference measurement
Toomim, M., Kriplean, T., Pörtner, C., & Landay, J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979277 · Cited by 64
The impact of gamification on students learning engagement
Khaleel, F. L., Ashaari, N. S., & Tengku Wook, T. S. M. (2020) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i5.pp4965-4972 · Cited by 64
Rosenthal, S., Veloso, M., & Dey, A. K. (2012) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-011-9610-4 · Cited by 60
GenAssist: Making Image Generation Accessible
Huh, M., Peng, Y.-H., & Pavel, A. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606735 · Cited by 67
Enhancing reliability using peer consistency evaluation in human computation
Huang, S.-W., & Fu, W.-T. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441847 · Cited by 50
“The ESP game [29], for example, encourages players to generate image labels while enjoying the game.”
BackgroundMethodInfluentialDesigning an Online Infrastructure for Collecting AI Data From People With Disabilities
Park, J. S., Bragg, D., Kamar, E., & Morris, M. R. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445870 · Cited by 50
What can 1 billion trials tell us about visual search?
Mitroff, S. R., Biggs, A. T., Adamo, S. H., Dowd, E. W., Winkle, J., & Clark, K. (2015) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000012 · Cited by 46
CrowdVerge: Predicting If People Will Agree on the Answer to a Visual Question
Gurari, D., & Grauman, K. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025781 · Cited by 45
A Large Inclusive Study of Human Listening Rates
Bragg, D., Bennett, C., Reinecke, K., & Ladner, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174018 · Cited by 43
Crowdsourcing the Unknown: The Satellite Search for Genghis Khan
Lin, A. Y.-M., Huynh, A., Lanckriet, G., & Barrington, L. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114046 · Cited by 35
Shirahama, K., & Grzegorzek, M. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-014-2292-8 · Cited by 24
What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative Captioning
Muehlbradt, A., & Kane, S. K. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3507659 · Cited by 22
Creating accessible online floor plans for visually impaired readers
Madugalla, A., Marriott, K., Marinai, S., Capobianco, S., & Goncu, C. (2020) · ACM Transactions on Accessible Computing · doi:10.1145/3410446 · Cited by 17
Practical Peer Prediction for Peer Assessment
Shnayder, V., & Parkes, D. (2016) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v4i1.13285 · Cited by 17
Building the Habit of Authoring Alt Text: Design for Making a Change
Bellscheidt, S., Metcalf, H., Pham, D., & Elglaly, Y. N. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3614495 · Cited by 8
Playing the System: Can Puzzle Players Teach us How to Solve Hard Problems?
Mutalova, R., Sarrazin-Gendron, R., Cai, E., Richard, G., Ghasemloo Gheidari, P., Caisse, S., Knight, R., Blanchette, M., Szantner, A., & Waldispühl, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581375 · Cited by 6
Trading Accuracy for Enjoyment? Data Quality and Player Experience in Data Collection Games
Gundry, D., & Deterding, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502025 · Cited by 6
“…responding, study completion versus dropout, or missing/dropping response items; these can be framed as behavioural engagement or validity threats [32]. such as automatically assessing how well a provided datum satisfes computable constraints [12], or establishing intersubjective consensus [73].”
Background
Metadata
- Authors
- von Ahn, L., & Dabbish, L.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2004-04-25
- Pages
- 319-326
- OpenAlex
- W2141282920
- Cited by
- 2,204
- References
- 4
- FWCI
- 34.55
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.