The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Input-agreement
Abstract
Since its introduction at CHI 2004, the ESP Game has inspired many similar games that share the goal of gathering data from players. This paper introduces a new mechanism for collecting labeled data using "games with a purpose." In this mechanism, players are provided with either the same or a different object, and asked to describe that object to each other. Based on each other's descriptions, players must decide whether they have the same object or not. We explain why this new mechanism is superior for input data with certain characteristics, introduce an enjoyable new game called "TagATune" that collects tags for music clips via this mechanism, and present findings on the data that is collected by this game.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,234
Designing games with a purpose
von Ahn, L., & Dabbish, L. (2008) · Communications of the ACM · doi:10.1145/1378704.1378719 · Cited by 1,186
von Ahn, L. (2006) · Computer · doi:10.1109/mc.2006.196 · Cited by 968
Social Tagging and Music Information Retrieval
Lamere, P. (2008) · Journal of New Music Research · doi:10.1080/09298210802479284 · Cited by 280
Games with a Purpose for the Semantic Web
Siorpaes, K., & Hepp, M. F. (2008) · IEEE Intelligent Systems · doi:10.1109/mis.2008.45 · Cited by 215
Tagatune: A Game For Music And Sound Annotation.
Law, E., von Ahn, L., Dannenberg, R. B., & Crawford, M. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1415567 · Cited by 195
Self-citationHacker, S., & von Ahn, L. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518882 · Cited by 142
A Web-Based Game for Collecting Music Metadata
Mandel, M., & Ellis, D. P. W. (2008) · Journal of New Music Research · doi:10.1080/09298210802479300 · Cited by 129
Moodswings: A Collaborative Game For Music Mood Label Collection.
Kim, Y. E., Schmidt, E. M., & Emelle, L. (2008) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1416585 · Cited by 106
A Game-Based Approach For Collecting Semantic Annotations Of Music.
Turnbull, D., Liu, R., Barrington, L., & Lanckriet, G. R. G. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1416463 · Cited by 98
Cited by
Sorted by citations
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
“• the MagnaTagATune dataset (Law & Von Ahn, 2009), which consists of about 200 hours of music audio.”
PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition
Kong, Q., Cao, Y., Iqbal, T., Wang, Y., Wang, W., & Plumbley, M. D. (2020) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3030497 · Cited by 1,235
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Bertin-Mahieux, T., Ellis, D. P. W., Whitman, B., & Lamere, P. (2011) · Columbia University · doi:10.7916/d8nz8j07 · Cited by 944
Quinn, A. J., & Bederson, B. B. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979148 · Cited by 837
A Survey of Crowdsourcing Systems
Yuen, M.-C., King, I., & Leung, K. (2011) · International Conference on Social Computing · doi:10.1109/passat/socialcom.2011.203 · Cited by 408
End-to-end learning for music audio
Dieleman, S., & Schrauwen, B. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854950 · Cited by 392
Deep Learning Techniques for Music Generation -- A SurveyPreprint
Briot, J.-P., Hadjeres, G., & Pachet, F.-D. (2017) · arXiv (Cornell University) · doi:10.4230/lipics.cp.2022.30 · Cited by 379
Music Information Retrieval: Recent Developments and Applications
Schedl, M., Gómez, E., & Urbano, J. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000042 · Cited by 303
A location-based incentive mechanism for participatory sensing systems with budget constraints
Jaimes, L. G., Vergara-Laurens, I. J., & Labrador, M. A. (2012) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2012.6199855 · Cited by 256
Contextual music information retrieval and recommendation: State of the art and challenges
Kaminskas, M., & Ricci⋆, F. (2012) · Computer Science Review · doi:10.1016/j.cosrev.2012.04.002 · Cited by 214
A Survey of Mobile Crowdsensing Techniques
Liu, J., Shen, H., Narman, H. S., Chung, W., & Lin, Z. (2018) · ACM Transactions on Cyber-Physical Systems · doi:10.1145/3185504 · Cited by 209
Freesound Datasets: A Platform For The Creation Of Open Audio Datasets.
Fonseca, E., Pons, J., Favory, X., Font, F., Bogdanov, D., Ferraro, A., Oramas, S., Porter, A., & Serra, X. (2017) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.5281/zenodo.1417158 · Cited by 172
Law, E., & von Ahn, L. (2011) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00371ed1v01y201107aim013 · Cited by 168
Self-citationHacker, S., & von Ahn, L. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518882 · Cited by 142
Toward Collaborative Ideation at Scale
Siangliulue, P., Arnold, K. C., Gajos, K. Z., & Dow, S. P. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675239 · Cited by 138
The neglected user in music information retrieval research
Schedl, M., Flexer, A., & Urbano, J. (2013) · Journal of Intelligent Information Systems · doi:10.1007/s10844-013-0247-6 · Cited by 132
Cheng, J., & Bernstein, M. S. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675214 · Cited by 117
Smarter Than Genius? Human Evaluation Of Music Recommender Systems.
Barrington, L., Oda, R., & Lanckriet, G. R. G. (2009) · doi:10.5281/zenodo.1417802 · Cited by 105
A Survey of Human Computation Systems
Yuen, M.-C., Chen, L., & King, I. (2009) · doi:10.1109/cse.2009.395 · Cited by 99
Putting humans in the loop: Social computing for Water Resources Management
Fraternali, P., Castelletti, A. F., Soncini‐Sessa, R., Vaca, C., & Rizzoli, A. E. (2012) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2012.03.002 · Cited by 96
Temporal Pooling And Multiscale Learning For Automatic Annotation And Ranking Of Music Audio.
Hamel, P., Lemieux, S., Bengio, Y., & Eck, D. (2011) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1418236 · Cited by 94
Towards a Research Agenda for Enterprise Crowdsourcing
Vuković, M., & Bartolini, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16558-0_36 · Cited by 92
Machine learning for music genre: multifaceted review and experimentation with audioset
Castillo, J. R., & Flores, M. J. (2019) · Journal of Intelligent Information Systems · doi:10.1007/s10844-019-00582-9 · Cited by 90
Exploring automatic music annotation with "acoustically-objective" tags
Tingle, D., Kim, Y. E., & Turnbull, D. (2010) · Multimedia Information Retrieval · doi:10.1145/1743384.1743400 · Cited by 89
Pe‐Than, E. P. P., Goh, D. H., & Lee, C. S. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.06.023 · Cited by 87
Designing for Citizen Data Analysis
Tinati, R., Kleek, M. G. V., Simperl, E. P. B., Luczak–Roesch, M., Simpson, R. J., & Shadbolt, N. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702420 · Cited by 85
Motivation and Data Quality in a Citizen Science Game: A Design Science Evaluation
Crowston, K., & Prestopnik, N. R. (2013) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2013.413 · Cited by 82
User-centered design of a social game to tag music
Barrington, L., O'Malley, D., Turnbull, D., & Lanckriet, G. R. G. (2009) · doi:10.1145/1600150.1600152 · Cited by 79
Enhancing multi-label music genre classification through ensemble techniques
Sanden, C., & Zhang, J. Z. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2010011 · Cited by 78
Multiscale Approaches To Music Audio Feature Learning.
Dieleman, S., & Schrauwen, B. (2013) · Ghent University Academic Bibliography (Ghent University) · doi:10.5281/zenodo.1416675 · Cited by 77
Freitas, A., & Curry, E. (2016) · Springer eBooks · doi:10.1007/978-3-319-21569-3_6 · Cited by 75
Stanculescu, L. C., Bozzon, A., Sips, R.-J., & Houben, G. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2820061 · Cited by 71
Moysis, L., Iliadis, L. A., Sotiroudis, S. P., Boursianis, A. D., Papadopoulou, M. S., Kokkinidis, K.-I. D., VOLOS, C. K., Sarigiannidis, P. G., Nikolaidis, S., & Goudos, S. K. (2023) · IEEE Access · doi:10.1109/access.2023.3244620 · Cited by 71
Learning Sparse Feature Representations For Music Annotation And Retrieval.
Nam, J., Herrera, J., Slaney, M., & Smith, J. O. (2012) · doi:10.5281/zenodo.1415201 · Cited by 69
A planetary nervous system for social mining and collective awareness
Giannotti, F., Pedreschi, D., Pentland, A., Lukowicz, P., Kossmann, D., Crowley, J. L., & Helbing, D. (2012) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2012-01688-9 · Cited by 69
Cartwright, M., Seals, A., Salamon, J., Williams, A. C., Mikloska, S., MacConnell, D., Law, E., Bello, J. P., & Nov, O. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134664 · Cited by 69
Self-citationTransfer Learning By Supervised Pre-Training For Audio-Based Music Classification.
van den Oord, A., Dieleman, S., & Schrauwen, B. (2014) · Ghent University Academic Bibliography (Ghent University) · doi:10.5281/zenodo.1415889 · Cited by 60
Multi-Tasking with Joint Semantic Spaces for Large-Scale Music Annotation and Retrieval
Weston, J., Samy Bengio, A., & Hamel, P. (2011) · Journal of New Music Research · doi:10.1080/09298215.2011.603834 · Cited by 59
Prestopnik, N. R., Crowston, K., & Wang, J. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.11.035 · Cited by 58
The CrowdWater game: A playful way to improve the accuracy of crowdsourced water level class data
Strobl, B., Etter, S., van Meerveld, I., & Seibert, J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222579 · Cited by 56
A Survey on the Design of Gamified Systems for Energy and Water Sustainability
Albertarelli, S., Fraternali, P., Herrera, S., Melenhorst, M., Novak, J., Pasini, C., Rizzoli, A. E., & Rottondi, C. (2018) · Games · doi:10.3390/g9030038 · Cited by 54
Natural language of uncertainty: numeric hedge words
Ferson, S. A., O'Rawe, J., Antonenko, A., Siegrist, J., Mickley, J., Luhmann, C. C., Sentz, K., & Finkel, A. M. (2014) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2014.11.003 · Cited by 53
Perceptions, quality and motivational needs in image tagging human computation games
Goh, D. H., & Lee, C. S. (2011) · Journal of Information Science · doi:10.1177/0165551511417786 · Cited by 52
MuLan: A Joint Embedding of Music Audio and Natural Language
Huang, Q., Jansen, A., Lee, J., Ganti, R., Li, J. Y., & Ellis, D. P. W. (2022) · arXiv · doi:10.48550/arxiv.2208.12415 · Cited by 49
Kolly, S. M., Wattenhofer, R. P., & Welten, S. (2012) · doi:10.1145/2389148.2389149 · Cited by 47
Purposeful gaming & socio-computational systems
Prestopnik, N. R., & Crowston, K. (2012) · International ACM SIGGROUP Conference on Supporting Group Work (GROUP) · doi:10.1145/2389176.2389188 · Cited by 47
Music auto-tagging using deep Recurrent Neural Networks
Song, G., Wang, Z., Han, F., Ding, S., & Hussain, M. A. I. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.02.076 · Cited by 45
Evaluating Visual Conversational Agents via Cooperative Human-AI Games
Chattopadhyay, P., Yadav, D., Prabhu, V., Chandrasekaran, A., Das, A., Lee, S., Batra, D., & Parikh, D. (2017) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v5i1.13312 · Cited by 44
Chen, D., Sun, N., Lee, J., Zou, C., & Jeon, W. (2024) · Applied Sciences · doi:10.3390/app142310811 · Cited by 43
Fight or unite: Investigating game genres for image tagging
Goh, D. H., Ang, R. P.-H., Lee, C. S., & Chua, A. Y. K. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21478 · Cited by 41
Assessing the Impact of Music Recommendation Diversity on Listeners: A Longitudinal Study
Porcaro, L., Gómez, E., & Castillo, C. (2023) · ACM Transactions on Recommender Systems · doi:10.1145/3608487 · Cited by 40
Heterogeneous Embedding For Subjective Artist Similarity.
McFee, B., & Lanckriet, G. R. G. (2009) · doi:10.5281/zenodo.1416283 · Cited by 39
Workshop on novelty and diversity in recommender systems - DiveRS 2011
Castells, P., Wang, Y.-X., Lara, R., & Zhang, D. (2011) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2043932.2044019 · Cited by 39
Reward Systems in Human Computation Games
Siu, K., & Riedl, M. O. (2016) · Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/2967934.2968083 · Cited by 38
Genre-Adaptive Semantic Computing and Audio-Based Modelling for Music Mood Annotation
Saari, P., Fazekas, G., Eerola, T., Barthet, M., Lartillot, O., & Sandler, M. B. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2462841 · Cited by 38
Crowdsourcing Collective Emotional IntelligencePreprint
Morris, R. R., & Picard, R. W. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1204.3481 · Cited by 38
Hamel, P., Davies, M. E. P., Yoshii, K., & Goto, M. (2013) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.5281/zenodo.1416107 · Cited by 37
The role of game theory in human computation systems
Jain, S., & Parkes, D. C. (2009) · doi:10.1145/1600150.1600171 · Cited by 36
Towards time-varying music auto-tagging based on CAL500 expansion
Wang, S.-Y., Wang, J.-C., Yang, Y., & Wang, H. (2014) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890290 · Cited by 35
Guy, I., Perer, A., Daniel, T., Greenshpan, O., & Turbahn, I. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979145 · Cited by 34
Barrington, L., Turnbull, D., & Lanckriet, G. R. G. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014748109 · Cited by 33
Alonso, O. (2019) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00904ed1v01y201903icr066 · Cited by 32
Modelling Cognitive Bias in Crowdsourcing Systems
Saab, F., Elhajj, I. H., Kayssi, A., & Chehab, A. (2019) · Cognitive Systems Research · doi:10.1016/j.cogsys.2019.04.004 · Cited by 31
Learning pseudo-tags to augment sparse tagging in hybrid music recommender systems
Horsburgh, B., Craw, S., & Massie, S. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.11.004 · Cited by 31
Learning to Tag from Open Vocabulary Labels
Law, E., Settles, B., & Mitchell, T. M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15883-4_14 · Cited by 30
Self-citationAdaptive music retrieval–a state of the art
Stober, S., & Nürnberger, A. (2012) · Multimedia Tools and Applications · doi:10.1007/s11042-012-1042-z · Cited by 30
Modeling CrowdSourcing Scenarios in Socially-Enabled Human Computation Applications
Bozzon, A., Fraternali, P., Galli, L., & Karam, R. (2013) · Journal on Data Semantics · doi:10.1007/s13740-013-0032-2 · Cited by 29
Ramona, M., & Peeters, G. G. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5946444 · Cited by 29
Walsh, G., & Golbeck, J. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753643 · Cited by 29
A comparative study of collaboration-based reputation models for social recommender systems
McNally, K., O’Mahony, M. P., & Smyth, B. (2013) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-013-9143-6 · Cited by 27
A game-theoretic analysis of the ESP game
Jain, S., & Parkes, D. C. (2013) · ACM Transactions on Economics and Computation · doi:10.1145/2399187.2399190 · Cited by 25
EventMask: A Game-Based Framework for Event-Saliency Identification in Images
Rosani, A., Boato, G., & Natale, F. G. B. D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2441003 · Cited by 24
Automatic Music Tag Classification Based On Block-Level Features
Seyerlehner, K., Widmer, G., Schedl, M., & Knees, P. (2010) · doi:10.5281/zenodo.849724 · Cited by 24
An experimental study of social tagging behavior and image content
Golbeck, J., Koepfler, J. A., & Emmerling, B. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21522 · Cited by 24
Toward a Comprehension Challenge, Using Crowdsourcing as a Tool
Paritosh, P. K., & Marcus, G. (2016) · AI Magazine · doi:10.1609/aimag.v37i1.2649 · Cited by 23
Human Computation Games: A Survey
Krause, M., & Smeddinck, J. D. (2011) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.42699 · Cited by 23
Gaston, J., & Cooper, S. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025997 · Cited by 23
Learnersourcing in Theory and Practice: Synthesizing the Literature and Charting the Future
Singh, A., Brooks, C. A., & Doroudi, S. (2022) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3491140.3528277 · Cited by 23
Improving music emotion labeling using human computation
Morton, B. G., Speck, J. A., Schmidt, E. M., & Kim, Y. E. (2010) · doi:10.1145/1837885.1837899 · Cited by 22
Mathematical Modeling of Social Games
Chan, K. T., King, I., & Yuen, M.-C. (2009) · doi:10.1109/cse.2009.166 · Cited by 22
Exploring Data Quality in Games With a Purpose
Prestopnik, N. R., Crowston, K., & Wang, J. (2014) · iConference · doi:10.9776/14066 · Cited by 22
Mayer, S., Lischke, L., Grønbæk, J. E. S., Sarsenbayeva, Z., Vogelsang, J., Woźniak, P. W., Henze, N., & Jacucci, G. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174113 · Cited by 22
InstructableCrowd: Creating IF-THEN Rules for Smartphones via Conversations with the Crowd
Huang, T.-H., Azaria, A., Romero, O. J., & Bigham, J. P. (2019) · Human Computation · doi:10.15346/hc.v6i1.104 · Cited by 22
Wang, J.-C., Shih, Y.-C., Wu, M.-S., Wang, H., & Jeng, S. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2072337 · Cited by 21
Large-Scale Weakly-Supervised Content Embeddings for Music Recommendation and Tagging
Huang, Q., Jansen, A., Zhang, L., Ellis, D. P. W., Saurous, R. A., & Anderson, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053240 · Cited by 20
Toward Complexity Measures for Systems Involving Human Computation
Crouser, R. J., Hescott, B. J., & Chang, R. (2014) · Human Computation · doi:10.15346/hc.v1i1.25 · Cited by 19
Creative professional users’ musical relevance criteria
Inskip, C., MacFarlane, A., & Rafferty, P. (2010) · Journal of Information Science · doi:10.1177/0165551510374006 · Cited by 19
Balancing Human and Machine Contributions in Human Computation Systems
Crouser, R. J., Ottley, A., & Chang, R. (2013) · Springer eBooks · doi:10.1007/978-1-4614-8806-4_48 · Cited by 19
Social Gamification in Enterprise Crowdsourcing
Afentoulidis, G., Szlávik, Z., Yang, J., & Bozzon, A. (2018) · ACM Web Science Conference (WebSci) · doi:10.1145/3201064.3201094 · Cited by 19
A Deep Bag-of-Features Model for Music Auto-TaggingPreprint
Nam, J., Herrera, J., & Lee, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.04999 · Cited by 19
Social Incentives in Paid Collaborative Crowdsourcing
Feyisetan, O., & Simperl, E. P. B. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3078852 · Cited by 18
Liem, C. C. S., Larson, M., & Hanjalić, A. (2013) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-012-0031-3 · Cited by 17
Evaluation of Acoustic Features for Music Emotion Recognition
Baume, C. (2013) · Journal of the Audio Engineering Society · Cited by 17
Deep Generative Models for Musical Audio Synthesis
Huzaifah, M., & Wyse, L. L. (2021) · Springer eBooks · doi:10.1007/978-3-030-72116-9_22 · Cited by 17
Incentive-Centric Semantic Web Application Engineering
Simperl, E. P. B., Cuel, R., & Stein, M. (2013) · Synthesis lectures on data, semantics and knowledge · doi:10.1007/978-3-031-79441-4 · Cited by 16
Music retagging using label propagation and robust principal component analysis
Yang, Y., Bogdanov, D., Herrera, P., & Sordo, M. (2012) · International World Wide Web Conference (WWW) · doi:10.1145/2187980.2188217 · Cited by 16
A Framework for Motivating Sketching Practice with Sketch-based Gameplay
Williford, B., Runyon, M., Cherian, J., Li, W., Linsey, J., & Hammond, T. (2019) · Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/3311350.3347175 · Cited by 16
Applying human computation methods to information science
Harris, C. G. (2013) · doi:10.17077/etd.6kebet6l · Cited by 16
On the application of game mechanics in information retrieval
Galli, L., Fraternali, P., & Bozzon, A. (2014) · doi:10.1145/2594776.2594778 · Cited by 15
Metadata
- Authors
- Law, E., & von Ahn, L.
- Affiliations
- Carnegie Mellon University (US)
- Carnegie Mellon University, Pittsburgh, PA, USA
- ORCID
- Law, Edith
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2009-04-04
- Pages
- 1197-1206
- OpenAlex
- W2067329295
- Semantic Scholar
- 72dd231084d2fee5c31343b395ae372b68389ba9
- Cited by
- 248
- References
- 12
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 5 · 2022: 5 · 2021: 2 · 2020: 6 · 2019: 12 · 2018: 9 · 2017: 14 · 2016: 18 · 2015: 19 · 2014: 29 · 2013: 37 · 2012: 32
- FWCI
- 30.05
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) (publishedVersion)
- Funders
- Heinz Endowments
- Intel Corporation
- Microsoft Research
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Social Sciences › Decision Sciences › Management Science and Operations Research › Game Theory and Applications
- Keywords
- games with a purpose, crowdsourcing, music tagging, object identification, collaborative games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review