Peer and self assessment in massive online classes

Kulkarni, Chinmay, Wei, Koh Pang, Le, Huy, Chia, Daniel, Papadopoulos, Kathryn, Cheng, Justin, Koller, Daphne, Klemmer, Scott R.·2013·ACM Transactions on Computer-Human Interaction
DOI 10.1145/2505057

Cited by (388)

Items 101–200 of 388

  1. PuzzleMe: Leveraging Peer Assessment for In-Class Programming Exercises
    April Yi Wang, Yan Chen, John Joon Young Chung · 2021 · Proceedings of the ACM on Human-Computer Interaction
  2. A system for scalable and reliable technical-skill testing in online labor markets
    Maria Christoforaki, Panagiotis G. Ipeirotis · 2015 · Computer Networks
  3. Revising Learner Misconceptions Without Feedback
    Joseph Jay Williams, Tania Lombrozo, Anne Hsu · 2016 · CHI Conference on Human Factors in Computing Systems
  4. Towards MOOCs and Their Role in Engineering Education
    Sajid Iqbal, Xizhe Zang, Yanhe Zhu, Danish Hussain, Jie Zhao, Muhammad Majid Gulzar, Shahid Rasheed · 2015 · International Conference on Information Technology in Medicine and Education
  5. Eliph
    Jungkook Park, Yeong Hoon Park, Suin Kim, Alice H. Oh · 2017 · ACM Conference on Computer Supported Cooperative Work (CSCW)
  6. Finding the diamond in the rough: Exploring communication and platform in crowdsourcing performance
    Kristen L. Guth, Daren C. Brabham · 2017 · Communication Monographs
  7. Understanding Essential Factors in Influencing Technology-Supported Learning: A Model toward Blended Learning Success
    Yulei Gavin Zhang, Mandy Yan Dang · 2020 · Journal of Information Technology Education Research
  8. Towards a Common Instrument for Measuring Prior Programming Knowledge
    Rodrigo Duran, Jan-Mikael Rybicki, Arto Hellas, Sanna Suoranta · 2019 · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE)
  9. Good practices to influence engagement and learning outcomes on a traditional introductory programming course
    Antonella Carbonaro · 2018 · Interactive Learning Environments
  10. Ventajas, desventajas y ocho recomendaciones para la educación médica virtual en tiempos del COVID-19: Revisión de Tema
    Daniel Vásquez · 2020 · CES Medicina
  11. Peer assessment methodology of open-ended assignments: Insights from a two-year case study within a university course using novel open source system
    Ljiljana Brkić, Igor Mekterović, M. Fertalj, D. Mekterović · 2024 · Comput. Educ.
  12. Self-evaluation in advanced power searching and mapping with google MOOCs
    Julia Wilkowski, D. Russell, Amit Deutsch · 2014 · ACM Conference on Learning @ Scale
  13. Modelling Learners in Crowdsourcing Educational Systems
    Solmaz Abdi, Hassan Khosravi, Shazia Wasim Sadiq · 2020 · Lecture notes in computer science
  14. BayesRank
    Andrew E. Waters, David Tinapple, Richard G. Baraniuk · 2015 · ACM Conference on Learning @ Scale (L@S)
  15. Learnersourcing in Theory and Practice: Synthesizing the Literature and Charting the Future
    Anjali Singh, Christopher A. Brooks, Shayan Doroudi · 2022 · ACM Conference on Learning @ Scale (L@S)
  16. Measuring performance of peer prediction mechanisms using replicator dynamics
    Victor Shnayder, Rafael Frongillo, David C. Parke · 2016 · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
  17. Integrating MOOCs in physics preliminary undergraduate education: beyond large size lectures
    Juliana Elisa Raffaghelli, Patrizia Ghislandi, Susanna Sancassani et al. · 2018 · Educational Media International
  18. Statistical semi-supervised system for grading multiple peer-reviewed open-ended works
    Juan Ramón Rico-Juan, Antonio‐Javier Gallego, Jose J. Valero-Mas, Jorge Calvo-Zaragoza · 2018 · Computers & Education
  19. Eğitimde yapay zekâ kullanımı: Etik sorunlar ve çözümler
    Süleyman Temur · 2025 · Mehmet Akif Ersoy üniversitesi eğitim fakültesi dergisi.
  20. Interest in Educational Data and Barriers to Data Use Among Massive Open Online Course Instructors
    Maya Usher, Arnon Hershkovitz · 2022 · Journal of Science Education and Technology
  21. The MOOC Post-Mortem: Bibliometric and Systematic Analyses of Research on Massive Open Online Courses (MOOCs), 2009 to 2022
    Jon Billsberry, Irit Alony · 2023 · Organizational Behavior Teaching Review
  22. Crowd-scale interactive formal reasoning and analytics
    Ethan Fast, Colleen Lee, Alex Aiken, Michael S. Bernstein, Daphne Koller, Eric W. Smith · 2013 · ACM Symposium on User Interface Software and Technology (UIST)
  23. Grading the Graders
    Yanxin Lu, Joe D. Warren, Christopher Jermaine · 2015 · International World Wide Web Conference (WWW)
  24. Creating Awareness and Reflection in a Large-Scale IS Lecture - The Application of a Peer Assessment in a Flipped Classroom Scenario
    Andreas Janson, Sissy-Josefina Ernst, Katja Lehmann, Jan Marco Leimeister · 2014 · Alexandria (UniSG) (University of St.Gallen)
  25. Leveraging Social Connections to Improve Peer Assessment in MOOCs
    Hou Pong Chan, Irwin King · 2017
  26. CritiqueKit
    C. Ailie Fraser, Tricia J. Ngoon, Ariel S. Weingarten, Mira Dontcheva, Scott Klemmer · 2017 · ACM Symposium on User Interface Software and Technology (UIST)
  27. Improving essay peer grading accuracy in massive open online courses using personalized weights from student's engagement and performance
    C. García-Martínez, R. Cerezo, Manuel Bermúdez, C. Romero · 2018 · Journal of Computer Assisted Learning
  28. Using Peer Code Review as an Educational Tool
    Xiangyu Song, Seth Copen Goldstein, Majd F. Sakr · 2020 · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE)
  29. Hybrid and Online Peer Group Grading: Adding Assessment Efficiency While Maintaining Perceived Fairness
    Brian A. Vander Schee, Tim Dugan Birrittella · 2021 · Marketing Education Review
  30. A complex event processing framework for an adaptive language learning system
    Dawei Jin, Si Shi, Yin Zhang⋆, Haider Abbas, Tiong‐Thye Goh · 2018 · Future Generation Computer Systems
  31. Code in Place
    Christopher Piech, Ali Malik, Kylie Jue · 2021 · ACM Technical Symposium on Computer Science Education (SIGCSE)
  32. CaptainTeach
    Joe Gibbs Politz, DANIEL C. PATTERSON, Shriram Krishnamurthi · 2014
  33. Tomorrow's EdTech Today: Establishing a Learning Platform as a Collaborative Research Tool for Sound Science
    Korinn Ostrow, Neil Thomas Heffernan, Joseph Jay Williams · 2017 · Teachers College Record The Voice of Scholarship in Education
  34. A Survey of Methods for Improving Review Quality
    Edward F. Gehringer · 2014 · Lecture notes in computer science
  35. Critter
    Aditya Bharadwaj, Pao Siangliulue, Adam Marcus, Kurt Luther · 2019 · CHI Conference on Human Factors in Computing Systems
  36. Eliciting Information From Heterogeneous Mobile Crowdsourced Workers Without Verification
    Chao Huang, Haoran Yu, Jianwei Huang · 2021 · IEEE Transactions on Mobile Computing
  37. What Does It Take for Organizations to Adopt Massive Open Online Courses (MOOCs)? A Fuzzy DANP Analysis
    Reyhaneh Bijaniaram, Maryam Tehrani, Roohallah Noori, Jongwook Pak · 2023 · Journal of the Knowledge Economy
  38. In-flow peer-review of tests in test-first programming
    Joe Gibbs Politz, Shriram Krishnamurthi, Kathi Fisler · 2014 · ACM Conference on International Computing Education Research (ICER)
  39. Optimal Spot-Checking for Improving Evaluation Accuracy of Peer Grading Systems
    Wan-Yuan Wang, Bo An, Yi-Chuan Jiang · 2018 · AAAI Conference on Artificial Intelligence
  40. Untitled work
    2018 · International journal of engineering education
  41. Practical Peer Prediction for Peer Assessment
    Shnayder, Victor, Parkes, David · 2016 · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing
  42. Designing Crowdcritique Systems for Formative Feedback
    Matthew W. Easterday, Daniel Rees Lewis, Elizabeth M. Gerber · 2016 · International Journal of Artificial Intelligence in Education
  43. Feedback Exchange and Online Affinity: A Case Study of Online Fanfiction Writers
    Ruijia Cheng, Jenna Frens · 2022 · Proceedings of the ACM on Human-Computer Interaction
  44. A Virtual Social Learner Community—Constitutive Element of MOOCs
    Christoph Meinel, Stefanie Schweiger · 2016 · Education Sciences
  45. SSPA: an effective semi-supervised peer assessment method for large scale MOOCs
    Yu-Feng Wang, Hui Fang, Qun Jin, Jian-Hua Ma · 2019 · Interactive Learning Environments
  46. Towards answering “Am I on the right track?” automatically using program synthesis
    Molly Q Feldman, Yiting Wang, William E. Byrd · 2019
  47. Optimal Spot-Checking for Improving the Evaluation Quality of Crowdsourcing: Application to Peer Grading Systems
    Wan-Yuan Wang, Bo An, Yi-Chuan Jiang · 2020 · IEEE Transactions on Computational Social Systems
  48. Similarity and difference in fee-paying and no-fee learner expectations, interaction and reaction to learning in a massive open online course
    Simon Cross, Denise M. Whitelock · 2016 · Interactive Learning Environments
  49. Advancing MOOC and SPOC development via a learner decision journey analytic framework
    Chi‐Un Lei, Xiangyu Hou, Tyrone Tai-On Kwok, Trudi S. F. Chan, Jane J. Lee, Elizabeth Oh, Donn Emmanuel Gonda, Yip-Chun Au Yeung, Cherry Lai · 2015 · IEEE International Conference on Teaching, Assessment, and Learning for Engineering
  50. Self- and Automated Assessment in Programming MOOCs
    Marina Lepp, Piret Luik, Tauno Palts · 2017 · Communications in computer and information science
  51. Can Learners Become Teachers? Evaluating the Merits of Student Generated Content and Peer Assessment
    David Murray, T. McGill, Nik Thompson, D. Toohey · 2017 · Issues in Informing Science and Information Technology
  52. Increasing Quality and Involvement in Online Peer Feedback Exchange
    Sneha R. Krishna Kumaran, Deana McDonagh, Brian P. Bailey · 2017 · Proceedings of the ACM on Human-Computer Interaction
  53. HirePeer: Impartial Peer-Assessed Hiring at Scale in Expert Crowdsourcing Markets
    Yasmine Kotturi, Anson Kahng, Ariel D. Procaccia, Chinmay Eishan Kulkarni · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  54. Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment
    Ivan Stelmakh, Nihar B. Shah, Aarti Singh · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  55. DesignQuizzer: A Community-Powered Conversational Agent for Learning Visual Design
    Zhenhui Peng, Qiaoyi Chen, Zhiyu Shen, Xiaojuan Ma, Antti Oulasvirta · 2024 · Proceedings of the ACM on Human-Computer Interaction
  56. Can Natural Language Processing Become Natural Language Coaching?
    Marti A. Hearst · 2015
  57. Predicting Student Participation in Peer Reviews in MOOCs
    Erkan Er, Miguel L. Bote‐Lorenzo, Eduardo Gómez‐Sánchez · 2017 · OpenMETU (Middle East Technical University)
  58. The Unique Challenges for Creative Small Businesses Seeking Feedback on Social Media
    Yasmine Kotturi, Allie Blaising, Sarah Fox, Chinmay Eishan Kulkarni · 2021 · Proceedings of the ACM on Human-Computer Interaction
  59. A systematic review of educational online peer-review and assessment systems: charting the landscape
    Dmytro Babik, Edward F. Gehringer, J. Kidd, Kristine Sunday, David Tinapple, Steven W. Gilbert · 2024 · Educational technology research and development
  60. Archaeology and the MOOC: Massive, open, online, and opportunistic
    Susan E. Alcock, J. Andrew Dufton, Müge Durusu-Tanrıöver · 2015 · Journal of Social Archaeology
  61. Robust Plackett–Luce model for k-ary crowdsourced preferences
    Bo Han, Yuangang Pan, Ivor Wai-Hung Tsang · 2017 · Machine Learning
  62. Introducing MOOC-like methodologies in a face-to-face undergraduate course: a detailed case study
    José Luis Brita-Paja, Christian Jake Gregorio, Luis Llana, Cristóbal Pareja-Flores, Adrián Riesco · 2018 · Interactive Learning Environments
  63. Self-Assessment to Improve Learning and Evaluation
    Edward F. Gehringer · 2018 · ASEE Annual Conference & Exposition
  64. Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments
    Nea Pirttinen, Vilma Kangas, Henrik Nygren · 2018 · Koli Calling International Conference on Computing Education Research
  65. Development of MOOC Service Framework for Life Long Learning: A Case Study of Thai MOOC
    Sila Chunwijitra, Phondanai Khanti, Supphachoke Suntiwichaya · 2020 · IEICE Transactions on Information and Systems
  66. Two Stances, Three Genres, and Four Intractable Dilemmas for the Future of Learning at Scale
    Justin Reich · 2020 · ACM Conference on Learning @ Scale (L@S)
  67. Peer assessment in MOOCs based on learners' profiles clustering
    Lynda Haddadi, Farida Bouarab‐Dahmani, Tassadit Berkane · 2017
  68. CrowdLayout
    Divit P. Singh, Lee Lisle, T. M. Murali, Kurt Luther · 2018 · CHI Conference on Human Factors in Computing Systems
  69. The Power of Integrated Wireless and Mobile Communication Technologies and Their Impact on the Corporate World
    Barbara J. Durkin, Izabella V. Lokshina · 2015 · International Journal of Interdisciplinary Telecommunications and Networking
  70. Trends the use of Artificial Intelligence techniques for peer assessment
    Lorena Elizabeth Bowen-Mendoza, Maricela Pinargote-Ortega, Jaime Meza, Sebastian Ventura Soto · 2020 · International Conference on Engineering & MIS (ICEMIS)
  71. Open, Collaborative, and AI-Augmented Peer Assessment: Student Participation, Performance, and Perceptions
    Chaohua Ou, Ploy Thajchayapong, David A. Joyner · 2024 · ACM Conference on Learning @ Scale (L@S)
  72. An Interoperability Framework of Open Educational Resources and Massive Open Online Courses for Sustainable e-Learning Platform
    Sila Chunwijitra, Chanchai Junlouchai, Sitdhibong Laokok · 2016 · IEICE Transactions on Information and Systems
  73. Peer assessment and groups formation in massive open online courses
    Lynda Haddadi, Farida Bouarab‐Dahmani, Nathalie Guin, Tassadit Berkane, Samia Lazib · 2018 · Computer Applications in Engineering Education
  74. Perceptions and practice of peer assessments: an empirical investigation
    Anand Agrawal, Damith C. Rajapakse · 2018 · International Journal of Educational Management
  75. Generating actionable predictions regarding MOOC learners’ engagement in peer reviews
    Erkan Er, E. Gómez-Sánchez, M. Bote-Lorenzo, Y. Dimitriadis, J. Asensio-Pérez · 2019 · Behavior and Information Technology
  76. Investigating Incentives for Students to Provide Peer Feedback in a Semi-Open Online Course
    German Neubaum, Astrid Wichmann, Sabrina Cornelia Eimler · 2014 · International Symposium on Open Collaboration
  77. An assessment for learning framework with peer assessment of group works
    Laurent Moccozet, Camille Tardy · 2015 · International Conference on Information Technology Based Higher Education and Training (ITHET)
  78. Design Perspectives of Learning at Scale
    Chinmay Eishan Kulkarni · 2019 · ACM Conference on Learning @ Scale (L@S)
  79. Improving Feedback and Discussion in MOOC Peer Assessement Using Introduced Peers
    Dilrukshi Gamage, Mark E. Whiting, Indika Perera · 2018 · IEEE International Conference on Teaching, Assessment, and Learning for Engineering
  80. Exploring an effective automated grading model with reliability detection for large‐scale online peer assessment
    Zirou Lin, Hanbing Yan, Li Zhao · 2024 · Journal of Computer Assisted Learning
  81. STEP: A Scalable Testing and Evaluation Platform
    Maria Christoforaki, Panagiotis G. Ipeirotis · 2014 · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing
  82. Probabilistic Modeling of Peer Correction and Peer Assessment.
    Takeru Sunahase, Yukino Baba, Hisashi Kashima · 2019 · Educational Data Mining
  83. The UX Factor: Using Comparative Peer Review to Evaluate Designs through User Preferences
    Sarah Bawabe, Laura Wilson, Tong-Yu Zhou, E. Marks, Jeff Huang · 2021 · Proc. ACM Hum. Comput. Interact.
  84. Learning innovation at scale
    Joseph Jay Williams, René F. Kizilcec, Daniel M. Russell · 2014 · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA)
  85. Do Numeric Ratings Impact Peer Reviewers?
    Catherine M. Hicks, C. Ailie Fraser, Purvi Desai, Scott Klemmer · 2015 · ACM Conference on Learning @ Scale (L@S)
  86. The Effects of Peer- and Self-assessment on the Assessors
    Joonsuk Park, Kimberley A. Williams · 2016
  87. Peer Assessment and Self-Assessment in Social Learning Environments Through a New Crowd-Sourced Mechanism
    Fatemeh Orooji, Fattaneh Taghiyareh · 2018 · IEEE Access
  88. Learning-oriented assessment in action: impact on students of physics for engineering
    Orlando E. González Pérez, Juan P. Treviño · 2019 · International Journal on Interactive Design and Manufacturing (IJIDeM)
  89. LIFT: Integrating Stakeholder Voices into Algorithmic Team Formation
    Emily M. Hastings, Albatool A. Alamri, Andrew V. Kuznetsov, Christine Pisarczyk, Karrie G. Karahalios, Darko Marinov, Brian P. Bailey · 2020 · CHI Conference on Human Factors in Computing Systems
  90. Technology Tools and Instructional Strategies for Designing and Delivering MOOCs to Facilitate Self-monitoring of Learners
    Meina Zhu, Curtis Jay Bonk · 2020 · Journal of Learning for Development
  91. Peer Grading Eliciting Truthfulness Based on Autograder
    Yong Han, Wenjun Wu, Yu Liang · 2022 · IEEE Transactions on Learning Technologies
  92. Rules of Engagement: Strategies to Increase Online Engagement at Scale
    Anne Trumbore · 2014 · Change The Magazine of Higher Learning
  93. In-Flow Peer Review
    Dave Clarke, Tony Clear, Kathi Fisler, Matthias Hauswirth, Shriram Krishnamurthi, Joe Gibbs Politz, Ville Tirronen, Tobias Wrigstad · 2014
  94. Dynamics of Peer Grading: An Empirical Study.
    Luca de Alfaro, Michael Shavlovsky · 2016 · eScholarship (California Digital Library)
  95. Using text mining for personalization and recommendation for an enriched hybrid learning experience
    Lei Liu, Rares Vernica, Tamir Hassan, Niranjan Damera Venkata · 2019 · Computational Intelligence
  96. How Effective Can Simple Ordinal Peer Grading Be?
    Ioannis Caragiannis, George A. Krimpas, Alexandros A. Voudouris · 2020 · ACM Transactions on Economics and Computation
  97. Police education and role play: Insights from the literature
    Allison H. Turner · 2021 · The Police Journal Theory Practice and Principles
  98. Peer assessment in the first French MOOC : Analyzing assessors' behavior
    Matthieu Cisel, Rémi Bachelet, Éric Bruillard · 2014 · HAL (Le Centre pour la Communication Scientifique Directe)
  99. Can students help themselves? An investigation of students’ feedback on the quality of the source code
    Raúl Eduardo Coló Andrade, João Brunet · 2018 · 2022 IEEE Frontiers in Education Conference (FIE)
  100. Google Form as an Online Assessment Tool to Improve the Students’ Vocabulary Mastery
    Rizal Rinaldi, Wiyaka Wiyaka, Entika Fani Prastikawati · 2022 · SALEE Study of Applied Linguistics and English Education