The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Automated Online Exam Proctoring
Abstract
Massive open online courses and other forms of remote education continue to increase in popularity and reach. The ability to efficiently proctor remote online examinations is an important limiting factor to the scalability of this next stage in education. Presently, human proctoring is the most common approach of evaluation, by either requiring the test taker to visit an examination center, or by monitoring them visually and acoustically during exams via a webcam. However, such methods are labor intensive and costly. In this paper, we present a multimedia analytics system that performs automatic online exam proctoring. The system hardware includes one webcam, one wearcam, and a microphone for the purpose of monitoring the visual and acoustic environment of the testing location. The system includes six basic components that continuously estimate the key behavior cues: user verification, text detection, voice detection, active window detection, gaze estimation, and phone detection. By combining the continuous estimation components, and applying a temporal sliding window, we design higher level features to classify whether the test taker is cheating at any moment during the exam. To evaluate our proposed system, we collect multimedia (audio and visual) data from $\text{24}$ subjects performing various types of cheating while taking online exams. Extensive experimental results demonstrate the accuracy, robustness, and efficiency of our online exam proctoring system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“At the initial step, we detect a set of strong corner points on the face [26], and then convert them to 3D model points by using a sinusoidal model.”
MethodModeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Pedestrian Detection via Classification on Riemannian Manifolds
Tuzel, O., Porikli, F., & Meer, P. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.75 · Cited by 975
Grade Change: Tracking Online Education in the United States.
Allen, I. E., & Seaman, J. (2014) · Cited by 710
Audio Engineering Society Convention
(1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392015 · Cited by 610
Event detection in field sports video using audio-visual features and a support vector Machine
Sadlier, D. A., & O'Connor, N. E. (2005) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2005.854237 · Cited by 222
Temporal segmentation and activity classification from first-person sensing
Spriggs, E. H., De La Torre, F., & Hebert, M. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204354 · Cited by 219
Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior
Nguyen, L. S., Frauendorfer, D., Mast, M. S., & Gatica-Perez, D. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2307169 · Cited by 187
Estimating Cohesion in Small Groups Using Audio-Visual Nonverbal Behavior
Hung, H., & Gatica-Perez, D. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2055233 · Cited by 181
Pose-Invariant 3D Face Alignment
Jourabloo, A., & Liu, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.421 · Cited by 165
Self-citationSpatio-Temporal Phrases for Activity Recognition
Zhang, Y., Liu, X., Chang, M., Ge, W., & Chen, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_51 · Cited by 130
Self-citationEnhanced Security for Online Exams Using Group Cryptography
Jung, I. Y., & Yeom, H. Y. (2009) · IEEE Transactions on Education · doi:10.1109/te.2008.928909 · Cited by 121
Automatic Feeding Control for Dense Aquaculture Fish Tanks
Atoum, Y., Srivastava, S., & Liu, X. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2385794 · Cited by 119
Self-citationOn Continuous User Authentication via Typing Behavior
Roth, J., Liu, X., & Metaxas, D. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2348802 · Cited by 98
Self-citationReale, M. J., Canavan, S. J., Yin, L., Hu, K., & Hung, T. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2120600 · Cited by 90
Audio Assisted Robust Visual Tracking With Adaptive Particle Filtering
Kılıç, V., Barnard, M., Wang, W., & Kittler, J. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2377515 · Cited by 80
E-CHEATING: INCIDENCE AND TRENDS AMONG COLLEGE STUDENTS
King, D., & Case, C. (2014) · Issues in Information Systems · doi:10.48009/1_iis_2014_20-27 · Cited by 77
Super Fast Event Recognition in Internet Videos
Jiang, Y., Dai, Q., Mei, T., Rui, Y., & Chang, S. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2436813 · Cited by 74
Head Motion Modeling for Human Behavior Analysis in Dyadic Interaction
Xiao, B., Georgiou, P., Baucom, B., & Narayanan, S. S. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2432671 · Cited by 55
Li, X., Chang, K.-M. K., Yuan, Y., & Hauptmann, A. G. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675245 · Cited by 55
Investigating the Discriminative Power of Keystroke Sound
Roth, J., Liu, X., Ross, A. A., & Metaxas, D. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2374424 · Cited by 52
Self-citationVideo-based face model fitting using Adaptive Active Appearance Model
Liu, X. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.09.016 · Cited by 51
Self-citationWhat are customers looking at?
Liu, X., Krahnstoever, N. O., Yu, T., & Tu, P. (2007) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2007.4425345 · Cited by 49
Self-citationA comparative study on automatic audio–visual fusion for aggression detection using meta-information
Lefter, I., Rothkrantz, L. J. M., & Burghouts, G. J. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.01.002 · Cited by 40
Transfer learning with one-class data
Chen, J.-X., & Liu, X. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.07.017 · Cited by 36
Self-citationE-CHEATING: INCIDENCE AND TRENDS AMONG COLLEGE STUDENTS
King, D. L., & Case, C. (2014) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 35
An autonomous articulating desktop robot for proctoring remote online examinations
Rosen, W. A., & Carr, M. E. (2013) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2013.6685172 · Cited by 34
Toward constructing a secure online examination system
Wahid, A. H., Sengoku, Y., & Mambo, M. (2015) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1145/2701126.2701203 · Cited by 33
Boosted deformable model for human body alignment
Liu, X., Yu, T., Sebastian, T. B., & Tu, P. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587563 · Cited by 22
Self-citation
Cited by
Face anti-spoofing using patch and depth-based CNNs
Atoum, Y., Liu, Y., Jourabloo, A., & Liu, X. (2017) · 2017 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272713 · Cited by 429
Self-citationA Systematic Review on AI-based Proctoring Systems: Past, Present and Future
Nigam, A., Pasricha, R., Singh, T., & Churi, P. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10597-x · Cited by 267
A systematic review of research on cheating in online exams from 2010 to 2021
Noorbehbahani, F., Mohammadi, A., & Aminazadeh, M. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10927-7 · Cited by 236
A Systematic Review of Online Exams Solutions in E-Learning: Techniques, Tools, and Global Adoption
Muzaffar, A. W., Tahir, M., Anwar, M. W., Chaudry, Q., Mir, S. R., & Rasheed, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3060192 · Cited by 149
Deep Video Anomaly Detection: Opportunities and Challenges
Ren, J., Xia, F., Liu, Y., & Lee, I. (2021) · 2021 International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw53433.2021.00125 · Cited by 84
Metadata
- Authors
- Atoum, Y., Chen, L., Liu, A. X., Hsu, S. D. H., & Liu, X.
- Venue
- IEEE Transactions on Multimedia
- Published
- 2017-07
- Volume
- 19
- Issue
- 7
- Pages
- 1609-1624
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2573323278
- Cited by
- 287
- References
- 31
- FWCI
- 17.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.