Automatic Attendance Management System based on Deep One-Shot Learning

Abstract

Due to the positive relationship between the presence of students in classes and their performance, student attendance assessment is considered essential within the classroom environment, even as a tiring and time-consuming task. We proposed a solution for student attendance control using face recognition with deep one-shot learning and evaluated our approach in different conditions and image capturing devices to confirm that such a pipeline may work in a real-world setting. For better results regarding the high number of false negatives that often occur in uncontrolled environments, we also proposed a face detection stage using HOG and a CNN with Max-Margin Object Detection based features. We achieved accuracy and F1 scores of 97% and 98.4% with an iPhone 7 camera, 91.9% and 94.8% with a Moto G camera, and 51.2% and 61.1% with a WebCam respectively. These experiments reinforce the effectiveness and availability of this approach to the student attendance assessment problem since the recognition pipeline can be either made available for embedded processing with limited computational resources (smartphones), or offered as “Software as a Service” tool.