A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition
Open accessThe DOI matches its Crossref record; 48 of the 62 references it cites were found in a registry or an index; 10 of the 34 sources its claims cite were checked for support.
Abstract
Recently, many researches have been conducted on recognition of facial emotion using convolutional neural networks (CNNs), which show excellent performance in computer vision. To obtain a high classification accuracy, a CNN architecture with many parameters and high computational complexity is required. However, this is not suitable for embedded systems where hardware resources are limited. In this paper, we present a lightweight CNN architecture optimized for embedded systems. The proposed CNN architecture has a small memory footprint and low computational complexity. Furthermore, a novel hardware-friendly quantization method that uses only integer-arithmetic is proposed. The proposed hardware-friendly quantization method maps the scale factors to power-of-two terms and replaces multiplication and division operations using scale factors with shift operations. To improve the generalization and classification performance of the CNN, we create the FERPlus-A dataset. This is a new training dataset created using a variety of image processing algorithms. After training with FERPlus-A, quantization has been performed. The size of a quantized CNN parameter is about 0.39 MB, and the number of operations is about 28 M integer operations (IOPs). By evaluating the performance of the quantized CNN that uses only integer-arithmetic on the FERPlus test dataset, the classification accuracy is approximately 86.58%. It achieved higher accuracy than other lightweight CNNs in prior studies. The proposed CNN architecture that uses only integer-arithmetic is implemented on the Xilinx ZC706 SoC platform for real-time facial emotion recognition by applying parallelism strategies and efficient data caching strategies. The FPGA-based CNN accelerator implemented for real-time facial emotion recognition achieves about 10 frame per second (FPS) at 250 MHz and consumes 2.3 W.
Overview
CoChat Summary
TL;DR
The paper proposes a lightweight CNN and log level threshold quantization (LLTQ) for integer-arithmetic-only facial emotion recognition on FPGA. It reports ~86.58% accuracy on the FERPlus test dataset, 0.39 MB parameters, 28 M IOPs, and an FPGA accelerator using 5,090 LUTs, 7,588 FFs, 61 BRAMs, 49 DSPs at ~2.3 W and ~10 FPS.
Key findings
- FERPlus-A was built by adding 143,545 images to the 28,709 FERPlus training images, resulting in 172,254 images; training on FERPlus-A improved accuracy from ~71.85% to ~86.58% (~14.73% improvement) on the same FERPlus test dataset.
- With 8-bit quantization-aware training, LSQ improved accuracy by ~0.13% over floating-point but was not hardware-friendly; TQT reduced accuracy by ~0.45%; LLTQ showed no accuracy drop relative to floating-point and used only integer-arithmetic.
- The proposed CNN has 0.39 MB parameters, 28 M IOPs, and ~86.58% accuracy; compared with lightweight CNNs, it achieved the highest accuracy among the considered methods, e.g., vs [17] it is 6.33× smaller and 3.28% more accurate but uses 1.4× more operations, and vs [23]-3 it is 1.67× smaller, uses 6.07× fewer operations, and is 0.91% more accurate.
- The FPGA accelerator on Xilinx ZC706 used 5,090 LUTs, 7,588 FFs, 61 BRAMs, and 49 DSPs, consumed ~2.3 W, and achieved ~10 FPS at 250 MHz; INT8 Type-2 vs FP32 Type-1 reduced LUTs by 3.23×, FFs by 4.39×, BRAMs by 1.97×, and DSPs by 4.18×, with total power decreased by 1.87×.
Methods
- Design flow: FERPlus-A was created by applying bilateral filtering, CLAHE, and sharpening to FERPlus training images; a lightweight CNN was trained in floating-point, then LLTQ quantization-aware training and integer scale conversion were applied; the CNN accelerator IP was designed with HLS and a device driver with C/C++ on a heterogeneous SoC.
- Architecture: the CNN consists of 21 convolution layers and one global average pooling layer, using modified SqueezeNet fire modules (FireA and FireB), only 3×3 or 1×1 convolutions, power-of-2 feature-map resolution, output channels in multiples of four, ReLU, and BN fusion.
- Hardware and evaluation: implemented on Xilinx Zynq-7000 SoC ZC706 (dual-core ARM Cortex-A9 PS and XC7Z045 PL) using Vivado HLS 2019.2 at a 250 MHz target; parallelism included intra-convolution fully unrolled MACU (9 multipliers, 8 adders for 3×3) and inter-feature-map parallelism with unroll factor 4, plus FMCM/PCM/OCAM caching and a post-processing module; training used FP batch size 64, 200 epochs, Adam with lr 1e-2 and weight decay 1e-5, and QAT batch size 32, 100 epochs, initial lr 1e-5 for weights/biases and 1e-3 for scale factors/log-thresholds/level-thresholds.
Limitations
- The paper does not state a limitations section.
- Evident from the text: compared with [42], the proposed accelerator is more accurate but has a frame rate about 5 FPS slower; compared with [17], it uses 1.4× more operations, though it uses only integer-arithmetic.
- Evident from the text: evaluation is reported only on the FERPlus test dataset, and hardware results are only for the Xilinx ZC706 platform.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


![FIGURE 3 The process of a uniform quantizer using the LSQ [38], the TQT [39] method, and the proposed quantization method, LLTQ.](https://figures.cochat.ai/paper-figures/402d30ce630e4c14aa0fb4fe65035ee2/a-resource-efficient-integer-arithmetic-only-fpga-based-cnn-accelerator-for-real-figure-3.png)











Verification
Claims the paper makes
8 Valid · 2 Not valid · 22 Not checked · 49 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“The proposed CNN is optimized the number of operations and memory footprint using the modified fire module in SqueezeNet [13] as the basic computation module.”
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > I. INTRODUCTION
What the sources say
- Supportedcites [13] 13. F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, ''SqueezeNet: AlexNet-level accuracy with 50x fewer param- eters and <0.5 MB model size,'' 2016, arXiv:1602.07360. [Online]. Avail- able: https://arxiv.org/abs/1602.07360 source
Section 3 (p. 3) introduces the Fire module as SqueezeNet’s building block, and Section 3.3 (p. 4) says SqueezeNet contains eight Fire modules. The citation identifies the module the citing authors say they modified; it does not attribute their CNN design to the SqueezeNet paper. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Compared with the methods in [43] and [44], the proposed method uses fewer resources.”
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > D. HARDWARE IMPLEMENTATION ON FPGA
What the sources say
- Partly supportedcites [43] 43. R. Ding, G. Su, G. Bai, W. Xu, N. Su, and X. Wu, ''A FPGA-based accelerator of convolutional neural network for face feature extraction,'' in Proc. IEEE Int. Conf. Electron Devices Solid-State Circuits (EDSSC), Xi'an, China, Jun. 2019, pp. 1-3. sourceExperimental — accuracy not yet measured
In D. Comparison with State-of-the-Art (page unavailable), the paper reports that its DenseNet models have fewer parameters than VGG13 and says they achieve the best tradeoff between accuracy and latency among the models tested. Our copy does not establish that the proposed method uses fewer resources than both methods labeled [43] and [44] in the citing document; those references cannot be identified from the sentence alone. (LLM, conf=0.76)
- Not checked — no full text of the sourcecites [44] 44. R. Ding, X. Tian, G. Bai, G. Su, and X. Wu, ''Hardware implementation of convolutional neural network for face feature extraction,'' in Proc. IEEE 13th Int. Conf. ASIC (ASICON), Chongqing, China, Oct. 2019, pp. 1-4. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“but it reduced accuracy by approximately 0.45% compared to the floating-point result.”
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > B. COMPARISON OF OTHER QUANTIZATION WORKS
What the sources say
- Partly supportedcites [39] 39. S. R. Jain, A. Gural, M. Wu, and C. H. Dick, ''Trained quantization thresholds for accurate and efficient fixed-point inference of deep neural networks,'' in Proc. Mach. Learn. Syst., Mar. 2020, pp. 112-128. sourceExperimental — accuracy not yet measured
Section 6.1 (p. 7) reports that INT4 accuracy falls short of FP32, so the paper does describe some accuracy loss. It does not report an approximately 0.45% loss for TQT as a general result; Section 6.2 (p. 8) says its INT8 MobileNet result matches floating-point accuracy with no loss. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Compared to [17], the new method is 6.33 times smaller parameter size”
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > C. COMPARISON WITH OTHER LIGHTWEIGHT CNNs
What the sources say
- Partly supportedcites [17] 17. R. K. Pandey, S. Karmakar, A. G. Ramakrishnan, and N. Saha, ''Improving facial emotion recognition systems using gradient and Laplacian images,'' 2019, arXiv:1902.05411. [Online]. Available: https://arxiv.org/abs/1902.05411 sourceExperimental — accuracy not yet measured
Table IV (Experiments and Results, p. 4) reports 0.65 million parameters for the source paper’s base model and variants, providing a possible comparator. The source does not report the citing paper’s new method or a 6.33-fold comparison, so it cannot establish the stated ratio. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“and 3.28% more accurate.”
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > C. COMPARISON WITH OTHER LIGHTWEIGHT CNNs
What the sources say
- Partly supportedcites [17] 17. R. K. Pandey, S. Karmakar, A. G. Ramakrishnan, and N. Saha, ''Improving facial emotion recognition systems using gradient and Laplacian images,'' 2019, arXiv:1902.05411. [Online]. Available: https://arxiv.org/abs/1902.05411 sourceExperimental — accuracy not yet measured
Tables I and II (p. 3) and Table IV (p. 4) report accuracy figures that could serve as a comparison benchmark. They do not identify the citing authors’ proposed method or establish that it is 3.28% more accurate; that difference cannot be verified from this source alone. (LLM, conf=0.78)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
62 more claims · 3 with their cited sources checked
Create a free account to see all 81 claims and every source verdict.
- Probably not a substantial claim. 2
- It may state two separate claims as one. 9
- The quote only partly states this claim. 4
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > 1) LOG LEVEL THRESHOLD QUANTIZATION (LLTQ)
“The second step, called the round process, converts all real values mapped to an integer value range into integers.The third step is the clamp process.”
§ A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition > 1) LOG LEVEL THRESHOLD QUANTIZATION (LLTQ)
“The clamp(x, Bound) function is the second step of the uniform quantizer and cuts the rounded value (x) to fit inside the Bound.The round(•) function is the third step of the uniform quantizer.”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
(2016) · arXiv (Cornell University) · Cited by 6,201
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Contrast Limited Adaptive Histogram Equalization
Zuiderveld, K. (1994) · Graphics Gems · doi:10.1016/b978-0-12-336156-1.50061-6 · Cited by 4,192
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., & Kalenichenko, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00286 · Cited by 4,114
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
Face Recognition with Local Binary Patterns
Ahonen, T., Hadid, A., & Pietikäinen, M. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_36 · Cited by 2,462
A desicion-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59119-2_166 · Cited by 2,252
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
Training deep networks for facial expression recognition with crowd-sourced label distribution
Barsoum, E., Zhang, C., Ferrer, C. C., & Zhang, Z. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2993165 · Cited by 926
PACT: Parameterized Clipping Activation for Quantized Neural Networks
Choi, J., Wang, Z., Venkataramani, S., Chuang, P. I.-J., Srinivasan, V., & Gopalakrishnan, K. (2018) · arXiv · doi:10.48550/arxiv.1805.06085 · Cited by 703
Challenges in representation learning: A report on three machine learning contests
Goodfellow, I. J., Erhan, D., Luc Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.005 · Cited by 697
LEARNED STEP SIZE QUANTIZATION
Esser, S. K., McKinstry, J. L., Bablani, D., Appuswamy, R., & Modha, D. S. (2020) · International Conference on Learning Representations · Cited by 666
Data-Free Quantization Through Weight Equalization and Bias Correction
Nagel, M., Baalen, M. V., Blankevoort, T., & Welling, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00141 · Cited by 500
Learned Step Size Quantization
Esser, S. K., McKinstry, J. L., Bablani, D., Appuswamy, R., & Modha, D. S. (2019) · arXiv · doi:10.48550/arxiv.1902.08153 · Cited by 415
Low-bit Quantization of Neural Networks for Efficient Inference
Choukroun, Y., Kravchik, E., Yang, F., & Kisilev, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00363 · Cited by 404
Learning to Quantize Deep Networks by Optimizing Quantization Intervals With Task Loss
Jung, S., Son, C., Lee, S., Son, J., Han, J.-J., Kwak, Y., Hwang, S. J., & Choi, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00448 · Cited by 385
ZeroQ: A Novel Zero Shot Quantization Framework
Cai, Y., Yao, Z., Dong, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01318 · Cited by 381
Facial Expression Recognition: A Survey
Huang, Y., Chen, F., Lv, S., & Wang, X. (2019) · Symmetry · doi:10.3390/sym11101189 · Cited by 195
Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., & Sarkar, N. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.42 · Cited by 144
Facial Expression Recognition with Identity and Emotion Joint Learning
Li, M., Xu, H., Huang, X., Song, Z., Liu, X., & Li, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2880201 · Cited by 128
Towards an Intelligent Algorithm for Profile Authentication and Identification
Jerónimo, N., Portela, F., & Santos, H. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.slate.2024.10 · Cited by 125
Post-training 4-bit quantization of convolution networks for rapid-deployment
Banner, R., Nahshan, Y., Hoffer, E., & Soudry, D. (2018) · arXiv · doi:10.48550/arxiv.1810.05723 · Cited by 115
Jain, S. R., Gural, A., Wu, M., & Dick, C. H. (2019) · arXiv · doi:10.48550/arxiv.1903.08066 · Cited by 115
Recognizing Facial Expressions Using a Shallow Convolutional Neural Network
Miao, S., Xu, H., Han, Z., & Zhu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2921220 · Cited by 110
Accelerating CNN inference on FPGAs: A Survey
Abdelouahab, K., Pelcat, M., Serot, J., & Berry, F. (2018) · arXiv · doi:10.48550/arxiv.1806.01683 · Cited by 107
Facial expression analysis for predicting unsafe driving behavior
Jabon, M. E., Bailenson, J. N., Pontikakis, E., Takayama, L., & Nass, C. (2011) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.46 · Cited by 90
Dual integrated convolutional neural network for real-time facial expression recognition in the wild
Saurav, S., Gidde, P., Saini, R., & Singh, S. K. (2021) · The Visual Computer · doi:10.1007/s00371-021-02069-7 · Cited by 73
Expression Recognition Method Based on a Lightweight Convolutional Neural Network
Zhao, G., Yang, H., & Yu, M. (2020) · IEEE Access · doi:10.1109/access.2020.2964752 · Cited by 53
Facial expression recognition based on Gabor wavelets and sparse representation
Zhang, S., Li, L., & Zhao, Z. (2012) · International Conference on Signal Processing · doi:10.1109/icosp.2012.6491706 · Cited by 37
A FPGA-based Accelerator of Convolutional Neural Network for Face Feature Extraction
Ding, R., Su, G., Bai, G., Xu, W., Su, N., & Wu, X. (2019) · IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC) · doi:10.1109/edssc.2019.8754067 · Cited by 31
FPGA Platform applied for Facial Expression Recognition System using Convolutional Neural Networks
Phan-Xuan, H., Le-Tien, T., & Nguyen-Tan, S. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.04.087 · Cited by 26
Facial Expression Recognition System on SoC FPGA
Vinh, P. T., & Quang Vinh, T. (2019) · 2019 International Symposium on Electrical and Electronics Engineering (ISEE) · doi:10.1109/isee2.2019.8921140 · Cited by 22
Improving Facial Emotion Recognition Systems with Crucial Feature Extractors
Pandey, R. K., Karmakar, S., Ramakrishnan, A. G., & Saha, N. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30642-7_24 · Cited by 17
Wikanningrum, A., Rachmadi, R. F., & Ogata, K. (2019) · 2019 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM) · doi:10.1109/cenim48368.2019.8973312 · Cited by 17
ZeroQ: A Novel Zero Shot Quantization FrameworkPreprint
Cai, Y., Yao, Z., Dong, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.00281 · Cited by 16
Region Based Robust Facial Expression Analysis
Lian, Z., Li, Y., Tao, J., Huang, J., & Niu, M. (2018) · 2018 First Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia) · doi:10.1109/aciiasia.2018.8470391 · Cited by 14
Effects of Modifying the Input Features and the Loss Function on Improving Emotion Classification
Pandey, R. K., Ramakrishnan, A. G., & Karmakar, S. (2019) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2019.8929485 · Cited by 9
Improving Facial Emotion Recognition Systems Using Gradient and Laplacian Images
Pandey, R. K., Karmakar, S., Ramakrishnan, A. G., & Saha, N. (2019) · arXiv · doi:10.48550/arxiv.1902.05411 · Cited by 9
Hardware Implementation of Convolutional Neural Network for Face Feature Extraction
Ding, R., Tian, X., Bai, G., Su, G., & Wu, X. (2019) · 2019 IEEE 13th International Conference on ASIC (ASICON) · doi:10.1109/asicon47005.2019.8983575 · Cited by 6
Facial Expressions Recognition System Using FPGA-Based Convolutional Neural Network
Phuc, T. N. D., Nhut, N. N., Trinh, N., & Tran, L. (2021) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-15-7527-3_33 · Cited by 1
Research works printed but not linked: 2
- 48. JIN-KU KANG (Senior Member, IEEE) received the B.S. degree from Seoul National University, Seoul, South Korea, in 1983, the M.S. degree in electrical engineering from New Jersey Insti- tute of Technology, Newark, NJ, USA, in 1990, and the Ph.D. degree in electrical and computer engineering from North Carolina State University, Raleigh, NC, USA, in 1996. From 1983 to 1988, he was with Samsung Electronics, Inc., South Korea, where he was involved in memory design. In 1988, he was with Texas Instruments, South Korea. From 1996 to 1997, he was with Intel Corporation, Portland, OR, USA, as a Senior Design Engineer, where he was involved in high-speed I/O and timing circuits for processors. Since 1997, he has been with Inha University, Incheon, South Korea, where he is currently a Professor and leads the System IC Design Laboratory, Department of Electronics Engineering. His research interest includes high-speed/low-power mixed-mode circuit design for high-speed serial interfaces.
- 49. YONGWOO KIM (Member, IEEE) received the B.S. and M.S. degrees from Inha University, Incheon, South Korea, in 2007 and 2009, respec- tively, and the Ph.D. degree in electrical engi- neering from Korea Advanced Institute of Science and Technology, Daejeon, South Korea, in 2019. From 2009 to 2017, he was a Senior Engineer with Silicon Works Company Ltd., Daejeon. From 2019 to 2020, he was a Senior Researcher with the Artificial Intelligence Research Division, Korea Aerospace Research Institute, Daejeon. Since 2020, he has been with Sangmyung University, Cheonan, South Korea, where he is currently an Assistant Professor with the Department of System Semiconductor Engi- neering. His current research interests include image/video processing algo- rithm, super-resolution, and deep learning hardware architecture for vision processing.
Cited by
Systematic Review of Emotion Detection with Computer Vision and Deep Learning
Pereira, R., Mendes, C., Ribeiro, J., Ribeiro, R., Miragaia, R., Rodrigues, N. M. M., Costa, N., & Pereira, A. M. D. J. (2024) · Sensors · doi:10.3390/s24113484 · Cited by 111
“Simultaneously, lightweight solutions [93,134] target embedded systems and edge computing with improved results over state-of-the-art CNNs [104,119,124,132,136].”
BackgroundUllah, Z., Qi, L., Hasan, A., & Asim, M. F. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105486 · Cited by 40
6G toward Metaverse: Technologies, Applications, and Challenges
Peng, H., Chen, P.-C., Chen, P.-H., Yang, Y.-S., Hsia, C.-C., & Wang, L. (2022) · IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS) · doi:10.1109/apwcs55727.2022.9906483 · Cited by 49
“However, generating vivid expressions of humans requires emotion recognition, which usually comes from video, audio, and EEG signals [42], [43].”
BackgroundShehada, D. J. M., Turky, A. M., Khan, W., Khan, B., & Hussain, A. J. (2023) · IEEE Access · doi:10.1109/access.2023.3264268 · Cited by 39
“Another lightweight approach is proposed in [17] for real-time expression detection.”
BackgroundMethodA Low-Cost Fully Integer-Based CNN Accelerator on FPGA for Real-Time Traffic Sign Recognition
Kim, J., Kang, J.-K., & Kim, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3197906 · Cited by 23
Self-citation
Metadata
- Authors
- Kim, J., Kang, J.-K., & Kim, Y.
- Affiliations
- Inha University (KR)
- Sangmyung University (KR)
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 104367-104381
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3186146740
- Semantic Scholar
- a22bddd6df37451f8c9882b21854d21696f264d1
- Cited by
- 50
- References
- 62
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 11 · 2023: 14 · 2022: 10 · 2021: 1
- FWCI
- 3.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Embedded Systems and FPGA Applications
- Keywords
- facial emotion recognition, lightweight CNN architecture, embedded systems, real-time inference, shift operations, data caching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.