Identification of Proper Use of Masks Based on Mouth and Nose Detection

  • Denny Hardiyanto Universitas PGRI Madiun
  • Ihtiari Prastyaningrum Universitas PGRI Madiun
  • Umi Kholifah Universitas PGRI Madiun
  • Dyah Anggun Sartika Politeknik Negeri Madiun
Keywords: Mask Identification, COVID-19, Viola-Jones, Face Detection


During the pandemic, the proper use of face masks is very critical to reduce and prevent the transmission of the COVID-19 between people. Unfortunately, many people are still careless about this proper use of masks like using masks to cover only their mouth or chin. There are also people who do not wear masks when traveling or interacting. Such conducts indicate the lack of concern for the mask use. This study aims to obtain an identification algorithm for using the face mask appropriately through digital photos/images. The basic algorithm used was the face, nose, and mouth detection algorithm developed by Viola and Jones. These algorithms were then combined so that they formed a strong algorithm for detecting the proper use of the face mask. The data tested were classified into five categories, namely images of proper use of masks, images of masks with visible noses, images of masks with visible mouths, images of faces with masks worn on the chin, and mixed images with various accessories. Results of the study employed sixty testing images with various variations of attributes, the result obtained an accuracy value of 90%, a sensitivity value of 100%, and a specificity value of 62.5%. The low specificity value was caused by many detection errors in the false positive (FP) attribute, meaning that the system can detect objects other than the mouth and nose. This research is expected to be developed and synergized with other applications so that it can raise public awareness about the proper use of masks.


M.D.C. Pane (2021) “Virus Corona,” [Online],, access date: 4-Apr-2021.

(2020) “Kilas Balik Pandemi Covid-19 di Indonesia,” [Online],, access date: 4-Apr-2021.

T. Anastasia (2021) “Mau Pandemi Usai? Ketahui Pentingnya Gerakan 5M COVID-19,” [Online],, access date: 4-Apr-2021.

M.N. Afifah (2020) “Virus Corona Berpotensi Menyebar Melalui Percikan Ludah,” [Online],, access date: 26-Mar-2021.

N. Azizah (2020) “Warga Bogor tak Pakai Masker Didenda Rp 50.000,” [Online],, access date: 2-Apr-2021.

P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. IEEE Comput. Soc. Conf. Comp. Vis., Pattern Recognit., 2001, pp. I-511-518.

P. Viola and M.J. Jones, “Robust Real-Time Face Detection,” Int. J. Comput. Vis., Vol. 57, No. 2, pp. 137–154, May 2004.

D. Hardiyanto and D.A. Sartika, “Optimalisasi Metode Deteksi Wajah Berbasis Pengolahan Citra untuk Aplikasi Identifikasi Wajah pada Presensi Digital,” Setrum, Vol. 7, No. 1, pp. 107–116, 2018.

P. Indrawan, “Implementasi Sistem Pengenalan Wajah sebagai Penghubung Jejaring Sosial: Aplikasi Mobile untuk Deteksi Wajah dengan Android Face Detector API dan Komunikasi REST ke Komputer Awan,” Undergraduate thesis, Universitas Indonesia, Jakarta, Indonesia, 2012.

W. Ge, Z. Xu, C. Shi, and W. Zhan, “Recognition of Expression-Variant Faces Using SIFT Method,” 2012 Fourth Int. Conf. Comput. Intell., Commun. Netw., 2012, pp. 398–401.

P. Saikia, G. Janam, and M. Kathing, “Face Detection Using Skin Colour Model and Distance Between Eyes,” Int. J. Comput. Commun., Netw., Vol. 1, No. 3, pp. 102–105, Nov.-Dec. 2012.

K. Vikram and S. Padmavathi, “Facial Parts Detection Using Viola Jones Algorithm,” 2017 4th Int. Conf. Adv. Comput., Commun. Syst. (ICACCS), 2017, pp. 1–4.

A. Tawari and M. Trivedi, “Audio-Visual Data Association for Face Expression Analysis,” Proc. 21st Int. Conf. Pattern Recognit. (ICPR2012), 2012, pp. 1120–1123.

[G. Deore, R. Bodhula, V. Udpikar, and V. More, “Study of Masked Face Detection Approach in Video Analytics,” Conf. Adv. Signal Process. (CASP), 2016, pp. 196–200.

R. Liu and Z. Ren, “Application of Yolo on Mask Detection Task,” 13th Int. Conf. Comput. Res. Develop. (ICCRD), 2021, pp. 130–136.

N.U. Din, K. Javed, S. Bae, and J. Yi, “A Novel GAN-Based Network for Unmasking of Masked Face,” IEEE Access, Vol. 8, pp. 44276–44287, Mar. 2020.

J. Zhang, F. Han, Y. Chun, and W. Chen, “A Novel Detection Framework About Conditions of Wearing Face Mask for Helping Control the Spread of COVID-19,” IEEE Access, Vol. 9, pp. 42975–42984, Mar. 2021.

M.S. Ejaz and M.R. Islam, “Masked Face Recognition Using Convolutional Neural Network,” 2019 Int. Conf. Sustain. Technol. Industry 4.0 (STI), 2019, pp. 1–6.

I.B. Venkateswarlu, J. Kakarla, and S. Prakash, “Face Mask Detection Using MobileNet and Global Pooling Block,” 2020 IEEE 4th Conf. Inf., Commun. Technol. (CICT), 2020, pp. 1–5.

B. Yilmazer and S. Solak, “Cloud Computing Based Masked Face Recognition Application,” 2020 Innov. Intell. Syst., Appl. Conf. (ASYU), 2020, pp. 1–5.

M.S. Ejaz, M.R. Islam, M. Sifatullah, and A. Sarker, “Implementation of Principal Component Analysis on Masked and Non-masked Face Recognition,” 2019 1st Int. Conf. Adv. Sci., Eng., Robot. Technol. (ICASERT), 2019, pp. 1–5.

M.D. Puto, T.B. Adji, and B. Winduratna, “Sistem Deteksi Wajah dengan Menggunakan Metode Viola-Jones,” Semin. Nas. Science, Eng. Technol., pp. 1–5, 2012.

How to Cite
Denny Hardiyanto, Ihtiari Prastyaningrum, Umi Kholifah, & Dyah Anggun Sartika. (2022). Identification of Proper Use of Masks Based on Mouth and Nose Detection. Jurnal Nasional Teknik Elektro Dan Teknologi Informasi, 11(4), 244-250.