ABSTRACT

Auto teller machines (ATM) are highly susceptible to crimes such as robbery, card fraud, card
skimming theft, cash theft and machine vandalism. Despite having video surveillance camera
ATM robbers or criminals are not afraid of committing crime. The reasons could be the
contemporary surveillance camera is only used for viewing from distant control room and
recording the incident. The security guard is usually occupied with so many monitors in the
distant control room that he is unable to give continuous attention to each monitor. On the
other hand, the recorded videos are used for forensic investigation of the robberys aftermath.
The video recording is unable to reveal the face information of the criminals significantly in
post crime investigation, since criminals usually cover their faces with some accessories
when they commit crime as reported in the recent news. The use of covered face detection
and warning alarm for crime prevention is also lacking due to insufficient covered face
detection technology in ATM surveillance camera. This thesis proposes a method for
uncovered, partially covered and fully covered face detection based on facial Width-to-Height

fWHR
Ratio ( ) theory, which is originated from rules of visual arts. Specifically, detecting
the face region using skin color, the method calculates the facial area and corresponding

fWHR fWHR
. Based on the value of , the method estimates the covered region by
morphological closing and according to ellipse area formula. The method can help make a
decision based on the estimated percentage of the covered region. The experimental result
shows that the proposed method achieves the detection rate of 98.3%, 93.3% and 97.78% for
full covered, uncovered and partially covered faces, respectively. The overall correct
detection rate is 96.48%, which is found to be better than previous studies. The proposed
method can also be used to develop a warning alarm system to detect potential ATM
criminals with covered face. Besides, this thesis is expected to contribute an innovative
covered face detection method to automatic face recognition systems research area. In
addition to the ATM surveillance camera, the method can be applied to face recognition based
secured entry such as, doorbell camera, airport security, border security and other
surveillance systems.
Mesin juruwang automatik (ATM) sangat terdedah kepada jenayah seperti
rompakan, penipuan kad, kecurian, permalsuan kad, kecurian wang tunai
dan aktiviti vandalisme.

Walaupun mempunyai sistem pengawasan video kamera, perompak ATM

atau penjenayah tidak takut melakukan jenayah.

Hal ini berikutan kamera pengawasan kontemporari hanya digunakan

untuk melihat dan merakam sesuatu kejadian dari bilik kawalan.

Pengawal keselamatan biasanya sibuk dengan banyak monitor di dalam

bilik kawalan.

Justeru itu, pengawal keselamatan tidak dapat memberi perhatian yang

berterusan untuk setiap monitor.

Video yang dirakam digunakan untuk siasatan forensik selepas rompakan

itu.

Walaubagaimanapun, rakaman video tidak dapat mendedahkan maklumat

muka penjenayah dengan jelas

Hal ini berlaku demikian kerana penjenayah biasanya menutup muka

mereka dengan beberapa aksesori ketika mereka melakukan jenayah
seperti yang dilaporkan dalam berita semasa.

Penggunaan sistem pengecaman muka tertutup dan penggera amaran

untuk pencegahan jenayah juga kurang berkesan kerana kelemahan
teknologi pengecaman muka dalam kamera ATM pengawasan.

Tesis ini mencadangkan satu kaedah untuk pengesanan muka tanpa

bertutup, separa tutup dan tutup sepenuhnya berdasarkan teori muka-
Nisbah Lebar ke Tinggi (fWHR) yang berasal dari kaedah-kaedah seni
visual yang secara khususnya dapat mengesan kawasan muka
menggunakan warna kulit, kaedah mengira kawasan muka dan memadan
fWHR
.

This thesis proposes a method for uncovered, partially covered and fully covered face
fWHR
detection based on facial Width-to-Height Ratio ( ) theory, which is originated from
rules of visual arts. Specifically, detecting the face region using skin color, the method
fWHR
calculates the facial area and corresponding .
 fWHR
Berdasarkan nilai , kaedah ini dapat kawasan bertutup dengan
penutup morfologi bertutup dan mengikut formula kawasan elips.

fWHR
Based on the value of , the method estimates the covered region by morphological
closing and according to ellipse area formula.

Kaedah ini boleh membantu membuat keputusan berdasarkan anggaran

peratus kawasan yang dilindungi.

Hasil eksperimen menunjukkan bahawa kaedah yang dicadangkan

masing-masing mencapai kadar pengesanan sebanyak 98.3%, 93.3% dan
97.78% bagi kes bertutup penuh, tanpa bertutup bertutup dan separa
tutup,

Purata pengesanan keseluruhan adalah 96,48%, dimana lebih baik

daripada kajian sebelumnya.

Kaedah yang dicadangkan juga boleh digunakan untuk membangunkan

sistem penggera amaran untuk mengesan potensi penjenayah ATM
dengan muka yang dilindungi.

Selain itu, tesis ini dijangka dapat menyumbang dalam bidang kajian
kaedah pengesanan muka tertutup secara automatik

Sebagai tambahan kepada kamera pengawasan ATM, kaedah ini boleh

diaplikasikan alatan pengecaman wajah yang lain seperti yang terdapat di
kamera loceng pintu, keselamatan lapangan terbang, keselamatan
sempadan dan sistem pengawasan lain.