2011 8th International Multi-Conference on Systems, Signals & Devices

MULTIMODAL BIOMETRIC SYSTEM BASED PALMPRZINT AND IRIS

Randa BOUKHRIS TRABELSI, Imene KHANFIR KALLEL andDorraSELLAMI IMASMOUDI Computers Imaging Electronics and Systems Group(CIELS) ICOS Research Unit University of Sfax, Sfax Engineering School, BP W,3038 Sfax, Tunisia Phone: (2 16-74) 274.088, Fax.(216-74) 275.595. Emails: trabelsiboukhrisranda@live.fr, imen. khan-fi r@betatex. com.tn, dorra.masmoudi~ieee.org
ABSTRACT Biometric technology identifies individuals automatically using their physiological and/or behavioral characteristics, The uni-modal biometric systems can recognize a person using a single biometric modality, but can not guarantee with certainty the proper identification. Moreover, these systems can present a variety of problems such as noisy data, the intra-class and unacceptable error rates. Some of these limitations can be addressed by the deployment of multimodal biometric systems that incorporate elements presented by multiple sources of information. In this paper, we present a new fusion technique of biometric signatures from the palmprint and iris. For iris recognition, we employ fractal analysis method, while a Local binary patterns (LBP)is used for palmprint recognition. Finally, the scores are fused to authenticate the identity using the new fusion scheme. Index Terms- Palmprint recognition, LB3P, Iris recognition., Fractal, Fusion, Score level, Multimodal Biometrics.2. it is more difficult to obtain and reproduce several features only. It exists in the literature, different approaches applied in multimodal biometric system [lI] [2] [3]. In this paper, we explore a new technique for fusion of biometric signatures from the palmprint (natural and non-intrusive method) and iris (one of the most accurate termns) and the score level fusion. in feature extraction of palmprint, we used the operator of local binary pattems(LBP) , this operator was introduced by Ojala et al in 1996 [4]. Iris recognition is performed using a new method based a fractal analysis. Thus the two recognizers (palmprint, iris) are combined at the match score level and the results as final decision allow us to validate the persons identity. This paper is organized as follows. Section 2 and 3 gives the feature extraction of the iris and palmprint. Section 4 presents the phase of classification . Section 5 contains a fusion between palmprint and iris and experimental results .In Sectin6w-falzdbacoluo. RECOGNITION PROCESS OF PALMPRINT 1. INRODUTIONThe recognition process of palmprint, shown by the -figurelI costsffurmdl. Biometrics is a term we hear more and more about life everyday. Biometrics is a technique for identifying a person through -his morphological and/or behavioral charac-Acusto therstis.%Bome ric sysftemta +rel+ o the evalatio of

Acuiito

2.1. Aquisition This phase is always proven to be very important in a processing chain image. Indeed, a good acquisition can pick up information. In the opposite case, a bad acquisition would cause the system to fail. In this step, we used theL CASIA database (Chinese Academy of Sciences of institution who Automation). This database is used for further research and advances in recogonition algorithms for palmprintjl5]. The database CASIA contains 5,230 palmprint of 3 12 subjects with 5493 images captured from 3 10 palmprits f eope. n ou daaba dffernt e31 ar files: All images shown on the records from 303 to 312 ae captured using different cameras and lenses. These images are taken by all other images stored in files I to 302. 2.2. Detection and extraction the region of interest The extraction of region of interest (ROI) is divided into 3 parts. First, in a step of segmenting the hand is separated by hand from behind plan such as a appliqant thresholding method. Then, an algorithm is used to detect the valleys of the fingers. Finally, these valleys are used for locating the palmprint region. Figure2 depicts the result of bloc detection and extraction the region of interest, 2.4. Feature extraction The original LBP operator was introduced by Ojala and al in 1996 [4]for the texture classification. This operator associates a label to each pixel of the image by thresholding 3x3 neighborhood of pixels located at the same distance from a central pixel with its value thereoflj6].The result obtamned is a binary number.Its given by these equations:
P-1

bloc of

Figure 3. processing.

palmprint image before and after pre-

tesaeb lcigtefle thg rdet ope serve the contour. Finally, we improve the contrast and sharpness of palmprint images and the dominant features in the palmprint as the main lines and ridges by a process of histogram equalization. Figure3 shows a palmprint image before and after pre-processing.

LBPP,R with,
(a) 1~)

s(gp, - g,)2P

(1)

P=O

if

> 0

S(x)

=(2)

0else
The idea is to apply the operator LBP taking eight neighborhoods and unit radius. LBP includes a heavy step interpolation of the image to generate the neighbors that do not correspond to image pixels. To overcome this drawback, an approximation can be applied as follows: the neighbors who do not correspond to the pixels of the image pixel

d)(e

Figure 2. Bloc of detection and extraction the region of interest:(a) the original hand image,(b) segmented image

I ... p....
Figure 4. Example of images generated by the simplified opertor BP.Figure olding. pixels.All images are of format "bmp". They are listed in 108 directories, because an individual folder. Each directory contains two subdirectories named "1" and "2" cor-.. responding respectively to the first and second session of shooting. 3.2. Localisation The iris localization is a fundamental step for the success of the treatment that follows. To locate the iris, it is prop osed to detect its internal and external contours, based on the distribution of gray levels within the iris and its vicinity[8]. The inner contour of the iris corresponds to that of the pupil. This region of the human eye has the distinction of being the darkest object in the image. Its location is ensured thanks to its peak in this histogram of gray levels of the entire image(see figure5). Following this observation, it was thought to employ a method of segmentation by pixel classification [9]. This method of region segmentation techniques generally used thresholding histograms. Several techniques for automatic selection of threshold, the algorithm as a minimum, intermeans, of intermode, triangle, minerror or entropy have been studied [10] [ II]then tested to isolate the pupil. Its contour is then ~- sutrctn ~ ~ generated th biar imgeby deie fo ~
. ..

5. Location of the pupil by the histogram thresh-

..

~..

Figure 6. Iris before and after the normalization phase. Cartesian coordinate system Polar coordinate systemn.Its is gvnb h olwn qain gvnb h olwn qain I (x (r; 9); y (r; 9)) -+ I (r; 9) (3) In the new polar coordinate system, the compensation of any movement that is horizontal, vertical or even a combination of both, is due to the inclusion of the pupil center as reference point. In its normalisation strategy, Daugman adpoi haalobeinrstdnivracefsale.

Figure 7. Status Points (XP,

yp,)

and (xi, yi).

changing the subject's position relative to the position of light sources on the one hand, and the change of lighting (4) 0.5 -- AUG -< 1 < environment for acquiring the other. To overcome these problems, Ma et al [1 3]have proposed a very interesting strategy.The latter is composed by two steps:5.FSO OFPL RITADRS a) Correction of the light distribution:To simulate a uni5.FSIN OF AMPRINTADII form distribution of light within the image, we calculateBIMTI an estimate of the brightness of the background texture of In the classification approach, a feature vector is constructed the ris.using the scores given correlation output by individual matchb) Contrast Correction: Since a very small range of variaes hsvco ste sindt n ftocass tio ofgra leelsdonotdisingishthefie dtais o th 1accepted" (genuine user or "'genuine use") or "rejected" texture of the iris, the contrast looks a correction necessary (user or impostor "impostor user"').In general, the classiusing histogram equalization. fier used for this operation is capable of learning the deci3.4. Feature extraction poposd Ine tis ectin, anew ethd fr exracing yis mehdfoexractil ngl onac anew Intthibtssetofn, wei propsed fraoctalfutatinalss. ofratal anaelniis thtd atrbuesf based on hen tudyhofrloca fluctuations of tatr pixelse n the yis ae s ofrapattr whmensobserved diforenth repetitionsTh inmthe sarc fractal dmnionDF differen reouions Thicnevovn ath imaagtries the space where it is represented. More DF is more great sion boundary irrespective of how the feature vector was generated.Thus, the output scores from different modalities can be non-homogeneous (distance measuring or similarity, different ranges of values taken, etc..) and no treatment is required before sending in the classifier. Figure correspond to the block-diagram of the proposed multimodal biometrics system integrating iris and palmprint. It exists in the literature, different approaches applied in mulioabomtcsye.
amrn templates

evaluation. Under biometric, this curve represents the evolution of true positive rate (TP) against the false positive rate (FP). The study of this curve to determine the performance of a biometric system. In fact, it shows the progress of the system studied, where the threshold discrimination varies.The curve of an ideal system for complete separation, passes through the point (0.1).A system that completely missed, which makes no separation, is the first bisector. Thus, The area under the ROC curve (AUC), provides information on system performance. We believe that a recognition system gives a recognition rate as reasonable if it satisfies the following equality:

developments of the object is "Chaotic".he technique being proposed is to quantify the evolution of the roughness of the texture within the iris and its fragmentation in its x
Ptnrn

landmark polar.his quantification is by calculating fractal

dimensions local fragments of contour map the texture of

exaractio

etr

Mthn sin ltiin

Mattchtng

the iris.In fact, it is proposed to share the image of the texaetue ture in 256 blocks, then calculate the fractal. dimension of ~ each block. It retrieves a vector of 256 elements. Each~ thmdsrbsteireuaiyo of~ ~ ~ ~ ~ h txuewti ~h ~ ~ ~ ~ cY~ntn ~ ~

Dcio

using a simple sum. Combining the average scores is to s S 1opt N

Ni=1

7. REFERENCES [1I] A. Ross and A. Jain,Information fusion in biometrics, Pattern Recognition letters, vol. 24, pp. 21152125, 2003. [2] F. Yang and B. Ma, A new mixed-mode biometrics information fusion based-on fingerprint, hand-geometry and palm-print, in Proc. 4th Int. IEEE Conf. Image Graph., 2007, pp. 689693. [3] J. Cui, J. P. Li, and X. J. Lu, Study on multi-biometric feature fusion and recognition model, in Proc. Int. IEEE Conf. Apperceiving Comput. Intell. Anal. (ICACIA),pp. 6669, 2008. T. Ojala, M. Pietikinen, and D. Harwook, A comsuyof texture mesrswith classification on feature distribution, PatternRecognition 29 CASIA palmprint Image Database, Inst. Auof Sciences, Academy Chinese

Si

(5)

The Receiver Operating Characteristic (ROC) curve obtained using fusion at score level as shown in figure 9.Thus, the area under the ROC curve, provides informnation on system performnance. The more it approaches unity, the more the system is performance.The graph in Figure 1, lets you view the perform-ance obtained by this criteria,

09 08parative 0.7

.[4]

.based

0.5[5] 0O.4 03 02[6] 01mpin 0.C 20 40 60

. .tomation, .http://www.sinobiometrics.coml.

rate falsepositive

Timo Ojala, Matti Pietikainen, Topi Maenpaa, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Transactions on Pattern analysis and machine intelligence vol.24, no.7, july 2002. Inst. Auiris Image Database, [7] CASIA Academy of Sciences, tomation, Chinese http://www.sinobiometrics.coml. Khanfir Kallel, D. Sellami Masmoudi and N. Der[8] I. bel, "A Wavelet Network Based Approach For Iris Localization", Transactions on Systems, Signals and Devices, Vol. 3, No. 3, pp. 349-369, 2008. [9] I. Khanfir Kallel, D. Sallemi Masmoudi, N. Derbel, "An Iris Extraction Technique For Person Authentication System Use", SSD'05, Tunisia, March 2005. [10] I. Khan-fir, A. Kallel, K. Taouil, M. S. Bouhlel et L. Kaon Sgenaindiagsprsul

Figure 9. Receiver Operating Characteristic (ROC) curve showing the performance when sum rule is used to combine the matching scores of palmprint and iris.

he OC crveshoingtheperorTabl 1.Are uner uner he Tabl 1.AreOC crveshoingtheperormance when sum rule is used to combine the matching scores of paimprint and iris. Biometric modality Area under curve 0.93 Iris 0.857 Palmprint Iri Pamrit0.98 and