Professional Documents
Culture Documents
Abstract: - This paper presents a method for recognition of the vehicle number plate from the image using neural nets and
mathematical morphology. The main theme is to use different morphological operations in such a way so that the number
plate of the vehicle can be extracted efficiently. The method makes the extraction of the plate independent of color, size
and location of number plate. The proposed approach can be divided into simple processes, which are, image
enhancement, morphing transformation, morphological gradient, combination of resultant images and extracting the
number plate from the objects that are left in the image. Then segmentation is applied to recognize the plate using neural
network. This algorithm can quickly and correctly recognize the number plate from the vehicle image.
Key-Words: - Mathematical morphology, morphological gradient, vehicle number plate, morphing transformations, image
enhancement.
edge densities in the region, etc. This approach was 3 Proposed Technique
commonly used in finding text in images, and could well The proposed technique [11] for the recognition involves
be used for discovering and designating candidate extraction of vehicle number plates using mathematical
number plate areas as they include alphabets and morphology techniques, character segmentation, use of
numerals. Another approach uses color image processing neural network for recognition of characters, Fig. 1. The
[5] for the detection of the number plates. In this word “morphology” commonly [3] denotes a branch of
approach a color histogram and a fixed horizontal to biology that deals with the form and structure of animals
vertical ratio is used to extract the number plates. and plants. We use the same word here in the context of
In addition, there have been a number of other “mathematical morphology (MM)” as a tool for
methods relating to this problem focusing on detecting extracting image components that are useful in the
VNP using artificial intelligence and genetic algorithms representation and description of region shape, such as
[7], [16]. These systems used edge detection and edge boundaries, skeletons, and the convex hull.
statistics and then AI techniques to detect the location of We are interested also in morphological techniques for
the number plate-designate area. All of the systems pre- and post-processing, such as morphological filtering,
discussed above have some kind of limitations for thinning, and pruning. The language of mathematical
example they are plate size dependent, color dependent, morphology is set theory. Approaches based on the
work only in certain conditions or environment like morphology of objects in an image are presented in [3].
indoor images etc. The method that we are proposing is This approach focuses on some salient properties of
independent of color, size, location and angle of the remotely sensed images such as their brightness,
number plate of the vehicle. Post-processing can be done symmetry, angles, etc. Due to these features, this method
to check the validity of the plate. could be used to detect the similar properties in a certain
The organization of rest of the paper is as follows: image and locate the position of the desired objects.
Section 3 describes the proposed technique adopted for In Fig. 1 we have not presented the image
recognition of the number plates of vehicles, Sections 4 enhancement or pre-processing part, because for most of
& 5 discuss the processes of extraction of number plates the number plates we follow the processes step by step.
from images and processes of segmentation and For already extracted plates we may or may not use pre-
recognition, while in section 6 we describe the processing and go to character segmentation process. We
experiments performed on the images and analyze the consider the different processes in the next two sections.
results in next section. Section 8 concludes our work.
Car Image
4 Extraction of Vehicle Number Plates
This process [10] consists of the following five
processes, as shown in Fig. 2. Image enhancement,
morphological transformation, morphological gradient,
Extraction of VNP combination of the two images obtained from the top or
bottom hat transformations and morphological
operations, resulting in the vehicle number plate
designate confirmation. The two steps, that is,
Character Segmentation morphological transformation and morphological
gradient may be performed in parallel using the parallel
processing software or hardware.
VNP Recognition
Combination of
resultant images
Plate region
confirmation
3a 3b
Figure 3a Original image and 3b shows the result of
intensity and contrast adjustments.
Figure 5. Structuring elements: (a) Box, (b) Rhombus, 4.4 Morphological Operations
and (c) Square Mathematical morphology commonly refers to a broad
set of image processing operations that process images
based on shapes. There are several morphological
4.3 Hat Transformations operations but we use only dilation and erosion for the
Hat transformations can be used for contrast purpose of number plate extraction. The subtraction of
enhancement. There are two hat operations and are an eroded image from its dilated version produces a
known as the top hat and bottom hat transformations [3]. morphological gradient, which is a measure of local gray
Tophat operation is actually the result of subtraction of level variation in the image. Mathematically,
an opened image from the original one, mathematically, g = (f ⊕ b) - (f θ b) (3)
th = f – (f D b) (1)
where, f is the input image and b is the structuring
element.
Fig. 8 illustrates the combination results. This gave us coordinates of the vehicle number plate. Fig. 9 presents
even fewer designated areas which were present in both the extracted number plate.
of the resulting images. i.e. the hat transformation and
the morphological gradient.
the rule of the thumb for capacity of the network. that an off-chip memory be accessible. This is necessary
According to rule of the thumb the capacity is to store neuron parameters and state information.
0.13 x N = 15.6 or 15 rounding off. As we have seen, MOSTs provide a natural way to
So we can store 7 more memories. Eight patterns were implement functional requirements of simple neurons in
used as fundamental memories in the storage (learning) analog VLSI. These have been used in the design of
phase of the HNN to create weight matrix W. The silicon retinas. Bio-inspired VLSI systems that employ
retrieval (recall) phase of the net’s operation was analog components lie well beyond the arena of
performed asynchronously, as described in the Table 2 conventional digital computing, and have found
for 25% error. The Mean number of iterations is 30. widespread applications. For example, various
Tables 3 - 6 present the recall at other error percentages. applications such as the silicon retina and NM systems
When we perform the recognition of numerals, are based on the design of a diode-capacitor integrator.
alphabet or characters, we are recognizing the parts of a Carver Mead’s not so recent book was the first
number plate, thus we can recognize the vehicle number comprehensive reference on this subject [83].
plates. A number of pulsed neuron implementation models
have been presented nicely in. In this context, returning
to conductance based model, a 112 compartment VLSI
5.1 Post-processing NM neuron has been designed by Elias and Northmore.
We can also perform post-processing to know the Dendrites in the model use integrate and fire (IF)
Chinese character, so that the region can be identified. neurons. Boahen used an extension of an IF neuron in a
Conversion of Character to Pin Yin [12]. The procedure NM retina. The use of digital amplitude signal such as
of automatic converting characters into Pinyin are as that employed in an action potential model are robust to
follows: noise and have been used in VLSI NNs. Other digital
* For single-Pinyin characters, directly convert the encoding techniques that use broadcast of action
character to Pinyin potential events include address-event representation
* For multi-Pinyin characters, search the word- base. If (AER) and virtual wires. Even closer to neurobiology,
the character is a part of a multi-character-word, select excitatory and inhibitory shunting synapses have been
the corresponding Pinyin syllable among the words approximated in silicon by Douglas and Mahowald.
* If a character is described in a Pinyin syllable bi-gram
or tri-gram data, select the corresponding Pinyin syllable.
* For a character which cannot be processed in above 6 Experiments
three steps, select the Pinyin syllable with the high Experiments were performed to test the efficiency and
frequency. accuracy of the proposed technique. 250 color images
For Korean number plates [5], there are 15 were used for testing the technique. All the images being
geographical names, and some characters are often normalized to just about 640 x 480 because some images
confused. But this kind of problem is solved by using were double this size and also it is normal to use the size.
post-processing, which may involve using a character For improving the complexity and generality of the test
dictionary. databases, the images were acquired from the highways,
For Japanese plates a method similar to [5] or [12] can car parks, at different lighting condition (cloudy, sunny,
be adopted to get the characters. daytime, night time) and different kinds of vehicle (van,
Further, this system can be modeled for truck, car).
implementation on FPGA hardware. The FPGAs [17] The images were taken of different color and variable
offer the most promising approach to emulation of NN sized number plates, also the images were irrespective of
models. An FPGA chip has a very large number of the angle and orientation of the camera. Some images
combinational logic blocks (CLBs) and generic contain Chinese and Arabic characters as in Fig. 11.
interconnect. Chip level functionality is determined by Also many images were acquired using the worldwide
the connectivity pattern that is specified in a vector of web. These results report a high accuracy rate of above
configuration bits. The configuration bit vector is 95%.
downloaded onto the chip through proper hardware and
software that permits high level logic to be expressed in
an HDL and finally into a configuration bit vector. In
order to emulate NNs, the memory requirements demand
Figure 11 The vehicle number plates in the images as Table 4 Results of the recall at 10% error.
well as an extracted vehicle plate.
Pattern No. of iterations
0 11
7 Analysis 1 10
Comparison of the results derived from proposed 2 17
method with other techniques. The other methods were 1. 3 16
Feed-Forward Neural Network [7], 2. Hough Transform 4 17
[2], 3. Back-Propagation Network [6], and 4. Maximum 6 11
Entropy method [8], respectively. Comparison of results 10
has been tabulated in Table 1, with these methods and 9 17
our proposed method, where the new method
corresponds well to the other methods of extraction. In Table 5 Results of the recall at 15% error.
our case, there were some cars that had no number plates
attached to them. Pattern No. of iterations
Table 1 Comparison of results for extraction 0 19
1 22
Method Correct Reject Other No 2 14
plate 3 19
1 90.00 % 8.00 % 2.0 % 4 16
2 92.85 % 7.15 % 6 22
3 95.0 % 5.00 % 25
4 93.00 % 7.00 %
9 17
PM 94.00 % 2.00 % 4.00 %
Appendix:
8 Conclusions Fig. 12 shows the sample plate with its measurements.
This is a sample of number plate that is used on Chinese
This paper describes an algorithm that allows the
vehicles [13]. In this plate, first there is a Chinese
recognition of vehicles’ number plates using hybrid
character that represents one of the provinces,
morphological techniques including hat transformations
municipalities, autonomous regions of China. The
and morphological gradients and neural networks. The
second is the Roman letter to represent the city. The
main advantage of the technique that we propose is the
third and fourth can be a letter or a number, while all
high accuracy of the technique that works irrespective of
remaining are numbers.
the color, size, location, and angle of the number plates.
Also, this figure shows that the numbers are embossed
Although the technique is quite efficient enough to
on a metallic sheet. The background is blue, the
work very well in the real time environment but
character or numerals are white. For buses and other
currently the technique proposed lays more emphasis on
vehicles, the typical background colors can be white,
the accuracy of the overall system, while the some more
yellow, and black. In buses, motorcycles, the front and
work is to be done to make the technique more efficient.
rear number plates are different in dimensions.
The authors are developing a vehicle detection system in
“Flschungserschwerende Schrift”, used [15] on
which the VNP is a main part, we want to use vehicle
German plates to hinder falsification. Note that normally
noise signature for detection of vehicle through its
similar glyphs (e.g. O and Q) are distinct in shape. This
engine sound. Also, future work is intended to
is illustrated in Fig. 13, and is an example of adapting
implement this system on FPGAs.
characters to simplify the pattern recognition task.
Japanese [15] use two types of plates yellow and
white depending on the vehicle engine.
Complex operations of Mathematical Morphology are
based on some simple operations such as opening and
closing, erosion and dilation.
Dilation and Erosion
The gray-scale dilation of f by SE b, denoted f ⊕ b, is
defined as
(f ⊕ b)(x, y) =
max{ f ( x − x / , y − y / ) + b( x / , y / ) | ( x / , y / ) ∈ Db }
(4)
where Db is the domain of b, and f(x, y) is assumed to
Figure 12 Sample number plate. equal - ∞ outside the domain of f.
[13] GA666-2006. People’s Republic of China [16] Sulehria, H.K., Zhang, Y.. Hopfield Neural
regulations for vehicles number plates (in Chinese). Nov, Networks: Model, Applications, and Implementations.
2006 WSEAS Transactions on Computer Research. February
[14] Malaysia to embed car license plates with 2007, pp. 156-159.
microchips to combat theft. International Herald [17] Kumar, S.. Neural Networks, McGraw-Hill, China,
Tribune, Dec. 8, 2006. 2006.
[15] Web page of http://thefreedictionary.com for [18] Snyder, W.E., Qi, H.R.. Machine Vision.
number plates regulations of many countries. Cambridge University Press, Cambridge, UK. 2004.