Professional Documents
Culture Documents
www.elsevier.com/locate/jfoodeng
Abstract
The growth in the popularity and consumption of pizzas has led to the need for automated quality inspection, so as to maintain
condence and increase production eciency. In the current research the use of computer vision for inspection of pizza base and
tomato sauce spread quality was investigated. Twenty pizza bases were analysed for base area, spatial ratio I (SRI), spatial ratio II
(SRII), and circularity. For the measurement of the sauce spread characteristics based on 25 samples, the indexes taken were sauce
area and heavy area percentage; a fuzzy logic system was then developed to classify the sauce spread samples into classes of acceptable and defective quality. The base area analysis gave a classication error of 13% when compared to human assessment. The
experimental results for the sauce spread analysis show that by using computer vision in conjunction with fuzzy logic a classication
accuracy of 92% can be achieved.
2002 Elsevier Science Ltd. All rights reserved.
Keywords: Computer vision; Pizza sauce; Pizza base; Fuzzy logic; Machine vision; Quality; Image processing; Pizza
1. Introduction
The pizza industry has continued to grow with unprecedented momentum in recent decades, leading to the
development of modern manufacturing processes and
facilities. However with the ever increasing production
eciency, the maintenance of quality is often dicult
due to changing production conditions and the inherent
sensitiveness of pizza-making. Much research has been
conducted in this area which focused on the individual aspects of pizza crust, sauce and cheese inspection
in order to achieve the desired quality (Burg, 1998).
However, quality assessment of pizza products is also
based on their appearance, with such aspects as the
shape of pizza base, sauce distribution, and topping
distribution being especially important in the present
competitive markets.
The quality of the pizza base and sauce plays an
important role in the overall quality of the whole pizza,
*
Corresponding author. Tel.: +353-1-7165528; fax: +353-14752119.
E-mail address: dawen.sun@ucd.ie (D.-W. Sun).
URL: http://www.ucd.ie/refrig.
0260-8774/02/$ - see front matter 2002 Elsevier Science Ltd. All rights reserved.
PII: S 0 2 6 0 - 8 7 7 4 ( 0 2 ) 0 0 2 7 5 - 3
82
Fig. 1. Classes of pizza bases found by human assessment. (a) Standard; (b) poor pressing; (c) poor alignment; and (d) owing base.
83
Fig. 2. Classication of pizza sauce spread characteristics by quality personnel. (a) Reject underwipe; (b) acceptable underwipe; (c) even spread; (d)
acceptable overwipe; and (e) reject overwipe.
84
85
Fig. 4. Segmentation of a sample on the basis of light and heavy zones of sauce. (a) Original image of even spread sample and (b) image after
segmentation where white zones are the light sauce spread areas.
86
Table 1
Shape analysis of pizza bases
Base area
(cm2 )
SRI
SRII
Circularity
Sample
1
2
3
4
5
424.70
394.69
h386.49i
h387.78i
390.79
h0.81306i
0.94323
0.94447
0.93440
0.93020
h0.90273i
0.95796
0.94023
0.92971
h0.91764i
h14.591i
h14.425i
h14.212i
h14.238i
h14.137i
Reject
Reject
Reject
Reject
Reject
Poor
Poor
Poor
Poor
Poor
alignment
alignment
alignment
alignment
alignment
1 h381.12i
2 402.23
3 397.30
4 410.23
5 h384.68i
0.94596
0.92069
h0.87400i
0.92041
0.92967
h0.91713i
h0.91972i
0.92650
0.95046
0.94272
h14.119i
h14.439i
14.070
h14.226i
h14.095i
Poor
Poor
Poor
Poor
Poor
pressing
pressing
pressing
pressing
pressing
h379.52i
399.44
391.56
390.90
403.12
0.95578
0.94981
0.94729
h0.89377i
0.94155
0.92527
0.95895
0.94156
h0.92211i
0.95934
0.93802
0.94948
0.90984
0.95005
0.93629
0.96373
0.97021
0.92221
0.96190
0.95902
Sample
Flowing
Flowing
Flowing
Flowing
Flowing
base
base
base
base
base
Standard
Standard
Standard
Standard
Standard
1
2
3
4
5
1
2
3
4
5
390.47
396.34
399.48
397.06
395.73
Pizza base
area (cm2 )
Sauce area
(cm2 )
Heavy area
(cm2 )
399.42
412.97
393.83
398.46
393.16
287.88
315.88
321.01
279.21
330.81
163.61
219.73
187.05
168.83
241.18
Acceptable underwipe 1
Acceptable underwipe 2
Acceptable underwipe 3
Acceptable underwipe 4
Acceptable underwipe 5
387.80
386.24
403.97
392.77
402.61
322.37
335.92
367.98
346.43
363.88
247.78
265.88
272.27
272.00
270.03
h14.174i
h14.196i
14.066
14.057
14.064
Even
Even
Even
Even
Even
394.94
382.75
376.55
397.32
405.16
338.62
340.91
350.23
353.12
359.62
264.73
230.25
249.60
268.91
254.37
14.031
13.981
14.031
14.002
14.094
Acceptable
Acceptable
Acceptable
Acceptable
Acceptable
402.69
399.87
381.30
409.96
411.54
369.75
372.25
360.94
386.76
362.05
249.57
286.49
285.62
298.47
264.07
404.61
414.15
395.79
419.22
405.76
382.54
404.77
373.83
410.06
374.57
298.57
328.11
254.96
344.04
282.27
The gures in the bracket are out of the limit of the standard shape.
The gures with an asterisk ahead are limit value of the four indices
for the standard shape, respectively.
Numbera
Ratio (%)b
a
Base area
SRI
SRII
Circularity
5
33.3
3
20
4
26.7
11
73.3
underwipe
underwipe
underwipe
underwipe
underwipe
spread
spread
spread
spread
spread
Reject
Reject
Reject
Reject
Reject
1
2
3
4
5
1
2
3
4
5
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
1
2
3
4
5
1
2
3
4
5
87
Table 4
Sauce distribution analysis of the pizza samples with pizza sauce
Sample
Reject
Reject
Reject
Reject
Reject
underwipe
underwipe
underwipe
underwipe
underwipe
Acceptable
Acceptable
Acceptable
Acceptable
Acceptable
Even
Even
Even
Even
Even
underwipe
underwipe
underwipe
underwipe
underwipe
spread
spread
spread
spread
spread
Acceptable
Acceptable
Acceptable
Acceptable
Acceptable
Reject
Reject
Reject
Reject
Reject
1
2
3
4
5
1
2
3
4
5
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
1
2
3
4
5
1
2
3
4
5
1
2
3
4
5
Sauce area
percentage (%)
Heavy area
percentage (%)
72.07
76.49
81.51
70.07
84.14
56.83
72.73
58.27
60.47
72.91
83.13
86.97
91.09
88.20
90.38
76.86
79.15
73.99
78.51
74.21
85.74
89.07
93.01
88.62
88.76
78.18
67.54
71.27
76.15
70.73
91.82
93.09
94.66
94.34
87.97
67.50
76.96
79.13
77.17
72.97
94.55
97.74
94.45
97.96
92.31
78.05
81.06
68.20
83.92
75.36
Fig. 6. The fuzzy sets representing membership of sauce area percentage (%) for the ve linguistic levels. Set T1: reject underwipe; Set T2: acceptable
underwipe; Set T3: even spread; Set T4: acceptable overwipe; and Set T5: reject overwipe. The shadow areas are overlapping boundaries.
Fig. 7. The fuzzy sets representing membership of heavy area percentage (%) for the ve linguistic levels. Set T1: reject underwipe; Set T2: acceptable
underwipe; Set T3: even spread; Set T4: acceptable overwipe; and Set T5: reject overwipe. The shadow areas are overlapping boundaries.
88
Table 5
FES of the sauced pizza samples
Sample
Reject
Reject
Reject
Reject
Reject
underwipe
underwipe
underwipe
underwipe
underwipe
Acceptable
Acceptable
Acceptable
Acceptable
Acceptable
Even
Even
Even
Even
Even
underwipe
underwipe
underwipe
underwipe
underwipe
spread
spread
spread
spread
spread
Acceptable
Acceptable
Acceptable
Acceptable
Acceptable
Reject
Reject
Reject
Reject
Reject
1
2
3
4
5
1
2
3
4
5
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
overwipe
1
2
3
4
5
1
2
3
4
5
1
2
3
4
5
FES
Ranka
5.612
6.417
6.124
5.650
6.796
1
4
3
2
5
6.893
7.165
7.173
7.201
7.147
7
15
17
18
14
7.069
6.836
7.166
7.134
6.939
11
6
16
13
8
6.968
7.381
7.538
7.449
6.984
9
20
23
21
10
7.492
7.759
7.122
7.876
7.284
22
24
h12i
25
h19i
quality may inuence consumer judgement. As mentioned earlier the assessment by human personnel leads
to subjectivity and inconsistency, which is conrmed by
the results in Fig. 5, showing the overlapping of the
linguistic terms.
The concept of using FES values as basis for the
construction of a fuzzy set was also considered (Fig. 8).
It is found that the AD value for the system was only
0.2005, which was less than both AD1 and AD2 . This
indicates that accuracy could be improved by introducing multi-factors into the fuzzy set design, thus validating the theory and method for this evaluation
criterion.
5. Conclusions
The results conrm that the computer vision can be
used for the analysis of pizza base and tomato sauce
spread characteristics. For the pizza base analysis a
shape and size technique was developed to classify the
captured images. The image analysis algorithm consisted of four dierent indexes with circularity being the
most eective for classication. The overall accuracy of
the system was 87% when compared with human quality
inspection.
The sauce spread analysis developed was based on the
use of fuzzy logic for the classication of acceptable and
defective quality samples. It was found that an overall
accuracy of 92% was obtained when only two levels
of quality was considered, however an inaccuracy of
52% was attained when classication into ve was tested. From the analysis it was also found that human
assessment overlapped in four of the dened classes,
indicating the inaccuracy and subjectivity of human inspection. From the results SAP was found to be a better
fuzzy index than HAP, however FES gave the best AD
value for the system examined. This indicates that system accuracy would be improved by the use of multi
quality measures in the calculation of the FES and
subsequent classication of the samples.
Fig. 8. The fuzzy sets representing membership of FES for the ve linguistic levels. Set T1: reject underwipe; Set T2: acceptable underwipe; Set T3:
even spread; Set T4: acceptable overwipe; and Set T5: reject overwipe. The shadow areas are overlapping boundaries.
Acknowledgements
This research has been part-funded by grant aid
under the European Regional Development Funs, which
is administered by the Department of Agriculture, Food
and Forestry, Ireland. The authors also wish to acknowledge Green Isle Foods (Naas, Ireland) for providing the samples and to thank student Mr. L. Wang
for his help in analysing the samples.
References
Burg, J. C. (1998). Piecing together the pizza puzzle. Food Product
Design (February), 58.
Dutta, S. (1993). Fuzzy logic applications: technological and strategic
issues. INSEAD (European Institute of Business Administration), Boulevard de Constance, 77305 Fontainebleau Cedex,
France.
89
Gerrard, D. E., Gao, X., & Tan, J. (1996). Beef marbling and colour
score determination by image processing. Journal of Food Science,
61(1), 145148.
Li, Q. Z., & Wang, M. H. (1999). Development and prospect of real
time fruit grading technique based on computer vision. Transactions of the Chinese Society of Agricultural Machinery, 30(6), 17.
Locht, P., Thomsen, K., & Mikkelsen, P. (1997). Full colour image
analysis as a tool for quality control and process development in the
food industry. ASAE Paper No. 973006, ASAE, St. Joseph,
Michigan, USA.
Optimas, (1998). Optimas User Manual, Version 6.5, Media Cybernetics, USA.
Sonka, M., Hlavac, V., & Boyle, R. (1999). Image processing, analysis
and machine vision. California, USA: PWS publishing.
Sun, D.-W. (2000). Inspecting pizza topping percentage and distribution by a computer vision method. Journal of Food Engineering, 44,
245249.
Suranjan, P., Doetkott, C., Chtioui, Y., & Marsh, R. (1998). Computer
vision system for colour evaluation of edible beans. ASAE Paper No.
983053, ASAE, St. Joseph, Michigan, USA.
Tan, J., Gao, X., & Gerrard, D. E. (1999). Application of fuzzy sets
and neural networks in sensory analysis. Journal of Sensory
Studies, 14, 119138.