African Journal of Agricultural Research Vol. 6(13), pp. 3131-3142, 4 July, 2011 Available online at http://www.academicjournals.org/AJAR
DOI: 10.5897/AJAR11.291
ISSN 1991-637X ©2011 Academic Journals
Full Length Research Paper
D
D
i
i
g
g
i
i
t
t
a
a
l
l
p
p
a
a
r
r
a
a
m
m
e
e
t
t
e
e
r
r
i
i
z
z
a
a
t
t
i
i
o
o
n
n
o
o
f
f
a
a
p
p
p
p
l
l
e
e
f
f
r
r
u
u
i
i
t
t
s
s
i
i
z
z
e
e
,
,
s
s
h
h
a
a
p
p
e
e
a
a
n
n
d
d
s
s
u
u
r
r
f
f
a
a
c
c
e
e
s
s
p
p
o
o
t
t
t
t
i
i
n
n
e
e
s
s
s
s
Rade L. Radojević
1*, Dragan V. Petrović
1, Vladimir B. Pavlović
2, Zoran M. Nikolić
3and
Mirko P. Urošević
11
University of Belgrade, Faculty of Agriculture, Nemanjina 6, 11081 Zemun, Serbia.
2
Serbian Academy of Sciences and Arts, Kneza Mihajla 35, 11000 Belgrade, Serbia.
3
University of Belgrade, Faculty of Physics, Studentski Trg 12, 11000 Belgrade, Serbia.
Accepted 16 May, 2011
To reach fruit market standards, quality evaluation has to be performed. Computer assisted fruit image analysis represents a technique, which offers a variety of automatic and semi-automatic procedures that can be used in combination with classic evaluation methods. To achieve this goal, a digital parameterization method for single apple fruit (Malus domestica) size, shape and surface spottiness has been recently developed. The appropriate mathematical procedures, defining the criteria for the fruit quality parameterization, are also defined and tested. The concept of the method, as well as the initial testing results, is presented in this paper. Basically, the technique combines analysis of apple fruit 256 gray-scale level images and parameterization algorithm of fruit quality. The former is based on digital pattern recognition method (DPR), and the latter employs linear fitting and numerical integration of DPR output data. This way, accurate parameterization of the fruit size, shape and surface spottiness, as well as the reliable fruit sorting according to the product quality, is enabled.
Key words: Apple fruit, computer vision, quality criteria, mathematical procedure, digital pattern recognition.
INTRODUCTION
Over the past decades, under highly increasing need for assuring the specified quality of fruit, a variety of methods for fruit quality evaluation and sorting has been developed (Abbott, 1999; Kheiralipour et al., 2008; Khojastehnazhand et al., 2008; Moreda et al., 2009; Esehaghbeygi et al., 2009; Baranowski and Mazurek, 2009). Particularly, quality of apple fruit depends on its size, color, shape and the presence and type of skin defects. Among others, fruit quality is defined in the European Commission standard (Anonymous, 2004). To achieve good market quality, different factors affecting apple farming, (Barandoozi and Talaie, 2009; Dolgun et al., 2009; Topcu et al., 2010; Karakurt and Aslantas, 2010) irrigation (Kafkas et al., 2009), diseases and protection (Frah et al., 2009; Karaca et al., 2010) as well as those related to optimal storage conditions (Amusa et al., 2003; Ghafir et al., 2009), should be carefully analyzed in detail. The fruit monitoring during its
*Corresponding author. E-mail: [email protected] Tel: +381112615315. Fax: +381113163317.
development, up to maturity stage is also needed (Greer, 2005; Zhaoxiang and Gang, 2007). Final evaluation of mature fruit quality and sorting is based on measurements of quality-related product attributes: electromagnetic (often optical) properties relate to appearance mechanical properties, texture, and chemical properties to taste and aroma. Instruments can approximate human judgments by imitating the way people test the product or by measuring fundamental properties and combining those mathematically to characterize and categorize the quality (Abbott, 1999).
Up to date, many non-destructive control methods and technical systems for fruits quality evaluation have been developed, including various computer vision techniques (Heinemann et al., 1995; Davenel et al., 1998; Brosnan and Sun, 2004; Zou and Zhao, 2009). Although optical inspection of fruits, with respect to size, shape and color, by machine vision is already automated in the industry, detection of apple defects is still problematic due to high variance of defect types and the presence of stem/calyx concavities (Unay et al., 2006). Fortunately, stem/calyx can be recognized and extracted from the fruit image (Bennedsen et al., 2005; Whitelock et al., 2006; Xing et
Figure 1. The experimental school estate “Radmilovac”, Belgrade region - Serbia.
al., 2007). Digital image analysis basically involves some kind of selective counting the number of pixels of each feature of interest. It is based on laws of photometry - automatic gray scale and object analysis of isohels contours for isolated and overlapped objects (Exner and Hougardy, 1988).
The main advantages of this type of the fruit condition evaluation lie in its reliability, non-destructive character and automated quick measurement. This paper presents a concept of apple fruit (Malus domestica) size, shape and surface characterization method. It utilizes output data of image analysis of fruit digital pictures converted to 256 gray scale levels, which are pre-processed by appropriate pattern recognition algorithms. The concept itself is primarily based on linear fitting and numerical integrating of pre-processed digitally acquired data. The main benefit of these techniques is in quantitative parameterization of various apples’ characteristics, providing accurate and reliable data for quality evaluation.
MATERIALS AND METHODS
Experimental site
The experimental data are acquired from digital images of Red and Golden delicious apple fruits, grown at experimental school estate “Radmilovac” of the Faculty of Agriculture in Belgrade, 10 km south-east from Belgrade, Figure 1 (longitude 44° 45’ N; 20° 35’ E and altitude 135 m above sea level). To suppress aging influence, digital photographs of the fruits under consideration are made
immediately after harvesting, in the autumn 2008.
Hardware
Computer vision hardware comprised standard elements, appropriate for initial research phases and technique development. The essential components are:
1. Personal computer Pentium IV, possessing Intel Celeron processor running at a clock speed of 1.7 GHz and possessing 512 MB of DDR memory;
2. CCD color camera Coolpix 5600, made by NIKON, Japan, having maximum resolution of 2592 x 1944 pixels;
3. Illumination device with electronic control unit; 4. Universal serial BUS cable and,
5. Test station.
To maximize the measurement accuracy of apple fruit parameters of interest, all photographs are made under maximum resolution of camera - 2592 x 1944 pixels. The camera was mounted on a 400 x 500 x 50 mm anodized aluminium platform via 90° angle mount horizontal/vertical rotation arm, forming the test station of machine vision system. The later was illuminated using warm white lights having a color rendering index of 79 and color temperature of 6000 K. The electronic control allowed continual from 10 to 100% adjustment of light intensity.
Processing procedures
The original processing algorithm for apple fruit digital image analysis has been developed. The appropriate software is realized in Microsoft C++ compiler, under support of various mathematical subroutines listed in Press et al. (2002). Acquired digital image data are processed by different numeric algorithms, divided in the three
main processing stages:
1. The first processing stage (pre-processing) includes the preprocessing methods, which adjust the image for further physical measurements;
2. The second processing stage (intermediate processing) comprehends digital pattern recognition method and some auxiliary numeric procedures, enabling physical measurements of apple fruit contour and surface parameters;
3. However, in the focus of interest of the present paper is the third processing stage (fruit quality parameters evaluation), whose concept is presented in most details. It includes numeric methods, which process output data from the second inter-processing stage, and provides quantitative characterization parameters for quality evaluation of single apple-fruit: size, shape and surface spottiness.
The first processing stage (pre-processing)
This stage assumes digital image optimization for further physical measurements (Nikolić, 2006), that is reading an image record, evaluation of its basic parameters, interpolated resizing, background digital filtering (noise reduction), determining the signal base line, converting the color image to 256 gray-scale levels format and balancing the contrast and brightness of the image. The photometric analysis of adapted image is also performed here, including the following tasks: correction of distorted or inappropriately rotated data traces and acquisition of physical data (like brightness level) from the image record. Consequently, image data reach the full, nearly continuous two-dimensional spectral record, which can be further processed applying standard methods of spectral analysis.
The second processing stage (intermediate processing)
The intermediate image processing stage comprehends digital pattern recognition methods (Press et al., 2002; Nikolić and Pavlović, 2004; Pavlović et al., 2006), based on non-analytical spectral profiles analysis of isolated isohels contours by various Fast Fourier Transform (FFT) algorithms and 3D image analysis in volume domain. Extracting objects (apple fruit contour, surface spots and damages,…) ensemble by digital image decomposition: objects border detection and contouring, morphological filtering of created objects (noise reduction within object borders), methods of objects growth that join the accompanied points to appropriate identified object, 3-D objects reconstruction, etc. The contour points are analysed enabling objects planimetry of length, width, perimeter, diameter, distance and area (Klette and Rosenfeld, 2004), as well as further calculation of surface, volumetric and morphometric object parameters. Consequently, distributions of apple contour diameters defining its size and shape, as well as of the number and size of surface defects (spots, damages), are established.
The third processing stage (fruit quality parameters evaluation)
(a) Apple fruit size and shape parameterization: Shape and size analysis of tested apple fruits starts from the angular distribution of apple fruit contour radius r = r(θ), where θ ∈ [-180°+180°] is the polar angle defined with respect to the polar coordinate system sketched in Figure 2. This way, a size of tested apple fruit is accurately defined. However, in order to enable shape comparison of apple fruits of different sizes, each measured contour radius ri =
r(θi), (i = 1, 2, … , n), is normalized with respect to the mean
contour radius: Radojević et al. 3133
( )
θ
= ==
∑
=
∑
1 11
n1
n m i i i ir
r
r
n
n
, (1)where n = 72 is the number of measured radiuses ri and θi = 0°,
±5°, ±10°, ... , ±175°, 180° are the appropriate polar angles, defined according (Figure 2a).
Thus, instead of the radius ri = r(θi), the analysis is focused to
non-dimensional relative parameter:
( )
%
100
%
100
=
⋅
⋅
m i m ir
r
r
r
θ
(2)The apple fruit symmetry around the stem-to-calyx axis is quantified by analyzing the dependence
y =
iry
ir( )
x
ir , based on experimental points M(x
ir,y
ir ). The coordinatesx
ir andy
ir are the appropriate pairs of normalized contour radiuses r(θi)/rm, takenfrom the left (
y
ir) and right side (x
ir ) of the fruit digital image, (Figure 2)(
)
=
(
)
⋅
100
%
=
m RIGHT i RIGHT i r r ir
r
x
x
θ
θ
; (θ
1RIGHT =0°, RIGHT 2θ
=5°,...,θ
nRIGHT/ +2 1 =θ
37RIGHT = 180°), (3)(
)
=(
)
⋅100% = m LEFT i LEFT i r r i r r y y θ θ ; (θ
1LEFT= 0°,θ
2LEFT= -5°,...,θ
nLEFT/ +2 1=θ
37LEFT = -180°) (4). The superscript “r” in variablesx
ir andy
ir emphasizes their relevance to normalized radiuses r(θiRIGHT)/rm and r(θiLEFT)/rm,respectively. As it can be seen in expressions (3) and (4), the values of normalized contour radius lying at the stem/calyx axis (θ = 0° and θ = ±180°) are joined both to the RIGHT and LEFT side of fruit contour. Mathematically, this can be simply written as
(
)
(
0)
1 1 0 1 1=
=
0
=
=
=
0
LEFT r r RIGHT r rx
y
y
x
θ
θ
, for thecontour point at stem position, and
(
)
(
0)
37 37 0 37 37=
=
180
=
=
=
−
180
LEFT r r RIGHT r rx
y
y
x
θ
θ
for the contour point at calyx position. Therefore, because of these two “duplicated points”, the number “m“ of contour points M(
x
ir ,y
ir), defining the left and right side of the fruit contour is (n/2+1) = 37, instead of n/2 = 36. For an apple fruit shape of theoretically perfect geometrical symmetry, as it is shown in Figure 2b, it follows:y
ir =x
ir , (i = 1, 2, …, n/2+1 = 37). This means that theoretical linear function y = x, that is:r
r
x
y =
, (5)represents a virtual ideally symmetrical fruit. It follows that the closer the points M(
x
ir ,y
ir), (i = 1, 2, …, n/2+1 = 37) to the fit line yr = xr, characterize the better symmetry of a real tested apple fruit. Mathematically, this criterion can be quantified using statistical(a)
(a)
(b)
Figure 2. A sketch defining: (a) the polar coordinate system fixed to an apple fruit and (b) a virtual model of an ideally symmetrical apple fruit.
approach in estimating the accuracy of empirical data approximation by linear model function (5). The goodness of fit of an arbitrary two-dimensional empirical data set, containing “m” points M(xi, yi); (i = 1, 2, … , m), is commonly estimated by residual
sum of squares (RSS), also known as error sum of squares:
(
)
∑
∑
= =−
=
=
m i i i m i iy
y
SSE
1 2 1 2ˆ
ε
, (6)where yi and
yˆ
i are the experimental (measured) and fitted values,respectively.
The most appropriate fit parameters of a model function, that is the most accurate fit, results in minimum value of SSE. To account for a number “m” of experimental data points N(xi, yi), (i = 1, 2, …, m),
and number “p“ of fitted parameters in a model function, an analogue estimate of fitting quality - the mean square error:
(
)
p
m
y
y
p
m
SSE
MSE
m i i i−
−
=
−
=
∑
=1 2ˆ
, (7)is introduced. Thus, for a linear approximation function
)
.
,
(
;
a
b
const
R
b
x
a
y
=
⋅
+
=
∈
, (8)having two fitting parameters, slope “a“ and intercept “b“ (p = 2), the following expression arises from (7):
(
)
∑
=−
⋅
−
=
=
m i i i LINy
y
m
MSE
MSE
1 2ˆ
2
1
. (9)a fruit possessing ideally symmetrical contour, is fixed - intercept b = 0. Thus, p = 0 and expression (9) transforms to:
(
)
∑
=−
⋅
−
=
=
m i i i IDEALy
y
m
MSE
MSE
1 2ˆ
1
1
(10)The square root of MSE, known as the root mean square error (RMS), or standard error of estimate (
σ
yˆ):MSE
yˆ
=
σ
, (11)represents an additional absolute parameter that characterizes fitting quality. An analogue relative parameter, coefficient of estimate variation:
%
100
ˆ ˆ=
⋅
y
V
yσ
y (12)seems to be more appropriate for the same purpose in some situations. The term:
∑
= ⋅ = m i i y m y 1 1 , (13)in expression (12) is the mean or expected value of yi (i = 1, 2, … ,
m). In this work, the coefficient of determination or R-square factor is also used:
(
)
(
)
∑
∑
= = − − − = − = m i i i m i i i y y y y TSS SSE R 1 2 1 2 2 ˆ 1 1 , (14)where the term TSS represents the total sum of squares:
(
)
∑
= − = m i i i y y TSS 1 2 (15)It is well known that R-square factor, which equals the square of the Pearson correlation between xi and yi, measures the contribution of
X in reducing the variation of Y, that is, in reducing the uncertainty in predicting Y. Two extreme cases exist:
1. If all obs ervations fall on the regress ion line (perfect regress ion, c omplete c ertainty), then SSE=0, R2 = 1; 2. For the horizontal regression line (no c ontribution of X in predicting Y), SSE=SST and R2=0.
However, when discussing the Pearson correlation, R-square factor does not assess the appropriateness of the linear regression model. Often the value of R-square is found to be slightly optimistic. Therefore, several authors proposed using the following Adjusted R-square factor instead:
p m R R Ra − − − = 2 2 2 1 (16)
Again, in full analogue to mean square error MSE, for the model function (5) that describes an apple fruit possessing ideally
Radojević et al. 3135
symmetrical contour, expression (16) transforms to:
1
1
2 2 2 2−
−
−
=
=
m
R
R
R
R
a aIDEAL (17)(b) Apple fruit surface spottiness: Output results of the second stage of apple fruit image analysis comprehend, among others, discrete distribution of area participations S
i
S
Σ (i = 1, 2, … , k) of surface spots of each of “k“ different size-classes, with respect to total area of apple fruit surface SΣ:)
...,
,
2
,
1
(
%,
100
i
k
S
S
p
S S i i⋅
=
=
Σ Σ (18)The superscript “S” in
p
Si , as well as in all other quantities used in further text, denotes their relevance to fruit surface spottiness analysis. Each size-class of surface spots is represented by appropriate equivalent radius:
)
...,
,
2
,
1
(
,
i
k
S
r
S i S i=
=
π
, (19) whereS
iS is the area of single spot of a specified i-th size-class. Thus:)
...,
,
2
,
1
(
,
i
k
n
S
S
S i i S i=
⋅
=
Σ , (20)where ni is the number of acquired surface spots of i-th size-class,
having surface area
S
iS and represented by equivalent radius Si
r
. Equivalent spot radiusr
iS is normalized with respect to apple fruit mean contour radius rm, defined in Formula (1):)
...,
,
2
,
1
(
%,
100
i
k
r
r
x
m S i S i=
⋅
=
(21)This way, a discrete distribution function:
)
...,
,
2
,
1
(
)%,
(
x
i
k
p
p
S i S S i=
=
, (22) is established. It relates the normalized (relative) area participationp
Si (18) and appropriate normalized radiusx
iS (21) of surface spots of each of “k” different size-classes. Following the common statistical approach, appropriate discrete probability density function is defined:)
...,
,
2
,
1
(
,
)
(
)
(
i
k
x
x
p
x
y
S S i S S i S S i=
∆
=
=
, (23)In this formula,
p
S(
x
iS)
is an area participation defined in (22), while∆
x
S represents the interval width of spots size-class. It has a constant value for all size-classes and equals difference betweena b c
Figure 3. Digital color photographs of Red delicious apple fruits and their gray-scale images: a) deformed fruit, b) satisfactory and c) virtual, ideally symmetrical fruit model.
the upper HIGHS i
x
and lower SLOW ix
limit:)
...,
,
2
,
1
(
.,
i
k
const
x
x
x
S HIGHS LOWS i i−
=
=
=
∆
, (24)of the normalized spot radius
x
iS of each size-class. Obviously, SLOW S
HIGHi
x
ix
−1=
. In order to characterize fruit surface quality, data of empirical probability density functiony
iS=
=
(
x
iS)
, (i = 1, 2, … , k), defined by (23), are integrated numerically by trapezoidal method. Using discrete functions (22) and (23), surface spottiness of tested apple fruit can be quantitatively characterized depending on the number and size of the spots detected on its digital image. It is fulfilled by formulation of appropriate mathematical criteria:(1) The first criterion defines maximum (allowed) normalized radius of surface spots: S m S m S S
x
r
r
r
r
x
max max=
≤
=
. (25)Thus, fruits having surface spots or damages characterized by xS
larger than
x
maxS , which can be arbitrarily set by computer operator according to the market requirements, are rejected from a specified selection.(2) It is also possible to estimate the area participation of spots, having normalized radius in some specified range between
x
lowS andx
highS , by numerical integration of the pdf S function (23):∫
⋅
=
S high S low S High S low x x S S S S x xx
dx
p
,(
)
. (26)Integration is performed by trapezoidal method.
(3) Depending on the market requirements and possible requirements of further processing of apple fruits under evaluation in food and beverage industry, the small surface spots and damages can be neglected (excluded) during the calculation of spotted area of apple fruit surface. This is done mathematically by introducing a “threshold”, which exclude spots having normalized
spot radius xS (21) smaller from the arbitrarily adopted value
x
trS:∫
⋅
=
1)
(
S tr S tr x S S S S xy
x
dx
p
. (27)This way, only spotted areas of spots characterized with S
tr S
x
x
>
are comprehended by numerical integration. Obviously: 1 1 0(
)
k(
)
S S S S S S i ip
Σy
x
dx
p
x
==
∫
⋅
=
∑
(28) gives the total spotted area participation with respect to the surface area of tested apple fruit.RESULTS AND DISCUSSION Apple fruit size evaluation
Analyzed apple fruit images of satisfactory and deformed shape are presented in Figures 3a and b while an image of virtual apple fruit of ideal symmetry (photomontage) is presented in Figure 3c. The images of real apples are processed assuming the polar coordinate system sketched in Figure 2a. Output results of size analysis are presented in Figures 4a and b in Descartes’ and polar coordinate system, respectively. Besides the size, the Figure 4b also presents a digital reconstruction of apple fruit contours, which corresponds to satisfactory (acceptable) and deformed fruit. Data given in Figure 4 enable further calculation of any of apple fruit measure of interest. For example, the radius of apple fruit having acceptable shape varies from 32.8 up to 39.9 mm, while radius range of tested deformed fruit lies in the interval between 33.4 and 41.6 mm. However, much more important information, related to the referent maximal horizontal diameter D of apple fruit, sketched in Figure 4c, can also be evaluated. Its size is 70.8 and 69.4 mm for apple fruit of satisfactory (Figure 3a) and deformed
Radojević et al. 3137 30 35 40 45 0 45 90 135 180 225 270 315 360 θ θ θ θ (o) r ( m m ) 0 10 20 30 40 50 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 58 59 60 61 62 63 64 65 6667 6869 7071 72 73 r (mm )
(a) (b) (c)
Figure 4. Radiuses r (mm) of Red delicious apple fruits of ▬▬ normal shape and - - - - deformed contour: a) Descartes’ coordinate system, b) polar coordinate system and (c) a sketch describing the referent maximal horizontal diameter of apple fruit.shape (Figure 3b), respectively.
Apple fruit shape analysis
To enable shape comparison of apple fruits of different sizes, their contour radiuses are normalized according to expression (2) and presented in Figure 5. For tested red delicious apple fruits, whose images are presented in Figure 3, the eccentricity factor for fruit of an acceptable shape is up to 9% and for deformed sample is up to 14%. This can be seen in classic data representation in Descartes’ coordinate system, given in Figure 5a, while Figures 5b and c present identical data in the polar coordinate system, which are more geometrically illustrative, especially according to the fruit symmetry. However, one of the most important qualitative measures of fruit shape is related to its symmetry according to the central stem/calyx axis. This is quantified by analyzing the trends of experimental points
N
(
x
ir,
y
ir)
, having coordinates defined by expressions (3) and (4). Resulting linear fit lines are presented in Figure 6a.To analyze an ideal apple fruit, possessing axially symmetrical contour around the stem/calyx axis, the virtual digital image presented in Figure 3c is made by photomontage. Digital image of a sample fruit image (digital photograph), presented in Figure 3b, is separated to the left-side and right-side parts, with respect to the stem/calyx axis, as it is shown in Figure 2a. Finally, using standard photo editor (Microsoft Photo Editor), the left-side part of the image is mirrored and joined to the original (non-mirrored) left-side part. This way, an ideally symmetrical virtual fruit image, is made. Its contour line is symmetrical around the stem/calux axis. Therefore, all contour points Mi(xi,yi) (i = 1, 2, … , n) of this symmetrical
fruit lie directly on the theoretical line (5) and the R-square coefficient R2 = 1.
As it is shown in Figure 6, the best match for the “points”
Mi(xi,yi) (i = 1, 2, … , n) describing the apple fruit having a
satisfactory shape (Figure 2b) is:
3054
.
4
9754
.
0
⋅
+
=
x
y
, (29)with determination factor R2 = 0.8823. Simultaneously, the unsatisfactory shape of the apple fruit shown in Figure 2a gives the following linear fit:
14
.
13
1438
.
1
⋅
−
=
x
y
, (30)with very low value of determination factor of only R2 = 0.183. In the latter case, low R2 value is a direct consequence of large data dispersion around the fitted line. Furthermore, the slope 0.9754 of the trend line (29), describing normal fruit shape, is closer to 1 (symmetrical shape) in comparison to the slope (1.1438) of fit line (30) related to deformed apple fruit. Previously discussed parameters are only general identifiers for crude evaluation of the fruit shape quality range. To accurately evaluate the fruit symmetry under the criterion “the closer the points Mi(xi,yi) defining the apple fruit contour to the
line (5) means the better fruit axial symmetry”, the additional appropriate parameters are needed. This is achieved by applying parameters (10), (11), (12), (14) and (16), specified for evaluation of fitting quality.
However, they are calculated against the theoretical fit line (5) representing the symmetrical fruit, instead of the lines (29) and (30), which really represent the best matches for tested apple fruits of normal and deformed contour/shape, respectively. This way, accurate direct measures of contour deviation from an ideal symmetry is provided, as it is illustrated in Figure 6b. The coefficients of determination or R-square factors are 0.7793 for tested apple fruit of satisfactory shape, while its value for a deformed apple fruit is much lower, 0.1502 only.
80 90 100 110 120 0 45 90 135 180 225 270 315 360 θ θθ θ (o) r /rm ( % ) a 0 20 40 60 80 100 120 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72
r/r
m(%)
b
0 20 40 60 80 100 120 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72r/r
m(%)
c
Figure 5. Normalized radiuses r/rm of red delicious apple fruit
of ▬▬ normal (satisfactory) shape; —●— symmetrical and - - - - deformed shape: (a) standard chart in orthogonal Descartes’ coordinate system, (b) normal and deformed shapes in the polar coordinate system and (c) ideal symmetrical shape in the polar system.
Radojević et al. 3139 y = 0.9754x + 4.3054 R2 = 0.8823 Acceptable shape y = 1.1438x - 13.14 R2 = 0.183 Deformed shape y = x R2 = 1 Ideal shape 90 100 110 120 90 100 110 Right side: x =xr=r /rm (% ) L e ft s id e : y = y r = r /rm ( % ) a y = x Ideal shape 90 100 110 120 90 100 110 Right side: x =xr=r /rm (% ) L e ft s id e : y = y r = r /rm ( % )
b
Figure 6. Correlation between the left and the right side of the normalized radius r/rm of red delicious apple fruit: ■ satisfactory shape, ▲ deformed
shape and ● ideal shape. Linear trend lines of a fruit having: ▬▬ normal (satisfactory) shape, - - - - deformed shape and ── ideal (symmetrical) shape.
Furthermore, the analogue values of adjusted coefficients of determination are 0.773 and 0.127. These results show strong relationship between the values of contour coordinates yi and xi (i = 1, 2, … , 37), acquired on the left
and right side of the apple fruit having satisfactory shape, Figure 3b. In opposite, the “strength” of the same relationship is weak for the other apple having deformed shape, Figure 3a.
The analogue results are achieved with respect to the second parameter of fitting quality, the standard error of estimate
σ
yˆ. For normal shape, the error reaches only 2.78%, what is less than half of the error value of 6.26% for tested apple fruit of deformed shape. Having in mind definition of normalized radius and variables xr and yr, given by (1) to (4), it is clear that both mean valuesr
x
x =
andy =
y
r equal 100%. Therefore, the coefficient of estimate variationV
yˆ, defined by (12), hasidentical value to standard error of estimate:
y y y y
y
V
ˆ ˆ ˆ100
%
ˆ%
100
%
100
σ
σ
σ
=
⋅
=
⋅
=
. (31)Apple fruit surface spottiness analysis
Apple fruit surface spottiness evaluation has been performed by detailed analysis of gray-level histograms and subsequent analysis of diameter distributions of spot-objects distributed on the sample surfaces of golden
(a) (b)
Figure 7. Surface spottiness analysis of golden delicious apple fruits, based on their 256 gray-scale images: a) Grade I, b) abnormal. 0 2 4 6 8 10 0 1 2 3 4 5 xS = rS/rm (%) y S = p d f S ( -) 0 5 10 15 20 25 0 1 2 3 4 5 xS = rS/r m (%) p S ( x S ) (% )
(a) (b)
Figure 8. Spottiness analysis of golden delicious apple fruits: (a) probability density functions (pdf S) and (b) integrated pdf S. Legend: ▬▬ grade I and - - - - abnormal.
delicious apple fruits presented in Figures 7a and b. Primary exported results give spotted area distribution with respect to spots size (normalized equivalent radius). Figure 8a presents probability density function (23) of spotted area participation in total area of apple fruit surface under evaluation, with respect to spot relative (normalized) diameter, xS (21). It can be seen that maximum spot normalized diameters of Grade I apple fruit is smaller than 3%, while its value is about 5% for abnormally spotted fruit.
It is also evident from the Figure 8a that pdfS values of abnormally spotted fruit are much higher in comparison to analogue values for Grade I fruit, in the whole range of interest, except a narrow region around xS = 0.9%. However, the differences between their values are extremely high at xS > 1.2%. Even more, for xS > 3% the
pdfS values of abnormally spotted fruit are very high, while the pdfS of Grade I fruit is zero in that range. In order to parameterize (that is quantify) the spotted area of fruit surface under consideration, the pdfS are numerically integrated using trapezoidal rule. Integration is performed between the zero spot radius (xS = 0) and some arbitrary value
x
0S:∫
⋅ = S x S S S S S x y x dx p 0 0 0) ( ) ( . (32)Physically, this is the fruit surface area covered with spots having normalized radiuses between zero and
x
0S. By varying thex
0S, a cumulative function is formulated (Motulsky and Christopoulos, 2003; Enderle et al., 2006), presented in Figure 8b. In the tested case, the spotted area of grade I apple fruit is smaller than 5%, while the spotted apple fruit covered by spotted area is over 23%. Depending on the imposed criteria related to the max allowed spots relative diameter xtr, the spots below this(adopted) critical size can be excluded from the integration, formula (27).
For example, if spots characterized by
x
trS < 1.0% are excluded from the analysis (neglected), the total participations of spotted areas in the total apple fruits surfaces are much smaller. Their values are only 2.2 and 19.6%, for Grade I and abnormal apple fruit, respectively. However, if a threshold valuex
trS is 2%, the analoguevalues of spotted areas participations are even smaller: 0.2 and 12.5%, respectively. These results confirm the significant flexibility of the evaluation method toward different standards in different regions: it is possible to include in damaged surface area either all spots, or only spots larger from some arbitrarily chosen critical diameter. Depending on the imposed criteria, the classifying of apple fruits under evaluation will be performed.
Conclusion
A concept of digital parameterization method for evaluation of single apple fruit size, shape and surface spottiness, is presented in the paper. Digital processing of fruit images under consideration is divided in three main stages. The primary stage converts the digital color photographs of fruit samples to appropriate 256 gray-scale images and adjusts them to facilitate further analysis. The second stage utilizes DPR method, followed by appropriate numerical procedures. They are specified for accurate physical measurements of contour geometrical parameters of a whole apple fruit and its surface spots. However, in the focus of interest of the present paper is the final (third) stage, whose concept is presented in most details. It includes mathematical procedures defining the criteria for quantitative parameterization and evaluation of the fruit size, shape and surface spottiness.
The method applicability is verified in the study. It enables accurate measurements of apple fruit dimensions. It can be noted, for illustration, that radius of apple fruit having acceptable shape varies from 32.8 up to 39.9 mm and between 33.4 and 41.6 mm for deformed shape. The shapes of apple fruit of satisfactory and deformed shape are clearly distinguished, having appropriately defined R-square factors 0.7793 and 0.1502 only, respectively. Surface spottiness analyses also enabled efficient and reliable fruit sorting with respect to the surface quality: the spotted areas of Grade I and abnormally spotted fruit is about 5 and 23%, respectively. Development of presented concept is in progress. The final phase will assume automated fruit and equipment managing during the evaluation and sorting process, including digital imaging, fruit inner transport and positioning within the test station and classification according to quality and consuming demands. Following the presented approach, an apple fruit surface damage and russetting can be also parameterized.
ACKNOWLEDGMENTS
This research was supported by the Ministry of Science and Technological Development, Republic of Serbia – projects ’’Improvement of biotechnological procedures as
Radojević et al. 3141
functions of rational utilization of energy, increasing the productivity and enhancing the quality of agricultural products’’ (project number TR 031051) and ’’Dynamical stability and instabillity of mechanical systems exposed to stohastical disturbances’’ (project number OI 174011).
REFERENCES
Abbott JA (1999). Quality measurement of fruits and vegetables. Post harvest Biol. Technol., 15(3): 207-225.
Amusa AN, Ashaye AO, Oladapo OM (2003). Biodeterioration of the African star apple (Chrysophylum albidum) in storage and the effect on its food value. Afr. J. Biotechnol., 2(3): 56-59.
Anonymous (2004). Commission regulation (EC) no. 85/2004 of 15 January 2004 on marketing standards for apples. Official J. Eur. Union, 13: 3-18.
Barandoozi NF, Talaie A (2009). The effect of gibberellins on russeting in golden delicious apples. J. Hort. For., 1(4): 61-64.
Baranowski P, Mazurek W (2009). Detection of physiological disorders and mechanical defects in apples using thermography. Int. Agrophys., 23: 9-17.
Bennedsen BS, Peterson DL, Tabb A (2005). Identifying defects in images of rotating apples. Comput. Electron. Agric., 48: 92-102. Brosnan T, Sun D-W (2004). Improving quality inspection of food
products by computer vision-a review. J. Food Eng., 61: 3-16. Davenel A, Guizard Ch, Labarre T, Sevila F (1998). Automatic detection
of surface defects on fruit by using a vision system. J. Agric. Eng. Res., 41(1): 1-9.
Dolgun O, Yıldırım A, Polat M, Yıldırım F, Askın A (2009). Apple graft formation in relation to growth rate features of rootstocks. Afr. J. Agric. Res., 4(5): 530-534.
Enderle JD, Farden DC, Krause DJ (2006). Basic Probability Theory for Biomedical Engineers. Morgan & Claypool, Connecticut, USA, p. 136. Exner HE, Hougardy HP (1988). Quantitative Image Analysis of Microstructures. DGM Informationsgesellschaft GmbH. Oberursel, 235.
Esehaghbeygi A, Ardforoushan M, Monajemi SAH, Masoumi AA (2009). Digital image processing for quality ranking of saffron peach. Int. Agrophys., 24: 115-120.
Frah N, Khelil MA, Medjdoub-Bensaad F (2009). Circulating entomofaune in orchards of apple trees in the region of the Aures (Eastern - Algeria). Afri. J. Agric. Res., 4(3): 178-186.
Ghafir AMS, Gadalla OS, Murajei NB, El-Nady Fathi M (2009). Physiological and anatomical comparison between four different apple cultivars under cold-storage conditions. Afr. J. Plant Sci., 3(6): 133-138.
Greer DH (2005). Non-destructive chlorophyll fluorescence and colour measurements of ‘Braeburn’ and ‘Royal Gala’ apple (Malus domestica) fruit development throughout the growing season. N. Z. J. Crop Hort. Sci., 33: 413-421.
Heinemann PH, Varghese ZA, Morrow CT, Sommer HJ, Crassweller RM (1995). Machine Vision Inspection of ‘Golden Delicious’ Apples. Appl. Eng. Agric., 11(6): 901-906.
Kafkas E, Atasay A, Sabir KF, Akgül H, Uçgun K (2009). Effects of different irrigation intervals and fertilizer applications on certain chemical contents of ‘Braeburn’ apple cultivar. Afr. J. Biotechnol., 8(10): 2138-2142.
Karaca G, Karaca I, Yardimci N, Demirözer O, Aslan B, Kiliç ÇH (2010). Investigations on pests, diseases and present early warning system of apple orchards in Isparta, Turkey. Afr. J. Biotechnol., 9(6): 834-841.
Karakurt H, Aslantas R (2010). Effects of some plant growth promoting rhizobacteria treated twice on flower thining, fruit set and fruit properties on apple. Afr. J. Agric. Res., 5(5): 384-388.
Kheiralipour K, Tabatabaeefar A, Mobli H, Rafiee S, Sharifi M, Jafari A, Rajabipour A (2008). Some physical and hydrodynamic properties of two varieties of apple (Malus domestica Borkh L.). Int. Agrophys., 22: 225-229.
of orange volume and surface area using image processing technique. Int. Agrophys., 23: 237-242.
Klette R, Rosenfeld A (2004). Digital Geometry - Geometric Methods for Digital Picture Analysis. Morgan Kaufmann Publishers, an imprint of Elsevier, San Francisco, California, USA, p. 656.
Moreda GP, Ortiz-Cañavate J, García-Ramos FJ, Ruiz-Altisent M (2009). Non-destructive technologies for fruit and vegetable size determination - A review. J. Food Eng., 92: 119-136.
Motulsky H, Christopoulos A (2003). Fitting Models to Biologycal Data Using Linear and Nonlinear Regression – A Practical Guide to Curve Fitting. GraphPad Software Inc., San Diego CA, p. 351.
Nikolić Z (2006). Application of Numerical Methods in Physical Characterisation of Polycrystalline and Biological Systems. Ph.D. Thesis, Belgrade, Serbia. Faculty of Physics, University of Belgrade, p. 157 (In Serbian).
Nikolić Z, Pavlović V (2004). DPR Analysis of Microstructural Evolution of ZnO Ceramics. Mater. Sci. Forum, 453(454): 453-458.
Pavlović V, Petrović D, Nikolić Z, Pavlović V (2006). Automatic Microstructure Analysis of Sintered Materials. FME Trans., 34: 159-163.
Press WH, Teukolsky SA, Vetterling WT, Flannery BP (2002). Numerical Recipes in C++, Cambridge, United Kingdom, Cambridge University Press, p. 994.
Topcu Y, Uzundumlu S, Celep S, Hun S (2010). Analysis of the factors affecting apple farming: The case of Isparta province, Turkey. Sci. Res. Essays, 5(14): 1881-1889.
Unay D, Gosselin B (2006). Automatic defect segmentation of ‘Jonagold’ apples on multi-spectral images: A comparative study. Postharvest Biol. Technol., 42: 271-279.
Whitelock DP, Brusewitz GH, Stone ML (2006). Apple Shape and Rolling Orientation. Appl. Eng. Agric., 22(1): 87-94.
Xing J, Jancsók P, De Baerdemaeker J (2007). Stem-end/Calyx Identification on Apples using Contour Analysis in Multispectral Images. Biosyst. Eng., 96(2): 231-237.
Zhaoxiang L, Gang L (2007). Apple maturity discrimination and positioning system in an apple harvesting robot. N. Z. J. Agric. Res., 50: 1103-1113.
Zou X, Zhao J (2009). On-Line Detecting Size And Color Of Fruit By Fusing Information From Images Of Three Color Camera Systems in IFIP International Federation for Information Processing, Volume 294, Computer and Computing Technologies in Agriculture II, Volume 2, eds. D. Li, Z. Chunjiang, (Boston: Springer), pp. 1087-1095.