Dmassign

1.
Task1:
1. Naïve-Bayes classifier
6 folds
Correctly Classified Instances 700
9 folds
14 folds
Here we see that as the number of folds increases the correctly classified
instances increase. The Folds value determines the random subsamples
equal in size collected from dataset.
As the value of the Folds increases the probability of classifying the

dataset is high and hence the value of the correctly classified instances
increases with the number of folds.
Random-Tree decision Tree
6 folds
Correctly Classified Instances 753 92.963 %

9 folds
14 folds
2. When the same were tried on different models
Random Forest classification model
6 folds
9 folds
14 folds
The same number of folds when applied to different models has an effect on
the number of correctly classified instances except for the Random tree
forest which had the same results for
6 folds and 9 folds.
3. Calculate accuracy and error rate

The test to be performed on 14 folds
Confusion matrix
Naïve-Bayes:
a b c d e f g <-- classified as
124 0 0 1 0 0 0| a = brickface
0 109 0 1 0 0 0 | b = sky
2 0 82 2 36 0 0 | c = foliage
6 0 1 91 8 4 0 | d = cement
14 0 15 7 90 0 0 | e = window
0 0 0 5 0 89 0 | f = path
1 0 0 1 2 0 119 | g = grass
Random Tree:
119 0 1 1 4 0 0 | a = brickface
0 110 0 0 0 0 0 | b = sky
0 0 107 1 13 1 0 | c = foliage
1 0 0 102 5 0 2 | d = cement
6 0 11 8 101 0 0 | e = window
0 0 0 4 0 90 0 | f = path
0 0 1 1 0 0 121 | g = grass
Problem 2:
Naïve-Bayes
1st run: 42%-58%
=== Summary ===

Incorrectly Classified Instances 65 13.8298 %
Kappa statistic 0.8383
Mean absolute error 0.0429
Root mean squared error 0.1809
Relative absolute error 17.5213 %
Root relative squared error 51.5541 %
Total Number of Instances 470
=== Confusion Matrix ===
59 0 0 0 1 0 0 | a = brickface
0 69 0 1 0 0 0 | b = sky
0 0 41 0 31 0 0 | c = foliage
2 0 0 55 11 2 0 | d = cement
6 0 6 2 62 0 0 | e = window
0 0 0 0 0 53 0 | f = path
0 0 0 1 2 0 66 | g = grass
2nd run: 54%-46%
=== Summary ===

44 0 0 1 1 0 0 | a = brickface
0 54 0 1 0 0 0 | b = sky
0 0 28 0 29 0 0 | c = foliage
3 0 0 48 3 2 0 | d = cement
12 0 4 7 37 0 0 | e = window
0 0 0 0 0 42 0 | f = path
0 0 0 0 2 0 55 | g = grass
3rd run: 65%-35%
=== Summary ===

33 0 0 1 0 0 0 | a = brickface
0 41 0 1 0 0 0 | b = sky
0 0 25 0 15 0 0 | c = foliage
2 0 0 41 2 0 0 | d = cement
10 0 3 2 33 0 0 | e = window
0 0 0 0 0 32 0 | f = path
1 0 0 0 1 0 40 | g = grass
Random Tree classifier
1st run: 42%-58%
=== Summary ===

59 0 0 0 1 0 0 | a = brickface
0 70 0 0 0 0 0 | b = sky
0 0 57 3 12 0 0 | c = foliage
2 0 3 56 1 3 5 | d = cement
3 0 18 2 51 0 2 | e = window
0 0 0 0 0 53 0 | f = path
0 0 0 0 1 0 68 | g = grass
2nd run: 54%-46%
=== Summary ===
44 0 1 0 1 0 0 | a = brickface
0 55 0 0 0 0 0 | b = sky
1 0 48 1 7 0 0 | c = foliage
1 0 3 48 2 2 0 | d = cement
0 0 10 4 46 0 0 | e = window
0 0 0 1 1 40 0 | f = path
1 0 0 0 1 0 55 | g = grass
3rd run: 65%-35%:
=== Summary ===
34 0 0 0 0 0 0 | a = brickface
0 42 0 0 0 0 0 | b = sky
0 0 35 0 5 0 0 | c = foliage
0 0 0 39 5 0 1 | d = cement
0 0 5 0 43 0 0 | e = window
0 0 0 0 0 32 0 | f = path
0 0 0 0 0 1 41 | g = grass
Task 3:
Problem 5:
Using anneals.arff
=== Run information ===
Scheme: weka.classifiers.trees.J48 -C 0.25 -M 2
Relation: anneal
Instances: 898
Attributes: 39
family
product-type
steel
carbon
hardness
temper_rolling
condition
formability
strength
non-ageing
surface-finish
surface-quality
enamelability
bc
bf
bt
bw/me
bl
chrom
phos
cbond
marvi
exptl
ferro
corr
blue/bright/varn/clean
lustre
jurofm
shape
thick
width
len
oil
bore
packing
class
Test mode: split 70.0% train, remainder test
=== Classifier model (full training set) ===
J48 pruned tree
------------------
hardness <= 70
| strength <= 350
| | family = ?
| | | surface-quality = ?
| | | | condition = ?: 3 (68.0/1.0)
| | | | condition = S
| | | | | thick <= 0.75: 3 (5.0)

| | | | | thick > 0.75
| | | | | | thick <= 2.501: 2 (81.0/1.0)
| | | | | | thick > 2.501: 3 (2.0)
| | | | condition = A: 2 (0.0)
| | | | condition = X: 2 (0.0)
| | | surface-quality = D: 3 (55.0)
| | | surface-quality = E
| | | | condition = ?: U (2.0)
| | | | condition = S: 3 (256.0)
| | | | condition = A: 3 (0.0)
| | | | condition = X: 3 (0.0)
| | | surface-quality = F: 3 (60.0)
| | | surface-quality = G: 3 (180.0)
| | family = GB: 3 (0.0)
| | family = GK: 3 (0.0)
| | family = GS: 3 (0.0)
| | family = TN: 5 (67.0)
| | family = ZA: 3 (0.0)
| | family = ZF: 3 (0.0)
| | family = ZH: 3 (0.0)
| | family = ZM: 3 (0.0)
| | family = ZS
| | | strength <= 0: 3 (46.0)
| | | strength > 0: 1 (2.0)
| strength > 350
| | steel = ?: 2 (8.0)
| | steel = R: 3 (5.0)
| | steel = A: 3 (5.0)
| | steel = U: 2 (0.0)
| | steel = K: 2 (0.0)
| | steel = M: 2 (11.0)
| | steel = S: 1 (5.0)
| | steel = W: 2 (0.0)
| | steel = V: 2 (0.0)
hardness > 70
| hardness <= 80
| | cbond = ?: U (3.0)
| | cbond = Y: 3 (2.0)
| hardness > 80: U (35.0)
Number of Leaves : 35
Size of the tree : 47
Time taken to build model: 0.05 seconds
=== Evaluation on test split ===
=== Summary ===

=== Detailed Accuracy By Class ===
TP Rate FP Rate Precision Recall F-Measure ROC Area Class
0.8 0 1 0.8 0.889 0.9 1
1 0.004 0.964 1 0.982 0.998 2
0.99 0.016 0.995 0.99 0.993 0.986 3
0 0 0 0 0 ? 4
1 0 1 1 1 1 5
1 0.004 0.917 1 0.957 0.998 U
Weighted Avg. 0.989 0.013 0.989 0.989 0.989 0.987
a b c d e f <-- classified as
4 0 1 0 0 0| a=1
0 27 0 0 0 0 | b = 2
0 1 204 0 0 1 | c = 3
0 0 0 0 0 0| d=4
0 0 0 0 20 0 | e = 5
0 0 0 0 0 11 | f = U
Using audiology.arff
Relation: audiology
Instances: 226
Attributes: 70
age_gt_60
air
airBoneGap
ar_c
ar_u
bone
boneAbnormal
bser
history_buzzing
history_dizziness
history_fluctuating
history_fullness
history_heredity
history_nausea
history_noise
history_recruitment
history_ringing
history_roaring
history_vomiting
late_wave_poor
m_at_2k
m_cond_lt_1k
m_gt_1k
m_m_gt_2k
m_m_sn
m_m_sn_gt_1k
m_m_sn_gt_2k
m_m_sn_gt_500
m_p_sn_gt_2k
m_s_gt_500
m_s_sn
m_s_sn_gt_1k
m_s_sn_gt_2k
m_s_sn_gt_3k
m_s_sn_gt_4k
m_sn_2_3k
m_sn_gt_1k
m_sn_gt_2k
m_sn_gt_3k
m_sn_gt_4k
m_sn_gt_500
m_sn_gt_6k
m_sn_lt_1k
m_sn_lt_2k
m_sn_lt_3k
middle_wave_poor
mod_gt_4k
mod_mixed
mod_s_mixed
mod_s_sn_gt_500
mod_sn
mod_sn_gt_1k
mod_sn_gt_2k
mod_sn_gt_3k
mod_sn_gt_4k
mod_sn_gt_500
notch_4k
notch_at_4k
o_ar_c
o_ar_u
s_sn_gt_1k
s_sn_gt_2k
s_sn_gt_4k
speech
static_normal
tymp
viith_nerve_signs
wave_V_delayed
waveform_ItoV_prolonged
class
J48 pruned tree
------------------
tymp = a
| age_gt_60 = f
| | history_fluctuating = f
| | | static_normal = f: possible_brainstem_disorder (5.0/1.0)
| | | static_normal = t
| | | | history_noise = f
| | | | | wave_V_delayed = f
| | | | | | air = mild: cochlear_unknown (25.0/3.0)
| | | | | | air = moderate: cochlear_unknown (2.0)

| | | | | | air = normal
| | | | | | | notch_4k = f
| | | | | | | | boneAbnormal = f
| | | | | | | | | history_nausea = f: normal_ear (23.0/4.0)
| | | | | | | | | history_nausea = t: cochlear_unknown (2.0)
| | | | | | | | boneAbnormal = t: cochlear_unknown (3.0)
| | | | | | | notch_4k = t: cochlear_unknown (7.0)
| | | | | | air = profound: cochlear_unknown (1.0)
| | | | | | air = severe: cochlear_unknown (2.0)
| | | | | wave_V_delayed = t: retrocochlear_unknown (2.0)
| | | | history_noise = t
| | | | | history_heredity = f
| | | | | | history_dizziness = f
| | | | | | | mod_sn_gt_4k = f: cochlear_poss_noise (22.0/2.0)
| | | | | | | mod_sn_gt_4k = t: cochlear_unknown (2.0)
| | | | | | history_dizziness = t: cochlear_unknown (2.0)
| | | | | history_heredity = t: cochlear_noise_and_heredity (2.0)
| | history_fluctuating = t: possible_menieres (6.0)
| age_gt_60 = t
| | history_noise = f
| | | history_nausea = f: cochlear_age (56.0/2.0)
| | | history_nausea = t: normal_ear (2.0/1.0)
| | history_noise = t: cochlear_age_and_noise (25.0/4.0)
tymp = ad
| airBoneGap = f: mixed_cochlear_unk_discontinuity (2.0)
| airBoneGap = t: conductive_discontinuity (2.0)

tymp = as
| age_gt_60 = f
| | bone = mild: mixed_cochlear_unk_fixation (9.0)
| | bone = moderate: mixed_cochlear_unk_fixation (0.0)
| | bone = normal: conductive_fixation (6.0)
| | bone = unmeasured: mixed_cochlear_unk_fixation (0.0)
| age_gt_60 = t: mixed_cochlear_age_fixation (3.0/1.0)
tymp = b
| age_gt_60 = f
| | boneAbnormal = f: otitis_media (2.0)
| | boneAbnormal = t: mixed_cochlear_unk_ser_om (3.0)
| age_gt_60 = t: mixed_cochlear_age_s_om (3.0/1.0)
tymp = c
| age_gt_60 = f
| | ar_c = absent: mixed_poss_central_om (2.0/1.0)
| | ar_c = elevated: mixed_poss_noise_om (2.0)
| | ar_c = normal: mixed_poss_noise_om (0.0)
| age_gt_60 = t: mixed_cochlear_age_otitis_media (3.0)
Time taken to build model: 0.02 seconds

=== Summary ===
0 0 0 0 0 ? acoustic_neuroma
0 0 0 0 0 ? bells_palsy
0.85 0.021 0.944 0.85 0.895 0.925 cochlear_age
1 0.017 0.9 1 0.947 0.992 cochlear_age_and_noise
0 0 0 0 0 0.5
cochlear_age_plus_poss_menieres
0 0 0 0 0 0.94 cochlear_noise_and_heredity
1 0.048 0.667 1 0.8 0.976 cochlear_poss_noise
0.857 0.016 0.857 0.857 0.857 0.958 cochlear_unknown
0 0 0 0 0 0.5 conductive_discontinuity
1 0 1 1 1 1 conductive_fixation
0 0 0 0 0 ? mixed_cochlear_age_fixation
0 0.015 0 0 0 ?
mixed_cochlear_age_otitis_media
0 0 0 0 0 0.425 mixed_cochlear_age_s_om
1 0.03 0.333 1 0.5 0.985

mixed_cochlear_unk_discontinuity
1 0 1 1 1 1 mixed_cochlear_unk_fixation
1 0 1 1 1 1 mixed_cochlear_unk_ser_om
0 0 0 0 0 0.5 mixed_poss_central_om
0 0.015 0 0 0 ? mixed_poss_noise_om
0.667 0.051 0.667 0.667 0.667 0.825 normal_ear
0 0 0 0 0 ? otitis_media
0 0 0 0 0 ? poss_central
1 0 1 1 1 1 possible_brainstem_disorder
1 0 1 1 1 1 possible_menieres
0 0 0 0 0 ? retrocochlear_unknown
Weighted Avg. 0.809 0.021 0.784 0.809 0.79 0.908
a b c d e f g h i j k l m n o p q r s t u v w x <-- classified as
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| a=
acoustic_neuroma
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 | b = bells_palsy
0 0 17 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 | c = cochlear_age
0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| d=
cochlear_age_and_noise
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0| e=
cochlear_age_plus_poss_menieres
0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| f=
cochlear_noise_and_heredity
0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| g=
cochlear_poss_noise
0 0 0 0 0 0 1 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| h=
cochlear_unknown
0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 0| i=
conductive_discontinuity
0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0| j=
conductive_fixation
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| k=
mixed_cochlear_age_fixation
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| l=
mixed_cochlear_age_otitis_media
0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0| m=
mixed_cochlear_age_s_om
0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0| n=
mixed_cochlear_unk_discontinuity
0 0 0 0 0 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0| o=
mixed_cochlear_unk_fixation
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0| p=
mixed_cochlear_unk_ser_om
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0| q=
mixed_poss_central_om
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| r=
mixed_poss_noise_om
0 0 1 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 | s = normal_ear
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 | t = otitis_media
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 | u = poss_central
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0| v=
possible_brainstem_disorder
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0| w=
possible_menieres
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0| x=
retrocochlear_unknown
Using autos.arff
Relation: autos
Instances: 205
Attributes: 26
normalized-losses
make
fuel-type
aspiration
num-of-doors
body-style
drive-wheels
engine-location
wheel-base
length
width
height
curb-weight
engine-type
num-of-cylinders
engine-size
fuel-system
bore
stroke
compression-ratio
horsepower
peak-rpm
city-mpg
highway-mpg
price
symboling
J48 pruned tree

------------------
num-of-doors = four
| wheel-base <= 101.2
| | height <= 51.6: 1 (10.56/1.0)
| | height > 51.6
| | | curb-weight <= 2050
| | | | horsepower <= 69: 1 (7.0)
| | | | horsepower > 69: 0 (4.0)
| | | curb-weight > 2050
| | | | height <= 55.6
| | | | | price <= 13860: 0 (31.56)
| | | | | price > 13860
| | | | | | normalized-losses <= 168: 2 (2.0)
| | | | | | normalized-losses > 168: 0 (2.0)
| | | | height > 55.6
| | | | | body-style = hardtop: 2 (0.0)
| | | | | body-style = wagon: 0 (4.0)
| | | | | body-style = sedan: 2 (8.0)
| | | | | body-style = hatchback: 2 (0.0)
| | | | | body-style = convertible: 2 (0.0)
| wheel-base > 101.2
| | make = alfa-romero: -1 (0.0)
| | make = audi: 1 (3.0)
| | make = bmw: 0 (3.0/1.0)
| | make = chevrolet: -1 (0.0)

| | make = dodge: -1 (1.0)
| | make = honda: -1 (0.0)
| | make = isuzu: -1 (0.0)
| | make = jaguar: 0 (2.0)
| | make = mazda: 0 (2.0)
| | make = mercedes-benz: -1 (5.0/1.0)
| | make = mercury: -1 (0.0)
| | make = mitsubishi: -1 (0.0)
| | make = nissan: -1 (0.0)
| | make = peugot: 0 (11.0)
| | make = plymouth: -1 (1.0)
| | make = porsche: -1 (0.0)
| | make = renault: -1 (0.0)
| | make = saab: -1 (0.0)
| | make = subaru: -1 (0.0)
| | make = toyota: -1 (7.0)
| | make = volkswagen: -1 (0.0)
| | make = volvo
| | | normalized-losses <= 98: -1 (8.0)
| | | normalized-losses > 98: -2 (3.0)
num-of-doors = two
| city-mpg <= 22
| | wheel-base <= 99.1: 3 (23.0/2.0)
| | wheel-base > 99.1
| | | engine-type = dohc: 3 (2.0)
| | | engine-type = dohcv: 0 (0.0)

| | | engine-type = l: 0 (0.0)
| | | engine-type = ohc: 0 (6.0/2.0)
| | | engine-type = ohcf: 0 (0.0)
| | | engine-type = ohcv: 1 (3.0/1.0)
| | | engine-type = rotor: 0 (0.0)
| city-mpg > 22
| | bore <= 3.39
| | | engine-size <= 103
| | | | width <= 64.2
| | | | | wheel-base <= 89.5: 2 (3.0)
| | | | | wheel-base > 89.5: 1 (26.44/1.0)
| | | | width > 64.2: 2 (4.0)
| | | engine-size > 103
| | | | compression-ratio <= 8.5: 3 (4.0)
| | | | compression-ratio > 8.5
| | | | | city-mpg <= 26: 1 (3.0)
| | | | | city-mpg > 26: 0 (3.44/1.0)
| | bore > 3.39: 2 (12.0)
Time taken to build model: 0 seconds

=== Summary ===
0 0 0 0 0 ? -3
0 0 0 0 0 ? -2
0.875 0.113 0.538 0.875 0.667 0.95 -1
0.739 0.158 0.739 0.739 0.739 0.789 0
0.636 0.16 0.467 0.636 0.538 0.811 1
0.5 0 1 0.5 0.667 0.865 2
0.538 0 1 0.538 0.7 0.769 3
Weighted Avg. 0.672 0.103 0.745 0.672 0.678 0.817

0 0 0 0 0 0 0 | a = -3
0 0 0 0 0 0 0 | b = -2
0 0 7 1 0 0 0 | c = -1
0 0 4 17 2 0 0 | d = 0
0 0 2 2 7 0 0| e=1
0 0 0 1 2 3 0| f=2
0 0 0 2 4 0 7| g=3

Dmassign

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Dmassign

Uploaded by

Copyright:

Available Formats

1.

Correctly Classified Instances 700

Correctly Classified Instances 702

Correctly Classified Instances 704

As the value of the Folds increases the probability of classifying the

Random-Tree decision Tree

Correctly Classified Instances 753 92.963 %

Correctly Classified Instances 737 90.9877 %

Correctly Classified Instances 750 92.5926 %

2. When the same were tried on different models

Random Forest classification model

3. Calculate accuracy and error rate

=== Summary ===

Incorrectly Classified Instances 65 13.8298 %

Kappa statistic 0.8383

Mean absolute error 0.0429

Root mean squared error 0.1809

Relative absolute error 17.5213 %

Root relative squared error 51.5541 %

Total Number of Instances 470

=== Confusion Matrix ===

2nd run: 54%-46%

=== Summary ===

Correctly Classified Instances 308 82.5737 %

Incorrectly Classified Instances 65 17.4263 %

Kappa statistic 0.7965

Root mean squared error 0.1926

Relative absolute error 19.9015 %

Root relative squared error 54.9491 %

Total Number of Instances 373

=== Confusion Matrix ===

3rd run: 65%-35%

=== Summary ===

Correctly Classified Instances 245 86.5724 %

Incorrectly Classified Instances 38 13.4276 %

Kappa statistic 0.843

Mean absolute error 0.0424

Relative absolute error 17.3228 %

Root relative squared error 50.0763 %

Total Number of Instances 283

=== Confusion Matrix ===

Random Tree classifier

1st run: 42%-58%

=== Summary ===

Correctly Classified Instances 414 88.0851 %

Incorrectly Classified Instances 56 11.9149 %

Kappa statistic 0.8608

Mean absolute error 0.034

Root mean squared error 0.1845

Relative absolute error 13.8978 %

Root relative squared error 52.5868 %

Total Number of Instances 470

=== Confusion Matrix ===

2nd run: 54%-46%

=== Summary ===

Correctly Classified Instances 336 90.0804 %

Incorrectly Classified Instances 37 9.9196 %

Kappa statistic 0.884

Mean absolute error 0.0283

Root mean squared error 0.1683

Relative absolute error 11.5735 %

Root relative squared error 48.0358 %