KKN Weighted

KKN/K-Nearest Neighbor Classifier adalah metode pengelompokan data dengan cara membandingkan data baru dengan K data terdekat, metode ini juga disebut juga dengan Lazy Algorithm karena cara perhitungannya yang mudah serta tingkat keakurasian yang tinggi

Mengklasifikasi data menggunakan metode weighted KNN. Menggunakan data iris yang diambil acak sebanyak 100 data.

dengan data sampel sebagai berikut :

sepal length sepal width petal length petal width variety
5.2 3.3 1.5 0.5 Setosa

Data training :

a b c d class
5.8 2.6 4 1.2 Versicolor
5.5 2.5 4 1.3 Versicolor
5.6 3 4.1 1.3 Versicolor
5.8 2.7 4.1 1 Versicolor
5.7 2.8 4.1 1.3 Versicolor
6.1 2.8 4 1.3 Versicolor
5.5 2.3 4 1.3 Versicolor
5.7 3 4.2 1.2 Versicolor
5.7 2.9 4.2 1.3 Versicolor
6 2.2 4 1 Versicolor
5.6 2.7 4.2 1.3 Versicolor
5.9 3 4.2 1.5 Versicolor
5.5 2.6 4.4 1.2 Versicolor
6.2 2.9 4.3 1.3 Versicolor
6.4 2.9 4.3 1.3 Versicolor
5.4 3 4.5 1.5 Versicolor
5.7 2.8 4.5 1.3 Versicolor
6.4 3.2 5.3 2.3 Virginica
6.4 3.1 5.5 1.8 Virginica
6.7 3 5.2 2.3 Virginica
6.2 3.4 5.4 2.3 Virginica
6.5 3 5.5 1.8 Virginica
6.3 2.9 5.6 1.8 Virginica
6.9 3.1 5.4 2.1 Virginica
6.4 2.8 5.6 2.1 Virginica
6.8 3 5.5 2.1 Virginica
6.4 2.8 5.6 2.2 Virginica
6.3 3.4 5.6 2.4 Virginica
6.7 3.3 5.7 2.1 Virginica
6.7 3.1 5.6 2.4 Virginica
6.7 2.5 5.8 1.8 Virginica
6.5 3 5.8 2.2 Virginica
6.9 3.2 5.7 2.3 Virginica
7.2 3 5.8 1.6 Virginica
6.7 3.3 5.7 2.5 Virginica
5.1 3.3 1.7 0.5 Setosa
5.4 3.4 1.5 0.4 Setosa
5 3.4 1.6 0.4 Setosa
5 3.5 1.6 0.6 Setosa
5.1 3.5 1.4 0.3 Setosa
5.2 3.4 1.4 0.2 Setosa
5.1 3.4 1.5 0.2 Setosa
5.2 3.5 1.5 0.2 Setosa
5 3.4 1.5 0.2 Setosa
5.1 3.5 1.4 0.2 Setosa
5 3.5 1.3 0.3 Setosa
5.4 3.4 1.7 0.2 Setosa
5.1 3.7 1.5 0.4 Setosa
5 3.2 1.2 0.2 Setosa
5 3.6 1.4 0.2 Setosa
4.3 3 1.1 0.1 Setosa
4.3 3 1.1 0.1 Setosa
5 2.3 3.3 1 Versicolor
5.7 2.6 3.5 1 Versicolor
5.6 2.9 3.6 1.3 Versicolor
5 2 3.5 1 Versicolor
5.5 2.4 3.7 1 Versicolor
5.5 2.4 3.8 1.1 Versicolor
5.6 2.5 3.9 1.1 Versicolor
5.2 2.7 3.9 1.4 Versicolor
5.8 2.7 3.9 1.2 Versicolor
5.3 3.7 1.5 0.2 Setosa
5.1 3.8 1.5 0.3 Setosa
4.9 3.6 1.4 0.1 Setosa
4.7 3.2 1.6 0.2 Setosa
5.1 3.8 1.6 0.2 Setosa
4.7 3.2 1.3 0.2 Setosa
4.8 3.4 1.9 0.2 Setosa
4.6 3.4 1.4 0.3 Setosa
4.6 3.2 1.4 0.2 Setosa
4.6 3.1 1.5 0.2 Setosa
4.4 3.2 1.3 0.2 Setosa
4.4 3 1.3 0.2 Setosa
4.4 2.9 1.4 0.2 Setosa
5.6 3 4.5 1.5 Versicolor
6 3.4 4.5 1.6 Versicolor
6.6 3 4.4 1.4 Versicolor
6.1 3 4.6 1.4 Versicolor
6.2 2.8 4.8 1.8 Virginica
6.1 3 4.9 1.8 Virginica
5.6 2.8 4.9 2 Virginica
6.5 3.2 5.1 2 Virginica
5.8 2.8 5.1 2.4 Virginica
6.5 3 5.2 2 Virginica
6.4 2.7 5.3 1.9 Virginica
6.1 2.6 5.6 1.4 Virginica
6.9 3.1 5.1 2.3 Virginica
6.8 3.2 5.9 2.3 Virginica
6.3 3.3 6 2.5 Virginica
7.1 3 5.9 2.1 Virginica
7.2 3.2 6 1.8 Virginica
7.4 2.8 6.1 1.9 Virginica
7.2 3.6 6.1 2.5 Virginica
7.3 2.9 6.3 1.8 Virginica
7.7 3 6.1 2.3 Virginica
7.9 3.8 6.4 2 Virginica
7.6 3 6.6 2.1 Virginica
7.7 2.8 6.7 2 Virginica
7.7 3.8 6.7 2.2 Virginica
7.7 2.6 6.9 2.3 Virginica

Menghitung Jarak

a b c d class (a-sd1)^2 (b-sd2)^2 (c-sd3)^2 (d-sd4)^2 SQRT
5.1 3.3 1.7 0.5 Setosa 0.01 0 0.04 0 0.223607
5.4 3.4 1.5 0.4 Setosa 0.04 0.01 0 0.01 0.244949
5 3.4 1.6 0.4 Setosa 0.04 0.01 0.01 0.01 0.264575
5 3.5 1.6 0.6 Setosa 0.04 0.04 0.01 0.01 0.316228
5.1 3.5 1.4 0.3 Setosa 0.01 0.04 0.01 0.04 0.316228
5.2 3.4 1.4 0.2 Setosa 0 0.01 0.01 0.09 0.331662
5.1 3.4 1.5 0.2 Setosa 0.01 0.01 0 0.09 0.331662
5.2 3.5 1.5 0.2 Setosa 0 0.04 0 0.09 0.360555
5 3.4 1.5 0.2 Setosa 0.04 0.01 0 0.09 0.374166
5.1 3.5 1.4 0.2 Setosa 0.01 0.04 0.01 0.09 0.387298
5 3.5 1.3 0.3 Setosa 0.04 0.04 0.04 0.04 0.4
5.4 3.4 1.7 0.2 Setosa 0.04 0.01 0.04 0.09 0.424264
5.1 3.7 1.5 0.4 Setosa 0.01 0.16 0 0.01 0.424264
5 3.2 1.2 0.2 Setosa 0.04 0.01 0.09 0.09 0.479583
5 3.6 1.4 0.2 Setosa 0.04 0.09 0.01 0.09 0.479583
5.3 3.7 1.5 0.2 Setosa 0.01 0.16 0 0.09 0.509902
5.1 3.8 1.5 0.3 Setosa 0.01 0.25 0 0.04 0.547723
4.9 3.6 1.4 0.1 Setosa 0.09 0.09 0.01 0.16 0.591608
4.7 3.2 1.6 0.2 Setosa 0.25 0.01 0.01 0.09 0.6
5.1 3.8 1.6 0.2 Setosa 0.01 0.25 0.01 0.09 0.6
4.7 3.2 1.3 0.2 Setosa 0.25 0.01 0.04 0.09 0.6245
4.8 3.4 1.9 0.2 Setosa 0.16 0.01 0.16 0.09 0.648074
4.6 3.4 1.4 0.3 Setosa 0.36 0.01 0.01 0.04 0.648074
4.6 3.2 1.4 0.2 Setosa 0.36 0.01 0.01 0.09 0.685565
4.6 3.1 1.5 0.2 Setosa 0.36 0.04 0 0.09 0.7
4.4 3.2 1.3 0.2 Setosa 0.64 0.01 0.04 0.09 0.883176
4.4 3 1.3 0.2 Setosa 0.64 0.09 0.04 0.09 0.927362
4.4 2.9 1.4 0.2 Setosa 0.64 0.16 0.01 0.09 0.948683
4.3 3 1.1 0.1 Setosa 0.81 0.09 0.16 0.16 1.104536
4.3 3 1.1 0.1 Setosa 0.81 0.09 0.16 0.16 1.104536
5 2.3 3.3 1 Versicolor 0.04 1 3.24 0.25 2.12838
5.7 2.6 3.5 1 Versicolor 0.25 0.49 4 0.25 2.233831
5.6 2.9 3.6 1.3 Versicolor 0.16 0.16 4.41 0.64 2.317326
5 2 3.5 1 Versicolor 0.04 1.69 4 0.25 2.445404
5.5 2.4 3.7 1 Versicolor 0.09 0.81 4.84 0.25 2.447448
5.5 2.4 3.8 1.1 Versicolor 0.09 0.81 5.29 0.36 2.559297
5.6 2.5 3.9 1.1 Versicolor 0.16 0.64 5.76 0.36 2.630589
5.2 2.7 3.9 1.4 Versicolor 0 0.36 5.76 0.81 2.632489
5.8 2.7 3.9 1.2 Versicolor 0.36 0.36 5.76 0.49 2.640076
5.8 2.6 4 1.2 Versicolor 0.36 0.49 6.25 0.49 2.754995
5.5 2.5 4 1.3 Versicolor 0.09 0.64 6.25 0.64 2.760435
5.6 3 4.1 1.3 Versicolor 0.16 0.09 6.76 0.64 2.765863
5.8 2.7 4.1 1 Versicolor 0.36 0.36 6.76 0.25 2.780288
5.7 2.8 4.1 1.3 Versicolor 0.25 0.25 6.76 0.64 2.810694
6.1 2.8 4 1.3 Versicolor 0.81 0.25 6.25 0.64 2.819574
5.5 2.3 4 1.3 Versicolor 0.09 1 6.25 0.64 2.824889
5.7 3 4.2 1.2 Versicolor 0.25 0.09 7.29 0.49 2.849561
5.7 2.9 4.2 1.3 Versicolor 0.25 0.16 7.29 0.64 2.887906
6 2.2 4 1 Versicolor 0.64 1.21 6.25 0.25 2.889637
5.6 2.7 4.2 1.3 Versicolor 0.16 0.36 7.29 0.64 2.906888
5.9 3 4.2 1.5 Versicolor 0.49 0.09 7.29 1 2.978255
5.5 2.6 4.4 1.2 Versicolor 0.09 0.49 8.41 0.49 3.078961
6.2 2.9 4.3 1.3 Versicolor 1 0.16 7.84 0.64 3.104835
6.4 2.9 4.3 1.3 Versicolor 1.44 0.16 7.84 0.64 3.174902
5.4 3 4.5 1.5 Versicolor 0.04 0.09 9 1 3.182766
5.7 2.8 4.5 1.3 Versicolor 0.25 0.25 9 0.64 3.184337
5.6 3 4.5 1.5 Versicolor 0.16 0.09 9 1 3.201562
6 3.4 4.5 1.6 Versicolor 0.64 0.01 9 1.21 3.295451
6.6 3 4.4 1.4 Versicolor 1.96 0.09 8.41 0.81 3.357082
6.1 3 4.6 1.4 Versicolor 0.81 0.09 9.61 0.81 3.364521
6.2 2.8 4.8 1.8 Virginica 1 0.25 10.89 1.69 3.718871
6.1 3 4.9 1.8 Virginica 0.81 0.09 11.56 1.69 3.761649
5.6 2.8 4.9 2 Virginica 0.16 0.25 11.56 2.25 3.770942
6.5 3.2 5.1 2 Virginica 1.69 0.01 12.96 2.25 4.112177
5.8 2.8 5.1 2.4 Virginica 0.36 0.25 12.96 3.61 4.144876
6.5 3 5.2 2 Virginica 1.69 0.09 13.69 2.25 4.209513
6.4 2.7 5.3 1.9 Virginica 1.44 0.36 14.44 1.96 4.266146
6.1 2.6 5.6 1.4 Virginica 0.81 0.49 16.81 0.81 4.349713
6.9 3.1 5.1 2.3 Virginica 2.89 0.04 12.96 3.24 4.373786
6.4 3.2 5.3 2.3 Virginica 1.44 0.01 14.44 3.24 4.373786
6.4 3.1 5.5 1.8 Virginica 1.44 0.04 16 1.69 4.378356
6.7 3 5.2 2.3 Virginica 2.25 0.09 13.69 3.24 4.389761
6.2 3.4 5.4 2.3 Virginica 1 0.01 15.21 3.24 4.411349
6.5 3 5.5 1.8 Virginica 1.69 0.09 16 1.69 4.412482
6.3 2.9 5.6 1.8 Virginica 1.21 0.16 16.81 1.69 4.457578
6.9 3.1 5.4 2.1 Virginica 2.89 0.04 15.21 2.56 4.549725
6.4 2.8 5.6 2.1 Virginica 1.44 0.25 16.81 2.56 4.589118
6.8 3 5.5 2.1 Virginica 2.56 0.09 16 2.56 4.605432
6.4 2.8 5.6 2.2 Virginica 1.44 0.25 16.81 2.89 4.624932
6.3 3.4 5.6 2.4 Virginica 1.21 0.01 16.81 3.61 4.651881
6.7 3.3 5.7 2.1 Virginica 2.25 0 17.64 2.56 4.738143
6.7 3.1 5.6 2.4 Virginica 2.25 0.04 16.81 3.61 4.765501
6.7 2.5 5.8 1.8 Virginica 2.25 0.64 18.49 1.69 4.803124
6.5 3 5.8 2.2 Virginica 1.69 0.09 18.49 2.89 4.812484
6.9 3.2 5.7 2.3 Virginica 2.89 0.01 17.64 3.24 4.876474
7.2 3 5.8 1.6 Virginica 4 0.09 18.49 1.21 4.877499
6.7 3.3 5.7 2.5 Virginica 2.25 0 17.64 4 4.88774
6.8 3.2 5.9 2.3 Virginica 2.56 0.01 19.36 3.24 5.016971
6.3 3.3 6 2.5 Virginica 1.21 0 20.25 4 5.04579
7.1 3 5.9 2.1 Virginica 3.61 0.09 19.36 2.56 5.06162
7.2 3.2 6 1.8 Virginica 4 0.01 20.25 1.69 5.094114
7.4 2.8 6.1 1.9 Virginica 4.84 0.25 21.16 1.96 5.311309
7.2 3.6 6.1 2.5 Virginica 4 0.09 21.16 4 5.408327
7.3 2.9 6.3 1.8 Virginica 4.41 0.16 23.04 1.69 5.412947
7.7 3 6.1 2.3 Virginica 6.25 0.09 21.16 3.24 5.544367
7.9 3.8 6.4 2 Virginica 7.29 0.25 24.01 2.25 5.813777
7.6 3 6.6 2.1 Virginica 5.76 0.09 26.01 2.56 5.866856
7.7 2.8 6.7 2 Virginica 6.25 0.25 27.04 2.25 5.982474
7.7 3.8 6.7 2.2 Virginica 6.25 0.25 27.04 2.89 6.035727
7.7 2.6 6.9 2.3 Virginica 6.25 0.49 29.16 3.24 6.256197

K=5

e 1/e setosa versicolor virginica
0.223607 4.472132 4.472132 0 0
0.244949 4.082482 4.082482 0 0
0.264575 3.779647 3.779647 0 0
0.316228 3.162275 3.162275 0 0
0.331662 3.015118 3.015118 0 0

CLASS : SETOSA