KKN Weighted
KKN/K-Nearest Neighbor Classifier adalah metode pengelompokan data dengan cara membandingkan data baru dengan K data terdekat, metode ini juga disebut juga dengan Lazy Algorithm karena cara perhitungannya yang mudah serta tingkat keakurasian yang tinggi
Mengklasifikasi data menggunakan metode weighted KNN. Menggunakan data iris yang diambil acak sebanyak 100 data.
dengan data sampel sebagai berikut :
| sepal length | sepal width | petal length | petal width | variety |
|---|---|---|---|---|
| 5.2 | 3.3 | 1.5 | 0.5 | Setosa |
Data training :
| a | b | c | d | class |
|---|---|---|---|---|
| 5.8 | 2.6 | 4 | 1.2 | Versicolor |
| 5.5 | 2.5 | 4 | 1.3 | Versicolor |
| 5.6 | 3 | 4.1 | 1.3 | Versicolor |
| 5.8 | 2.7 | 4.1 | 1 | Versicolor |
| 5.7 | 2.8 | 4.1 | 1.3 | Versicolor |
| 6.1 | 2.8 | 4 | 1.3 | Versicolor |
| 5.5 | 2.3 | 4 | 1.3 | Versicolor |
| 5.7 | 3 | 4.2 | 1.2 | Versicolor |
| 5.7 | 2.9 | 4.2 | 1.3 | Versicolor |
| 6 | 2.2 | 4 | 1 | Versicolor |
| 5.6 | 2.7 | 4.2 | 1.3 | Versicolor |
| 5.9 | 3 | 4.2 | 1.5 | Versicolor |
| 5.5 | 2.6 | 4.4 | 1.2 | Versicolor |
| 6.2 | 2.9 | 4.3 | 1.3 | Versicolor |
| 6.4 | 2.9 | 4.3 | 1.3 | Versicolor |
| 5.4 | 3 | 4.5 | 1.5 | Versicolor |
| 5.7 | 2.8 | 4.5 | 1.3 | Versicolor |
| 6.4 | 3.2 | 5.3 | 2.3 | Virginica |
| 6.4 | 3.1 | 5.5 | 1.8 | Virginica |
| 6.7 | 3 | 5.2 | 2.3 | Virginica |
| 6.2 | 3.4 | 5.4 | 2.3 | Virginica |
| 6.5 | 3 | 5.5 | 1.8 | Virginica |
| 6.3 | 2.9 | 5.6 | 1.8 | Virginica |
| 6.9 | 3.1 | 5.4 | 2.1 | Virginica |
| 6.4 | 2.8 | 5.6 | 2.1 | Virginica |
| 6.8 | 3 | 5.5 | 2.1 | Virginica |
| 6.4 | 2.8 | 5.6 | 2.2 | Virginica |
| 6.3 | 3.4 | 5.6 | 2.4 | Virginica |
| 6.7 | 3.3 | 5.7 | 2.1 | Virginica |
| 6.7 | 3.1 | 5.6 | 2.4 | Virginica |
| 6.7 | 2.5 | 5.8 | 1.8 | Virginica |
| 6.5 | 3 | 5.8 | 2.2 | Virginica |
| 6.9 | 3.2 | 5.7 | 2.3 | Virginica |
| 7.2 | 3 | 5.8 | 1.6 | Virginica |
| 6.7 | 3.3 | 5.7 | 2.5 | Virginica |
| 5.1 | 3.3 | 1.7 | 0.5 | Setosa |
| 5.4 | 3.4 | 1.5 | 0.4 | Setosa |
| 5 | 3.4 | 1.6 | 0.4 | Setosa |
| 5 | 3.5 | 1.6 | 0.6 | Setosa |
| 5.1 | 3.5 | 1.4 | 0.3 | Setosa |
| 5.2 | 3.4 | 1.4 | 0.2 | Setosa |
| 5.1 | 3.4 | 1.5 | 0.2 | Setosa |
| 5.2 | 3.5 | 1.5 | 0.2 | Setosa |
| 5 | 3.4 | 1.5 | 0.2 | Setosa |
| 5.1 | 3.5 | 1.4 | 0.2 | Setosa |
| 5 | 3.5 | 1.3 | 0.3 | Setosa |
| 5.4 | 3.4 | 1.7 | 0.2 | Setosa |
| 5.1 | 3.7 | 1.5 | 0.4 | Setosa |
| 5 | 3.2 | 1.2 | 0.2 | Setosa |
| 5 | 3.6 | 1.4 | 0.2 | Setosa |
| 4.3 | 3 | 1.1 | 0.1 | Setosa |
| 4.3 | 3 | 1.1 | 0.1 | Setosa |
| 5 | 2.3 | 3.3 | 1 | Versicolor |
| 5.7 | 2.6 | 3.5 | 1 | Versicolor |
| 5.6 | 2.9 | 3.6 | 1.3 | Versicolor |
| 5 | 2 | 3.5 | 1 | Versicolor |
| 5.5 | 2.4 | 3.7 | 1 | Versicolor |
| 5.5 | 2.4 | 3.8 | 1.1 | Versicolor |
| 5.6 | 2.5 | 3.9 | 1.1 | Versicolor |
| 5.2 | 2.7 | 3.9 | 1.4 | Versicolor |
| 5.8 | 2.7 | 3.9 | 1.2 | Versicolor |
| 5.3 | 3.7 | 1.5 | 0.2 | Setosa |
| 5.1 | 3.8 | 1.5 | 0.3 | Setosa |
| 4.9 | 3.6 | 1.4 | 0.1 | Setosa |
| 4.7 | 3.2 | 1.6 | 0.2 | Setosa |
| 5.1 | 3.8 | 1.6 | 0.2 | Setosa |
| 4.7 | 3.2 | 1.3 | 0.2 | Setosa |
| 4.8 | 3.4 | 1.9 | 0.2 | Setosa |
| 4.6 | 3.4 | 1.4 | 0.3 | Setosa |
| 4.6 | 3.2 | 1.4 | 0.2 | Setosa |
| 4.6 | 3.1 | 1.5 | 0.2 | Setosa |
| 4.4 | 3.2 | 1.3 | 0.2 | Setosa |
| 4.4 | 3 | 1.3 | 0.2 | Setosa |
| 4.4 | 2.9 | 1.4 | 0.2 | Setosa |
| 5.6 | 3 | 4.5 | 1.5 | Versicolor |
| 6 | 3.4 | 4.5 | 1.6 | Versicolor |
| 6.6 | 3 | 4.4 | 1.4 | Versicolor |
| 6.1 | 3 | 4.6 | 1.4 | Versicolor |
| 6.2 | 2.8 | 4.8 | 1.8 | Virginica |
| 6.1 | 3 | 4.9 | 1.8 | Virginica |
| 5.6 | 2.8 | 4.9 | 2 | Virginica |
| 6.5 | 3.2 | 5.1 | 2 | Virginica |
| 5.8 | 2.8 | 5.1 | 2.4 | Virginica |
| 6.5 | 3 | 5.2 | 2 | Virginica |
| 6.4 | 2.7 | 5.3 | 1.9 | Virginica |
| 6.1 | 2.6 | 5.6 | 1.4 | Virginica |
| 6.9 | 3.1 | 5.1 | 2.3 | Virginica |
| 6.8 | 3.2 | 5.9 | 2.3 | Virginica |
| 6.3 | 3.3 | 6 | 2.5 | Virginica |
| 7.1 | 3 | 5.9 | 2.1 | Virginica |
| 7.2 | 3.2 | 6 | 1.8 | Virginica |
| 7.4 | 2.8 | 6.1 | 1.9 | Virginica |
| 7.2 | 3.6 | 6.1 | 2.5 | Virginica |
| 7.3 | 2.9 | 6.3 | 1.8 | Virginica |
| 7.7 | 3 | 6.1 | 2.3 | Virginica |
| 7.9 | 3.8 | 6.4 | 2 | Virginica |
| 7.6 | 3 | 6.6 | 2.1 | Virginica |
| 7.7 | 2.8 | 6.7 | 2 | Virginica |
| 7.7 | 3.8 | 6.7 | 2.2 | Virginica |
| 7.7 | 2.6 | 6.9 | 2.3 | Virginica |
Menghitung Jarak
| a | b | c | d | class | (a-sd1)^2 | (b-sd2)^2 | (c-sd3)^2 | (d-sd4)^2 | SQRT |
|---|---|---|---|---|---|---|---|---|---|
| 5.1 | 3.3 | 1.7 | 0.5 | Setosa | 0.01 | 0 | 0.04 | 0 | 0.223607 |
| 5.4 | 3.4 | 1.5 | 0.4 | Setosa | 0.04 | 0.01 | 0 | 0.01 | 0.244949 |
| 5 | 3.4 | 1.6 | 0.4 | Setosa | 0.04 | 0.01 | 0.01 | 0.01 | 0.264575 |
| 5 | 3.5 | 1.6 | 0.6 | Setosa | 0.04 | 0.04 | 0.01 | 0.01 | 0.316228 |
| 5.1 | 3.5 | 1.4 | 0.3 | Setosa | 0.01 | 0.04 | 0.01 | 0.04 | 0.316228 |
| 5.2 | 3.4 | 1.4 | 0.2 | Setosa | 0 | 0.01 | 0.01 | 0.09 | 0.331662 |
| 5.1 | 3.4 | 1.5 | 0.2 | Setosa | 0.01 | 0.01 | 0 | 0.09 | 0.331662 |
| 5.2 | 3.5 | 1.5 | 0.2 | Setosa | 0 | 0.04 | 0 | 0.09 | 0.360555 |
| 5 | 3.4 | 1.5 | 0.2 | Setosa | 0.04 | 0.01 | 0 | 0.09 | 0.374166 |
| 5.1 | 3.5 | 1.4 | 0.2 | Setosa | 0.01 | 0.04 | 0.01 | 0.09 | 0.387298 |
| 5 | 3.5 | 1.3 | 0.3 | Setosa | 0.04 | 0.04 | 0.04 | 0.04 | 0.4 |
| 5.4 | 3.4 | 1.7 | 0.2 | Setosa | 0.04 | 0.01 | 0.04 | 0.09 | 0.424264 |
| 5.1 | 3.7 | 1.5 | 0.4 | Setosa | 0.01 | 0.16 | 0 | 0.01 | 0.424264 |
| 5 | 3.2 | 1.2 | 0.2 | Setosa | 0.04 | 0.01 | 0.09 | 0.09 | 0.479583 |
| 5 | 3.6 | 1.4 | 0.2 | Setosa | 0.04 | 0.09 | 0.01 | 0.09 | 0.479583 |
| 5.3 | 3.7 | 1.5 | 0.2 | Setosa | 0.01 | 0.16 | 0 | 0.09 | 0.509902 |
| 5.1 | 3.8 | 1.5 | 0.3 | Setosa | 0.01 | 0.25 | 0 | 0.04 | 0.547723 |
| 4.9 | 3.6 | 1.4 | 0.1 | Setosa | 0.09 | 0.09 | 0.01 | 0.16 | 0.591608 |
| 4.7 | 3.2 | 1.6 | 0.2 | Setosa | 0.25 | 0.01 | 0.01 | 0.09 | 0.6 |
| 5.1 | 3.8 | 1.6 | 0.2 | Setosa | 0.01 | 0.25 | 0.01 | 0.09 | 0.6 |
| 4.7 | 3.2 | 1.3 | 0.2 | Setosa | 0.25 | 0.01 | 0.04 | 0.09 | 0.6245 |
| 4.8 | 3.4 | 1.9 | 0.2 | Setosa | 0.16 | 0.01 | 0.16 | 0.09 | 0.648074 |
| 4.6 | 3.4 | 1.4 | 0.3 | Setosa | 0.36 | 0.01 | 0.01 | 0.04 | 0.648074 |
| 4.6 | 3.2 | 1.4 | 0.2 | Setosa | 0.36 | 0.01 | 0.01 | 0.09 | 0.685565 |
| 4.6 | 3.1 | 1.5 | 0.2 | Setosa | 0.36 | 0.04 | 0 | 0.09 | 0.7 |
| 4.4 | 3.2 | 1.3 | 0.2 | Setosa | 0.64 | 0.01 | 0.04 | 0.09 | 0.883176 |
| 4.4 | 3 | 1.3 | 0.2 | Setosa | 0.64 | 0.09 | 0.04 | 0.09 | 0.927362 |
| 4.4 | 2.9 | 1.4 | 0.2 | Setosa | 0.64 | 0.16 | 0.01 | 0.09 | 0.948683 |
| 4.3 | 3 | 1.1 | 0.1 | Setosa | 0.81 | 0.09 | 0.16 | 0.16 | 1.104536 |
| 4.3 | 3 | 1.1 | 0.1 | Setosa | 0.81 | 0.09 | 0.16 | 0.16 | 1.104536 |
| 5 | 2.3 | 3.3 | 1 | Versicolor | 0.04 | 1 | 3.24 | 0.25 | 2.12838 |
| 5.7 | 2.6 | 3.5 | 1 | Versicolor | 0.25 | 0.49 | 4 | 0.25 | 2.233831 |
| 5.6 | 2.9 | 3.6 | 1.3 | Versicolor | 0.16 | 0.16 | 4.41 | 0.64 | 2.317326 |
| 5 | 2 | 3.5 | 1 | Versicolor | 0.04 | 1.69 | 4 | 0.25 | 2.445404 |
| 5.5 | 2.4 | 3.7 | 1 | Versicolor | 0.09 | 0.81 | 4.84 | 0.25 | 2.447448 |
| 5.5 | 2.4 | 3.8 | 1.1 | Versicolor | 0.09 | 0.81 | 5.29 | 0.36 | 2.559297 |
| 5.6 | 2.5 | 3.9 | 1.1 | Versicolor | 0.16 | 0.64 | 5.76 | 0.36 | 2.630589 |
| 5.2 | 2.7 | 3.9 | 1.4 | Versicolor | 0 | 0.36 | 5.76 | 0.81 | 2.632489 |
| 5.8 | 2.7 | 3.9 | 1.2 | Versicolor | 0.36 | 0.36 | 5.76 | 0.49 | 2.640076 |
| 5.8 | 2.6 | 4 | 1.2 | Versicolor | 0.36 | 0.49 | 6.25 | 0.49 | 2.754995 |
| 5.5 | 2.5 | 4 | 1.3 | Versicolor | 0.09 | 0.64 | 6.25 | 0.64 | 2.760435 |
| 5.6 | 3 | 4.1 | 1.3 | Versicolor | 0.16 | 0.09 | 6.76 | 0.64 | 2.765863 |
| 5.8 | 2.7 | 4.1 | 1 | Versicolor | 0.36 | 0.36 | 6.76 | 0.25 | 2.780288 |
| 5.7 | 2.8 | 4.1 | 1.3 | Versicolor | 0.25 | 0.25 | 6.76 | 0.64 | 2.810694 |
| 6.1 | 2.8 | 4 | 1.3 | Versicolor | 0.81 | 0.25 | 6.25 | 0.64 | 2.819574 |
| 5.5 | 2.3 | 4 | 1.3 | Versicolor | 0.09 | 1 | 6.25 | 0.64 | 2.824889 |
| 5.7 | 3 | 4.2 | 1.2 | Versicolor | 0.25 | 0.09 | 7.29 | 0.49 | 2.849561 |
| 5.7 | 2.9 | 4.2 | 1.3 | Versicolor | 0.25 | 0.16 | 7.29 | 0.64 | 2.887906 |
| 6 | 2.2 | 4 | 1 | Versicolor | 0.64 | 1.21 | 6.25 | 0.25 | 2.889637 |
| 5.6 | 2.7 | 4.2 | 1.3 | Versicolor | 0.16 | 0.36 | 7.29 | 0.64 | 2.906888 |
| 5.9 | 3 | 4.2 | 1.5 | Versicolor | 0.49 | 0.09 | 7.29 | 1 | 2.978255 |
| 5.5 | 2.6 | 4.4 | 1.2 | Versicolor | 0.09 | 0.49 | 8.41 | 0.49 | 3.078961 |
| 6.2 | 2.9 | 4.3 | 1.3 | Versicolor | 1 | 0.16 | 7.84 | 0.64 | 3.104835 |
| 6.4 | 2.9 | 4.3 | 1.3 | Versicolor | 1.44 | 0.16 | 7.84 | 0.64 | 3.174902 |
| 5.4 | 3 | 4.5 | 1.5 | Versicolor | 0.04 | 0.09 | 9 | 1 | 3.182766 |
| 5.7 | 2.8 | 4.5 | 1.3 | Versicolor | 0.25 | 0.25 | 9 | 0.64 | 3.184337 |
| 5.6 | 3 | 4.5 | 1.5 | Versicolor | 0.16 | 0.09 | 9 | 1 | 3.201562 |
| 6 | 3.4 | 4.5 | 1.6 | Versicolor | 0.64 | 0.01 | 9 | 1.21 | 3.295451 |
| 6.6 | 3 | 4.4 | 1.4 | Versicolor | 1.96 | 0.09 | 8.41 | 0.81 | 3.357082 |
| 6.1 | 3 | 4.6 | 1.4 | Versicolor | 0.81 | 0.09 | 9.61 | 0.81 | 3.364521 |
| 6.2 | 2.8 | 4.8 | 1.8 | Virginica | 1 | 0.25 | 10.89 | 1.69 | 3.718871 |
| 6.1 | 3 | 4.9 | 1.8 | Virginica | 0.81 | 0.09 | 11.56 | 1.69 | 3.761649 |
| 5.6 | 2.8 | 4.9 | 2 | Virginica | 0.16 | 0.25 | 11.56 | 2.25 | 3.770942 |
| 6.5 | 3.2 | 5.1 | 2 | Virginica | 1.69 | 0.01 | 12.96 | 2.25 | 4.112177 |
| 5.8 | 2.8 | 5.1 | 2.4 | Virginica | 0.36 | 0.25 | 12.96 | 3.61 | 4.144876 |
| 6.5 | 3 | 5.2 | 2 | Virginica | 1.69 | 0.09 | 13.69 | 2.25 | 4.209513 |
| 6.4 | 2.7 | 5.3 | 1.9 | Virginica | 1.44 | 0.36 | 14.44 | 1.96 | 4.266146 |
| 6.1 | 2.6 | 5.6 | 1.4 | Virginica | 0.81 | 0.49 | 16.81 | 0.81 | 4.349713 |
| 6.9 | 3.1 | 5.1 | 2.3 | Virginica | 2.89 | 0.04 | 12.96 | 3.24 | 4.373786 |
| 6.4 | 3.2 | 5.3 | 2.3 | Virginica | 1.44 | 0.01 | 14.44 | 3.24 | 4.373786 |
| 6.4 | 3.1 | 5.5 | 1.8 | Virginica | 1.44 | 0.04 | 16 | 1.69 | 4.378356 |
| 6.7 | 3 | 5.2 | 2.3 | Virginica | 2.25 | 0.09 | 13.69 | 3.24 | 4.389761 |
| 6.2 | 3.4 | 5.4 | 2.3 | Virginica | 1 | 0.01 | 15.21 | 3.24 | 4.411349 |
| 6.5 | 3 | 5.5 | 1.8 | Virginica | 1.69 | 0.09 | 16 | 1.69 | 4.412482 |
| 6.3 | 2.9 | 5.6 | 1.8 | Virginica | 1.21 | 0.16 | 16.81 | 1.69 | 4.457578 |
| 6.9 | 3.1 | 5.4 | 2.1 | Virginica | 2.89 | 0.04 | 15.21 | 2.56 | 4.549725 |
| 6.4 | 2.8 | 5.6 | 2.1 | Virginica | 1.44 | 0.25 | 16.81 | 2.56 | 4.589118 |
| 6.8 | 3 | 5.5 | 2.1 | Virginica | 2.56 | 0.09 | 16 | 2.56 | 4.605432 |
| 6.4 | 2.8 | 5.6 | 2.2 | Virginica | 1.44 | 0.25 | 16.81 | 2.89 | 4.624932 |
| 6.3 | 3.4 | 5.6 | 2.4 | Virginica | 1.21 | 0.01 | 16.81 | 3.61 | 4.651881 |
| 6.7 | 3.3 | 5.7 | 2.1 | Virginica | 2.25 | 0 | 17.64 | 2.56 | 4.738143 |
| 6.7 | 3.1 | 5.6 | 2.4 | Virginica | 2.25 | 0.04 | 16.81 | 3.61 | 4.765501 |
| 6.7 | 2.5 | 5.8 | 1.8 | Virginica | 2.25 | 0.64 | 18.49 | 1.69 | 4.803124 |
| 6.5 | 3 | 5.8 | 2.2 | Virginica | 1.69 | 0.09 | 18.49 | 2.89 | 4.812484 |
| 6.9 | 3.2 | 5.7 | 2.3 | Virginica | 2.89 | 0.01 | 17.64 | 3.24 | 4.876474 |
| 7.2 | 3 | 5.8 | 1.6 | Virginica | 4 | 0.09 | 18.49 | 1.21 | 4.877499 |
| 6.7 | 3.3 | 5.7 | 2.5 | Virginica | 2.25 | 0 | 17.64 | 4 | 4.88774 |
| 6.8 | 3.2 | 5.9 | 2.3 | Virginica | 2.56 | 0.01 | 19.36 | 3.24 | 5.016971 |
| 6.3 | 3.3 | 6 | 2.5 | Virginica | 1.21 | 0 | 20.25 | 4 | 5.04579 |
| 7.1 | 3 | 5.9 | 2.1 | Virginica | 3.61 | 0.09 | 19.36 | 2.56 | 5.06162 |
| 7.2 | 3.2 | 6 | 1.8 | Virginica | 4 | 0.01 | 20.25 | 1.69 | 5.094114 |
| 7.4 | 2.8 | 6.1 | 1.9 | Virginica | 4.84 | 0.25 | 21.16 | 1.96 | 5.311309 |
| 7.2 | 3.6 | 6.1 | 2.5 | Virginica | 4 | 0.09 | 21.16 | 4 | 5.408327 |
| 7.3 | 2.9 | 6.3 | 1.8 | Virginica | 4.41 | 0.16 | 23.04 | 1.69 | 5.412947 |
| 7.7 | 3 | 6.1 | 2.3 | Virginica | 6.25 | 0.09 | 21.16 | 3.24 | 5.544367 |
| 7.9 | 3.8 | 6.4 | 2 | Virginica | 7.29 | 0.25 | 24.01 | 2.25 | 5.813777 |
| 7.6 | 3 | 6.6 | 2.1 | Virginica | 5.76 | 0.09 | 26.01 | 2.56 | 5.866856 |
| 7.7 | 2.8 | 6.7 | 2 | Virginica | 6.25 | 0.25 | 27.04 | 2.25 | 5.982474 |
| 7.7 | 3.8 | 6.7 | 2.2 | Virginica | 6.25 | 0.25 | 27.04 | 2.89 | 6.035727 |
| 7.7 | 2.6 | 6.9 | 2.3 | Virginica | 6.25 | 0.49 | 29.16 | 3.24 | 6.256197 |
K=5
| e | 1/e | setosa | versicolor | virginica |
|---|---|---|---|---|
| 0.223607 | 4.472132 | 4.472132 | 0 | 0 |
| 0.244949 | 4.082482 | 4.082482 | 0 | 0 |
| 0.264575 | 3.779647 | 3.779647 | 0 | 0 |
| 0.316228 | 3.162275 | 3.162275 | 0 | 0 |
| 0.331662 | 3.015118 | 3.015118 | 0 | 0 |
CLASS : SETOSA