KKN Weighted
KKN/K-Nearest Neighbor Classifier adalah metode pengelompokan data dengan cara membandingkan data baru dengan K data terdekat, metode ini juga disebut juga dengan Lazy Algorithm karena cara perhitungannya yang mudah serta tingkat keakurasian yang tinggi
Mengklasifikasi data menggunakan metode weighted KNN. Menggunakan data iris yang diambil acak sebanyak 100 data.
dengan data sampel sebagai berikut :
sepal length | sepal width | petal length | petal width | variety |
---|---|---|---|---|
5.2 | 3.3 | 1.5 | 0.5 | Setosa |
Data training :
a | b | c | d | class |
---|---|---|---|---|
5.8 | 2.6 | 4 | 1.2 | Versicolor |
5.5 | 2.5 | 4 | 1.3 | Versicolor |
5.6 | 3 | 4.1 | 1.3 | Versicolor |
5.8 | 2.7 | 4.1 | 1 | Versicolor |
5.7 | 2.8 | 4.1 | 1.3 | Versicolor |
6.1 | 2.8 | 4 | 1.3 | Versicolor |
5.5 | 2.3 | 4 | 1.3 | Versicolor |
5.7 | 3 | 4.2 | 1.2 | Versicolor |
5.7 | 2.9 | 4.2 | 1.3 | Versicolor |
6 | 2.2 | 4 | 1 | Versicolor |
5.6 | 2.7 | 4.2 | 1.3 | Versicolor |
5.9 | 3 | 4.2 | 1.5 | Versicolor |
5.5 | 2.6 | 4.4 | 1.2 | Versicolor |
6.2 | 2.9 | 4.3 | 1.3 | Versicolor |
6.4 | 2.9 | 4.3 | 1.3 | Versicolor |
5.4 | 3 | 4.5 | 1.5 | Versicolor |
5.7 | 2.8 | 4.5 | 1.3 | Versicolor |
6.4 | 3.2 | 5.3 | 2.3 | Virginica |
6.4 | 3.1 | 5.5 | 1.8 | Virginica |
6.7 | 3 | 5.2 | 2.3 | Virginica |
6.2 | 3.4 | 5.4 | 2.3 | Virginica |
6.5 | 3 | 5.5 | 1.8 | Virginica |
6.3 | 2.9 | 5.6 | 1.8 | Virginica |
6.9 | 3.1 | 5.4 | 2.1 | Virginica |
6.4 | 2.8 | 5.6 | 2.1 | Virginica |
6.8 | 3 | 5.5 | 2.1 | Virginica |
6.4 | 2.8 | 5.6 | 2.2 | Virginica |
6.3 | 3.4 | 5.6 | 2.4 | Virginica |
6.7 | 3.3 | 5.7 | 2.1 | Virginica |
6.7 | 3.1 | 5.6 | 2.4 | Virginica |
6.7 | 2.5 | 5.8 | 1.8 | Virginica |
6.5 | 3 | 5.8 | 2.2 | Virginica |
6.9 | 3.2 | 5.7 | 2.3 | Virginica |
7.2 | 3 | 5.8 | 1.6 | Virginica |
6.7 | 3.3 | 5.7 | 2.5 | Virginica |
5.1 | 3.3 | 1.7 | 0.5 | Setosa |
5.4 | 3.4 | 1.5 | 0.4 | Setosa |
5 | 3.4 | 1.6 | 0.4 | Setosa |
5 | 3.5 | 1.6 | 0.6 | Setosa |
5.1 | 3.5 | 1.4 | 0.3 | Setosa |
5.2 | 3.4 | 1.4 | 0.2 | Setosa |
5.1 | 3.4 | 1.5 | 0.2 | Setosa |
5.2 | 3.5 | 1.5 | 0.2 | Setosa |
5 | 3.4 | 1.5 | 0.2 | Setosa |
5.1 | 3.5 | 1.4 | 0.2 | Setosa |
5 | 3.5 | 1.3 | 0.3 | Setosa |
5.4 | 3.4 | 1.7 | 0.2 | Setosa |
5.1 | 3.7 | 1.5 | 0.4 | Setosa |
5 | 3.2 | 1.2 | 0.2 | Setosa |
5 | 3.6 | 1.4 | 0.2 | Setosa |
4.3 | 3 | 1.1 | 0.1 | Setosa |
4.3 | 3 | 1.1 | 0.1 | Setosa |
5 | 2.3 | 3.3 | 1 | Versicolor |
5.7 | 2.6 | 3.5 | 1 | Versicolor |
5.6 | 2.9 | 3.6 | 1.3 | Versicolor |
5 | 2 | 3.5 | 1 | Versicolor |
5.5 | 2.4 | 3.7 | 1 | Versicolor |
5.5 | 2.4 | 3.8 | 1.1 | Versicolor |
5.6 | 2.5 | 3.9 | 1.1 | Versicolor |
5.2 | 2.7 | 3.9 | 1.4 | Versicolor |
5.8 | 2.7 | 3.9 | 1.2 | Versicolor |
5.3 | 3.7 | 1.5 | 0.2 | Setosa |
5.1 | 3.8 | 1.5 | 0.3 | Setosa |
4.9 | 3.6 | 1.4 | 0.1 | Setosa |
4.7 | 3.2 | 1.6 | 0.2 | Setosa |
5.1 | 3.8 | 1.6 | 0.2 | Setosa |
4.7 | 3.2 | 1.3 | 0.2 | Setosa |
4.8 | 3.4 | 1.9 | 0.2 | Setosa |
4.6 | 3.4 | 1.4 | 0.3 | Setosa |
4.6 | 3.2 | 1.4 | 0.2 | Setosa |
4.6 | 3.1 | 1.5 | 0.2 | Setosa |
4.4 | 3.2 | 1.3 | 0.2 | Setosa |
4.4 | 3 | 1.3 | 0.2 | Setosa |
4.4 | 2.9 | 1.4 | 0.2 | Setosa |
5.6 | 3 | 4.5 | 1.5 | Versicolor |
6 | 3.4 | 4.5 | 1.6 | Versicolor |
6.6 | 3 | 4.4 | 1.4 | Versicolor |
6.1 | 3 | 4.6 | 1.4 | Versicolor |
6.2 | 2.8 | 4.8 | 1.8 | Virginica |
6.1 | 3 | 4.9 | 1.8 | Virginica |
5.6 | 2.8 | 4.9 | 2 | Virginica |
6.5 | 3.2 | 5.1 | 2 | Virginica |
5.8 | 2.8 | 5.1 | 2.4 | Virginica |
6.5 | 3 | 5.2 | 2 | Virginica |
6.4 | 2.7 | 5.3 | 1.9 | Virginica |
6.1 | 2.6 | 5.6 | 1.4 | Virginica |
6.9 | 3.1 | 5.1 | 2.3 | Virginica |
6.8 | 3.2 | 5.9 | 2.3 | Virginica |
6.3 | 3.3 | 6 | 2.5 | Virginica |
7.1 | 3 | 5.9 | 2.1 | Virginica |
7.2 | 3.2 | 6 | 1.8 | Virginica |
7.4 | 2.8 | 6.1 | 1.9 | Virginica |
7.2 | 3.6 | 6.1 | 2.5 | Virginica |
7.3 | 2.9 | 6.3 | 1.8 | Virginica |
7.7 | 3 | 6.1 | 2.3 | Virginica |
7.9 | 3.8 | 6.4 | 2 | Virginica |
7.6 | 3 | 6.6 | 2.1 | Virginica |
7.7 | 2.8 | 6.7 | 2 | Virginica |
7.7 | 3.8 | 6.7 | 2.2 | Virginica |
7.7 | 2.6 | 6.9 | 2.3 | Virginica |
Menghitung Jarak
a | b | c | d | class | (a-sd1)^2 | (b-sd2)^2 | (c-sd3)^2 | (d-sd4)^2 | SQRT |
---|---|---|---|---|---|---|---|---|---|
5.1 | 3.3 | 1.7 | 0.5 | Setosa | 0.01 | 0 | 0.04 | 0 | 0.223607 |
5.4 | 3.4 | 1.5 | 0.4 | Setosa | 0.04 | 0.01 | 0 | 0.01 | 0.244949 |
5 | 3.4 | 1.6 | 0.4 | Setosa | 0.04 | 0.01 | 0.01 | 0.01 | 0.264575 |
5 | 3.5 | 1.6 | 0.6 | Setosa | 0.04 | 0.04 | 0.01 | 0.01 | 0.316228 |
5.1 | 3.5 | 1.4 | 0.3 | Setosa | 0.01 | 0.04 | 0.01 | 0.04 | 0.316228 |
5.2 | 3.4 | 1.4 | 0.2 | Setosa | 0 | 0.01 | 0.01 | 0.09 | 0.331662 |
5.1 | 3.4 | 1.5 | 0.2 | Setosa | 0.01 | 0.01 | 0 | 0.09 | 0.331662 |
5.2 | 3.5 | 1.5 | 0.2 | Setosa | 0 | 0.04 | 0 | 0.09 | 0.360555 |
5 | 3.4 | 1.5 | 0.2 | Setosa | 0.04 | 0.01 | 0 | 0.09 | 0.374166 |
5.1 | 3.5 | 1.4 | 0.2 | Setosa | 0.01 | 0.04 | 0.01 | 0.09 | 0.387298 |
5 | 3.5 | 1.3 | 0.3 | Setosa | 0.04 | 0.04 | 0.04 | 0.04 | 0.4 |
5.4 | 3.4 | 1.7 | 0.2 | Setosa | 0.04 | 0.01 | 0.04 | 0.09 | 0.424264 |
5.1 | 3.7 | 1.5 | 0.4 | Setosa | 0.01 | 0.16 | 0 | 0.01 | 0.424264 |
5 | 3.2 | 1.2 | 0.2 | Setosa | 0.04 | 0.01 | 0.09 | 0.09 | 0.479583 |
5 | 3.6 | 1.4 | 0.2 | Setosa | 0.04 | 0.09 | 0.01 | 0.09 | 0.479583 |
5.3 | 3.7 | 1.5 | 0.2 | Setosa | 0.01 | 0.16 | 0 | 0.09 | 0.509902 |
5.1 | 3.8 | 1.5 | 0.3 | Setosa | 0.01 | 0.25 | 0 | 0.04 | 0.547723 |
4.9 | 3.6 | 1.4 | 0.1 | Setosa | 0.09 | 0.09 | 0.01 | 0.16 | 0.591608 |
4.7 | 3.2 | 1.6 | 0.2 | Setosa | 0.25 | 0.01 | 0.01 | 0.09 | 0.6 |
5.1 | 3.8 | 1.6 | 0.2 | Setosa | 0.01 | 0.25 | 0.01 | 0.09 | 0.6 |
4.7 | 3.2 | 1.3 | 0.2 | Setosa | 0.25 | 0.01 | 0.04 | 0.09 | 0.6245 |
4.8 | 3.4 | 1.9 | 0.2 | Setosa | 0.16 | 0.01 | 0.16 | 0.09 | 0.648074 |
4.6 | 3.4 | 1.4 | 0.3 | Setosa | 0.36 | 0.01 | 0.01 | 0.04 | 0.648074 |
4.6 | 3.2 | 1.4 | 0.2 | Setosa | 0.36 | 0.01 | 0.01 | 0.09 | 0.685565 |
4.6 | 3.1 | 1.5 | 0.2 | Setosa | 0.36 | 0.04 | 0 | 0.09 | 0.7 |
4.4 | 3.2 | 1.3 | 0.2 | Setosa | 0.64 | 0.01 | 0.04 | 0.09 | 0.883176 |
4.4 | 3 | 1.3 | 0.2 | Setosa | 0.64 | 0.09 | 0.04 | 0.09 | 0.927362 |
4.4 | 2.9 | 1.4 | 0.2 | Setosa | 0.64 | 0.16 | 0.01 | 0.09 | 0.948683 |
4.3 | 3 | 1.1 | 0.1 | Setosa | 0.81 | 0.09 | 0.16 | 0.16 | 1.104536 |
4.3 | 3 | 1.1 | 0.1 | Setosa | 0.81 | 0.09 | 0.16 | 0.16 | 1.104536 |
5 | 2.3 | 3.3 | 1 | Versicolor | 0.04 | 1 | 3.24 | 0.25 | 2.12838 |
5.7 | 2.6 | 3.5 | 1 | Versicolor | 0.25 | 0.49 | 4 | 0.25 | 2.233831 |
5.6 | 2.9 | 3.6 | 1.3 | Versicolor | 0.16 | 0.16 | 4.41 | 0.64 | 2.317326 |
5 | 2 | 3.5 | 1 | Versicolor | 0.04 | 1.69 | 4 | 0.25 | 2.445404 |
5.5 | 2.4 | 3.7 | 1 | Versicolor | 0.09 | 0.81 | 4.84 | 0.25 | 2.447448 |
5.5 | 2.4 | 3.8 | 1.1 | Versicolor | 0.09 | 0.81 | 5.29 | 0.36 | 2.559297 |
5.6 | 2.5 | 3.9 | 1.1 | Versicolor | 0.16 | 0.64 | 5.76 | 0.36 | 2.630589 |
5.2 | 2.7 | 3.9 | 1.4 | Versicolor | 0 | 0.36 | 5.76 | 0.81 | 2.632489 |
5.8 | 2.7 | 3.9 | 1.2 | Versicolor | 0.36 | 0.36 | 5.76 | 0.49 | 2.640076 |
5.8 | 2.6 | 4 | 1.2 | Versicolor | 0.36 | 0.49 | 6.25 | 0.49 | 2.754995 |
5.5 | 2.5 | 4 | 1.3 | Versicolor | 0.09 | 0.64 | 6.25 | 0.64 | 2.760435 |
5.6 | 3 | 4.1 | 1.3 | Versicolor | 0.16 | 0.09 | 6.76 | 0.64 | 2.765863 |
5.8 | 2.7 | 4.1 | 1 | Versicolor | 0.36 | 0.36 | 6.76 | 0.25 | 2.780288 |
5.7 | 2.8 | 4.1 | 1.3 | Versicolor | 0.25 | 0.25 | 6.76 | 0.64 | 2.810694 |
6.1 | 2.8 | 4 | 1.3 | Versicolor | 0.81 | 0.25 | 6.25 | 0.64 | 2.819574 |
5.5 | 2.3 | 4 | 1.3 | Versicolor | 0.09 | 1 | 6.25 | 0.64 | 2.824889 |
5.7 | 3 | 4.2 | 1.2 | Versicolor | 0.25 | 0.09 | 7.29 | 0.49 | 2.849561 |
5.7 | 2.9 | 4.2 | 1.3 | Versicolor | 0.25 | 0.16 | 7.29 | 0.64 | 2.887906 |
6 | 2.2 | 4 | 1 | Versicolor | 0.64 | 1.21 | 6.25 | 0.25 | 2.889637 |
5.6 | 2.7 | 4.2 | 1.3 | Versicolor | 0.16 | 0.36 | 7.29 | 0.64 | 2.906888 |
5.9 | 3 | 4.2 | 1.5 | Versicolor | 0.49 | 0.09 | 7.29 | 1 | 2.978255 |
5.5 | 2.6 | 4.4 | 1.2 | Versicolor | 0.09 | 0.49 | 8.41 | 0.49 | 3.078961 |
6.2 | 2.9 | 4.3 | 1.3 | Versicolor | 1 | 0.16 | 7.84 | 0.64 | 3.104835 |
6.4 | 2.9 | 4.3 | 1.3 | Versicolor | 1.44 | 0.16 | 7.84 | 0.64 | 3.174902 |
5.4 | 3 | 4.5 | 1.5 | Versicolor | 0.04 | 0.09 | 9 | 1 | 3.182766 |
5.7 | 2.8 | 4.5 | 1.3 | Versicolor | 0.25 | 0.25 | 9 | 0.64 | 3.184337 |
5.6 | 3 | 4.5 | 1.5 | Versicolor | 0.16 | 0.09 | 9 | 1 | 3.201562 |
6 | 3.4 | 4.5 | 1.6 | Versicolor | 0.64 | 0.01 | 9 | 1.21 | 3.295451 |
6.6 | 3 | 4.4 | 1.4 | Versicolor | 1.96 | 0.09 | 8.41 | 0.81 | 3.357082 |
6.1 | 3 | 4.6 | 1.4 | Versicolor | 0.81 | 0.09 | 9.61 | 0.81 | 3.364521 |
6.2 | 2.8 | 4.8 | 1.8 | Virginica | 1 | 0.25 | 10.89 | 1.69 | 3.718871 |
6.1 | 3 | 4.9 | 1.8 | Virginica | 0.81 | 0.09 | 11.56 | 1.69 | 3.761649 |
5.6 | 2.8 | 4.9 | 2 | Virginica | 0.16 | 0.25 | 11.56 | 2.25 | 3.770942 |
6.5 | 3.2 | 5.1 | 2 | Virginica | 1.69 | 0.01 | 12.96 | 2.25 | 4.112177 |
5.8 | 2.8 | 5.1 | 2.4 | Virginica | 0.36 | 0.25 | 12.96 | 3.61 | 4.144876 |
6.5 | 3 | 5.2 | 2 | Virginica | 1.69 | 0.09 | 13.69 | 2.25 | 4.209513 |
6.4 | 2.7 | 5.3 | 1.9 | Virginica | 1.44 | 0.36 | 14.44 | 1.96 | 4.266146 |
6.1 | 2.6 | 5.6 | 1.4 | Virginica | 0.81 | 0.49 | 16.81 | 0.81 | 4.349713 |
6.9 | 3.1 | 5.1 | 2.3 | Virginica | 2.89 | 0.04 | 12.96 | 3.24 | 4.373786 |
6.4 | 3.2 | 5.3 | 2.3 | Virginica | 1.44 | 0.01 | 14.44 | 3.24 | 4.373786 |
6.4 | 3.1 | 5.5 | 1.8 | Virginica | 1.44 | 0.04 | 16 | 1.69 | 4.378356 |
6.7 | 3 | 5.2 | 2.3 | Virginica | 2.25 | 0.09 | 13.69 | 3.24 | 4.389761 |
6.2 | 3.4 | 5.4 | 2.3 | Virginica | 1 | 0.01 | 15.21 | 3.24 | 4.411349 |
6.5 | 3 | 5.5 | 1.8 | Virginica | 1.69 | 0.09 | 16 | 1.69 | 4.412482 |
6.3 | 2.9 | 5.6 | 1.8 | Virginica | 1.21 | 0.16 | 16.81 | 1.69 | 4.457578 |
6.9 | 3.1 | 5.4 | 2.1 | Virginica | 2.89 | 0.04 | 15.21 | 2.56 | 4.549725 |
6.4 | 2.8 | 5.6 | 2.1 | Virginica | 1.44 | 0.25 | 16.81 | 2.56 | 4.589118 |
6.8 | 3 | 5.5 | 2.1 | Virginica | 2.56 | 0.09 | 16 | 2.56 | 4.605432 |
6.4 | 2.8 | 5.6 | 2.2 | Virginica | 1.44 | 0.25 | 16.81 | 2.89 | 4.624932 |
6.3 | 3.4 | 5.6 | 2.4 | Virginica | 1.21 | 0.01 | 16.81 | 3.61 | 4.651881 |
6.7 | 3.3 | 5.7 | 2.1 | Virginica | 2.25 | 0 | 17.64 | 2.56 | 4.738143 |
6.7 | 3.1 | 5.6 | 2.4 | Virginica | 2.25 | 0.04 | 16.81 | 3.61 | 4.765501 |
6.7 | 2.5 | 5.8 | 1.8 | Virginica | 2.25 | 0.64 | 18.49 | 1.69 | 4.803124 |
6.5 | 3 | 5.8 | 2.2 | Virginica | 1.69 | 0.09 | 18.49 | 2.89 | 4.812484 |
6.9 | 3.2 | 5.7 | 2.3 | Virginica | 2.89 | 0.01 | 17.64 | 3.24 | 4.876474 |
7.2 | 3 | 5.8 | 1.6 | Virginica | 4 | 0.09 | 18.49 | 1.21 | 4.877499 |
6.7 | 3.3 | 5.7 | 2.5 | Virginica | 2.25 | 0 | 17.64 | 4 | 4.88774 |
6.8 | 3.2 | 5.9 | 2.3 | Virginica | 2.56 | 0.01 | 19.36 | 3.24 | 5.016971 |
6.3 | 3.3 | 6 | 2.5 | Virginica | 1.21 | 0 | 20.25 | 4 | 5.04579 |
7.1 | 3 | 5.9 | 2.1 | Virginica | 3.61 | 0.09 | 19.36 | 2.56 | 5.06162 |
7.2 | 3.2 | 6 | 1.8 | Virginica | 4 | 0.01 | 20.25 | 1.69 | 5.094114 |
7.4 | 2.8 | 6.1 | 1.9 | Virginica | 4.84 | 0.25 | 21.16 | 1.96 | 5.311309 |
7.2 | 3.6 | 6.1 | 2.5 | Virginica | 4 | 0.09 | 21.16 | 4 | 5.408327 |
7.3 | 2.9 | 6.3 | 1.8 | Virginica | 4.41 | 0.16 | 23.04 | 1.69 | 5.412947 |
7.7 | 3 | 6.1 | 2.3 | Virginica | 6.25 | 0.09 | 21.16 | 3.24 | 5.544367 |
7.9 | 3.8 | 6.4 | 2 | Virginica | 7.29 | 0.25 | 24.01 | 2.25 | 5.813777 |
7.6 | 3 | 6.6 | 2.1 | Virginica | 5.76 | 0.09 | 26.01 | 2.56 | 5.866856 |
7.7 | 2.8 | 6.7 | 2 | Virginica | 6.25 | 0.25 | 27.04 | 2.25 | 5.982474 |
7.7 | 3.8 | 6.7 | 2.2 | Virginica | 6.25 | 0.25 | 27.04 | 2.89 | 6.035727 |
7.7 | 2.6 | 6.9 | 2.3 | Virginica | 6.25 | 0.49 | 29.16 | 3.24 | 6.256197 |
K=5
e | 1/e | setosa | versicolor | virginica |
---|---|---|---|---|
0.223607 | 4.472132 | 4.472132 | 0 | 0 |
0.244949 | 4.082482 | 4.082482 | 0 | 0 |
0.264575 | 3.779647 | 3.779647 | 0 | 0 |
0.316228 | 3.162275 | 3.162275 | 0 | 0 |
0.331662 | 3.015118 | 3.015118 | 0 | 0 |
CLASS : SETOSA