Yucatan Molly (Poecilia velifera...Category 0.000≤X≤0.005 Low 0.005
1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest...
-
date post
15-Jan-2016 -
Category
Documents
-
view
219 -
download
0
Transcript of 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest...
![Page 1: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/1.jpg)
![Page 2: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/2.jpg)
1-NN Rule: Given an unknown sample X decide if
for
That is, assign X to category if the closest neighbor of X is from category i.
i
),(),( jlik XXdXXd ikjl
i
X
![Page 3: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/3.jpg)
k-NN rule: instead of looking at the closest sample, we look at k nearest neighbors to X and we take a vote. The largest vote wins. k is usually taken as an odd number so that no ties occur.
![Page 4: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/4.jpg)
![Page 5: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/5.jpg)
Distance Measures(Metrices)Non-negativity
Reflexivity when only x = y
Symmetry
Triangle inequality
Euclidian distance satisfies.Not always a meaningful measure.Consider 2 features with different units scaling
problem.
0),( yxD
0),( yxD
),(),( xyDyxD
),(),(),( yxDyzDzxD
)(2
hight
X
)(1
weight
X
Scale of changed to half.1X
![Page 6: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/6.jpg)
Minkowski MetricA general definition
norm – City block (Manhattan) distance norm – Euclidian
Scaling: Normalize the data by re-scaling (Reduce the range to 0-1) (equivalent to changing the metric)
kd
i
k
iik yxyxL/1
1
),(
1L2L
Y
b
a
X
baL 1
![Page 7: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/7.jpg)
![Page 8: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/8.jpg)
![Page 9: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/9.jpg)
![Page 10: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/10.jpg)
![Page 11: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/11.jpg)
![Page 12: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/12.jpg)
![Page 13: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/13.jpg)
![Page 14: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/14.jpg)
![Page 15: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/15.jpg)
![Page 16: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/16.jpg)
![Page 17: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/17.jpg)
![Page 18: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/18.jpg)
![Page 19: 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.](https://reader035.fdocuments.net/reader035/viewer/2022062409/56649d4d5503460f94a2bc63/html5/thumbnails/19.jpg)
References
R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, New York: John Wiley, 2001. N. Yalabık, “Pattern Classification with Biomedical Applications Course Material”, 2010.