nearest neighbors (KNN) are known as one of the simplest nonparametric classifiers but in high dimensional setting accuracy of KNN are affected by nuisance features. In this study, we proposed the important neighbors (KIN) as a novel approach for binary classification in high dimensional problems. To avoid the curse of dimensionality, we implemented smoothly clipped absolute deviation (SCAD) logistic regression at the initial stage and considered the importance of each feature in construction of dissimilarity measure with imposing features contribution as a function of SCAD coefficients on Euclidean distance. The nature of this hybrid dissimilarity measure, which combines information of both features and distances, enjoys all good properties of SCAD penalized regression and KNN simultaneously. In comparison to KNN, simulation studies showed that KIN has a good performance in terms of both accuracy and dimension reduction. The proposed approach was found to be capable of eliminating nearly all of the noninformative features because of utilizing oracle property of SCAD penalized regression in the construction of dissimilarity measure. In very sparse settings, KIN also outperforms support vector machine (SVM) and random forest (RF) as the best classifiers.
from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/2yZGJY5
via IFTTT
Εγγραφή σε:
Σχόλια ανάρτησης (Atom)
Δημοφιλείς αναρτήσεις
-
The new app from IBM will let crowds automatically coordinates mass displays at big sporting events or protests using their smartphone camer...
-
Abstract Objective The objective of this study were to find the annual case trend of inflammatory jawbone diseases and to investigate th...
-
The investigational third-generation nonsteroidal oral selective estrogen receptor degrader RAD1901 was associated with a 23% objective resp...
-
by Patrick P. Lowe, Benedek Gyongyosi, Abhishek Satishchandran, Arvin Iracheta-Vellve, Aditya Ambade, Yeonhee Cho, Karen Kodys, Donna Catala...
-
A magnetic Fe3O4/GO composite with potential for rapid solid-liquid separation through a magnetic field was synthesized using GO (graphene o...
-
Very high cycle fatigue behavior of nugget zone in AA 7075 friction stir welded joint was experimentally investigated using ultrasonic fatig...
-
from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/2tGBTt3 via IFTTT
-
People with attention deficit hyperactivity disorder (ADHD) had a lower risk of motor vehicle crashes when they had received their medicatio...
-
No abstract available from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/2s0tRdV via IFTTT
-
Activation of class I Phosphoinositide 3-kinases (PI3Ks) by mutation or overexpression closely correlates with the development of various hu...
Δεν υπάρχουν σχόλια:
Δημοσίευση σχολίου