nearest neighbors (KNN) are known as one of the simplest nonparametric classifiers but in high dimensional setting accuracy of KNN are affected by nuisance features. In this study, we proposed the important neighbors (KIN) as a novel approach for binary classification in high dimensional problems. To avoid the curse of dimensionality, we implemented smoothly clipped absolute deviation (SCAD) logistic regression at the initial stage and considered the importance of each feature in construction of dissimilarity measure with imposing features contribution as a function of SCAD coefficients on Euclidean distance. The nature of this hybrid dissimilarity measure, which combines information of both features and distances, enjoys all good properties of SCAD penalized regression and KNN simultaneously. In comparison to KNN, simulation studies showed that KIN has a good performance in terms of both accuracy and dimension reduction. The proposed approach was found to be capable of eliminating nearly all of the noninformative features because of utilizing oracle property of SCAD penalized regression in the construction of dissimilarity measure. In very sparse settings, KIN also outperforms support vector machine (SVM) and random forest (RF) as the best classifiers.
from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/2yZGJY5
via IFTTT
Εγγραφή σε:
Σχόλια ανάρτησης (Atom)
Δημοφιλείς αναρτήσεις
-
Publication date: Available online 4 January 2018 Source: European Journal of Radiology Author(s): Peiyao Zhang, Jing Wang, Qin Xu, Zhen...
-
Medicine by Alexandros G. Sfakianakis,Anapafseos 5 Agios Nikolaos 72100 Crete Greece,00302841026182, Butyric Acid from Probiotic Staphyloco...
-
Does CBD Oil Lower Blood Pressure? This article was originally published at SundayScaries." Madeline Taylor POSTED ON January 13, 20...
-
Medicine by Alexandros G. Sfakianakis,Αλέξανδρος Γ. Σφακιανάκης A Novel Technique for Endoscopic Repair of Large Anterior Skull Base Defect...
-
2016-11-22T07-55-59Z Source: International Journal of Medical Science and Public Health Banothu Srinivas, Madhu Mohan Reddy B. Backgrou...
-
2016-10-15T06-30-01Z Source: The Southeast Asian Journal of Case Report and Review Sangita Deepak Kamath, Neeraj Jain, Saurabh Pathak, Ba...
-
BACKGROUND AND PURPOSE: Lesion load is a common biomarker in multiple sclerosis, yet it has historically shown modest association with cl...
-
Abstract The development of focused ion beam-scanning electron microscopy (FIB-SEM) techniques has allowed high-resolution 3D imaging of n...
-
Vol.48 No.2 from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/1S2Z7n2 via IFTTT
Δεν υπάρχουν σχόλια:
Δημοσίευση σχολίου