論文

査読有り
2017年12月6日

sCwc/sLcc: Highly scalable feature selection algorithms

Information (Switzerland)
  • Kilho Shin
  • ,
  • Tetsuji Kuboyama
  • ,
  • Takako Hashimoto
  • ,
  • Dave Shepard

8
4
開始ページ
159
終了ページ
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.3390/info8040159
出版者・発行元
MDPI AG

Feature selection is a useful tool for identifying which features, or attributes, of a dataset cause or explain the phenomena that the dataset describes, and improving the efficiency and accuracy of learning algorithms for discovering such phenomena. Consequently, feature selection has been studied intensively in machine learning research. However, while feature selection algorithms that exhibit excellent accuracy have been developed, they are seldom used for analysis of high-dimensional data because high-dimensional data usually include too many instances and features, which make traditional feature selection algorithms inefficient. To eliminate this limitation, we tried to improve the run-time performance of two of the most accurate feature selection algorithms known in the literature. The result is two accurate and fast algorithms, namely SCWC and SLCC. Multiple experiments with real social media datasets have demonstrated that our algorithms improve the performance of their original algorithms remarkably. For example, we have two datasets, one with 15,568 instances and 15,741 features, and another with 200,569 instances and 99,672 features. SCWC performed feature selection on these datasets in 1.4 seconds and in 405 seconds, respectively. In addition, SLCC has turned out to be as fast as SCWC on average. This is a remarkable improvement because it is estimated that the original algorithms would need several hours to dozens of days to process the same datasets. In addition, we introduce a fast implementation of our algorithms: SCWC does not require any adjusting parameter, while SLCC requires a threshold parameter, which we can use to control the number of features that the algorithm selects.

リンク情報
DOI
https://doi.org/10.3390/info8040159
DBLP
https://dblp.uni-trier.de/rec/journals/information/ShinKHS17
URL
http://dblp.uni-trier.de/db/journals/information/information8.html#journals/information/ShinKHS17
ID情報
  • DOI : 10.3390/info8040159
  • ISSN : 2078-2489
  • DBLP ID : journals/information/ShinKHS17
  • SCOPUS ID : 85037736058

エクスポート
BibTeX RIS