論文

査読有り
2017年6月14日

Hayabusa: Simple and fast full-Text search engine for massive system log data

ACM International Conference Proceeding Series
  • Hiroshi Abe
  • ,
  • Keiichi Shima
  • ,
  • Yuji Sekiya
  • ,
  • Daisuke Miyamoto
  • ,
  • Tomohiro Ishihara
  • ,
  • Kazuya Okada

128772
記述言語
英語
掲載種別
研究論文(国際会議プロシーディングス)
DOI
10.1145/3095786.3095788
出版者・発行元
Association for Computing Machinery

In this study, we introduce a simple and high-speed search engine for large-scale system logs, called Hayabusa. Hayabusa uses SQLite, standard lightweight database software with GNU Parallel and general Linux commands, such that it can run efficiently without complex components. Network administrators can use Hayabusa to accumulate and store log information at high speeds and to search the logs quickly. In our experiments, Hayabusa required only 8 seconds to convert 1.2Mlog messages into a database file. Moreover, Hayabusa required only 5 seconds to search a keyword from 1.7 billion records. Hayabusa achieved high-performance search speed in a stand-Alone environment without a complex distributed environment. Compared with the distributed environment, Spark, the proposed standalone Hayabusa was approximately 27 times faster.

リンク情報
DOI
https://doi.org/10.1145/3095786.3095788
ID情報
  • DOI : 10.1145/3095786.3095788
  • SCOPUS ID : 85025836955

エクスポート
BibTeX RIS