論文

査読有り
2016年

Task allocation scheme based on computational and network resources for heterogeneous Hadoop clusters.

17th IEEE International Conference on High Performance Switching and Routing(HPSR)
  • Tomohiro Matsuno
  • ,
  • Bijoy Chand Chatterjee
  • ,
  • Eiji Oki
  • ,
  • Malathi Veeraraghavan
  • ,
  • Satoru Okamoto
  • ,
  • Naoaki Yamanaka

1
開始ページ
200
終了ページ
205
記述言語
英語
掲載種別
研究論文(国際会議プロシーディングス)
DOI
10.1109/HPSR.2016.7525667
出版者・発行元
IEEE

This paper aims to design a Hadoop system and evaluates the performance of a task allocation scheme. The task allocation scheme splits each job into tasks using an appropriate splitting ratio, and assigns tasks to slave servers based on server processing performance and network resource availability. We experimentally evaluate the performance of the scale out of the task allocation scheme with five machines. We focus on the configuration of jobtracker and tasktracker in Hadoop. In cases with heterogeneous Hadoop clusters, we distribute task blocks to high-capability slaves with proportionally larger-sized tasks than to low-capability slaves. We create an environment in which high-capability slaves perform more work than low-capability slaves. The experimental testbed results indicate that the task allocation scheme is effective.

リンク情報
DOI
https://doi.org/10.1109/HPSR.2016.7525667
DBLP
https://dblp.uni-trier.de/rec/conf/hpsr/MatsunoCOVOY16
Web of Science
https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000387074800037&DestApp=WOS_CPL
URL
https://dblp.uni-trier.de/rec/conf/hpsr/2016
URL
https://dblp.uni-trier.de/db/conf/hpsr/hpsr2016.html#MatsunoCOVOY16
ID情報
  • DOI : 10.1109/HPSR.2016.7525667
  • ISBN : 9781479989508
  • DBLP ID : conf/hpsr/MatsunoCOVOY16
  • Web of Science ID : WOS:000387074800037

エクスポート
BibTeX RIS