2016年
Task allocation scheme based on computational and network resources for heterogeneous Hadoop clusters.
17th IEEE International Conference on High Performance Switching and Routing(HPSR)
- ,
- ,
- ,
- ,
- ,
- 巻
- 1
- 号
- 開始ページ
- 200
- 終了ページ
- 205
- 記述言語
- 英語
- 掲載種別
- 研究論文(国際会議プロシーディングス)
- DOI
- 10.1109/HPSR.2016.7525667
- 出版者・発行元
- IEEE
This paper aims to design a Hadoop system and evaluates the performance of a task allocation scheme. The task allocation scheme splits each job into tasks using an appropriate splitting ratio, and assigns tasks to slave servers based on server processing performance and network resource availability. We experimentally evaluate the performance of the scale out of the task allocation scheme with five machines. We focus on the configuration of jobtracker and tasktracker in Hadoop. In cases with heterogeneous Hadoop clusters, we distribute task blocks to high-capability slaves with proportionally larger-sized tasks than to low-capability slaves. We create an environment in which high-capability slaves perform more work than low-capability slaves. The experimental testbed results indicate that the task allocation scheme is effective.
- リンク情報
-
- DOI
- https://doi.org/10.1109/HPSR.2016.7525667
- DBLP
- https://dblp.uni-trier.de/rec/conf/hpsr/MatsunoCOVOY16
- Web of Science
- https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000387074800037&DestApp=WOS_CPL
- URL
- https://dblp.uni-trier.de/rec/conf/hpsr/2016
- URL
- https://dblp.uni-trier.de/db/conf/hpsr/hpsr2016.html#MatsunoCOVOY16
- ID情報
-
- DOI : 10.1109/HPSR.2016.7525667
- ISBN : 9781479989508
- DBLP ID : conf/hpsr/MatsunoCOVOY16
- Web of Science ID : WOS:000387074800037