Self-Slot Configurations for Dynamic Hadoop Clusters – A Review
Keywords:
mapreduce, jobreduce, recommendation model, dynamic scheduling, taskingAbstract
For analyzing the large set of scalable data by using map reduce framework and Hadoop has become popular. The major concentration of this paper is to produce the review on static slot configuration of Hadoop clusters under a dynamic job reduce approach. As the static slot of the cluster shall deal with only a similar pattern of data sets. By this paper, we shall present a brief survey on the Hadoop slot configuration and hence a clear agenda is being maintained as a clear comparison.
References
Sharma, B., Prabhakar, R., Lim, S. H., Kandemir, M. T., & Das, C. R. (2012, June). Mrorchestrator: A fine-grained resource orchestration framework for mapreduce clusters. In 2012 IEEE Fifth International Conference on Cloud Computing (pp. 1-8). IEEE.
Yao, Y., Wang, J., Sheng, B., Lin, J., & Mi, N. (2014, June). Haste: Hadoop yarn scheduling based on task-dependency and resource-demand. In 2014 IEEE 7th international conference on cloud computing (pp. 184-191). IEEE.
Dean, J., & Ghemawat, S. (2008). MapReduce: simplified data processing on large clusters. Communications of the ACM, 51(1), 107-113.
Ahmed, S. T., Basha, S. M., Arumugam, S. R., & Kodabagi, M. M. (2021). Pattern Recognition: An Introduction. MileStone Research Publications.
Zaharia, M., Borthakur, D., Sen Sarma, J., Elmeleegy, K., Shenker, S., & Stoica, I. (2010, April). Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In Proceedings of the 5th European conference on Computer systems (pp. 265-278).
Verma, A., Cherkasova, L., & Campbell, R. H. (2012, August). Two sides of a coin: Optimizing the schedule of mapreduce jobs to minimize their makespan and improve cluster performance. In 2012 IEEE 20th international symposium on modeling, analysis and simulation of computer and telecommunication systems (pp. 11-18). IEEE.
Isard, M., Prabhakaran, V., Currey, J., Wieder, U., Talwar, K., & Goldberg, A. (2009, October). Quincy: fair scheduling for distributed computing clusters. In Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles (pp. 261-276).
Verma, A., Cherkasova, L., & Campbell, R. H. (2011, June). Aria: automatic resource inference and allocation for mapreduce environments. In Proceedings of the 8th ACM international conference on Autonomic computing (pp. 235-244).
Polo, J., Carrera, D., Becerra, Y., Torres, J., Ayguadé, E., Steinder, M., & Whalley, I. (2010, April). Performance-driven task co-scheduling for mapreduce environments. In 2010 IEEE Network Operations and Management Symposium-NOMS 2010 (pp. 373-380). IEEE.
Vavilapalli, V. K., Murthy, A. C., Douglas, C., Agarwal, S., Konar, M., Evans, R., ... & Baldeschwieler, E. (2013, October). Apache hadoop yarn: Yet another resource negotiator. In Proceedings of the 4th annual Symposium on Cloud Computing (pp. 1-16).
Wang, X. W., Zhang, J., Liao, H. M., & Zha, L. (2011, November). Dynamic split model of resource utilization in mapreduce. In Proceedings of the second international workshop on Data intensive computing in the clouds (pp. 21-30).
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Ahmed Zuber Behar, Mohammed Zain Khalid
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
