<abstract xmlns="http://www.w3.org/1999/xhtml"><p> Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks in a distributed data processing. Hadoop is also open source software that allows the user to effectively utilize the hardware. Various scheduling algorithms of the MapReduce model using Hadoop vary with design and behavior, and are used for handling many issues like data locality, awareness with resource, energy and time. This paper gives the outline of job scheduling, classification of the scheduler, and comparison of different existing algorithms with advantages, drawbacks, limitations. In this paper, we discussed various tools and frameworks used for monitoring and the ways to improve the performance in MapReduce. This paper helps the beginners and researchers in understanding the scheduling mechanisms used in Big Data.</p></abstract>

Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks in a distributed data processing. Hadoop is also open source software that allows the user to effectively utilize the hardware. Various scheduling algorithms of the MapReduce model using Hadoop vary with design and behavior, and are used for handling many issues like data locality, awareness with resource, energy and time. This paper gives the outline of job scheduling, classification of the scheduler, and comparison of different existing algorithms with advantages, drawbacks, limitations. In this paper, we discussed various tools and frameworks used for monitoring and the ways to improve the performance in MapReduce. This paper helps the beginners and researchers in understanding the scheduling mechanisms used in Big Data.

A Survey on Job Scheduling in Big Data

School of Information Technology and Engineering, VIT University, Vellore, India

School of Computer Science and Engineering, VIT University, Vellore, India

Cybernetics and Information Technologies

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"A Survey on Job Scheduling in Big Data"}

Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks...

A Survey on Job Scheduling in Big Data

Published Online: Aug 19, 2016

Page range: 35 - 51

DOI: https://doi.org/10.1515/cait-2016-0033

Keywords
Big Data, Hadoop, MapReduce, classification, HDFS (Hadoop Distributed File System), scheduler

© by M. Senthilkumar

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

A Survey on Job Scheduling in Big Data

Published Online: Aug 19, 2016

Page range: 35 - 51

DOI: https://doi.org/10.1515/cait-2016-0033

KeywordsBig Data, Hadoop, MapReduce, classification, HDFS (Hadoop Distributed File System), scheduler

© by M. Senthilkumar

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Keywords
Big Data, Hadoop, MapReduce, classification, HDFS (Hadoop Distributed File System), scheduler