<abstract xmlns="http://www.w3.org/1999/xhtml"><p> Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks in a distributed data processing. Hadoop is also open source software that allows the user to effectively utilize the hardware. Various scheduling algorithms of the MapReduce model using Hadoop vary with design and behavior, and are used for handling many issues like data locality, awareness with resource, energy and time. This paper gives the outline of job scheduling, classification of the scheduler, and comparison of different existing algorithms with advantages, drawbacks, limitations. In this paper, we discussed various tools and frameworks used for monitoring and the ways to improve the performance in MapReduce. This paper helps the beginners and researchers in understanding the scheduling mechanisms used in Big Data.</p></abstract>

Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks in a distributed data processing. Hadoop is also open source software that allows the user to effectively utilize the hardware. Various scheduling algorithms of the MapReduce model using Hadoop vary with design and behavior, and are used for handling many issues like data locality, awareness with resource, energy and time. This paper gives the outline of job scheduling, classification of the scheduler, and comparison of different existing algorithms with advantages, drawbacks, limitations. In this paper, we discussed various tools and frameworks used for monitoring and the ways to improve the performance in MapReduce. This paper helps the beginners and researchers in understanding the scheduling mechanisms used in Big Data.

A Survey on Job Scheduling in Big Data

School of Information Technology and Engineering, VIT University, Vellore, India

School of Computer Science and Engineering, VIT University, Vellore, India

Cybernetics and Information Technologies

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"A Survey on Job Scheduling in Big Data"}

Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks...

A Survey on Job Scheduling in Big Data

Publié en ligne: 19 août 2016

Pages: 35 - 51

DOI: https://doi.org/10.1515/cait-2016-0033

Mots clés
Big Data, Hadoop, MapReduce, classification, HDFS (Hadoop Distributed File System), scheduler

© by M. Senthilkumar

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

A Survey on Job Scheduling in Big Data

Publié en ligne: 19 août 2016

Pages: 35 - 51

DOI: https://doi.org/10.1515/cait-2016-0033

Mots clésBig Data, Hadoop, MapReduce, classification, HDFS (Hadoop Distributed File System), scheduler

© by M. Senthilkumar

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Mots clés
Big Data, Hadoop, MapReduce, classification, HDFS (Hadoop Distributed File System), scheduler