Scheduling Job Queue In Hadoop

March 2017
Vol-3, Issue-2
Paper ID: 4225
ISSN: 2395-4396
Downloads: 67
Download PDF

Abstract & Details

Research Area
Computer Science Engineering
Keywords
Map Reduce SRPT Performance Scheduling.
Abstract
Size-based scheduling has been recognized as an effective approach to guarantee fairness and near optimal system response times. HFSP is a scheduler used in this technique to a real, multi-server, complex and widely used system such as Hadoop. It is a widely used bigdata processing engine with a master slave setup. Our solution implements a size-based and pre-emptive scheduling discipline. Scheduling decisions use the concept of virtual time and cluster resource. The jobs are focused according to their priorities that are computed through aging. This ensures that neither small nor large jobs suffer from starvation. The Size based scheduling in HFSP, gives the priority to small jobs that they will not be slowed down by large ones. The Shortest Remaining Processing Time (SRPT) concept gives priority to the jobs that requires minimum amount of work to complete. It minimizes the mean response time (or sojourn time), that is the time that passes between a job submission and its completion. We Extend HFSP to pause jobs with Higher SRPT and allow other waiting jobs in Queue based on FCFS.

Author Information

# Name Institute / Affiliation
1 R.Jamroth Banu Panimalar Engineering College
2 E.Jamuna Panimalar Engineering College
3 S.Janani Panimalar Engineering College
4 Mrs. N.INDIRA PANIMALAR ENGINEERING COLLEGE

How to Cite

Use the following formats to cite this article in your research.

APA Style
Banu, R.Jamroth, E.Jamuna, S.Janani, & N.INDIRA, Mrs. (2017). Scheduling Job Queue In Hadoop. International Journal of Advance Research and Innovative Ideas In Education, 3(2), 2123-2128.
MLA Style
Banu, R.Jamroth, et al. "Scheduling Job Queue In Hadoop." International Journal of Advance Research and Innovative Ideas In Education, vol. 3, no. 2, 2017, pp. 2123-2128.
IEEE Style
R.Jamroth Banu, E.Jamuna, S.Janani, and Mrs. N.INDIRA, "Scheduling Job Queue In Hadoop," International Journal of Advance Research and Innovative Ideas In Education, vol. 3, no. 2, pp. 2123-2128, 2017.
Vancouver Style
Banu R.Jamroth, E.Jamuna, S.Janani, N.INDIRA Mrs.. Scheduling Job Queue In Hadoop. International Journal of Advance Research and Innovative Ideas In Education. 2017;3(2):2123-2128.
Harvard Style
Banu, R.Jamroth, E.Jamuna, S.Janani, & N.INDIRA, Mrs. (2017) 'Scheduling Job Queue In Hadoop', International Journal of Advance Research and Innovative Ideas In Education, 3(2), pp. 2123-2128.
Chicago Style
Banu, R.Jamroth, et al. "Scheduling Job Queue In Hadoop." International Journal of Advance Research and Innovative Ideas In Education 3, no. 2 (2017): 2123-2128.
Turabian Style
Banu, R.Jamroth, et al. "Scheduling Job Queue In Hadoop." International Journal of Advance Research and Innovative Ideas In Education 3, no. 2 (2017): 2123-2128.

Export Citation

Related Research

PReFace : AI -Assisted Plausible Facial Restoration and Damage Reconstruction System
Syeda Arbeena Kausar et al. 2026 Computer Science and Engineering (Computer Vision, Deep Learning and Image Processing)
Download PDF
Customer Churn Prediction Using Machine Learning
Dr. Roshni Khlhe et al. 2026 Machine Learning, Artificial Intelligence, Data Analytics, and Customer Churn Prediction.
Download PDF
Automated web vulnerability scanner
Jitendra Sahu et al. 2026 Computer science
Download PDF
BLOOD BANK DEMAND PREDICTION SYSTEM: MACHINE LEARNINGBASED BLOOD DEMAND FORECASTING
Uday Dharmapal Wankhede et al. 2026 Computer Science & Engineering
Download PDF