Call for Papers:Vol.11 Issue.3

Submission
Last date		 28-Jun-2025
Acceptance Status In One Day
Paper Publish In Two Days
Submit ManuScript

News & Updates

Submit Article

Dear Authors, Article publish in our journal for Volume-11,Issue-3. For article submission on below link: Submit Manuscript


Join As Board

Dear Reviewer, You can join our Reviewer team without given any charges in our journal. Submit Details on below link: Join As Board


Paper Publication Charges

IJARIIE APP
Download Android App

For Authors

Archives

IJARIIE Board

Downloads

Android App

Download IJARIIE APP

Authors

Title: :  Design of an Optimal Data Placement Strategy in Hadoop Environment
PaperId: :  4966
Published in:   International Journal Of Advance Research And Innovative Ideas In Education
Publisher:   IJARIIE
e-ISSN:   2395-4396
Volume/Issue:    Volume 3 Issue 2 2017
DUI:    16.0415/IJARIIE-4966
Licence: :   IJARIIE is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Author NameAuthor Institute
Shah Dhairya VipulkumarL.J.I.E.T.
Saket SwarndeepL.J.I.E.T.

Abstract

Computer Engineering
Hadoop, Data Placement, Data-Locality, Distributed Computing, Big Data, Cloud Computing.
The MapReduce framework has gained wide popularity as a scalable distributed system environment for efficient processing of large scale data of the order of Terabytes or more. Hadoop, an open source implementation of MapReduce coupled with Hadoop Distributed File System, is widely applied to support cluster computing jobs requiring low response time. The current Hadoop implementation assumes that nodes in the cluster are homogenous in nature. Data placement and locality has not been taken into account for launching speculative processing tasks. Furthermore, every node in the cluster is assumed to have same CPU and memory capacity despite some of the nodes being configured using vastly varying generation of hardware. Unfortunately, both the homogeneity and data placement assumptions in Hadoop are optimistic at best and unachievable at worst, potentially introducing performance problems in Hadoop clusters at data centres. This dissertation explores the Hadoop data placement policy in detail and proposes a modified data placement approach that increases the performance of the overall system. Also, the idea of placing data across the cluster according to the processing capacity utilization of the nodes is presented, which will improve the workload processing in Hadoop environment. This is expected to reduce the response times for the applications in large-scale Hadoop clusters.

Citations

Copy and paste a formatted citation or use one of the links to import into a bibliography manager and reference.

IJARIIE Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment" International Journal Of Advance Research And Innovative Ideas In Education Volume 3 Issue 2 2017 Page 5721-5732
MLA Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment." International Journal Of Advance Research And Innovative Ideas In Education 3.2(2017) : 5721-5732.
APA Shah Dhairya Vipulkumar, & Saket Swarndeep. (2017). Design of an Optimal Data Placement Strategy in Hadoop Environment. International Journal Of Advance Research And Innovative Ideas In Education, 3(2), 5721-5732.
Chicago Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment." International Journal Of Advance Research And Innovative Ideas In Education 3, no. 2 (2017) : 5721-5732.
Oxford Shah Dhairya Vipulkumar, and Saket Swarndeep. 'Design of an Optimal Data Placement Strategy in Hadoop Environment', International Journal Of Advance Research And Innovative Ideas In Education, vol. 3, no. 2, 2017, p. 5721-5732. Available from IJARIIE, http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf (Accessed : 30 September 2024).
Harvard Shah Dhairya Vipulkumar, and Saket Swarndeep. (2017) 'Design of an Optimal Data Placement Strategy in Hadoop Environment', International Journal Of Advance Research And Innovative Ideas In Education, 3(2), pp. 5721-5732IJARIIE [Online]. Available at: http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf (Accessed : 30 September 2024)
IEEE Shah Dhairya Vipulkumar, and Saket Swarndeep, "Design of an Optimal Data Placement Strategy in Hadoop Environment," International Journal Of Advance Research And Innovative Ideas In Education, vol. 3, no. 2, pp. 5721-5732, Mar-App 2017. [Online]. Available: http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf [Accessed : 30 September 2024].
Turabian Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment." International Journal Of Advance Research And Innovative Ideas In Education [Online]. volume 3 number 2 (30 September 2024).
Vancouver Shah Dhairya Vipulkumar, and Saket Swarndeep. Design of an Optimal Data Placement Strategy in Hadoop Environment. International Journal Of Advance Research And Innovative Ideas In Education [Internet]. 2017 [Cited : 30 September 2024]; 3(2) : 5721-5732. Available from: http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf
BibTex EndNote RefMan RefWorks

Number Of Downloads


Last download on 9/30/2024 2:55:55 PM

Save in Google Drive

Similar-Paper

TitleArea of ResearchAuther NameAction
A Comparative Analysis of DevOps CI/Cd Tools: Optimizing Operational Efficiency of Software DeploymentComputer EngineeringSandeep Naduvinmani Download
An Overview of Cybersecurity in Connected and Autonomous Vehicles (CAVs) Computer EngineeringVaishali Kailas Shinde Download
"Lossless Data Hiding in the NTRU Cryptosystem Using Polynomial Encoding and Modulation"Computer EngineeringSanjana Sanjay Udare Download
"Real-Time Forest Fire Detection Using FireNet-CNN and Explainable AI Methods"Computer EngineeringPriyanka Navanath Bale Download
THE EVOLUTION OF JAVASCRIPT FRAMEWORKS: FROM JQUERY TO MODERN REACT/ANGULARCSEG.TAMILSELVAN Download
(BBMS) - BLOOD MANAGEMENT SYSTEMEngineeringInamullah Download
Deep Convolutional Neural Network-Based Recognition of Air-WritingComputer Engineering Dhongde.V.S Download
Medical Assistance Chatbot using Artificial Intelligence and Machine LearningComputer Engineering Shaikh Akhil Shadul Pasha Download
AGRICARD: ONE PLATFORM FOR ALL AGRICUTURAL NEEDSComputer Engineering Patil Kalpesh Prashant Download
CHANGE DETECTION APPROACH FOR DETECTING DEFORESTATIONComputer EngineeringAbhishek Kailas Tekale Download
Transforming Rural Administration Through Digital Innovation: The E-Gram Panchayat ApproachComputer EngineeringMiss. Mali Mansi Kishor Download
AI-Augmented Systems for Medication AdherenceComputer scienceSushritha Harthi H.Y Download
AI-Based Analytics for Chronic Obstructive Pulmonary DiseaseComputer scienceAnusha B.C Download
Dynamic AI Models for Real-Time ICU MonitoringComputer scienceMouna Shree Gowda Download
Predictive AI Models for Emergency Room TriageComputer scienceAkshatha H.U Download
12