Call for Papers:Vol.9 Issue.5

Submission
Last date		 30-Oct-2023
Acceptance Status In One Day
Paper Publish In Two Days
Submit ManuScript

News & Updates

Submit Article

Dear Authors, Article publish in our journal for Volume-9,Issue-5. For article submission on below link: Submit Manuscript


Join As Board

Dear Reviewer, You can join our Reviewer team without given any charges in our journal. Submit Details on below link: Join As Board


Paper Publication Charges

IJARIIE APP
Download Android App

For Authors

Archives

IJARIIE Board

Downloads

Android App

Download IJARIIE APP

Authors

Title: :  Design of an Optimal Data Placement Strategy in Hadoop Environment
PaperId: :  4966
Published in:   International Journal Of Advance Research And Innovative Ideas In Education
Publisher:   IJARIIE
e-ISSN:   2395-4396
Volume/Issue:    Volume 3 Issue 2 2017
DUI:    16.0415/IJARIIE-4966
Licence: :   IJARIIE is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Author NameAuthor Institute
Shah Dhairya VipulkumarL.J.I.E.T.
Saket SwarndeepL.J.I.E.T.

Abstract

Computer Engineering
Hadoop, Data Placement, Data-Locality, Distributed Computing, Big Data, Cloud Computing.
The MapReduce framework has gained wide popularity as a scalable distributed system environment for efficient processing of large scale data of the order of Terabytes or more. Hadoop, an open source implementation of MapReduce coupled with Hadoop Distributed File System, is widely applied to support cluster computing jobs requiring low response time. The current Hadoop implementation assumes that nodes in the cluster are homogenous in nature. Data placement and locality has not been taken into account for launching speculative processing tasks. Furthermore, every node in the cluster is assumed to have same CPU and memory capacity despite some of the nodes being configured using vastly varying generation of hardware. Unfortunately, both the homogeneity and data placement assumptions in Hadoop are optimistic at best and unachievable at worst, potentially introducing performance problems in Hadoop clusters at data centres. This dissertation explores the Hadoop data placement policy in detail and proposes a modified data placement approach that increases the performance of the overall system. Also, the idea of placing data across the cluster according to the processing capacity utilization of the nodes is presented, which will improve the workload processing in Hadoop environment. This is expected to reduce the response times for the applications in large-scale Hadoop clusters.

Citations

Copy and paste a formatted citation or use one of the links to import into a bibliography manager and reference.

IJARIIE Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment" International Journal Of Advance Research And Innovative Ideas In Education Volume 3 Issue 2 2017 Page 5721-5732
MLA Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment." International Journal Of Advance Research And Innovative Ideas In Education 3.2(2017) : 5721-5732.
APA Shah Dhairya Vipulkumar, & Saket Swarndeep. (2017). Design of an Optimal Data Placement Strategy in Hadoop Environment. International Journal Of Advance Research And Innovative Ideas In Education, 3(2), 5721-5732.
Chicago Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment." International Journal Of Advance Research And Innovative Ideas In Education 3, no. 2 (2017) : 5721-5732.
Oxford Shah Dhairya Vipulkumar, and Saket Swarndeep. 'Design of an Optimal Data Placement Strategy in Hadoop Environment', International Journal Of Advance Research And Innovative Ideas In Education, vol. 3, no. 2, 2017, p. 5721-5732. Available from IJARIIE, http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf (Accessed : 06 June 2022).
Harvard Shah Dhairya Vipulkumar, and Saket Swarndeep. (2017) 'Design of an Optimal Data Placement Strategy in Hadoop Environment', International Journal Of Advance Research And Innovative Ideas In Education, 3(2), pp. 5721-5732IJARIIE [Online]. Available at: http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf (Accessed : 06 June 2022)
IEEE Shah Dhairya Vipulkumar, and Saket Swarndeep, "Design of an Optimal Data Placement Strategy in Hadoop Environment," International Journal Of Advance Research And Innovative Ideas In Education, vol. 3, no. 2, pp. 5721-5732, Mar-App 2017. [Online]. Available: http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf [Accessed : 06 June 2022].
Turabian Shah Dhairya Vipulkumar, and Saket Swarndeep. "Design of an Optimal Data Placement Strategy in Hadoop Environment." International Journal Of Advance Research And Innovative Ideas In Education [Online]. volume 3 number 2 (06 June 2022).
Vancouver Shah Dhairya Vipulkumar, and Saket Swarndeep. Design of an Optimal Data Placement Strategy in Hadoop Environment. International Journal Of Advance Research And Innovative Ideas In Education [Internet]. 2017 [Cited : 06 June 2022]; 3(2) : 5721-5732. Available from: http://ijariie.com/AdminUploadPdf/Design_of_an_Optimal_Data_Placement_Strategy_in_Hadoop_Environment_ijariie4966.pdf
BibTex EndNote RefMan RefWorks

Number Of Downloads


Last download on 6/6/2022 12:37:43 PM

Save in Google Drive

Similar-Paper

TitleArea of ResearchAuther NameAction
REVIEW ON EMBEDDED WEB TECHNOLOGY AND INDUSTRIAL COMMUNICATIONTECHNOLOGY Bharath Download
Search Engine Optimization with Google Updates 2022Computer Science and Engineering DHAMOTHIRAN V Download
A Review Paper on Networking TopologiesComputer ScienceSanjay GK Download
Deep Neural Networks are used to identify theft of energy in systems for managing energy.MCAShubha R Download
Writing Overview on Huge Information about De-duplication of Data in Large Firms using Cloud ComputingComputer Science & Engineering Mohd Naseerruddin Download
Redundancy in Cloud Server De-duplication of Data in Big Data (Hadoop)Computer Science & Engineering Abdul Ahad Afroz Download
Multi-threshold image segmentation based on an improved differential evolutiondata mining Zahid Hussaen Download
OBJECT DETECTION USING CNNMaster Of Computer ApplicationVinay L Download
Working Phenomena DistributerComputer EngineeringM.D Akbar Ali Download
A Three Layer Privacy Preserving Cloud Storage SchemeComputer EngineeringSaud Ahmed Khan Download
Plant Disease Prediction using the Internet Of Things. (IOT) and Machine Learning - Blister Blight in the Tea Plant.MCA (MASTER OF COMPUTER APPLICATION)Simran M Download
Cottage WorksMaster of Computer ApplicationSushma K S Download
A SURVEY OF DONOR CONNECT ANDROID APPLICATIONMaster of Computer ApplicationPreethi N.R Download
E LEARNING MANAGEMENT SYSTEM USING DJANGO FRAMEWORKMASTER OF COMPUTER APPLICATIONARUNA V Download
Big Data Privacy-Preserving Encryption in Mobile Cloud StorageComputer ApplicationsDhanush P V Download
12