DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS
Abstract & Details
Research Area
computer science and engineering
Keywords
HDFS: Hadoop Distributed File System
MD5: Message Digest
3DES: Triple Data Encryption Standard
POF: Proof Of Ownership.
Abstract
Deduplication characterizes the elimination of duplicate or redundant information and it removes the repetitive information before storing it. These techniques are widely employed for data backup, network minimization, and storage overhead. Long established deduplication schemes have restrictions on encrypted data and security. In the proposed system, new deduplication techniques are employed efficiently. Instead of possessing periphrasis of a sole content, deduplication banishes redundant data by keeping only one physical copy and broaching other redundant data to that copy. Each one can be expounded based on nonidentical granularities which may be either way a whole file or a data block. MD5 and 3DES algorithm strengthen the technique. The methodology proposed here is (POF) of the file. Deduplication can now, properly address the reliability and tag consistency problem in HDFS storage systems. The proposed system succeeded in reducing the cost and time of uploading and downloading with storage space.
License
This work is licensed under a Creative
Commons
Attribution-ShareAlike 4.0 International License.
Author Information
| # | Name | Institute / Affiliation |
|---|---|---|
| 1 | indira.n | panimalar engineering college |
| 2 | s.sowmya | panimalar engineering college |
| 3 | karthika.s | panimalar engineering college |
| 4 | l.visudha | panimalar engineering college |
How to Cite
Use the following formats to cite this article in your research.
APA Style
indira.n, s.sowmya, karthika.s, & l.visudha (2017). DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS. International Journal of Advance Research and Innovative Ideas In Education, 3(2), 1347-1353.
MLA Style
indira.n, et al. "DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS." International Journal of Advance Research and Innovative Ideas In Education, vol. 3, no. 2, 2017, pp. 1347-1353.
IEEE Style
indira.n, s.sowmya, karthika.s, and l.visudha, "DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS," International Journal of Advance Research and Innovative Ideas In Education, vol. 3, no. 2, pp. 1347-1353, 2017.
Vancouver Style
indira.n, s.sowmya, karthika.s, l.visudha. DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS. International Journal of Advance Research and Innovative Ideas In Education. 2017;3(2):1347-1353.
Harvard Style
indira.n, s.sowmya, karthika.s, & l.visudha (2017) 'DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS', International Journal of Advance Research and Innovative Ideas In Education, 3(2), pp. 1347-1353.
Chicago Style
indira.n, et al. "DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS." International Journal of Advance Research and Innovative Ideas In Education 3, no. 2 (2017): 1347-1353.
Turabian Style
indira.n, et al. "DEDUPLICATION WITH KEYS AND CHUNKS IN HDFS STORAGE PROVIDERS." International Journal of Advance Research and Innovative Ideas In Education 3, no. 2 (2017): 1347-1353.
Related Research
EduQuest AI: A Gamified Learning Platform for Interactive and Personalized Digital Education
Download PDF
Distributed Real-Time Stream Analytics and Ingestion Engine for High-Velocity Big Data Architectures
Download PDF