"EXMR; An Enhanced way for Incremental Data Processing based on MapReduce"

January 2016
Vol-2, Issue-1
Paper ID: 1557
ISSN: 2395-4396
Downloads: 61
Download PDF

Abstract & Details

Research Area
Computer Engineering
Keywords
BigData MapReduce Incremental Processing MRBG
Abstract
Map Reduce programming model is widely used for large scale and one-time data-intensive distributed computing, but lacks flexibility and efficiency of processing small incremental data. Incremental Mapreduce framework is proposed in this paper for incrementally processing new data of a large data set, which takes state as implicit input and combines it with new data. Map tasks are created according to new splits instead of entire splits while reduce tasks fetch their inputs including the state and the intermediate results of new map tasks from Preserved and latest generated result. The preserved states really producing the promising result and significantly reduce the run time for refreshing big data mining results compared to re-calculating on both simple and multi stage MapReduce. The intermediate states are saved in the form of kv-pair level data flow and data dependence in a MapReduce computation as a bipartitegraph, called MRBGraph. A MRBG-Store is designed to preserve the fine-grain states in the MRBGraph and support efficient queries to retrieve fine-grain states for incremental processing.

Author Information

# Name Institute / Affiliation
1 Mr.Nilesh Vasant Kurhade SPIET.Otur(Pune)
2 Prof.Kahate Sandip. SPCOE,Otur(Pune)

How to Cite

Use the following formats to cite this article in your research.

APA Style
Kurhade, Mr.Nilesh Vasant & Sandip., Prof.Kahate (2016). "EXMR; An Enhanced way for Incremental Data Processing based on MapReduce". International Journal of Advance Research and Innovative Ideas In Education, 2(1), 135-140.
MLA Style
Kurhade, Mr.Nilesh Vasant, and Prof.Kahate Sandip.. ""EXMR; An Enhanced way for Incremental Data Processing based on MapReduce"." International Journal of Advance Research and Innovative Ideas In Education, vol. 2, no. 1, 2016, pp. 135-140.
IEEE Style
Mr.Nilesh Vasant Kurhade and Prof.Kahate Sandip., ""EXMR; An Enhanced way for Incremental Data Processing based on MapReduce"," International Journal of Advance Research and Innovative Ideas In Education, vol. 2, no. 1, pp. 135-140, 2016.
Vancouver Style
Kurhade Mr.Nilesh Vasant, Sandip. Prof.Kahate. "EXMR; An Enhanced way for Incremental Data Processing based on MapReduce". International Journal of Advance Research and Innovative Ideas In Education. 2016;2(1):135-140.
Harvard Style
Kurhade, Mr.Nilesh Vasant & Sandip., Prof.Kahate (2016) '"EXMR; An Enhanced way for Incremental Data Processing based on MapReduce"', International Journal of Advance Research and Innovative Ideas In Education, 2(1), pp. 135-140.
Chicago Style
Kurhade, Mr.Nilesh Vasant and Prof.Kahate Sandip.. ""EXMR; An Enhanced way for Incremental Data Processing based on MapReduce"." International Journal of Advance Research and Innovative Ideas In Education 2, no. 1 (2016): 135-140.
Turabian Style
Kurhade, Mr.Nilesh Vasant and Prof.Kahate Sandip.. ""EXMR; An Enhanced way for Incremental Data Processing based on MapReduce"." International Journal of Advance Research and Innovative Ideas In Education 2, no. 1 (2016): 135-140.

Export Citation

Related Research

Survey On : Intelligent Payroll and Human Resource Management Systems: A Systematic Review of Automation, Security, and Analytics
Vishakha Jadhav et al. 2026 Human Resource Management, Artificial Intelligence, Machine Learning, Payroll Systems, Cybersecurity, Business Intelligence, Robotic Process Automation, Employee Analytics, Digital Transforma
Download PDF
Civic Engagement & Empowerment Platform
Supriya Dadaso Bankar et al. 2026 Computer engineering
Download PDF
RAG System Development with Pydantic AI ChromaDB & Groq
Prof. Priyanka P. Kakade et al. 2026 Computer Engineering
Download PDF