AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING
Abstract & Details
Research Area
Data Science , Machine Learning
Keywords
Self-healing systems
data pipelines
machine learning
anomaly detection
failure prediction
root-cause analysis
AIOps
predictive analytics.
Abstract
Modern data-driven organizations employ highly configurable data pipelines to ingest, transform, and deliver data between a variety of disparate systems. Such pipelines are prone to failures due to schema drift, upstream data-quality issues, infrastructure instability, and orchestration errors. Conventional monitoring practices are often limited in their capacity to address the complexity and scale of such pipelines. This paper surveys the literature on self-healing systems, machine-learning-based prediction of failures, detection of anomalies in log data, and machine-assisted root-cause analysis. Based on the survey, a self-healing data-pipeline platform, AutoHeal, is proposed, which employs pipeline health monitoring, failure prediction based on classification, unsupervised anomaly detection, automated recovery processes, and AI-assisted root-cause analysis. It is also equipped with a real-time dashbaord and alerting subsystem to display pipeline status, alerts, and recovery details. The architecture, methodology, algorithms, technology stack, expected evaluation metrics, and future scope are discussed. The proposed system is intended to reduce the burden on the human operators and improve the resiliency of modern data pipelines; however, its effectiveness still has to be proven in practice by experimentation.
License
This work is licensed under a Creative
Commons
Attribution-ShareAlike 4.0 International License.
Author Information
| # | Name | Institute / Affiliation |
|---|---|---|
| 1 | SWAYAM DHEERAJ JAISWAL | GURU NANAK INSTITUTE OF TECHNOLOGGY |
| 2 | SANKET AVINASH HEDAOO | GURU NANAK INSTITUTE OF TECHNOLOGGY |
| 3 | TANMAY UPADHYAY | GURU NANAK INSTITUTE OF TECHNOLOGGY |
| 4 | Prof. Jagruti Ghatole | GURU NANAK INSTITUTE OF TECHNOLOGGY |
| 5 | Dr. Bharati Sayankar | GURU NANAK INSTITUTE OF TECHNOLOGGY |
| 6 | Dr. Sudhir N. Shelke | GURU NANAK INSTITUTE OF TECHNOLOGGY |
How to Cite
Use the following formats to cite this article in your research.
APA Style
JAISWAL, SWAYAM DHEERAJ, HEDAOO, SANKET AVINASH, UPADHYAY, TANMAY, Ghatole, Prof. Jagruti, Sayankar, Dr. Bharati, & Shelke, Dr. Sudhir N. (2026). AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING. International Journal of Advance Research and Innovative Ideas In Education, 12(5), 689-693.
MLA Style
JAISWAL, SWAYAM DHEERAJ, et al. "AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING." International Journal of Advance Research and Innovative Ideas In Education, vol. 12, no. 5, 2026, pp. 689-693.
IEEE Style
SWAYAM DHEERAJ JAISWAL, SANKET AVINASH HEDAOO, TANMAY UPADHYAY, Prof. Jagruti Ghatole, Dr. Bharati Sayankar, and Dr. Sudhir N. Shelke, "AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING," International Journal of Advance Research and Innovative Ideas In Education, vol. 12, no. 5, pp. 689-693, 2026.
Vancouver Style
JAISWAL SWAYAM DHEERAJ, HEDAOO SANKET AVINASH, UPADHYAY TANMAY, Ghatole Prof. Jagruti, Sayankar Dr. Bharati, Shelke Dr. Sudhir N.. AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING. International Journal of Advance Research and Innovative Ideas In Education. 2026;12(5):689-693.
Harvard Style
JAISWAL, SWAYAM DHEERAJ, HEDAOO, SANKET AVINASH, UPADHYAY, TANMAY, Ghatole, Prof. Jagruti, Sayankar, Dr. Bharati, & Shelke, Dr. Sudhir N. (2026) 'AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING', International Journal of Advance Research and Innovative Ideas In Education, 12(5), pp. 689-693.
Chicago Style
JAISWAL, SWAYAM DHEERAJ, et al. "AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING." International Journal of Advance Research and Innovative Ideas In Education 12, no. 5 (2026): 689-693.
Turabian Style
JAISWAL, SWAYAM DHEERAJ, et al. "AUTOHEAL: AN INTELLIGENT SELF-HEALING DATA PIPELINE PLATFORM USING MACHINE LEARNING." International Journal of Advance Research and Innovative Ideas In Education 12, no. 5 (2026): 689-693.
Related Research
EduQuest AI: A Gamified Learning Platform for Interactive and Personalized Digital Education
Download PDF
Distributed Real-Time Stream Analytics and Ingestion Engine for High-Velocity Big Data Architectures
Download PDF