FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS

April 2024
Vol-10, Issue-2
Paper ID: 23303
ISSN: 2395-4396
Downloads: 68
Download PDF

Abstract & Details

Research Area
Computer Engineering
Keywords
Federated Learning LSTM Authentication Secure data transmission
Abstract
The surge in machine learning necessitates novel techniques that prioritize data privacy and decentralized training. Federated learning (FL) emerges as a promising solution in this domain. This research explores the potential of FL, particularly focusing on Long Short-Term Memory (LSTM) networks for next-word prediction in a Homogeneous FL setting. We propose a secure FL architecture involving three client devices and a central server, each contributing to the learning process. To ensure data security, a robust two-factor authentication framework is implemented for all participating clients. This framework merges mobile One-Time Passwords (OTPs) with traditional username/password credentials, bolstering security against unauthorized access and data breaches. Within the FL setup, client devices independently train the LSTM model on their local datasets. Subsequently, the server aggregates these local models into a global model, which is then distributed back to the clients for further training iterations. This cyclical process continues until the desired level of prediction accuracy is achieved. Furthermore, this research delves into the impact of the proposed secure FL setup on the performance of the LSTM-based next-word prediction model. We analyze the influence of secure data transmission and robust authentication on the learning outcomes, comparing model performance across different scenarios. This investigation sheds light on the trade-offs between security and performance in FL for next-word prediction tasks. Additionally, this study explores how the LSTM-based next-word prediction model performs in relation to the suggested secure FL setup. We examine how reliable authentication and secure data transmission affect learning outcomes by contrasting model performance in various contexts. The trade-offs between security and performance in FL for next-word prediction tasks are clarified by this work.

Author Information

# Name Institute / Affiliation
1 P. Narendra Babu Lakireddy Bali Reddy College of Engineering
2 K. Likhitha Suma Venkat Lakireddy Bali Reddy College of Engineering
3 T. Praveena Lakireddy Bali Reddy College of Engineering
4 G. Pradeep Kumar Lakireddy Bali Reddy College of Engineering

How to Cite

Use the following formats to cite this article in your research.

APA Style
Babu, P. Narendra, Venkat, K. Likhitha Suma, Praveena, T., & Kumar, G. Pradeep (2024). FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS. International Journal of Advance Research and Innovative Ideas In Education, 10(2), 3826-3831.
MLA Style
Babu, P. Narendra, et al. "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS." International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 2, 2024, pp. 3826-3831.
IEEE Style
P. Narendra Babu, K. Likhitha Suma Venkat, T. Praveena, and G. Pradeep Kumar, "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS," International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 2, pp. 3826-3831, 2024.
Vancouver Style
Babu P. Narendra, Venkat K. Likhitha Suma, Praveena T., Kumar G. Pradeep. FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS. International Journal of Advance Research and Innovative Ideas In Education. 2024;10(2):3826-3831.
Harvard Style
Babu, P. Narendra, Venkat, K. Likhitha Suma, Praveena, T., & Kumar, G. Pradeep (2024) 'FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS', International Journal of Advance Research and Innovative Ideas In Education, 10(2), pp. 3826-3831.
Chicago Style
Babu, P. Narendra, et al. "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS." International Journal of Advance Research and Innovative Ideas In Education 10, no. 2 (2024): 3826-3831.
Turabian Style
Babu, P. Narendra, et al. "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS." International Journal of Advance Research and Innovative Ideas In Education 10, no. 2 (2024): 3826-3831.

Export Citation

Related Research

PReFace : AI -Assisted Plausible Facial Restoration and Damage Reconstruction System
Syeda Arbeena Kausar et al. 2026 Computer Science and Engineering (Computer Vision, Deep Learning and Image Processing)
Download PDF
Customer Churn Prediction Using Machine Learning
Dr. Roshni Khlhe et al. 2026 Machine Learning, Artificial Intelligence, Data Analytics, and Customer Churn Prediction.
Download PDF
Automated web vulnerability scanner
Jitendra Sahu et al. 2026 Computer science
Download PDF
BLOOD BANK DEMAND PREDICTION SYSTEM: MACHINE LEARNINGBASED BLOOD DEMAND FORECASTING
Uday Dharmapal Wankhede et al. 2026 Computer Science & Engineering
Download PDF