FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS
Abstract & Details
Research Area
Computer Engineering
Keywords
Federated Learning
LSTM
Authentication
Secure data transmission
Abstract
The surge in machine learning necessitates novel techniques that prioritize data privacy and decentralized training. Federated learning (FL) emerges as a promising solution in this domain. This research explores the potential of FL, particularly focusing on Long Short-Term Memory (LSTM) networks for next-word prediction in a Homogeneous FL setting. We propose a secure FL architecture involving three client devices and a central server, each contributing to the learning process. To ensure data security, a robust two-factor authentication framework is implemented for all participating clients. This framework merges mobile One-Time Passwords (OTPs) with traditional username/password credentials, bolstering security against unauthorized access and data breaches. Within the FL setup, client devices independently train the LSTM model on their local datasets. Subsequently, the server aggregates these local models into a global model, which is then distributed back to the clients for further training iterations. This cyclical process continues until the desired level of prediction accuracy is achieved. Furthermore, this research delves into the impact of the proposed secure FL setup on the performance of the LSTM-based next-word prediction model. We analyze the influence of secure data transmission and robust authentication on the learning outcomes, comparing model performance across different scenarios. This investigation sheds light on the trade-offs between security and performance in FL for next-word prediction tasks. Additionally, this study explores how the LSTM-based next-word prediction model performs in relation to the suggested secure FL setup. We examine how reliable authentication and secure data transmission affect learning outcomes by contrasting model performance in various contexts. The trade-offs between security and performance in FL for next-word prediction tasks are clarified by this work.
License
This work is licensed under a Creative
Commons
Attribution-ShareAlike 4.0 International License.
Author Information
| # | Name | Institute / Affiliation |
|---|---|---|
| 1 | P. Narendra Babu | Lakireddy Bali Reddy College of Engineering |
| 2 | K. Likhitha Suma Venkat | Lakireddy Bali Reddy College of Engineering |
| 3 | T. Praveena | Lakireddy Bali Reddy College of Engineering |
| 4 | G. Pradeep Kumar | Lakireddy Bali Reddy College of Engineering |
How to Cite
Use the following formats to cite this article in your research.
APA Style
Babu, P. Narendra, Venkat, K. Likhitha Suma, Praveena, T., & Kumar, G. Pradeep (2024). FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS. International Journal of Advance Research and Innovative Ideas In Education, 10(2), 3826-3831.
MLA Style
Babu, P. Narendra, et al. "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS." International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 2, 2024, pp. 3826-3831.
IEEE Style
P. Narendra Babu, K. Likhitha Suma Venkat, T. Praveena, and G. Pradeep Kumar, "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS," International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 2, pp. 3826-3831, 2024.
Vancouver Style
Babu P. Narendra, Venkat K. Likhitha Suma, Praveena T., Kumar G. Pradeep. FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS. International Journal of Advance Research and Innovative Ideas In Education. 2024;10(2):3826-3831.
Harvard Style
Babu, P. Narendra, Venkat, K. Likhitha Suma, Praveena, T., & Kumar, G. Pradeep (2024) 'FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS', International Journal of Advance Research and Innovative Ideas In Education, 10(2), pp. 3826-3831.
Chicago Style
Babu, P. Narendra, et al. "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS." International Journal of Advance Research and Innovative Ideas In Education 10, no. 2 (2024): 3826-3831.
Turabian Style
Babu, P. Narendra, et al. "FEDERATED LEARNING FOR NEXT-WORD PREDICTION: A DISTRIBUTED APPROACH FOR IMPROVED LANGUAGE MODELS." International Journal of Advance Research and Innovative Ideas In Education 10, no. 2 (2024): 3826-3831.
Related Research
EduQuest AI: A Gamified Learning Platform for Interactive and Personalized Digital Education
Download PDF
Distributed Real-Time Stream Analytics and Ingestion Engine for High-Velocity Big Data Architectures
Download PDF