Call for Papers:Vol.10 Issue.6

Submission
Last date		 30-Dec-2024
Acceptance Status In One Day
Paper Publish In Two Days
Submit ManuScript

News & Updates

Submit Article

Dear Authors, Article publish in our journal for Volume-10,Issue-6. For article submission on below link: Submit Manuscript


Join As Board

Dear Reviewer, You can join our Reviewer team without given any charges in our journal. Submit Details on below link: Join As Board


Paper Publication Charges

IJARIIE APP
Download Android App

For Authors

Archives

IJARIIE Board

Downloads

Android App

Download IJARIIE APP

Authors

Title: :  DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)
PaperId: :  22101
Published in:   International Journal Of Advance Research And Innovative Ideas In Education
Publisher:   IJARIIE
e-ISSN:   2395-4396
Volume/Issue:    Volume 9 Issue 6 2023
DUI:    16.0415/IJARIIE-22101
Licence: :   IJARIIE is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Author NameAuthor Institute
Jeethu Srinivas ABannari Amman Institute of Technology
Hari Prechetha KBannari Amman Institute of Technology
Kavin DevrajBannari Amman Institute of Technology

Abstract

Artificial Intelligence
Natural Language Processing (NLP), Decoder-Only Transformer, Text Generation, Deep Learning, PyTorch, Autoregressive Generation, Self-Attention Mechanism, Benchmark Datasets, Model Evaluation, Long-Range Dependencies, BLEU Score, Perplexity, Machine Translation, Text Summarization, Creative Writing
Natural language processing (NLP) has developed dramatically in recent years, particularly with the introduction of transformer-based architectures in deep learning. Among these, decoder-only transformers stand out as a straightforward yet promising approach to text generation. This project focuses on developing and testing a decoder-only transformer model for text creation jobs. A crucial part of NLP is text creation, which includes synthesizing human-like text from provided inputs. Traditional techniques, like as n-gram models, have limitations in terms of understanding long-distance relationships and producing cohesive text. However, decoder-only transformers that use self-attention and autoregressive generation have demonstrated superior text creation capabilities. The key goals here are to build a decoder-only transformer model with PyTorch, train it on large amounts of text input, and evaluate its ability to generate high-quality text. Data cleansing, creating the model's architecture, training with optimization approaches, and evaluating performance using measures such as perplexity and BLEU score are all part of the process. The results show the model's ability to generate coherent and contextually relevant content, demonstrating its promise in machine translation, text summarization, and creative writing.

Citations

Copy and paste a formatted citation or use one of the links to import into a bibliography manager and reference.

IJARIIE Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)" International Journal Of Advance Research And Innovative Ideas In Education Volume 9 Issue 6 2023 Page 1002-1008
MLA Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)." International Journal Of Advance Research And Innovative Ideas In Education 9.6(2023) : 1002-1008.
APA Jeethu Srinivas A, Hari Prechetha K, & Kavin Devraj. (2023). DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture). International Journal Of Advance Research And Innovative Ideas In Education, 9(6), 1002-1008.
Chicago Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)." International Journal Of Advance Research And Innovative Ideas In Education 9, no. 6 (2023) : 1002-1008.
Oxford Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. 'DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)', International Journal Of Advance Research And Innovative Ideas In Education, vol. 9, no. 6, 2023, p. 1002-1008. Available from IJARIIE, https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf (Accessed : ).
Harvard Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. (2023) 'DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)', International Journal Of Advance Research And Innovative Ideas In Education, 9(6), pp. 1002-1008IJARIIE [Online]. Available at: https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf (Accessed : )
IEEE Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj, "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)," International Journal Of Advance Research And Innovative Ideas In Education, vol. 9, no. 6, pp. 1002-1008, Nov-Dec 2023. [Online]. Available: https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf [Accessed : ].
Turabian Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)." International Journal Of Advance Research And Innovative Ideas In Education [Online]. volume 9 number 6 ().
Vancouver Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture). International Journal Of Advance Research And Innovative Ideas In Education [Internet]. 2023 [Cited : ]; 9(6) : 1002-1008. Available from: https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf
BibTex EndNote RefMan RefWorks

Number Of Downloads



Save in Google Drive

Similar-Paper

TitleArea of ResearchAuther NameAction
Enhancing Diabetic Retinopathy Management Through Personalized Recommendations with Reinforcement LearningComputer EngineeringH.M.A.I.B Herath Download
Development Of Novel Speech To Text Medical App On Patient’s Data using Artificial Intelligence and Edge Computingcomputer engineeringKriti prasad Download
The Role of Artificial Intelligence in HealthcareComputer engineeringMandla Tirumala Sai Download
Speech Sentiment Classification with MLMachine LearningSagar M Prajapathi Download
BIPOLAR AND SLEEP APNEA DETECTIONSComputer ScienceKarthik V Download
Quantum Computing in Cryptography: Revolutionizing Security in the Digital EraComputer EngineeringAnanya T Download
Exploring Audio Features for Enhanced Bird Identification Using Neural NetworksMachine LearningAshwin Bhatt Download
The Impact of Emerging Technologies on Modern E-Commercecomputer scienceAnisha shermi A Download
Transforming Emergency Response and Personalized Health Management with AI and Quantum InnovationsComputer ScienceTapaswini Kar Download
Harnessing Artificial Intelligence for the Future of Personalized HealthcareComputer EngineeringShravani A Download
Optimisation de l’apprentissage des données météorologique déséquilibrées basé sur la modélisation du formule d’Itô et le k-NNIntelligence artificiel, InformatiqueRAMAHEFY Tiana Razefania Download
Comparative Analysis of Machine Learning Techniques for Human Stress Level Prediction: Performance Metrics and InsightsBiomedical EngineeringA. Rasheedha Download
Natural Language Processing Techniques for Ranking Subjective ResponsesComputer ScienceMohammed Ayub G Download
Decision Support System for predicting Diseases using A.I.AI in HealthcareRitika Chatterjee Download
REVIEW ON MACHINE LEARNINGartificial intelligenceBHUMIKA S K Download
12