Call for Papers:Vol.11 Issue.3

Submission
Last date		 28-Jun-2025
Acceptance Status In One Day
Paper Publish In Two Days
Submit ManuScript

News & Updates

Submit Article

Dear Authors, Article publish in our journal for Volume-11,Issue-3. For article submission on below link: Submit Manuscript


Join As Board

Dear Reviewer, You can join our Reviewer team without given any charges in our journal. Submit Details on below link: Join As Board


Paper Publication Charges

IJARIIE APP
Download Android App

For Authors

Archives

IJARIIE Board

Downloads

Android App

Download IJARIIE APP

Authors

Title: :  DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)
PaperId: :  22101
Published in:   International Journal Of Advance Research And Innovative Ideas In Education
Publisher:   IJARIIE
e-ISSN:   2395-4396
Volume/Issue:    Volume 9 Issue 6 2023
DUI:    16.0415/IJARIIE-22101
Licence: :   IJARIIE is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Author NameAuthor Institute
Jeethu Srinivas ABannari Amman Institute of Technology
Hari Prechetha KBannari Amman Institute of Technology
Kavin DevrajBannari Amman Institute of Technology

Abstract

Artificial Intelligence
Natural Language Processing (NLP), Decoder-Only Transformer, Text Generation, Deep Learning, PyTorch, Autoregressive Generation, Self-Attention Mechanism, Benchmark Datasets, Model Evaluation, Long-Range Dependencies, BLEU Score, Perplexity, Machine Translation, Text Summarization, Creative Writing
Natural language processing (NLP) has developed dramatically in recent years, particularly with the introduction of transformer-based architectures in deep learning. Among these, decoder-only transformers stand out as a straightforward yet promising approach to text generation. This project focuses on developing and testing a decoder-only transformer model for text creation jobs. A crucial part of NLP is text creation, which includes synthesizing human-like text from provided inputs. Traditional techniques, like as n-gram models, have limitations in terms of understanding long-distance relationships and producing cohesive text. However, decoder-only transformers that use self-attention and autoregressive generation have demonstrated superior text creation capabilities. The key goals here are to build a decoder-only transformer model with PyTorch, train it on large amounts of text input, and evaluate its ability to generate high-quality text. Data cleansing, creating the model's architecture, training with optimization approaches, and evaluating performance using measures such as perplexity and BLEU score are all part of the process. The results show the model's ability to generate coherent and contextually relevant content, demonstrating its promise in machine translation, text summarization, and creative writing.

Citations

Copy and paste a formatted citation or use one of the links to import into a bibliography manager and reference.

IJARIIE Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)" International Journal Of Advance Research And Innovative Ideas In Education Volume 9 Issue 6 2023 Page 1002-1008
MLA Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)." International Journal Of Advance Research And Innovative Ideas In Education 9.6(2023) : 1002-1008.
APA Jeethu Srinivas A, Hari Prechetha K, & Kavin Devraj. (2023). DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture). International Journal Of Advance Research And Innovative Ideas In Education, 9(6), 1002-1008.
Chicago Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)." International Journal Of Advance Research And Innovative Ideas In Education 9, no. 6 (2023) : 1002-1008.
Oxford Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. 'DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)', International Journal Of Advance Research And Innovative Ideas In Education, vol. 9, no. 6, 2023, p. 1002-1008. Available from IJARIIE, https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf (Accessed : ).
Harvard Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. (2023) 'DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)', International Journal Of Advance Research And Innovative Ideas In Education, 9(6), pp. 1002-1008IJARIIE [Online]. Available at: https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf (Accessed : )
IEEE Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj, "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)," International Journal Of Advance Research And Innovative Ideas In Education, vol. 9, no. 6, pp. 1002-1008, Nov-Dec 2023. [Online]. Available: https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf [Accessed : ].
Turabian Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. "DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture)." International Journal Of Advance Research And Innovative Ideas In Education [Online]. volume 9 number 6 ().
Vancouver Jeethu Srinivas A, Hari Prechetha K, and Kavin Devraj. DoctorGPT (A Decoder-Only Implementation of GPT2 Architecture). International Journal Of Advance Research And Innovative Ideas In Education [Internet]. 2023 [Cited : ]; 9(6) : 1002-1008. Available from: https://ijariie.com/AdminUploadPdf/DoctorGPT__A_Decoder_Only_Implementation_of_GPT2_Architecture__ijariie22101.pdf
BibTex EndNote RefMan RefWorks

Number Of Downloads



Save in Google Drive

Similar-Paper

TitleArea of ResearchAuther NameAction
USER’S PERSPECTIVES ON AI- POWERED VIRTUAL ASSISTANT IN EDUCATION AND EVERYDAY LIFEEducational TechnologyRechelle M. Cardines Download
FLAP-AI BIRDArtificial Intelligence and Machine LearningRamya BN Download
AL-Powered healthcare chatbot for personalized medical assistance and wound classificationAI-Powered Healthcare SystemProf. Manjunath N Download
AI-Powered Resume Generation: A Streamlit-Based System Using PyTorch for Intelligent Career ProfilingComputer EngineeringAditi Meshram Download
AI based object color detection and sorting automationRobotics and AutomationBHUVAN THEJASWI T Download
Advanced knowledge on Synthetic Data Generation Using GANs for Medical Imaging ApplicationsArtificial IntelligenceRajeev Ranjan Download
Information on Cognitive AI Assistants for Visually Impaired Navigation SupportComputer ScienceNagaraj.H Download
Speech Emotion AI for Mental Health Monitoring in Call CentersComputer ScienceGowtham Kumar Download
Multi-Agent Reinforcement Learning for Coordinated Drone SwarmsComputer ScienceDeepak Gowda Download
AI-Based Soil Health Monitoring Using Remote Sensing and Deep LearningArtificial IntelligenceChethan Nagraj Download
Dynamic Criminal Network Link Forecasting via Deep Reinforcement LearningDeep LearningSrikant Tayade Download
Virtual Try-On-Enhancing Fashion Exploration for Gen-ZDeep Learning & Generative ModelsAnushka Mane Download
To Develop an EMG-Based Expert System for the Detection of Wrist Flexion and ExtensionArtificial Intelligence and Data ScienceRohit Mehta Download
LUNG CANCER PREDICTION AND DETECTION USING MLCOMPUTER SCIENCE & ENGINEERINGRASHMI T N Download
NewsTrust: AI-Driven News Verification with Social Publishing FeaturesArtificial IntelligenceRaj Mehta Download
12