Natural Language Processing Techniques for Ranking Subjective Responses

August 2024
Vol-10, Issue-4
Paper ID: 24871
ISSN: 2395-4396
Downloads: 63
Download PDF

Abstract & Details

Research Area
Computer Science
Keywords
Subjective answer evaluation big data machine learning natural language processing Word2Vec WordNet.
Abstract
Each year, universities and educational boards conduct exams offline, requiring students to participate in subjective tests. The manual evaluation of a vast number of such answer sheets is labor-intensive and time consuming. Moreover, the quality of assessment can sometimes be inconsistent, influenced by the evaluator's mindset or fatigue. In contrast, objective or multiple-choice questions, often used in competitive and entrance exams, are easily assessed through automated systems, simplifying the evaluation process. However, the manual grading of subjective responses remains a challenging task. The integration of artificial intelligence (AI) in evaluating subjective responses faces significant hurdles, primarily due to skepticism about the accuracy and reliability of the results. Although there have been various attempts to leverage computer science for assessing student answers, many of these efforts rely heavily on standardized counts or specific keywords, and often suffer from a lack of comprehensive datasets. This paper introduces a novel approach for the automatic evaluation of descriptive answers by employing a combination of machine learning techniques and natural language processing tools such as WordNet, Word2Vec, word mover's distance (WMD), cosine similarity, Multinomial Naive Bayes (MNB), and term frequency-inverse document frequency (TF-IDF). The proposed method assesses answers by comparing them to solution statements and relevant keywords, and it also develops a machine learning model to predict grades. The findings suggest that WMD provides better performance compared to cosine similarity. Additionally, with appropriate training, the machine learning model can be used independently. Experimental results show that the approach achieves an accuracy of 88% without using the MNB model, while incorporating MNB further reduces the error rate by 1.3%.

Author Information

# Name Institute / Affiliation
1 Mohammed Ayub G CMR University
2 Surya Prakash Gupta CMR University
3 Dr. V. Srikanth CMR University

How to Cite

Use the following formats to cite this article in your research.

APA Style
G, Mohammed Ayub, Gupta, Surya Prakash, & Srikanth, Dr. V. (2024). Natural Language Processing Techniques for Ranking Subjective Responses. International Journal of Advance Research and Innovative Ideas In Education, 10(4), 3286-3291.
MLA Style
G, Mohammed Ayub, et al. "Natural Language Processing Techniques for Ranking Subjective Responses." International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 4, 2024, pp. 3286-3291.
IEEE Style
Mohammed Ayub G, Surya Prakash Gupta, and Dr. V. Srikanth, "Natural Language Processing Techniques for Ranking Subjective Responses," International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 4, pp. 3286-3291, 2024.
Vancouver Style
G Mohammed Ayub, Gupta Surya Prakash, Srikanth Dr. V.. Natural Language Processing Techniques for Ranking Subjective Responses. International Journal of Advance Research and Innovative Ideas In Education. 2024;10(4):3286-3291.
Harvard Style
G, Mohammed Ayub, Gupta, Surya Prakash, & Srikanth, Dr. V. (2024) 'Natural Language Processing Techniques for Ranking Subjective Responses', International Journal of Advance Research and Innovative Ideas In Education, 10(4), pp. 3286-3291.
Chicago Style
G, Mohammed Ayub, Surya Prakash Gupta, and Dr. V. Srikanth. "Natural Language Processing Techniques for Ranking Subjective Responses." International Journal of Advance Research and Innovative Ideas In Education 10, no. 4 (2024): 3286-3291.
Turabian Style
G, Mohammed Ayub, Surya Prakash Gupta, and Dr. V. Srikanth. "Natural Language Processing Techniques for Ranking Subjective Responses." International Journal of Advance Research and Innovative Ideas In Education 10, no. 4 (2024): 3286-3291.

Export Citation

Related Research

AI-Based Smart Waste Segregation and Recycling Assistant
Priyanka Patil et al. 2026 Artificial Intelligence (AI) and Machine Learning
Download PDF
Precision Agriculture Using Computer Vision: A Review of In-Field Disease Detection, Foliar Severity Estimation
Ashlesha Adsul et al. 2026 Precision Agriculture, Computer Vision, AI, Machine Learning
Download PDF
Explainable AI for Classification and Prioritization of QHSE Audit Findings
Dr. Feroz Khan Ismail 2026 Artificial Intelligence, Quality Management, QHSE Auditing, Risk Management and Engineering
Download PDF
Development of a Custom Handwritten Kannada Dataset and CNN-BiLSTM-CTC Based OCR System
Nandini G R et al. 2026 OCR, Machine learning, Image Processing, CNN, Deep learning
Download PDF
CodeCoach AI: A Review of Automated Programming Assessment, Explainable Feedback, and an AI-Assisted Coding Practice Framework
Mr. Pratham Tembhurne et al. 2026 Artificial Intelligence in Education, focusing on automated code assessment and personalized feedback to improve programming skills.
Download PDF