Natural Language Processing Techniques for Ranking Subjective Responses
Abstract & Details
Research Area
Computer Science
Keywords
Subjective answer evaluation
big data
machine learning
natural language processing
Word2Vec
WordNet.
Abstract
Each year, universities and educational boards conduct exams offline, requiring students to participate in subjective tests. The manual evaluation of a vast number of such answer sheets is labor-intensive and time consuming. Moreover, the quality of assessment can sometimes be inconsistent, influenced by the evaluator's mindset or fatigue. In contrast, objective or multiple-choice questions, often used in competitive and entrance exams, are easily assessed through automated systems, simplifying the evaluation process. However, the manual grading of subjective responses remains a challenging task. The integration of artificial intelligence (AI) in evaluating subjective responses faces significant hurdles, primarily due to skepticism about the accuracy and reliability of the results. Although there have been various attempts to leverage computer science for assessing student answers, many of these efforts rely heavily on standardized counts or specific keywords, and often suffer from a lack of comprehensive datasets. This paper introduces a novel approach for the automatic evaluation of descriptive answers by employing a combination of machine learning techniques and natural language processing tools such as WordNet, Word2Vec, word mover's distance (WMD), cosine similarity, Multinomial Naive Bayes (MNB), and term frequency-inverse document frequency (TF-IDF). The proposed method assesses answers by comparing them to solution statements and relevant keywords, and it also develops a machine learning model to predict grades. The findings suggest that WMD provides better performance compared to cosine similarity. Additionally, with appropriate training, the machine learning model can be used independently. Experimental results show that the approach achieves an accuracy of 88% without using the MNB model, while incorporating MNB further reduces the error rate by 1.3%.
License
This work is licensed under a Creative
Commons
Attribution-ShareAlike 4.0 International License.
Author Information
| # | Name | Institute / Affiliation |
|---|---|---|
| 1 | Mohammed Ayub G | CMR University |
| 2 | Surya Prakash Gupta | CMR University |
| 3 | Dr. V. Srikanth | CMR University |
How to Cite
Use the following formats to cite this article in your research.
APA Style
G, Mohammed Ayub, Gupta, Surya Prakash, & Srikanth, Dr. V. (2024). Natural Language Processing Techniques for Ranking Subjective Responses. International Journal of Advance Research and Innovative Ideas In Education, 10(4), 3286-3291.
MLA Style
G, Mohammed Ayub, et al. "Natural Language Processing Techniques for Ranking Subjective Responses." International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 4, 2024, pp. 3286-3291.
IEEE Style
Mohammed Ayub G, Surya Prakash Gupta, and Dr. V. Srikanth, "Natural Language Processing Techniques for Ranking Subjective Responses," International Journal of Advance Research and Innovative Ideas In Education, vol. 10, no. 4, pp. 3286-3291, 2024.
Vancouver Style
G Mohammed Ayub, Gupta Surya Prakash, Srikanth Dr. V.. Natural Language Processing Techniques for Ranking Subjective Responses. International Journal of Advance Research and Innovative Ideas In Education. 2024;10(4):3286-3291.
Harvard Style
G, Mohammed Ayub, Gupta, Surya Prakash, & Srikanth, Dr. V. (2024) 'Natural Language Processing Techniques for Ranking Subjective Responses', International Journal of Advance Research and Innovative Ideas In Education, 10(4), pp. 3286-3291.
Chicago Style
G, Mohammed Ayub, Surya Prakash Gupta, and Dr. V. Srikanth. "Natural Language Processing Techniques for Ranking Subjective Responses." International Journal of Advance Research and Innovative Ideas In Education 10, no. 4 (2024): 3286-3291.
Turabian Style
G, Mohammed Ayub, Surya Prakash Gupta, and Dr. V. Srikanth. "Natural Language Processing Techniques for Ranking Subjective Responses." International Journal of Advance Research and Innovative Ideas In Education 10, no. 4 (2024): 3286-3291.
Related Research
Precision Agriculture Using Computer Vision: A Review of In-Field Disease Detection, Foliar Severity Estimation
Download PDF
Development of a Custom Handwritten Kannada Dataset and CNN-BiLSTM-CTC Based OCR System
Download PDF
Adaptive multi-model knowledge distillation with dynamic teacher selection for efficient lightweight network intrusion detection
Download PDF
CodeCoach AI: A Review of Automated Programming Assessment, Explainable Feedback, and an AI-Assisted Coding Practice Framework
Download PDF
BudgetBee - A Review of AI Enabled Personal Finance Management and Smart Budgeting Application
Download PDF
Krishi Sathi and AI-Powered Farming Assistants: A Systematic Review of Conversational and Decision-Support Intelligence for Smallholder Agriculture
Download PDF