Call for Papers:Vol.11 Issue.3

Submission
Last date		 28-Jun-2025
Acceptance Status In One Day
Paper Publish In Two Days
Submit ManuScript

News & Updates

Submit Article

Dear Authors, Article publish in our journal for Volume-11,Issue-3. For article submission on below link: Submit Manuscript


Join As Board

Dear Reviewer, You can join our Reviewer team without given any charges in our journal. Submit Details on below link: Join As Board


Paper Publication Charges

IJARIIE APP
Download Android App

For Authors

Archives

IJARIIE Board

Downloads

Android App

Download IJARIIE APP

Authors

Title: :  Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition
PaperId: :  9653
Published in:   International Journal Of Advance Research And Innovative Ideas In Education
Publisher:   IJARIIE
e-ISSN:   2395-4396
Volume/Issue:    Volume 5 Issue 2 2019
DUI:    16.0415/IJARIIE-9653
Licence: :   IJARIIE is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Author NameAuthor Institute
GOKUL RAJES PSRM Institute of Science and Technology
Sayantan Chatterjee SRM Institute of Science and Technology
N SRICHARAN PHANINDRASRM Institute of Science and Technology
Kaustubh NarkhedeSRM Institute of Science and Technology
Saksham AlagSRM Institute of Science and Technology

Abstract

Electronics and Communication Engineering
CNN-convolutional neural network, HMM- Hidden Markov model, GMM- Gaussian Markov Model, and Architecture
This column orates the difficulties of continuous speech recognition system from optical information only, without using audio signal. Our method combines a video camera and an ultrasound imagining system for simultaneously detecting the speaker’s lips and the mobility of our tongue. We considered the usage of convolution neural network (CNN) to elicit the optical features directly from the basic ultrasound and optical images. We want to introduce variant architectures among which is a multimodal CNN processing jointly the two optical modalities together with an HMM-GMM decoder, the CNN type approach suppresses our earlier baseline based on principal component analysis. Notably, the recognition efficiency is 4 % lower than which was obtained decoding audio signal which makes it better for practical optical speech recognition system.

Citations

Copy and paste a formatted citation or use one of the links to import into a bibliography manager and reference.

IJARIIE GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. "Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition" International Journal Of Advance Research And Innovative Ideas In Education Volume 5 Issue 2 2019 Page 476-480
MLA GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. "Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition." International Journal Of Advance Research And Innovative Ideas In Education 5.2(2019) : 476-480.
APA GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, & Saksham Alag. (2019). Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition. International Journal Of Advance Research And Innovative Ideas In Education, 5(2), 476-480.
Chicago GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. "Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition." International Journal Of Advance Research And Innovative Ideas In Education 5, no. 2 (2019) : 476-480.
Oxford GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. 'Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition', International Journal Of Advance Research And Innovative Ideas In Education, vol. 5, no. 2, 2019, p. 476-480. Available from IJARIIE, https://ijariie.com/AdminUploadPdf/Feature_Extraction_Using_Multi_modal_Convolution_Neural_Network_for_Optical_Speech_Recognition_ijariie9653.pdf (Accessed : 01 August 2020).
Harvard GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. (2019) 'Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition', International Journal Of Advance Research And Innovative Ideas In Education, 5(2), pp. 476-480IJARIIE [Online]. Available at: https://ijariie.com/AdminUploadPdf/Feature_Extraction_Using_Multi_modal_Convolution_Neural_Network_for_Optical_Speech_Recognition_ijariie9653.pdf (Accessed : 01 August 2020)
IEEE GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag, "Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition," International Journal Of Advance Research And Innovative Ideas In Education, vol. 5, no. 2, pp. 476-480, Mar-App 2019. [Online]. Available: https://ijariie.com/AdminUploadPdf/Feature_Extraction_Using_Multi_modal_Convolution_Neural_Network_for_Optical_Speech_Recognition_ijariie9653.pdf [Accessed : 01 August 2020].
Turabian GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. "Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition." International Journal Of Advance Research And Innovative Ideas In Education [Online]. volume 5 number 2 (01 August 2020).
Vancouver GOKUL RAJES P, Sayantan Chatterjee , N SRICHARAN PHANINDRA, Kaustubh Narkhede, and Saksham Alag. Feature Extraction Using Multi-modal Convolution Neural Network for Optical Speech Recognition. International Journal Of Advance Research And Innovative Ideas In Education [Internet]. 2019 [Cited : 01 August 2020]; 5(2) : 476-480. Available from: https://ijariie.com/AdminUploadPdf/Feature_Extraction_Using_Multi_modal_Convolution_Neural_Network_for_Optical_Speech_Recognition_ijariie9653.pdf
BibTex EndNote RefMan RefWorks

Number Of Downloads


Last download on 8/1/2020 5:27:14 AM

Save in Google Drive

Similar-Paper

TitleArea of ResearchAuther NameAction
Iot based automated paralysis patient healthcare systemElectronics and communication Engineering Thanushree K V Download
UNDERWATER AUDIO TRANSMISSION USING LI-FI TECHNOLOGYElectronics and CommunicationGousiya Khan Download
High-Efficiency Bidirectional DC-DC Converters for Electric Vehicle(EV)Electronics and Telecommunication EngineeringAjay Mishra Download
Interactive Joint Feature Extraction for Diabetic Retinopathy Classification using Multiple Instance Neural Symbolic LearningSri Venkatesa Perumal College of Engineering & TechnologyK Purushotham Download
SMART HOME SECURITY SYSTEMELECTRONICS AND COMMUNICATION ENGINEERINGArshi Download
Evaluation of Machine Learning Models for Air Quality Index PredictionElectronics and Communication EngineeringI.S.Priya Download
A Deep Learning Approach For Plant Leaf Disease Detection Using VGG16Electronics and Communication EngineeringA.Geethanjali Download
Data - driven Explainable Predictive Features For Water Quality Prediction Using Ensemble LearningSri Venkatesa Perumal college of Engineering & TechnologyT.V.Ananda Babu Download
Enhanced Intrusion and Anomaly Detection in Industrial IoT Using Ensemble Learning and LSTMElecfA.Nithyavel Krishna Download
Robust Glaucoma Prediction from Fundus Images using DenseNet201 &NASNetMobileElectronics and Communication Engineering A.Geethanjali Download
Optimized Metric Learning for Enhanced Coronary Heart Disease PredictionSri Venkatesa Perumal college of Engineering and TechnologyMr. T V Ananda Babu Download
Performance Analysis of LMS-MUSIC and LMS-MVDR DOA Estimation AlgorithmELECTRONICS ENGINEERINGKAMAL NIWARIA Download
IoT SMART GARDENING SYSTEMElectronics and Communication EngineeringS. SAI PRUTHVI Download
Classification and Recognisation of Lung Sounds Based on Improved Bi-ResNet modelSri Venkatesa Perumal college of Engineering and TechnologyMr. Y Maheshwar Download
E-Ration SystemElectronics Dr. Trupti K. Wable Download
12