My Account | Careers | Downloads | Blog

PROJECT TITLE :

A novel lip descriptor for audio-visual keyword Spotting based on adaptive decision fusion - 2016

ABSTRACT:

Keyword spotting remains a challenge when applied to real-world environments with dramatically changing noise. In recent studies, audio-visual integration methods have demonstrated superiorities since visual speech isn't influenced by acoustic noise. However, for visual speech recognition, individual utterance mannerisms can cause confusion and false recognition. To solve this drawback, a novel lip descriptor is presented involving both geometry-based mostly and appearance-based options during this paper. Specifically, a group of geometry-based mostly options is proposed based on a complicated facial landmark localization technique. In order to obtain sturdy and discriminative representation, a spatiotemporal lip feature is put forward regarding similarities among textons and mapping the feature to intra-category subspace. Moreover, a parallel 2-step keyword recognizing strategy based mostly on decision fusion is proposed so as to form the most effective use of audio-visual speech and adapt to various noise conditions. Weights generated employing a neural network combine acoustic and visual contributions. Experimental results on the OuluVS dataset and PKU-AV dataset demonstrate that the proposed lip descriptor shows competitive performance compared to the cutting-edge. Additionally, the proposed audio-visual keyword spotting (AV-KWS) method primarily based on call-level fusion considerably improves the noise robustness and attains higher performance than feature-level fusion, that is also capable of adapting to numerous noisy conditions.


Did you like this research project?

To get this research project Guidelines, Training and Code... Click Here

Neural Nets Feature Extraction Image Fusion Face Recognition Audio-Visual Systems Decision Theory Spatiotemporal Phenomena Speech Recognition
PROJECT TITLE : Novel Secure Outsourcing of Modular Inversion for Arbitrary and Variable Modulus ABSTRACT: In the fields of cryptography and algorithmic number theory, modular inversion is regarded as one of the operations that
PROJECT TITLE : A Novel Blockchain Based Secured and QoS Aware IoT Vehicular Network in Edge Cloud Computing ABSTRACT: An IoT (Internet of Things)-based vehicular ad-hoc network and a software-defined network are the two components
PROJECT TITLE : Progressive Self-Supervised Clustering With Novel Category Discovery ABSTRACT: Clustering is one of the most classical methods used to analyze data structures in machine learning and pattern recognition at the
PROJECT TITLE : Large-Scale Affine Matrix Rank Minimization With a Novel Nonconvex Regularizer ABSTRACT: The goal of low-rank minimization is to recover a matrix with the lowest possible rank while still satisfying the constraints
PROJECT TITLE : A Novel Discriminative Dictionary Pair Learning Constrained by Ordinal Locality for Mixed Frequency Data Classification ABSTRACT: One of the challenges that classification must overcome is the fact that the data

Ready to Complete Your Academic MTech Project Work In Affordable Price ?

Project Enquiry