Deep Coupled ISTA Network for Multi-Modal Image Super-Resolution


In order to obtain a high-resolution (HR) version of a low-resolution (LR) image, multi-modal image super-resolution (MISR) uses another modality's high-resolution image as guidance. In this research, we propose a new deep network architecture for MISR based on a model-based approach. A new joint multi-modal dictionary learning (JMDL) approach is first introduced to model cross-modal dependency. There are four different dictionaries in JMDL, each with its own set of two transform matrices. The JMDL model is then transformed into a deep neural network known as a "deep coupled ISTA network" by using the "iterative shrinkage and thresholding method" (ISTA). We also present a layer-wise optimization algorithm (LOA) to initialise the network parameters prior to executing back-propagation method, because network initialization is critical in deep network training. We tackle the convex optimization problem by modelling the network initialization as a multi-layer dictionary learning problem. In a study, the proposed LOA was found to reduce training loss and improve reconstruction accuracy. As a last step, we compare our method to various current methods for analysing MISR images. A comparison of the numerical findings for numerous multi-modal scenarios shows that our method regularly surpasses the competition in terms of both quantitative and qualitative metrics.

Did you like this research project?

To get this research project Guidelines, Training and Code... Click Here

PROJECT TITLE : Alzheimers Diseases Detection by Using Deep Learning Algorithms ABSTRACT: Accurate Alzheimer's disease (AD) diagnosis is critical for patient treatment, especially in the early stages of the disease, because
PROJECT TITLE : Deep Learning for Plant Species Classification Using Leaf Vein Morphometric ABSTRACT: Botanists and laypeople alike could benefit from a system that automatically identifies plant species. Deep learning is effective
PROJECT TITLE : Deep Learning for Smartphone-Based Malaria Parasite Detection in Thick Blood Smears ABSTRACT: This study looks into the possibilities of using smartphones to detect malaria parasites in thick blood smears. We've
PROJECT TITLE : Object Detection from Scratch with Deep Supervision ABSTRACT: We propose Deeply Supervised Object Detectors (DSOD) as an object detection framework that can be taught from the ground up in this research. Off-the-shelf
PROJECT TITLE : Robust Lane Detection from Continuous Driving ScenesUsing Deep Neural Networks ABSTRACT: For autonomous vehicles and sophisticated driver assistance systems, lane recognition in driving scenes is a critical element.

Ready to Complete Your Academic MTech Project Work In Affordable Price ?

Project Enquiry