Attention in Attention Network for Image Super-Resolution

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

1. Very close Not relevant

   Effectiveness Evaluation of Attention Mechanism Strategies in Deep Learning-Based Single Image Super-Resolution

   Xu Wang, Mu-Yu Liu, Liqun Long · 2026 · Journal of Global Engineering Review · cited 2 times · Not summarized yet

   Abstract

   Single image super-resolution (SISR) has experienced rapid advancements through the integration of attention mechanisms into deep neural networks. Diverse attention strategies, including channel attention, spatial attention, second-order attention, and self-attention, have been incorporated into SISR architectures with varying degrees of success. A systematic and fair comparison of these attention strategies under unified experimental conditions remains absent from the current literature. This study conducts a controlled benchmark evaluation of five representative SISR algorithms—EDSR, RCAN, SAN, SwinIR, and HAT—each embodying a distinct attention paradigm, across four standard datasets (Set…

2. Very close Cited by this paper Used in depth by this paper A method it uses Not relevant

   Lightweight Single-Image Super-Resolution Network with Attentive Auxiliary Feature Learning

   Xue-Hui Wang, Qing Wang, Yuzhi Zhao et al. · 2020 · Asian Conference on Computer Vision · cited 62 times · Not summarized yet

   Abstract

   Despite convolutional network-based methods have boosted the performance of single image super-resolution (SISR), the huge computation costs restrict their practical applicability. In this paper, we develop a computation efficient yet accurate network based on the proposed attentive auxiliary features (A$^2$F) for SISR. Firstly, to explore the features from the bottom layers, the auxiliary feature from all the previous layers are projected into a common space. Then, to better utilize these projected auxiliary features and filter the redundant information, the channel attention is employed to select the most important common feature based on current layer feature. We incorporate these two mod…

3. Very close Not relevant

   Kernel Attention Network for Single Image Super-Resolution

   Dong-Yang Zhang, Jie Shao, Heng-Tao Shen · 2020 · ACM Trans. Multim. Comput. Commun. Appl. · cited 24 times · Not summarized yet

   Abstract

   Recently, attention mechanisms have shown a developing tendency toward convolutional neural network (CNN), and some representative attention mechanisms, i.e., channel attention (CA) and spatial attention (SA) have been fully applied to single image super-resolution (SISR) tasks. However, the existing architectures directly apply these attention mechanisms to SISR without much consideration of the nature characteristic, resulting in less strong representational power. In this article, we propose a novel kernel attention module (KAM) for SISR, which enables the network to adjust its receptive field size corresponding to various scales of input by dynamically selecting the appropriate kernel. B…

4. Very close Not relevant

   Single image super resolution using deep attention network

   Jagrati Talreja · Not summarized yet

   Abstract

   This thesis introduces two innovative frameworks for Single Image Super Resolution (SISR) that enhances image quality while optimizing computational efficiency. The motivation for this research is driven by the need to overcome the limitations of current SISR techniques like capturing long-range dependencies, enhancing multi-scale feature learning, mitigating over-smoothing, and managing computational demands. The choice to incorporate attention mechanisms in both frameworks is motivated by their proven ability to allow the model to focus on the most relevant parts of the image, thereby improving the reconstruction of high-resolution details from low-resolution inputs. By integrating attenti…

5. Very close Not relevant

   Densely convolutional attention network for image super-resolution

   Furui Bai, Wen Lu, Yuan-Fei Huang et al. · 2019 · Neurocomputing · cited 11 times · Not summarized yet

   Abstract

   Abstract Recently, deep convolutional neural networks (CNNs) with skip-connections in single image super-resolution (SISR) have received great success. However, the difficulty of reconstructing high-resolution images is particularly pronounced for the limited information extracted from input low-resolution images, for which the performance bottleneck of these SR networks still exists. In this paper, we present a novel Densely Convolutional Attention Network (DCAN) for SISR to improve the quality of reconstructed images. Specifically, we propose a convolutional attention mechanism which adds an weighted skip-connection joint the original convolution. Our network can adaptively recalibrate con…

6. Very close Cited by this paper Not relevant

   Second-Order Attention Network for Single Image Super-Resolution

   Tao Dai, Jianrui Cai, Yong-Bing Zhang et al. · 2019 · Computer Vision and Pattern Recognition · cited 1,868 times · Not summarized yet

   Abstract

   Recently, deep convolutional neural networks (CNNs) have been widely explored in single image super-resolution (SISR) and obtained remarkable performance. However, most of the existing CNN-based SISR methods mainly focus on wider or deeper architecture design, neglecting to explore the feature correlations of intermediate layers, hence hindering the representational power of CNNs. To address this issue, in this paper, we propose a second-order attention network (SAN) for more powerful feature expression and feature correlation learning. Specifically, a novel train- able second-order channel attention (SOCA) module is developed to adaptively rescale the channel-wise features by using second-o…

7. Very close Not relevant

   Multi-Grained Attention Networks for Single Image Super-Resolution

   Hua-Peng Wu, Zhengxia Zou, Jie Gui et al. · 2019 · IEEE transactions on circuits and systems for video technology (Print) · cited 68 times · Not summarized yet

   Abstract

   Deep Convolutional Neural Networks (CNN) have drawn great attention in image super-resolution (SR). Recently, visual attention mechanism, which exploits both of the feature importance and contextual cues, has been introduced to image SR and proves to be effective to improve CNN-based SR performance. In this paper, we make a thorough investigation on the attention mechanisms in a SR model and shed light on how simple and effective improvements on these ideas improve the state-of-the-arts. We further propose a unified approach called “multi-grained attention networks (MGAN)” which fully exploits the advantages of multi-scale and attention mechanisms in SR tasks. In our method, the importance o…

8. Very close Cites this paper Not relevant

   Efficient Image Super-Resolution using Vast-Receptive-Field Attention

   Ling Zhou, Haoming Cai, Jinjin Gu et al. · 2022 · ECCV Workshops · cited 102 times · Not summarized yet

   Abstract

   The attention mechanism plays a pivotal role in designing advanced super-resolution (SR) networks. In this work, we design an efficient SR network by improving the attention mechanism. We start from a simple pixel attention module and gradually modify it to achieve better super-resolution performance with reduced parameters. The specific approaches include: (1) increasing the receptive field of the attention branch, (2) replacing large dense convolution kernels with depth-wise separable convolutions, and (3) introducing pixel normalization. These approaches paint a clear evolutionary roadmap for the design of attention mechanisms. Based on these observations, we propose VapSR, the VAst-recep…

Prior work it builds on

1. Close Used in depth by this paper Not relevant

   Image Super-Resolution Using Very Deep Residual Channel Attention Networks

   Yulun Zhang, Kunpeng Li, Kai Li et al. · 2018 · European Conference on Computer Vision · cited 5,659 times · Not summarized yet

   Abstract

   Convolutional neural network (CNN) depth is of crucial importance for image super-resolution (SR). However, we observe that deeper networks for image SR are more difficult to train. The low-resolution inputs and features contain abundant low-frequency information, which is treated equally across channels, hence hindering the representational ability of CNNs. To solve these problems, we propose the very deep residual channel attention networks (RCAN). Specifically, we propose a residual in residual (RIR) structure to form very deep network, which consists of several residual groups with long skip connections. Each residual group contains some residual blocks with short skip connections. Meanw…

2. Close Used in depth by this paper A method it uses Not relevant

   Lightweight Image Super-Resolution with Adaptive Weighted Learning Network

   Chaofeng Wang, Zheng Li, Jun Shi · 2019 · arXiv.org · preprint, not peer reviewed · cited 125 times · Not summarized yet

   Abstract

   Deep learning has been successfully applied to the single-image super-resolution (SISR) task with great performance in recent years. However, most convolutional neural network based SR models require heavy computation, which limit their real-world applications. In this work, a lightweight SR network, named Adaptive Weighted Super-Resolution Network (AWSRN), is proposed for SISR to address this issue. A novel local fusion block (LFB) is designed in AWSRN for efficient residual learning, which consists of stacked adaptive weighted residual units (AWRU) and a local residual fusion unit (LRFU). Moreover, an adaptive weighted multi-scale (AWMS) module is proposed to make full use of features in r…

3. Very close Not relevant

   Hierarchical Residual Attention Network for Single Image Super-Resolution

   Parichehr Behjati, Pau Rodríguez López, Armin Mehri et al. · 2020 · arXiv.org · preprint, not peer reviewed · cited 8 times · Not summarized yet

   Abstract

   Convolutional neural networks are the most successful models in single image super-resolution. Deeper networks, residual connections, and attention mechanisms have further improved their performance. However, these strategies often improve the reconstruction performance at the expense of considerably increasing the computational cost. This paper introduces a new lightweight super-resolution model based on an efficient method for residual feature and attention aggregation. In order to make an efficient use of the residual features, these are hierarchically aggregated into feature banks for posterior usage at the network output. In parallel, a lightweight hierarchical attention mechanism extra…

4. Close Used in depth by this paper A method it uses Not relevant

   Lightweight Image Super-Resolution with Information Multi-distillation Network

   Zheng Hui, Xin-Bo Gao, Yunchu Yang et al. · 2019 · ACM Multimedia · cited 1,261 times · Not summarized yet

   Abstract

   In recent years, single image super-resolution (SISR) methods using deep convolution neural network (CNN) have achieved impressive results. Thanks to the powerful representation capabilities of the deep networks, numerous previous ways can learn the complex non-linear mapping between low-resolution (LR) image patches and their high-resolution (HR) versions. However, excessive convolutions will limit the application of super-resolution technology in low computing power devices. Besides, super-resolution of any arbitrary scale factor is a critical issue in practical applications, which has not been well solved in the previous approaches. To address these issues, we propose a lightweight inform…

5. Close Used in depth by this paper A method it uses Not relevant

   Accurate Image Super-Resolution Using Very Deep Convolutional Networks

   Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee · 2015 · Computer Vision and Pattern Recognition · cited 7,263 times · Not summarized yet

   Abstract

   We present a highly accurate single-image superresolution (SR) method. Our method uses a very deep convolutional network inspired by VGG-net used for ImageNet classification [19]. We find increasing our network depth shows a significant improvement in accuracy. Our final model uses 20 weight layers. By cascading small filters many times in a deep network structure, contextual information over large image regions is exploited in an efficient way. With very deep networks, however, convergence speed becomes a critical issue during training. We propose a simple yet effective training procedure. We learn residuals only and use extremely high learning rates (104 times higher than SRCNN [6]) enable…

Papers that cite it

1. Close Uses this paper in depth Not relevant

   A Simple Transformer-style Network for Lightweight Image Super-resolution

   Garas Gendy, Nabil Sabor, Jingchao Hou et al. · 2023 · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · cited 31 times · Not summarized yet

   Abstract

   The task of single image super resolution (SISR) has taken much attention in the last few years due to the wide range of real-world applications. However, most of the recently developed methods are computationally expensive and need much more memory. To solve this issue, we propose a simple Transformer-style network (STSN) for the image super resolution (SR) task. The idea of this method is based on using convolutional modulation (Conv2Former), which is a very simple block with a linearly compared to quadratically as in Transformers. This Conv2Former is simplified the self-attention mechanism based on utilizing only convolutions and Hadamard product. Also, the original Conv2Former is further…

2. Close Uses this paper in depth Not relevant

   Structured Fusion Attention Network for Image Super-Resolution Reconstruction

   Yao-Nan Dai, Jiu-Yang Yu, Tianhao Hu et al. · 2022 · IEEE Access · cited 1 time · Not summarized yet

   Abstract

   To improve the extraction ability of image features, reduce the complexity of model parameters, and enhance the reconstruction effect of image super-resolution (SR), a structured fusion attention network (SFAN) is proposed. Firstly, the deep convolution method is used to extract shallow features from low-resolution images, and different residual attention modules are considered to improve the structured residual of the encoder to extract more image features. Secondly, the features output by the encoder are refined, and the spatial attention module and the channel attention module are reorganized according to an improved fusion attention method to provide better input features for PixelShuffl…

3. Close Uses this paper in depth Not relevant

   Counterfactual Attention for Facial Image Super-Resolution

   Jayanthi Raghavan, M. Ahmadi · 2023 · International Symposium on Signals, Circuits and Systems · cited 2 times · Not summarized yet

   Abstract

   Super-resolution (SR) is the task of recovering High-Resolution (HR) images from given Low- Resolution (LR) Images. Various SR methods are available in the literature. The attention mechanism is one of the widely used approaches in the field of SR. In this paper, Counterfactual Attention Learning (CAL) based on causal inference is applied to increase the quality of attention in Face Super-Resolution (FSR). This approach helps to assess the quality of attention and provides a strong signal to supervise the learning activity. The paper discusses the effect of the learned attention on the task of SR through counterfactual intervention and the effect is maximized to make the model learn useful a…

4. Close Not relevant

   A Channel Contrastive Attention-Based Local-Nonlocal Mutual Block on Super-Resolution

   Yu-Hao Liu, Zhenzhong Chu, Li-Fei Wei · 2024 · IEICE Trans. Inf. Syst. · cited 1 time · Not summarized yet

   Abstract

   SUMMARY In the realm of Single Image Super-Resolution (SISR), the meticulously crafted Nonlocal Sparse Attention-based block demonstrates its efficacy in noise reduction and computational cost reduction for nonlocal (global) features. However, it neglect the traditional Convolutional-based block, which proficient in handling local features. Thus, merging both the Nonlocal Sparse Attention-based block and the Convolutional-based block to concurrently manage local and nonlocal features poses a significant challenge. To tackle the aforementioned issues, this paper introduces the Channel Contrastive Attention-based Local-Nonlocal Mutual block (CCLN) for Super-Resolution (SR). (1) We introduce the CC…

5. Close Not relevant

   Deep HyFeat Based Attention in Attention Model for Face Super-Resolution

   A. Tomar, K. V. Arya, S. S. Rajput · 2023 · IEEE Transactions on Instrumentation and Measurement · cited 27 times · Not summarized yet

   Abstract

   Face super-resolution (SR) is the task of generating high-resolution (HR) face images from the low-resolution (LR) inputs. Recently, deep learning-based methods have shown remarkable progress in the SR field. Most of the methods perform additional tasks such as face parsing, landmark, and attention to generate the HR images. However, parsing maps and landmark-guided models require the supplementary labeled dataset, which is difficult to obtain in real life. The attention mechanism does not require the datasets extra labeling and is also beneficial for face SR. These methods focus on a few critical features and ignore the remaining ones, which sometime causes to ignore the valuable features. …