Ref-ZSSR: Zero-Shot Single Image Superresolution with Reference Image

Simple item page
dc.contributor.authorHan, Xianjunen_US
dc.contributor.authorWang, Xueen_US
dc.contributor.authorWang, Huabinen_US
dc.contributor.authorLi, Xuejunen_US
dc.contributor.authorYang, Hongyuen_US
dc.contributor.editorUmetani, Nobuyukien_US
dc.contributor.editorWojtan, Chrisen_US
dc.contributor.editorVouga, Etienneen_US
dc.date.accessioned2022-10-04T06:41:15Z
dc.date.available2022-10-04T06:41:15Z
dc.date.issued2022
dc.description.abstractSingle image superresolution (SISR) has achieved substantial progress based on deep learning. Many SISR methods acquire pairs of low-resolution (LR) images from their corresponding high-resolution (HR) counterparts. Being unsupervised, this kind of method also demands large-scale training data. However, these paired images and a large amount of training data are difficult to obtain. Recently, several internal, learning-based methods have been introduced to address this issue. Although requiring a large quantity of training data pairs is solved, the ability to improve the image resolution is limited if only the information of the LR image itself is applied. Therefore, we further expand this kind of approach by using similar HR reference images as prior knowledge to assist the single input image. In this paper, we proposed zero-shot single image superresolution with a reference image (Ref-ZSSR). First, we use an unconditional generative model to learn the internal distribution of the HR reference image. Second, a dual-path architecture that contains a downsampler and an upsampler is introduced to learn the mapping between the input image and its downscaled image. Finally, we combine the reference image learning module and dual-path architecture module to train a new generative model that can generate a superresolution (SR) image with the details of the HR reference image. Such a design encourages a simple and accurate way to transfer relevant textures from the reference high-definition (HD) image to LR image. Compared with using only the image itself, the HD feature of the reference image improves the SR performance. In the experiment, we show that the proposed method outperforms previous image-specific network and internal learning-based methods.en_US
dc.description.number7
dc.description.sectionheadersImage Enhancement
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14679
dc.identifier.issn1467-8659
dc.identifier.pages311-322
dc.identifier.pages12 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14679
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14679
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies --> Reconstruction
dc.subjectComputing methodologies
dc.subjectReconstruction
dc.titleRef-ZSSR: Zero-Shot Single Image Superresolution with Reference Imageen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
v41i7pp311-322.pdf
Size:
47 MB
Format:
Adobe Portable Document Format
Download
Collections
41-Issue 7