HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Real-World Super-Resolution via Kernel Estimation and Noise Injection

{Feiyue Huang Jilin Li Chengjie Wang Ying Tai Yun Cao Xiaozhong Ji}

Abstract

Recent state-of-the-art super-resolution methods have achieved impressive performance on ideal datasets regardless of blur and noise. However, these methods always fail in real-world image super-resolution, since most of them adopt simple bicubic downsampling from high-quality images to construct Low-Resolution (LR) and High-Resolution (HR) pairs for training which may lose track of frequency-related details. To address this issue, we focus on designing a novel degradation framework for real- world images by estimating various blur kernels as well as real noise distributions. Based on our novel degradation framework, we can acquire LR images sharing a common domain with real-world images. Then, we propose a real- world super-resolution model aiming at better perception. Extensive experiments on synthetic noise data and real- world images demonstrate that our method outperforms the state-of-the-art methods, resulting in lower noise and better visual quality. In addition, our method is the winner of NTIRE 2020 Challenge on both tracks of Real-World Super-Resolution, which significantly outperforms other competitors by large margins.

Benchmarks

BenchmarkMethodologyMetrics
video-super-resolution-on-msu-super-1RealSR + uavs3e
BSQ-rate over ERQA: 1.943
BSQ-rate over LPIPS: 1.149
BSQ-rate over MS-SSIM: 1.441
BSQ-rate over PSNR: 14.741
BSQ-rate over Subjective Score: 0.639
BSQ-rate over VMAF: 2.253
video-super-resolution-on-msu-super-1RealSR + x265
BSQ-rate over ERQA: 1.622
BSQ-rate over LPIPS: 1.206
BSQ-rate over MS-SSIM: 1.033
BSQ-rate over PSNR: 1.064
BSQ-rate over Subjective Score: 0.502
BSQ-rate over VMAF: 1.617
video-super-resolution-on-msu-super-1RealSR + vvenc
BSQ-rate over ERQA: 21.965
BSQ-rate over LPIPS: 18.344
BSQ-rate over MS-SSIM: 11.643
BSQ-rate over PSNR: 15.144
BSQ-rate over VMAF: 10.67
video-super-resolution-on-msu-super-1RealSR + x264
BSQ-rate over ERQA: 0.77
BSQ-rate over LPIPS: 0.591
BSQ-rate over MS-SSIM: 0.487
BSQ-rate over PSNR: 0.675
BSQ-rate over Subjective Score: 0.196
BSQ-rate over VMAF: 0.775
video-super-resolution-on-msu-super-1RealSR + aomenc
BSQ-rate over ERQA: 6.762
BSQ-rate over LPIPS: 10.915
BSQ-rate over MS-SSIM: 5.463
BSQ-rate over PSNR: 15.144
BSQ-rate over Subjective Score: 0.843
BSQ-rate over VMAF: 4.283
video-super-resolution-on-msu-video-upscalersRealSR
LPIPS: 0.220
PSNR: 30.64
SSIM: 0.900
video-super-resolution-on-msu-vsr-benchmarkRealSR
1 - LPIPS: 0.911
ERQAv1.0: 0.69
FPS: 0.352
PSNR: 25.989
QRCRv1.0: 0
SSIM: 0.767
Subjective score: 5.286

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp