Content-Aware Compression using Saliency-Driven Image Retargeting for Wireless Video

 

In this paper, we propose a novel method to compress video content based on image retargeting. 

September 18, 2013
International Conference on Image Processing (ICIP) 2013

 

Authors

Fabio Zund (Disney Research/ETH Joint PhD)

Yael Pritch (Disney Research)

Alexander Sorkine-Hornung (Disney Research)

Stefan Mangold (Disney Research)

Thomas Gross (ETH Zurich)

Content-Aware Compression using Saliency-Driven Image Retargeting for Wireless Video

Abstract

First, a saliency map is extracted from the video frames either automatically or according to user input. Next, nonlinear image scaling is performed which assigns a higher pixel count to salient image regions and fewer pixels to non-salient regions. The nonlinearly downscaled images can then be compressed using existing compression techniques and decoded and upscaled at the receiver. To this end, we introduce a non-uniform antialiasing technique that significantly improves the image resampling quality. The overall process is complementary to existing compression methods and can be seamlessly incorporated into existing pipelines. We compare our method to JPEG 2000 and H.264/AVC-10 and show that, at the cost of visual quality in non-salient image regions, our method achieves a significant improvement of the visual quality of salient image regions in terms of Structural Similarity (SSIM) and Peak Signal-to-Noise-Ratio (PSNR) quality measures, in particular for scenarios with high compression ratios.

Copyright Notice