Interview Motion Compensated Joint Decoding for Compressively Sampled Multiview Video Streams


In this paper, we design a novel multiview video encoding/decoding architecture for wirelessly multiview video streaming applications, e.g., 360 degrees video, Internet of Things (IoT) multimedia sensing, among others, based on distributed video coding and compressed sensing principles. Specifically, we focus on joint decoding of independently encoded compressively sampled multiview video streams. We first propose a novel side-information (SI) generation method based on a new interview motion compensation algorithm for multiview video joint reconstruction at the decoder end. Then, we propose a technique to fuse the received measurements with resampled measurements from the generated SI to perform the final recovery. Based on the proposed joint reconstruction method, we also derive a blind video quality estimation technique that can be used to adapt online the video encoding rate at the sensors to guarantee desired quality levels in multiview video streaming. Extensive simulation results of real multiview video traces show the effectiveness of the proposed fusion reconstruction method with the assistance of SI generated by an interview motion compensation method. Moreover, they also illustrate that the blind quality estimation algorithm can accurately estimate the reconstruction quality.


Computer Science


This work is based upon material supported in part by the U.S. National Science Foundation under Grant CNS1422874, and in part by the U.S. Office of Naval Research under Grant N00014-16-1-2213 and Grant ARMY W911NF-17-1-0034.

This paper was presented in part at the Picture Coding Symposium, San Jose, CA, December 2013.

Keywords and Phrases

360 Degrees Video; Compressed Sensing (CS); Internet of Things (IoT); Multiview Video Streaming

International Standard Serial Number (ISSN)


Document Type

Article - Journal

Document Version


File Type





© 2017 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

01 Jun 2017