TR2018-134

FreeCast: Graceful Free-Viewpoint Video Delivery


    •  Fujihashi, T., Koike-Akino, T., Watanabe, T., Orlik, P.V., "FreeCast: Graceful Free-Viewpoint Video Delivery", IEEE Transactions on Multimedia, DOI: 10.1109/​TMM.2018.2870074, Vol. 21, No. 4, pp. 1000-1010, September 2018.
      BibTeX TR2018-134 PDF
      • @article{Fujihashi2018sep,
      • author = {Fujihashi, Takuya and Koike-Akino, Toshiaki and Watanabe, Takashi and Orlik, Philip V.},
      • title = {FreeCast: Graceful Free-Viewpoint Video Delivery},
      • journal = {IEEE Transactions on Multimedia},
      • year = 2018,
      • volume = 21,
      • number = 4,
      • pages = {1000--1010},
      • month = sep,
      • doi = {10.1109/TMM.2018.2870074},
      • url = {https://www.merl.com/publications/TR2018-134}
      • }
  • MERL Contacts:
  • Research Areas:

    Communications, Digital Video, Signal Processing

Abstract:

Wireless multi-view plus depth (MVD) video streaming enables free viewpoint video playback on wireless devices, where a viewer can freely synthesize any preferred virtual viewpoint from the received MVD frames. Existing schemes of wireless MVD streaming use digital-based compression to achieve better coding efficiency. However, the digital-based schemes have an issue called cliff effect, where the video quality is a step function in terms of wireless channel quality. In addition, parameter optimization to assign quantization levels and transmission power across MVD frames are cumbersome. To realize highquality wireless MVD video streaming, we propose a novel graceful video delivery scheme, called FreeCast. FreeCast directly transmits linear-transformed signals based on five-dimensional discrete cosine transform (5D-DCT), without digital quantization and entropy coding operations. In addition, we exploit a fitting function based on multidimensional Gaussian Markov random field (GMRF) model for overhead reduction to mitigate rate and power loss due to large overhead. The proposed FreeCast achieves graceful video quality with the improvement of wireless channel quality under a low overhead requirement. In addition, the parameter optimization to achieve highest video quality can be simplified by only controlling transmission power assignment. Performance results with several test MVD video sequences show that FreeCast yields better video quality in band-limited environments by significantly decreasing the amount of overhead. For instance, structural similarity (SSIM) performance of FreeCast is approximately 0.127 higher than the existing graceful video delivery schemes across wireless channel quality, i.e., signal-tonoiseratio (SNR), of 0 to 25 dB at a transmission symbol rate of 37.5 Msymbols/s.