360 Degree Video Streaming Over Next-Gen Communication Networks

In this project, we are exploring efficient compression and streaming solutions to deliver 360 video contents for VR/AR applications. We prototype a novel two-tier system to encode and stream 360 degree videos, to simultaneously improve the bandwidth utilization and handle the network dynamics and user viewing direction variations more efficiently. The base tier (BT) video chunks represent the entire 360 view span at a low bit rate and are pre-fetched in a long display buffer to smooth the network jitters effectively. The enhancement tier (ET) video chunks represent the full 360 view span using multiple overlapping viewports, coded with different video rates. When users view directions are predicted accurately and ET chunks are received promptly, the client video player can combine the ET chunk with the pre-fetched BT chunk for an enhanced quality of service. Even if the view prediction fails (e.g., due to the unexpected head motion) or when the requested ET chunk does not arrive in time (e.g., due to sudden bandwidth decrease), the client player can still render the desired view with basic quality from the pre-fetched BT. In parallel, we are also investigating the delivery of 360 videos over the next-generation communication technologies (e.g., 5G millimeter wave) through network emulations and examining the user quality of experience.

Publications

CitationResearch AreasDate

G. Tian, Y. Liu, “Towards Agile and Smooth Video Adaptation in HTTP Adaptive Streaming”, in IEEE/ACM Transactions on Networking, Volume 24, Number 4, Pages 2386 – 2399 August 2016

360 Video StreamingAugust 28, 2018

Fanyi Duanmu, Eymen Kurdoglu, Yong Liu and Yao Wang,
“View Direction and Bandwidth Adaptive 360 Degree Video Streaming using a Two-Tier System”,
in the Proceedings of International Symposium on Circuits and Systems (ISCAS), May 2017.

360 Video Streaming, 5g and 6g appsMay 1, 2017

F. Duanmu, E. Kurdoglu, Amir Hosseini, Y. Liu, Y. Wang, “Prioritized Buffer Control in Two-tier 360 Video Streaming”, ACM SigComm Workshop on Virtual Reality and Augmented Reality Network, Los Angeles, California, USA, 2017.

360 Video Streaming, 5g and 6g appsApril 13, 2017

F. Duanmu, E. Kurdoglu, Y. Liu, Y. Wang, “View Direction and Bandwidth adaptive 360 Degree Video Streaming using a Two-Tier System:, International Symposium on Circuits and Systems (ISCAS), Baltimore, Maryland, USA, 2017.

360 Video Streaming, 5g and 6g appsApril 7, 2017

F. Duanmu, E. Kurdoglu, Amir Hosseini, Y. Liu, Y. Wang, “Buffer-Based 360 Video Streaming Using A Two-Tier System”, ACM SigComm Workshop on Virtual Reality and Augmented Reality Network, Los Angeles, California, USA, 2017.

360 Video Streaming, 5g and 6g appsApril 7, 2017

E. Kurdoglu, Y. Liu, Y. Wang, “Dealing with User Heterogeneity in P2P Multi-party Video Conferencing: Layered Distribution vs. Partitioned Simulcast”, in IEEE Transactions on Multimedia, Volume 18, Number 1, Pages 90 –101, January 2016.

360 Video StreamingJanuary 1, 2016