360 Degree Video Streaming Over Next-Gen Communication Networks

In this project, we are exploring efficient compression and streaming solutions to deliver 360 video contents for VR/AR applications. We prototype a novel two-tier system to encode and stream 360 degree videos, to simultaneously improve the bandwidth utilization and handle the network dynamics and user viewing direction variations more efficiently. The base tier (BT) video chunks represent the entire 360 view span at a low bit rate and are pre-fetched in a long display buffer to smooth the network jitters effectively. The enhancement tier (ET) video chunks represent the full 360 view span using multiple overlapping viewports, coded with different video rates. When users view directions are predicted accurately and ET chunks are received promptly, the client video player can combine the ET chunk with the pre-fetched BT chunk for an enhanced quality of service. Even if the view prediction fails (e.g., due to the unexpected head motion) or when the requested ET chunk does not arrive in time (e.g., due to sudden bandwidth decrease), the client player can still render the desired view with basic quality from the pre-fetched BT. In parallel, we are also investigating the delivery of 360 videos over the next-generation communication technologies (e.g., 5G millimeter wave) through network emulations and examining the user quality of experience.

Publications

CitationResearch AreasDate
F. Duanmu, E. Kurdoglu, Amir Hosseini, Y. Liu, Y. Wang, “Prioritized Buffer Control in Two-tier 360 Video Streaming”, ACM SigComm Workshop on Virtual Reality and Augmented Reality Network, Los Angeles, California, USA, 2017. (Submitted) 360 Video Streaming2017/04/13
F. Duanmu, E. Kurdoglu, Y. Liu, Y. Wang, “View Direction and Bandwidth adaptive 360 Degree Video Streaming using a Two-Tier System”, International Symposium on Circuits and Systems (ISCAS), Baltimore, Maryland, USA, 2017. (Accepted)360 Video Streaming2017/04/07
F. Duanmu, E. Kurdoglu, Amir Hosseini, Y. Liu, Y. Wang, “Buffer-Based 360 Video Streaming Using A Two-Tier System”, ACM SigComm Workshop on Virtual Reality and Augmented Reality Network, Los Angeles, California, USA, 2017. (Pending Submission) 360 Video Streaming2017/04/07