Complexity Estimation for Load Balancing of 360-Degree Intra Versatile Video Coding

Filipe, Jose N.; Monteiro Carreira, João Filipe; Tavora, Luis M. N.; Faria, Sergio; Navarro, Antonio; Assuncao, Pedro A. A.

http://hdl.handle.net/10400.8/13594

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
Complexity Estimation for Load Balancing of 360-Degree Intra Versatile Video Coding.pdf	The ever increasing demand for image and video content poses new requirements to support higher resolutions and richer representation formats, creating new challenges in coding algorithms. The forthcoming Versatile Video Coding (VVC) standard aims to increase the coding efficiency of existing algorithms and it is particularly suitable for Ultra-High Definition (UHD) resolutions and 360° video. However, since coding efficiency gains are obtained at the cost of increased complexity, fast computational approaches are needed to cope with realtime requirements, such as parallel processing. Thus, this work presents a contribution towards efficient parallel encoding of 360° video, based on coding complexity estimation and nonuniform data-level splitting (slice-based) for load balancing across multiple processors. A machine learning approach is proposed to estimate the complexity of intra coding VVC, using uncorrelated features, obtained through Principal Component Analysis (PCA) and Extremely Randomised Trees (ERT). Then, a complexity-balanced slice partition is devised, taking advantage of the clustered complexity inherent to Equirectangular Projection (ERP). It is shown that coding complexity is estimated with an accuracy of 92.25%, and the encoding time is reduced by 8.50%, when compared to the case where the 360° frames are evenly split.	262.55 KB	Adobe PDF	Download

Send Feedback

Authors

Filipe, Jose N.

Monteiro Carreira, João Filipe

Tavora, Luis M. N.

Faria, Sergio

Navarro, Antonio

Assuncao, Pedro A. A.

Abstract(s)

The ever increasing demand for image and video content poses new requirements to support higher resolutions and richer representation formats, creating new challenges in coding algorithms. The forthcoming Versatile Video Coding (VVC) standard aims to increase the coding efficiency of existing algorithms and it is particularly suitable for Ultra-High Definition (UHD) resolutions and 360° video. However, since coding efficiency gains are obtained at the cost of increased complexity, fast computational approaches are needed to cope with realtime requirements, such as parallel processing. Thus, this work presents a contribution towards efficient parallel encoding of 360° video, based on coding complexity estimation and nonuniform data-level splitting (slice-based) for load balancing across multiple processors. A machine learning approach is proposed to estimate the complexity of intra coding VVC, using uncorrelated features, obtained through Principal Component Analysis (PCA) and Extremely Randomised Trees (ERT). Then, a complexity-balanced slice partition is devised, taking advantage of the clustered complexity inherent to Equirectangular Projection (ERP). It is shown that coding complexity is estimated with an accuracy of 92.25%, and the encoding time is reduced by 8.50%, when compared to the case where the 360° frames are evenly split.

Description

Article number - 9195224; Conference name - 34th IEEE Workshop on Signal Processing Systems, SiPS 2020; Conference city - Coimbra; Conference date - 20 October 2020 - 22 October 2020; Conference code - 164857

Keywords

Video Coding Complexity Load-balancing VVC Complexity Estimation

URI

http://hdl.handle.net/10400.8/13594

Citation

J. N. Filipe, J. Carreira, L. M. N. Tavora, S. M. M. Faria, A. Navarro and P. A. A. Assuncao, "Complexity Estimation for Load Balancing of 360-Degree Intra Versatile Video Coding," 2020 IEEE Workshop on Signal Processing Systems (SiPS), Coimbra, Portugal, 2020, pp. 1-5, doi: https://doi.org/10.1109/SiPS50750.2020.9195224.