Percorrer por autor "Carreira, J."
A mostrar 1 - 10 de 12
Resultados por página
Opções de ordenação
- 360° Video Coding using Adaptive Tile PartitioningPublication . Carreira, J.; Faria, Sergio M. M. de; Tavora, Luis M. N.; Navarro, Antonio; Assuncao, Pedro A.Encoding 360° video with ultra high definition requires high bit rate to guarantee either immersive experiences and acceptable QoE in video delivery services, or high performance in machine vision applications. However, since in general the full Field-of-View (FoV), i.e., 360°, is not required at once, a great deal of bandwidth can be saved by allowing partial decoding of limited size FoVs. The conventional approach to accomplish such goal has been to encode several fixed-size independent tiles of each video frame. In this work a novel tile-based video coding scheme is proposed to achieve further reduction on the average maximum bit rate required for partial delivery of 360° video. The proposed method dynamically adapts the tile sizes to the omnidirectional video content in order to obtain uniform bit rate in each one. Therefore, more complex image regions, i.e., those requiring higher bit rates are partitioned in smaller tiles, allowing finer bit rate granularity when FoVs with higher spatiotemporal complexity are selected for transmission and decoding. The simulation results show that the proposed adaptive tile-based coding mechanism outperforms the conventional fixed-size tilling methods, achieving an average of 4.78% and 16.88% bit rate reduction for FoVs of 90° × 90° and 45° × 45°, respectively.
- Attention-driven tile splitting method for improved efficiency of omnidirectional versatile video codingPublication . Carreira, J.; Faria, Sergio M. M. de; Tavora, Luis M. N.; Navarro, Antonio; Assuncao, Pedro A.A common approach used in omnidirectional video coding is based on frame splitting into tiles, allowing partial delivery of only the subset of tiles that is necessary to render the user’s current viewing region, defined as a specific viewport or Field-of-View (FoV). Since tiles can be independently encoded, such mechanism provides a flexible solution for encoding planar representations with ultra-high definition (UHD), such as the Equirectangular Projection (ERP), using Versatile Video Coding (VVC). By only selecting and transmitting the coded data that is required to render the necessary FoV, rather than the full 360°, a great deal of bandwidth can be saved. While current solutions are based on splitting the omnidirectional video frames into tiles of equal size, this paper proposes a new approach based on adaptive tile size, driven by visual attention. Those regions where the visual attention is higher are partitioned in smaller tiles to obtain higher bit rate granularity, allowing to decode the most frequent FoVs with minimum out-of-FoV pixels and reduced bandwidth. Optimal tile boundaries are found by solving a lagrangian minimisation problem with a cost function that achieves the best tradeoff between the standard deviation and the average attention-weighted bit rate per tile. The experimental results show that an average of 7.17% and 17.73% of bit rate savings is obtained in comparison with conventional tilling methods for the commonly used FoVs of 90° ×90° and 45° ×45°, respectively.
- Dynamic Motion Vector Refreshing For Enhanced Error Resilience In HevcPublication . Carreira, J.; Silva, V. de; Ekmekcioglu, E.; Kondoz, A.; Assuncao, P.; Faria, S.The high level of compression efficiency achieved by HEVC coding techniques decreases the error resilience performance under error prone conditions. This paper addresses the error resiliency of the HEVC standard, focusing on the new motion estimation tools. It is shown that the temporal dependency of motion information is comparatively higher than that in the H.264/AVC standard, causing an increase in the error propagation. Based on this evidence, this paper proposes a method to make intelligent use of temporal motion vector (MV) candidates during the motion estimation process, in order to decrease the temporal dependency, and improve the error resiliency without penalising the rate-distortion performance. The simulation results show that the proposed method improves the error resilience under tested conditions by increasing the video quality by up to 1.7 dB in average, compared to the reference method that always enables temporal MV candidates.
- Frame loss concealment for 3D video decoders based on disparity-compensated motion fieldPublication . Carreira, J.; Assunção, P.; Rodrigues, N.; Faria, S.This paper addresses the problem of frame loss concealment in 3D video decoders capable of handling stereoscopic views compliant with H.264/MVC. A joint motion-disparity compensation method is proposed to fully recover an estimated motion field for the lost frame in stereoscopic video, by using a combination of inter-view disparity-compensated motion vectors and intra-view motion extrapolation. The overall motion field is estimated from both the motion information of the co-located view, through disparity compensation, and neighboring frames of the same view, through motion vector extrapolation. The results show that the proposed method outperforms currently used methods such as frame-copy and motion-copy. In video sequences, average PSNR gains up to 1.6 dB are obtained over motion-copy, while for individual frames a maximum of 5 dB is achieved.
- Reference picture selection using checkerboard pattern for resilient video codingPublication . Carreira, J.; Assunção, P.; Faria, S.; Ekmekcioglu, E.; Kondoz, A.; Lim, H.The improved compression efficiency achieved by the High Efficiency Video Coding (HEVC) standard has the counter-effect of decreasing error resilience in transmission over error-prone channels. To increase the error resilience of HEVC streams, this paper proposes a checkerboard reference picture selection method in order to reduce the prediction mismatch at the decoder in case of frame losses. The proposed approach not only allows to reduce the error propagation at the decoder, but also enhances the quality of reconstructed frames by selectively constraining the choice of reference pictures used for temporal prediction. The underlying approach is to increase the amount of accurate temporal information at the decoder when transmission errors occur, to improve the video quality by using an efficient combination of diverse motion fields. The proposed method compensates for the small loss of coding efficiency at frame loss rates as low as 3%. For a single frame-loss event the proposed method can achieve up to 2 dB of gain in the affected frames and an average quality gain of 0.84 dB for different error prone conditions.
- Scalable Coding of 360-degree Video for Streaming Adaptation at 5G Network EdgesPublication . Carreira, J.; Faria, Sergio M. M. de; Tavora, Luis M. N.; Navarro, Antonio; Assuncao, Pedro A. A.The huge amount of data that is necessary to capture the full field-of-view (FoV) in omnidirectional video, i.e., 360°, imposes the use of highly efficient compressed formats as well as adaptive broadcast and streaming mechanisms, such as those foreseen for 5G networks. To cope with the demanding requirements of 360° video streaming over 5G networks, this work proposes a scalable 360° video coding architecture, by enabling adaptation through the Multi-Access Edge Computing (MEC) server in two different domains of the spherical visual content, namely spatial resolution and FoV. In the proposed architecture two-layers are encoded from the input 360° video content: (i) the base-layer (BL), encoding each 360° image as a whole, at a lower spatial resolution; (ii) the enhancement-layer (EL) encoding each spherical image as a set of multiple FoVs with higher spatial resolution. Such arrangement enables flexible stream adaptation for the smart decision algorithms to be implemented at the MEC server, enabling significant reduction of the overall bit rate through the radio interface. The simulation results show that the proposed scalable coding scheme allows a great deal of bit rate savings across the 5G network, achieving 36% of bit rate saving, on average, for a 90° FoV in comparison with conventional single-layer coding.
- Selective motion vector redundancies for improved error resilience in HEVCPublication . Carreira, J.; Ekmekcioglu, E; Kondoz, A.; Assuncao, P.; Faria, S.; Silva, V. DeThis paper addresses the problem caused by motion vector coding dependencies on the error resilience performance of the emergent High Efficiency Video Coding (HEVC) standard. We propose a method based on the prediction dependency of motion vectors (MV) to select the most relevant ones for redundant coding with reduced overhead. The spatial dependencies are analysed in the encoder to prioritise the MVs that should be selected for redundancy, based on the number of subsequent dependent coding units. Then, a subset of prioritised MVs is transmitted as redundancy (referred to as side information in the paper), to reduce the use and propagation of mismatched MV predictions in case of transmission errors or data loss. The simulation results show that the proposed MV selection method can effectively identify the most relevant motion field, achieving improved error robustness with a reduced redundancy overhead. Exploiting only 30% of the generated MVs for redundancy, average quality gains of up to 1 dB are achieved compared to a uniform MV selection scheme, and up to 2 dB compared to the original HEVC standard with no redundant encoded information.
- Subjective assessment of frame loss concealment methods in 3D videoPublication . Carreira, J.; Pinto, L.; Rodrigues, N.; Faria, S.; Assuncao, P.This paper investigates the subjective impact resulting from different concealment methods for coping with lost frames in 3D video communication systems. It is assumed that a high priority channel is assigned to the main view and only the auxiliary view is subject to either transmission errors or packet loss, leading to missing frames at the decoder output. Three methods are used for frame concealment under different loss ratios. The results show that depth is well perceived by users and the subjective impact of frame loss not only depends on the concealment method but also exhibits high correlation with the disparity of the original sequence. It is also shown that under heavy loss conditions it is better to switch from 3D to 2D rather than presenting concealed 3D video to users.
- Subjective quality factors in packet 3D videoPublication . Pinto, L.; Carreira, J.; Faria, S.; Rodrigues, N.; Assunção, P.; Carreira, J.This paper presents an experimental study on subjective quality of 3D video under packet loss conditions. A priority network is assumed, such that the base view of a stereoscopic video stream is delivered through a guaranteed channel and the auxiliary view is subject to packet losses over a low priority channel. Due to the packetisation scheme, one frame is lost whenever a packet is lost. Three frame concealment methods are proposed to deal with frame losses and seven different 3DTV sequences are used. The subjective evaluation study was carried out for different packet loss ratios and concealment methods, using shutter glasses with synchronized display. The experimental results show that sequence disparity, type of loss concealment and packet loss pattern should be jointly considered as relevant quality factors in 3D video over packet networks.
- Tree-Based Ensemble Methods for Complexity Reduction of VVC Intra CodingPublication . Filipe, Jose N.; Carreira, J.; Tavora, Luis M. N.; Faria, Sergio M. M. de; Navarro, Antonio; Assuncao, Pedro A. A.The rise of new applications and emerging services required ultra-high definition (UHD) led to the development of a new video compression standard, name Versatile Video Coding (VVC). In comparison with High Efficiency Video Coding, the new standard increases the coding efficiency, at the expense of greatly increasing the computational complexity of the encoding process, especially in UHD and 360°video. To overcome this issue, this paper presents a novel method to reduce the computational complexity of intra-coded 360°video in Equirectangular Projection format, based on 3 tree-based ensemble models to predict the maximum partition depth that should be used for intra-coding of the complex nested data structures (Quad Tree, Binary Tree and Ternary Tree) used in the VVC standard. Two different tree-based ensemble methods are studied, namely Random Forest and Extremely Randomised Trees. The experimental results achieve, on average, complexity reductions of 56.25% and 57.45% for Random Forests and Extremely Randomised Trees methods, with small loss of coding efficiency of 1.37 % and 1.46 %, respectively.