Repository logo
 
Publication

Light field image coding: objective performance assessment of Lenslet and 4D LF data representations

dc.contributor.authorMonteiro, Ricardo
dc.contributor.authorM. M. Rodrigues, Nuno
dc.contributor.authorFaria, Sergio
dc.contributor.authorNunes, paulo
dc.contributor.editorTescher, Andrew G.
dc.date.accessioned2025-07-24T14:51:49Z
dc.date.available2025-07-24T14:51:49Z
dc.date.issued2018-09-17
dc.description.abstractState-of-the-art light field (LF) image coding solutions, usually, rely in one of two LF data representation formats: Lenslet or 4D LF. While the Lenslet data representation is a more compact version of the LF, it requires additional camera metadata and processing steps prior to image rendering. On the contrary, 4D LF data, consisting of a stack of sub-aperture images, provides a more redundant representation requiring, however, minimal side information, thus facilitating image rendering. Recently, JPEG Pleno guidelines on objective evaluation of LF image coding defined a processing chain that allows to compare different 4D LF data codecs, aiming to facilitate codec assessment and benchmark. Thus, any codec that does not rely on the 4D LF representation needs to undergo additional processing steps to generate an output comparable to a reference 4D LF image. These additional processing steps may have impact on the quality of the reconstructed LF image, especially if color subsampling format and bit depth conversions have been performed. Consequently, the influence of these conversions needs to be carefully assessed as it may have a significant impact on a comparison between different LF codecs. Very few in-depth comparisons on the effects of using existing LF representation have been reported. Therefore, using the guidelines from JPEG Pleno, this paper presents an exhaustive comparative analysis of these two LF data representation formats in terms of LF image coding efficiency, considering different color subsampling formats and bit depths. These comparisons are performed by testing different processing chains to encode and decode the LF images. Experimental results have shown that, in terms of coding efficiency for different color subsampling formats, the Lenslet LF data representation is more efficient when using YUV 4:4:4 with 10 bit/sample, while the 4D LF data representation is more efficient when using YUV 4:2:0 with 8 bit/sample. The “best” LF data representation, in terms of coding efficiency, depends on several factors which are extensively analyzed in this paper, such as the objective metric that is used for comparison (e.g., average PSNR-Y or average PNSR-YUV), the type of LF content, as well as the color format. The maximum objective quality is also determined, by evaluating the influence of each block from each processing chain in the objective quality of the reconstructed LF image. Experimental results show that, when the 4D LF data representation is not used the maximum achieved objective quality is lower than 50 dB, in terms of average PSNR-YUV.eng
dc.identifier.citationMonteiro, Ricardo & Nunes, Paulo & Rodrigues, Nuno & De Faria, Sergio. (2018). Light field image coding: objective performance assessment of Lenslet and 4D LF data representations. 13. 10.1117/12.2322713.
dc.identifier.doi10.1117/12.2322713
dc.identifier.isbn978-151062075-9
dc.identifier.issn0277-786X
dc.identifier.urihttp://hdl.handle.net/10400.8/13775
dc.language.isoeng
dc.peerreviewedyes
dc.publisherSPIE
dc.relation.hasversionhttps://spie.org/publications/conference-proceedings
dc.relation.ispartofApplications of Digital Image Processing XLI
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectLight Field
dc.subjectLight Field Image Coding
dc.subjectLight Field Data Representation
dc.subjectJPEG Pleno
dc.subjectObjective Performance Assessment
dc.titleLight field image coding: objective performance assessment of Lenslet and 4D LF data representationseng
dc.typeconference paper
dspace.entity.typePublication
oaire.citation.conferenceDate2018
oaire.citation.titleProceedings of SPIE - The International Society for Optical Engineering
oaire.versionhttp://purl.org/coar/version/c_970fb48d4fbd8a85
person.familyNameM. M. Rodrigues
person.familyNameFaria
person.familyNameNunes
person.givenNameNuno
person.givenNameSergio
person.givenNamepaulo
person.identifier.ciencia-id8815-4101-28DD
person.identifier.ciencia-idC411-7110-D557
person.identifier.orcid0000-0001-9536-1017
person.identifier.orcid0000-0002-0993-9124
person.identifier.orcid0000-0002-2866-842X
person.identifier.ridC-5245-2011
person.identifier.scopus-author-id7006052345
person.identifier.scopus-author-id14027853900
person.identifier.scopus-author-id35583352900
relation.isAuthorOfPublicationb4ebe652-7f0e-4e67-adb0-d5ea29fc9e69
relation.isAuthorOfPublicationf69bd4d6-a6ef-4d20-8148-575478909661
relation.isAuthorOfPublication9949ca65-9c3e-4f73-b515-39ed1d491109
relation.isAuthorOfPublication.latestForDiscovery9949ca65-9c3e-4f73-b515-39ed1d491109

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Lightfieldimagecodingobjectiveperformanceassessmentoflensletand4DLFdatarepresentations.pdf
Size:
1.68 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.32 KB
Format:
Item-specific license agreed upon to submission
Description: