Publicação
Deep Learning-Based Event Data Coding: A Joint Spatiotemporal and Polarity Solution
| datacite.subject.fos | Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática | |
| datacite.subject.sdg | 09:Indústria, Inovação e Infraestruturas | |
| datacite.subject.sdg | 10:Reduzir as Desigualdades | |
| datacite.subject.sdg | 11:Cidades e Comunidades Sustentáveis | |
| dc.contributor.author | Seleem, Abdelrahman | |
| dc.contributor.author | Guarda, André F. R. | |
| dc.contributor.author | Rodrigues, Nuno M. M. | |
| dc.contributor.author | Pereira, Fernando | |
| dc.date.accessioned | 2026-03-02T10:25:59Z | |
| dc.date.available | 2026-03-02T10:25:59Z | |
| dc.date.issued | 2026-01-20 | |
| dc.date.updated | 2026-02-21T09:11:31Z | |
| dc.description | Submitted version: 5 Feb 2025. | |
| dc.description.abstract | Neuromorphic vision sensors, commonly referred to as event cameras, generate a massive number of pixel-level events, composed by spatiotemporal and polarity information, thus demanding highly efficient coding solutions. Existing solutions focus on lossless coding of event data, assuming that no distortion is acceptable for the target use cases, mostly including computer vision tasks such as classification and recognition. One promising coding approach exploits the similarity between event data and point clouds, both being sets of 3D points, thus allowing to use current point cloud coding solutions to code event data, typically adopting a two-point clouds representation, one for each event polarity. This paper proposes a novel lossy Deep Learning-based Joint Event data Coding (DL-JEC) solution, which adopts for the first time a single-point cloud representation, where the event polarity plays the role of a point cloud attribute, thus enabling to exploit the correlation between the geometry/spatiotemporal and polarity event information. Moreover, this paper also proposes novel adaptive voxel binarization strategies which may be used in DL-JEC, optimized for either quality-oriented or computer vision task-oriented purposes which allow to maximize the performance for the task at hand. DL-JEC can achieve significant compression performance gains when compared with relevant conventional and DL-based state-of-the-art event data coding solutions, notably the MPEG G-PCC and JPEG Pleno PCC standards. Furthermore, it is shown that it is possible to use lossy event data coding, with significantly reduced rate regarding lossless coding, without compromising the target computer vision task performance, notably event classification, thus changing the current event data coding paradigm. | eng |
| dc.description.sponsorship | This work was supported by the National Funds through FCT– Fundação para a Ciência e a Tecnologia, I.P., and, when eligible, co-funded by EU Funds under Project/Support UID/50008/2025– Instituto de Telecomunicações., [DOI:10.54499/UID/50008/2025]. | |
| dc.description.version | N/A | |
| dc.identifier.citation | Seleem, Abdelrahman & Guarda, André & Rodrigues, Nuno. (2025). Deep Learning-based Event Data Coding: A Joint Spatiotemporal and Polarity Solution. 10.48550/arXiv.2502.03285. | |
| dc.identifier.doi | 10.1109/ojsp.2026.3656104 | en_US |
| dc.identifier.issn | 2644-1322 | en_US |
| dc.identifier.slug | cv-prod-4757762 | |
| dc.identifier.uri | http://hdl.handle.net/10400.8/15748 | |
| dc.language.iso | eng | |
| dc.peerreviewed | n/a | |
| dc.publisher | IEEE | |
| dc.relation | Instituto de Telecomunicações | |
| dc.relation.hasversion | https://signalprocessingsociety.org/publications-resources/ieee-open-journal-signal-processing?field_magazine_category_target_id_selective=1200 | |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | |
| dc.subject | Deeplearning | |
| dc.subject | event data classification | |
| dc.subject | event data coding | |
| dc.subject | point cloud coding | |
| dc.title | Deep Learning-Based Event Data Coding: A Joint Spatiotemporal and Polarity Solution | eng |
| dc.type | journal article | |
| dspace.entity.type | Publication | |
| oaire.awardNumber | UID/50008/2025 | |
| oaire.awardTitle | Instituto de Telecomunicações | |
| oaire.awardURI | http://hdl.handle.net/10400.8/15747 | |
| oaire.citation.endPage | 237 | |
| oaire.citation.startPage | 222 | |
| oaire.citation.title | IEEE Open Journal of Signal Processing | en_US |
| oaire.citation.volume | 7 | en_US |
| oaire.fundingStream | Avaliação UID 2023/2024 | |
| oaire.version | http://purl.org/coar/version/c_71e4c1898caa6e32 | |
| person.familyName | M. M. Rodrigues | |
| person.givenName | Nuno | |
| person.identifier.ciencia-id | 6917-B121-4E34 | |
| person.identifier.orcid | 0000-0001-9536-1017 | |
| person.identifier.scopus-author-id | 7006052345 | |
| rcaap.cv.cienciaid | 6917-B121-4E34 | NUNO MIGUEL MORAIS RODRIGUES | |
| rcaap.rights | openAccess | en_US |
| relation.isAuthorOfPublication | b4ebe652-7f0e-4e67-adb0-d5ea29fc9e69 | |
| relation.isAuthorOfPublication.latestForDiscovery | b4ebe652-7f0e-4e67-adb0-d5ea29fc9e69 | |
| relation.isProjectOfPublication | fb51562e-8a49-4d10-b530-5f39dca8aa62 | |
| relation.isProjectOfPublication.latestForDiscovery | fb51562e-8a49-4d10-b530-5f39dca8aa62 |
Ficheiros
Principais
1 - 2 de 2
Miniatura indisponível
- Nome:
- OJSP3656104.pdf
- Tamanho:
- 3.18 MB
- Formato:
- Adobe Portable Document Format
- Descrição:
- Versão editora, IEEE Open Journal of Signal Processing A. Seleem, A. Guarda, Nuno M. M. Rodrigues, F. Pereira, Deep Learning-based Event Data Coding: A Joint Spatiotemporal and Polarity Solution, IEEE Open Journal of Signal Processing, Vol. 7, No., pp. 222 - 237, 2026. 10.54499/UID/50008/2025.
Miniatura indisponível
- Nome:
- Versão submetida.pdf
- Tamanho:
- 913.04 KB
- Formato:
- Adobe Portable Document Format
- Descrição:
- _PDF em arXiv:2502.03285 [cs.CV].
Licença
1 - 1 de 1
Miniatura indisponível
- Nome:
- license.txt
- Tamanho:
- 1.33 KB
- Formato:
- Item-specific license agreed upon to submission
- Descrição:
