Skip to Main content Skip to Navigation
Conference papers

Deep learning-based blind quality assessment of 3D point clouds

Aladine Chetouani 1, 2 Maurice Quach 2 Giuseppe Valenzise 2 Frédéric Dufaux 2
1 Axe Image Vision
PRISME - Laboratoire Pluridisciplinaire de Recherche en Ingénierie des Systèmes, Mécanique et Energétique
Abstract : Point cloud (PC) quality assessment is of fundamental importance to enable the efficient processing, coding and transmission of 3D data for virtual/augmented reality, autonomous driving, cultural heritage, etc. The quality metrics proposed so far aim at quantifying the distortion in the PC geometry and/or attributes with respect to a reference pristine point cloud, using simple features extracted by the points. In this work, we target instead a blind (no-reference) scenario in which the original point cloud is not available. In addition, we learn features from data using deep neural networks. Given the limited availability of subjectively annotated datasets of corrupted point clouds, and the consequent difficulty to learn in an end-to-end fashion PC quality features, in this work we use instead a two-step procedure. First, we extract from local patches three relevant low-level features which have been commonly used in other PC quality metrics, i.e., geometric distance, local curvature and luminance values. Afterwards, we employ a deep neural network to learn, from these low-level features, a mapping to the PC ground truth mean opinion score. Our results on two state-of-the-art PC quality datasets show the potential of the proposed approach. The code is available here : https://github.com/achetouani/NR-CNN-3D-PC
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03198099
Contributor : Frédéric Dufaux Connect in order to contact the contributor
Submitted on : Monday, April 26, 2021 - 10:26:55 PM
Last modification on : Friday, September 3, 2021 - 3:35:52 AM
Long-term archiving on: : Tuesday, July 27, 2021 - 7:44:40 PM

File

2021_ICMEW_Chetouani_et_al.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03198099, version 1

Citation

Aladine Chetouani, Maurice Quach, Giuseppe Valenzise, Frédéric Dufaux. Deep learning-based blind quality assessment of 3D point clouds. IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Jul 2021, Shenzhen (virtual), China. ⟨hal-03198099⟩

Share

Metrics

Record views

165

Files downloads

140