Semi-supervised 3D object recognition through CNN labeling

 

Authors
Rangel, José Carlos; Martínez Gómez, Jesus; Romero González, Cristina; García Varea, Ismael; Cazorla, Miguel
Format
Article
Status
publishedVersion
Description

Despite the outstanding results of Convolutional Neural Networks (CNNs) in object recognition and classification, there are still some open problems to address when applying these solutions to real-world problems. Specifically, CNNs struggle to generalize under challenging scenarios, like recognizing the variability and heterogeneity of the instances of elements belonging to the same category. Some of these difficulties are directly related to the input information, 2D-based methods still show a lack of robustness against strong lighting variations, for example. In this paper, we propose to merge techniques using both 2D and 3D information to overcome these problems. Specifically, we take advantage of the spatial information in the 3D data to segment objects in the image and build an object classifier, and the classification capabilities of CNNs to semi-supervisedly label each object image for training. As the experimental results demonstrate, our model can successfully generalize for categories with high intra-class variability and outperform the accuracy of a well-known CNN model.
Despite the outstanding results of Convolutional Neural Networks (CNNs) in object recognition and classification, there are still some open problems to address when applying these solutions to real-world problems. Specifically, CNNs struggle to generalize under challenging scenarios, like recognizing the variability and heterogeneity of the instances of elements belonging to the same category. Some of these difficulties are directly related to the input information, 2D-based methods still show a lack of robustness against strong lighting variations, for example. In this paper, we propose to merge techniques using both 2D and 3D information to overcome these problems. Specifically, we take advantage of the spatial information in the 3D data to segment objects in the image and build an object classifier, and the classification capabilities of CNNs to semi-supervisedly label each object image for training. As the experimental results demonstrate, our model can successfully generalize for categories with high intra-class variability and outperform the accuracy of a well-known CNN model.

Publication Year
2019
Language
eng
Topic
Object recognition
Deep learning
Object labeling
Machine learning
Object recognition
Deep learning
Object labeling
Machine learning
Repository
RI de Documento Digitales de Acceso Abierto de la UTP
Get full text
https://www.sciencedirect.com/science/article/abs/pii/S1568494618300553
https://ridda2.utp.ac.pa/handle/123456789/9433
Rights
embargoedAccess
License