Skip to main navigation Skip to search Skip to main content

Learning high-level features by fusing multi-view representation of MLS point clouds for 3D object recognition in road environments

  • Zhipeng Luo
  • , Jonathan Li*
  • , Zhenlong Xiao
  • , Z. Geroge Mou
  • , Xiaojie Cai
  • , Cheng Wang
  • *Corresponding author for this work
  • Xiamen University
  • University of Waterloo

Research output: Contribution to journal › Article › peer-review

Abstract

Most existing 3D object recognition methods still suffer from low descriptiveness and weak robustness although remarkable progress has made in 3D computer vision. The major challenge lies in effectively mining high-level 3D shape features. This paper presents a high-level feature learning framework for 3D object recognition through fusing multiple 2D representations of point clouds. The framework has two key components: (1) three discriminative low-level 3D shape descriptors for obtaining multi-view 2D representation of 3D point clouds. These descriptors preserve both local and global spatial relationships of points from different perspectives and build a bridge between 3D point clouds and 2D Convolutional Neural Networks (CNN). (2) A two-stage fusion network, which consists of a deep feature learning module and two fusion modules, for extracting and fusing high-level features. The proposed method was tested on three datasets, one of which is Sydney Urban Objects dataset and the other two were acquired by a mobile laser scanning (MLS) system along urban roads. The results obtained from comprehensive experiments demonstrated that our method is superior to the state-of-the-art methods in descriptiveness, robustness and efficiency. Our method achieves high recognition rates of 94.6%, 93.1% and 74.9% on the above three datasets, respectively.

Original languageEnglish
Pages (from-to)44-58
Number of pages15
JournalISPRS Journal of Photogrammetry and Remote Sensing
Volume150
DOIs
StatePublished - Apr 2019
Externally publishedYes

Keywords

  • 3D object recognition
  • Convolutional neural networks
  • MLS point clouds
  • Multi-view representation
  • Two-stage fusion network

Fingerprint

Dive into the research topics of 'Learning high-level features by fusing multi-view representation of MLS point clouds for 3D object recognition in road environments'. Together they form a unique fingerprint.

Cite this