跳到主要导航 跳到搜索 跳到主要内容

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

  • Kun Zhao
  • , Lingfei Ma
  • , Yu Meng
  • , Li Liu*
  • , Junbo Wang
  • , Jose Marcato Junior
  • , Wesley Nunes Goncalves
  • , Jonathan Li*
  • *此作品的通讯作者
  • University of Waterloo
  • Central University of Finance and Economics
  • University of Science and Technology Beijing
  • Xiamen University
  • Universidade Federal de Mato Grosso do Sul

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

3D vehicle detectors based on point clouds generally have higher detection performance than detectors based on multi-sensors. However, with the lack of texture information, point-based methods get many missing detection of occluded and distant vehicles, and false detection with high-confidence of similarly shaped objects, which is a potential threat to traffic safety. Therefore, in the long run, fusion-based methods have more potential. This paper presents a multi-level fusion network for 3D vehicle detection from point clouds and images. The fusion network includes three stages: data-level fusion of point clouds and images, feature-level fusion of voxel and Bird's Eye View (BEV) in the point cloud branch, and feature-level fusion of point clouds and images. Besides, a novel coarse-fine detection header is proposed, which simulates the two-stage detectors, generating coarse proposals on the encoder, and refining them on the decoder. Extensive experiments show that the proposed network has better detection performance on occluded and distant vehicles, and reduces the false detection of similarly shaped objects, proving its superiority over some state-of-the-art detectors on the challenging KITTI benchmark. Ablation studies have also demonstrated the effectiveness of each designed module.

源语言英语
页(从-至)15146-15154
页数9
期刊IEEE Transactions on Intelligent Transportation Systems
卷23
期9
DOI
出版状态已出版 - 1 9月 2022
已对外发布是

学术指纹

探究 '3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images' 的科研主题。它们共同构成独一无二的学术指纹。

引用此