TY - JOUR
T1 - Vehicle global 6-DoF pose estimation under traffic surveillance camera
AU - Zhang, Shanxin
AU - Wang, Cheng
AU - He, Zijian
AU - Li, Qing
AU - Lin, Xiuhong
AU - Li, Xin
AU - Zhang, Juyong
AU - Yang, Chenhui
AU - Li, Jonathan
N1 - Publisher Copyright:
© 2019 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS)
PY - 2020/1
Y1 - 2020/1
N2 - Accurately sensing the global position and posture of vehicles in traffic surveillance videos is a challenging but valuable issue for future intelligent transportation systems. Although in recent years, deep learning has brought about major breakthroughs in the six degrees of freedom (6-DoF) pose estimation of objects from monocular images, accurate estimation of the geographic 6-DoF poses of vehicles using images from traffic surveillance cameras remains challenging. We present an architecture that computes continuous global 6-DoF poses throughout joint 2D landmark estimation and 3D pose reconstruction. The architecture infers the 6-DoF pose of a vehicle from the appearance of the image of the vehicle and 3D information. The architecture, which does not rely on intrinsic camera parameters, can be applied to all surveillance cameras by a pre-trained model. Also, with the help of 3D information from the point clouds and the 3D model itself, the architecture can predict landmarks with few and/or blurred textures. Moreover, because of the lack of public training datasets, we release a large-scale dataset, ADFSC, that contains 120 K groups of data with random viewing angles. Regarding both 2D and 3D metrics, our architecture outperforms existing state-of-the-art algorithms in vehicle 6-DoF estimation.
AB - Accurately sensing the global position and posture of vehicles in traffic surveillance videos is a challenging but valuable issue for future intelligent transportation systems. Although in recent years, deep learning has brought about major breakthroughs in the six degrees of freedom (6-DoF) pose estimation of objects from monocular images, accurate estimation of the geographic 6-DoF poses of vehicles using images from traffic surveillance cameras remains challenging. We present an architecture that computes continuous global 6-DoF poses throughout joint 2D landmark estimation and 3D pose reconstruction. The architecture infers the 6-DoF pose of a vehicle from the appearance of the image of the vehicle and 3D information. The architecture, which does not rely on intrinsic camera parameters, can be applied to all surveillance cameras by a pre-trained model. Also, with the help of 3D information from the point clouds and the 3D model itself, the architecture can predict landmarks with few and/or blurred textures. Moreover, because of the lack of public training datasets, we release a large-scale dataset, ADFSC, that contains 120 K groups of data with random viewing angles. Regarding both 2D and 3D metrics, our architecture outperforms existing state-of-the-art algorithms in vehicle 6-DoF estimation.
KW - 6-DoF
KW - Deep learning
KW - Dynamic 3D reconstruction
KW - Point clouds
KW - Pose
KW - Surveillance camera
UR - https://www.scopus.com/pages/publications/85075538985
U2 - 10.1016/j.isprsjprs.2019.11.005
DO - 10.1016/j.isprsjprs.2019.11.005
M3 - 文章
AN - SCOPUS:85075538985
SN - 0924-2716
VL - 159
SP - 114
EP - 128
JO - ISPRS Journal of Photogrammetry and Remote Sensing
JF - ISPRS Journal of Photogrammetry and Remote Sensing
ER -