跳到主要导航 跳到搜索 跳到主要内容

SAR-Optical Image Matching with Semantic Position Probability Distribution

  • Liangzhi Li
  • , Ling Han*
  • , Ming Liu
  • , Kyle Gao
  • , Hongjie He
  • , Lanying Wang
  • , Jonathan Li*
  • *此作品的通讯作者
  • Chang'an University
  • University of Waterloo

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

We propose a deep learning framework of semantic position probability distribution for synthetic aperture radar (SAR)-optical image matching, termed as SPPD. Unlike the pixel-by-pixel searching matching method, a correspondence is directly obtained by an outputted matching position probability distribution. First, multiscale pyramidal features are created for each pixel in the SAR and optical images by using two weight-sharing ResNet-50 + feature pyramid network (FPN) networks. The features containing high-level semantic information are then embedded into the proposed image position attention module to obtain the spatial position dependencies between two images. Then, we present a loss function for semantic position matching to optimize the network from both semantic information and pixel alignment perspectives, converting the probability distribution of semantic matching positions into a point-to-point matching problem. In this article, the SAR and optical images are set as the sensed and reference images. The effects of different image sizes, training label types, and loss function weights on matching accuracy are explored to obtain the optimal parameter settings for matching. The experimental results show that the proposed method is insensitive to image deformation and achieves cross-modal matching for SAR-optical images with high accuracy compared with the best matching method on different scene images, with several orders of magnitude faster inferences time.

源语言英语
期刊论文编号5111315
页(从-至)1-15
页数15
期刊IEEE Transactions on Geoscience and Remote Sensing
卷61
DOI
出版状态已出版 - 2023
已对外发布是

学术指纹

探究 'SAR-Optical Image Matching with Semantic Position Probability Distribution' 的科研主题。它们共同构成独一无二的学术指纹。

引用此