跳到主要导航 跳到搜索 跳到主要内容

DDFL: Dual-Domain Feature Learning for nighttime semantic segmentation

  • Xiao Lin
  • , Peiwen Tan
  • , Zhengkai Wang
  • , Lizhuang Ma
  • , Yan Li*
  • *此作品的通讯作者
  • Shanghai Normal University
  • Research Base of Online Education for Shanghai Middle and Primary Schools
  • Shanghai Jiao Tong University

科研成果: 期刊稿件文章同行评审

摘要

Nighttime semantic segmentation has been playing a critical role in intelligent transportation, building safety and urban management. However, nighttime scenes present some challenges such as complex structures, multiple light sources, uneven lighting and blurry image noise, which severely degrade the segmentation quality of nighttime images. To address these challenges, we propose a Dual-Domain Feature Learning (DDFL) model for nighttime semantic segmentation. Our approach introduces three innovative ideas. First, we establish an exposure correction module to address the impact of lighting differences on the model's learning, so as to maximally restore the pixel distortion and blurry areas caused by artificial light in nighttime scenes. Second, we incorporate frequency domain information into the nighttime segmentation task to give the model stronger discrimination ability. Finally, we introduce a dual-domain fusion module to complement the information of learning from the spatial and frequency domains in a cross-fusion manner, enabling the network to perceive semantic information while preserving details. The proposed model was experimentally tested on the Nightcity, Nightcity+ and BDD100k datasets. Our results demonstrate that our model outperforms mainstream models, achieving mIoU scores of 56.73%, 57.41% and 28.97%, respectively, under different lighting, image exposure levels, and resolutions. These results show that our model is capable of segmenting nighttime scenes efficiently in a high-quality way.

源语言英语
文章编号102685
期刊Displays
83
DOI
出版状态已出版 - 7月 2024

联合国可持续发展目标

此成果有助于实现下列可持续发展目标:

  1. 可持续发展目标 11 - 可持续城市和社区
    可持续发展目标 11 可持续城市和社区

指纹

探究 'DDFL: Dual-Domain Feature Learning for nighttime semantic segmentation' 的科研主题。它们共同构成独一无二的指纹。

引用此