Image Fusion Based on Feature Decoupling and Proportion Preserving

  • Bin Fang
  • , Ran Yi*
  • , Lizhuang Ma
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Image fusion is a widely used technique for generating a new image by combining information from multiple input images. However, existing image fusion algorithms are often domain-specific, which limits their generalization ability and processing capacity. In this paper, we propose a fast unified fusion network called FDF, based on feature decoupling and intensity and gradient feature proportion maintenance. FDF is an end-to-end network that can perform multiple image fusion tasks. We first decouple the features of the source images into intensity features and texture features and then fuse them using the intensity and gradient paths. To improve the generalization ability, we design a unified loss function that can adapt to different fusion tasks. We evaluate FDF on three image fusion tasks, namely visible and infrared image fusion, multi-exposure image fusion, and medical image fusion. Our experimental results show that FDF outperforms state-of-the-art methods in terms of visual effects and multiple quantitative metrics. The proposed method has the potential to be applied to other image fusion tasks and domains, making it a promising approach for future research. Overall, FDF provides a fast and unified solution for image fusion tasks, which can significantly improve the efficiency and effectiveness of image fusion applications.

Original languageEnglish
Title of host publicationComputer-Aided Design and Computer Graphics - 18th International Conference, CAD/Graphics 2023, Proceedings
EditorsShi-Min Hu, Yiyu Cai, Paul Rosin
PublisherSpringer Science and Business Media Deutschland GmbH
Pages60-74
Number of pages15
ISBN (Print)9789819996650
DOIs
StatePublished - 2024
Externally publishedYes
Event18th International Conference on Computer-Aided Design and Computer Graphics, CAD/Graphics 2023 - Shanghai, China
Duration: 19 Aug 202321 Aug 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14250 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th International Conference on Computer-Aided Design and Computer Graphics, CAD/Graphics 2023
Country/TerritoryChina
CityShanghai
Period19/08/2321/08/23

Keywords

  • Feature decoupling
  • Image fusion
  • Multimodal fusion

Fingerprint

Dive into the research topics of 'Image Fusion Based on Feature Decoupling and Proportion Preserving'. Together they form a unique fingerprint.

Cite this