TY - JOUR
T1 - Toward a Unified Dual-Path Framework for Multimodal Remote Sensing Data Fusion
T2 - Integrating Temporal, Resolution, and Spectral Dimensions
AU - Jiang, Mingyu
AU - Shao, Hua
AU - Cao, Kai
AU - Ding, Yuan
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026
Y1 - 2026
N2 - Remote sensing image fusion integrates observations from multiple sensors, spectral domains, and temporal acquisitions to exploit complementary and differential information, thereby producing more complete, consistent, and analytically valuable representations of the Earth system. However, existing fusion approaches are predominantly designed for specific tasks or modalities, which restrict their generalization and scalability. To this end, we propose a fusion network with dual-path learning strategy (DPLNet) that provides a unified framework for three fusion tasks: spatiotemporal fusion, change detection, and pan-sharpening. DPLNet comprises two primary stages: Feature extraction (FE) stage and multiscale feature fusion (MFF) stage. In the FE stage, the two remote sensing images are independently processed through one stream of the dual-path encoder. Subsequently, in the MFF stage, all multiscale features are adaptively integrated within a unified fusion module, where features from corresponding scales are fused adaptively without predefined task-specific interaction rules, allowing the model to learn cross-source feature relationships in a data-driven manner for final prediction. Experiments on multiple datasets demonstrate that DPLNet achieves state-of-the-art performance, consistently surpassing specialized models in both quantitative accuracy and qualitative comparison. These results highlight the potential of DPLNet as a task-general framework for representative optical remote sensing fusion tasks, offering a scalable and efficient solution for Earth observation.
AB - Remote sensing image fusion integrates observations from multiple sensors, spectral domains, and temporal acquisitions to exploit complementary and differential information, thereby producing more complete, consistent, and analytically valuable representations of the Earth system. However, existing fusion approaches are predominantly designed for specific tasks or modalities, which restrict their generalization and scalability. To this end, we propose a fusion network with dual-path learning strategy (DPLNet) that provides a unified framework for three fusion tasks: spatiotemporal fusion, change detection, and pan-sharpening. DPLNet comprises two primary stages: Feature extraction (FE) stage and multiscale feature fusion (MFF) stage. In the FE stage, the two remote sensing images are independently processed through one stream of the dual-path encoder. Subsequently, in the MFF stage, all multiscale features are adaptively integrated within a unified fusion module, where features from corresponding scales are fused adaptively without predefined task-specific interaction rules, allowing the model to learn cross-source feature relationships in a data-driven manner for final prediction. Experiments on multiple datasets demonstrate that DPLNet achieves state-of-the-art performance, consistently surpassing specialized models in both quantitative accuracy and qualitative comparison. These results highlight the potential of DPLNet as a task-general framework for representative optical remote sensing fusion tasks, offering a scalable and efficient solution for Earth observation.
KW - Adaptive fusion strategy
KW - change detection (CD)
KW - multi source remote sensing image fusion (RSIF)
KW - pan-sharpening (Pan)
KW - spatiotemporal fusion (STF)
UR - https://www.scopus.com/pages/publications/105042002008
U2 - 10.1109/JSTARS.2026.3702669
DO - 10.1109/JSTARS.2026.3702669
M3 - 文章
AN - SCOPUS:105042002008
SN - 1939-1404
VL - 19
SP - 20772
EP - 20793
JO - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
JF - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
ER -