TY - JOUR
T1 - HI-MAFE
T2 - Hyperspectral Image Multi-Agent Deep Reinforcement Learning Feature Extraction
AU - Sun, Jin
AU - Ji, Renjie
AU - Wang, Xue
AU - Tan, Kun
AU - Mei, Yong
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Hyperspectral image feature extraction plays a crucial role in reducing the redundancy and correlation among spectral bands while preserving the essential information. Knowledge-driven feature extraction methods, such as spectral indices (SIs), leverage the interaction mechanisms between electromagnetic waves and materials to enhance the characteristic attributes of ground objects through band operations. These methods offer key advantages, including strong physical interpretability, simple construction, and robust scene reusability. However, most of the existing SIs still rely on expert knowledge tailored to specific scenarios, leading to inherent limitations, such as subjectivity, high time consumption, and implementation complexity. In this article, to address these challenges, we propose a hyperspectral image multi-agent deep reinforcement learning feature extraction (HI-MAFE) algorithm, aiming to alleviate the burden of manual SIs design by human experts. HI-MAFE employs a heuristic 'generation-selection' strategy to simulate the decision-making process of domain experts, with specifically designed deep reinforcement learning (DRL) models for both the generation and selection steps. To accelerate exploration in a high-dimensional action space, the model incorporates a multi-agent deep reinforcement learning (MADRL) framework. The experimental results demonstrate the effectiveness and superiority of the proposed algorithm for hyperspectral image classification. The proposed HI-MAFE framework leverages DRL to autonomously generate meaningful environmental interpretation from spectral data, thereby reducing the reliance on manually designed SIs. This research can inspire future work in SIs construction and complement the limitations of data-driven approaches.
AB - Hyperspectral image feature extraction plays a crucial role in reducing the redundancy and correlation among spectral bands while preserving the essential information. Knowledge-driven feature extraction methods, such as spectral indices (SIs), leverage the interaction mechanisms between electromagnetic waves and materials to enhance the characteristic attributes of ground objects through band operations. These methods offer key advantages, including strong physical interpretability, simple construction, and robust scene reusability. However, most of the existing SIs still rely on expert knowledge tailored to specific scenarios, leading to inherent limitations, such as subjectivity, high time consumption, and implementation complexity. In this article, to address these challenges, we propose a hyperspectral image multi-agent deep reinforcement learning feature extraction (HI-MAFE) algorithm, aiming to alleviate the burden of manual SIs design by human experts. HI-MAFE employs a heuristic 'generation-selection' strategy to simulate the decision-making process of domain experts, with specifically designed deep reinforcement learning (DRL) models for both the generation and selection steps. To accelerate exploration in a high-dimensional action space, the model incorporates a multi-agent deep reinforcement learning (MADRL) framework. The experimental results demonstrate the effectiveness and superiority of the proposed algorithm for hyperspectral image classification. The proposed HI-MAFE framework leverages DRL to autonomously generate meaningful environmental interpretation from spectral data, thereby reducing the reliance on manually designed SIs. This research can inspire future work in SIs construction and complement the limitations of data-driven approaches.
KW - automatic feature engineering
KW - Hyperspectral remote sensing
KW - multi-agent deep reinforcement learning
KW - spectral indices
UR - https://www.scopus.com/pages/publications/105021415820
U2 - 10.1109/TGRS.2025.3631865
DO - 10.1109/TGRS.2025.3631865
M3 - 文章
AN - SCOPUS:105021415820
SN - 0196-2892
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
ER -