HI-MAFE: Hyperspectral Image Multi-Agent Deep Reinforcement Learning Feature Extraction

Hyperspectral image (HSI) feature extraction plays a crucial role in reducing the redundancy and correlation among spectral bands while preserving the essential information. Knowledge-driven feature extraction methods, such as spectral indices (SIs), leverage the interaction mechanisms between electromagnetic waves and materials to enhance the characteristic attributes of ground objects through band operations. These methods offer key advantages, including strong physical interpretability, simple construction, and robust scene reusability. However, most of the existing SIs still rely on expert knowledge tailored to specific scenarios, leading to inherent limitations, such as subjectivity, high time consumption, and implementation complexity. In this article, to address these challenges, we propose a HSI multi-agent deep reinforcement learning (MADRL) feature extraction (HI-MAFE) algorithm, aiming to alleviate the burden of manual SIs design by human experts. HI-MAFE employs a heuristic “generation-selection” strategy to simulate the decision-making process of domain experts, with specifically designed deep reinforcement learning (DRL) models for both the generation and selection steps. To accelerate exploration in a high-dimensional action space, the model incorporates a MADRL framework. The experimental results demonstrate the effectiveness and superiority of the proposed algorithm for HSI classification. The proposed HI-MAFE framework leverages DRL to autonomously generate meaningful environmental interpretation from spectral data, thereby reducing the reliance on manually designed SIs. This research can inspire future work in SIs construction and complement the limitations of data-driven approaches.