HI-MAFE: Hyperspectral Image Multi-Agent Deep Reinforcement Learning Feature Extraction

Jin Sun, Renjie Ji, Xue Wang, Kun Tan*, Yong Mei

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Hyperspectral image feature extraction plays a crucial role in reducing the redundancy and correlation among spectral bands while preserving the essential information. Knowledge-driven feature extraction methods, such as spectral indices (SIs), leverage the interaction mechanisms between electromagnetic waves and materials to enhance the characteristic attributes of ground objects through band operations. These methods offer key advantages, including strong physical interpretability, simple construction, and robust scene reusability. However, most of the existing SIs still rely on expert knowledge tailored to specific scenarios, leading to inherent limitations, such as subjectivity, high time consumption, and implementation complexity. In this article, to address these challenges, we propose a hyperspectral image multi-agent deep reinforcement learning feature extraction (HI-MAFE) algorithm, aiming to alleviate the burden of manual SIs design by human experts. HI-MAFE employs a heuristic 'generation-selection' strategy to simulate the decision-making process of domain experts, with specifically designed deep reinforcement learning (DRL) models for both the generation and selection steps. To accelerate exploration in a high-dimensional action space, the model incorporates a multi-agent deep reinforcement learning (MADRL) framework. The experimental results demonstrate the effectiveness and superiority of the proposed algorithm for hyperspectral image classification. The proposed HI-MAFE framework leverages DRL to autonomously generate meaningful environmental interpretation from spectral data, thereby reducing the reliance on manually designed SIs. This research can inspire future work in SIs construction and complement the limitations of data-driven approaches.

Original languageEnglish
JournalIEEE Transactions on Geoscience and Remote Sensing
DOIs
StateAccepted/In press - 2025

Keywords

  • automatic feature engineering
  • Hyperspectral remote sensing
  • multi-agent deep reinforcement learning
  • spectral indices

Fingerprint

Dive into the research topics of 'HI-MAFE: Hyperspectral Image Multi-Agent Deep Reinforcement Learning Feature Extraction'. Together they form a unique fingerprint.

Cite this