TY - JOUR
T1 - Parameter-Efficient Fine-Tuning With Frequency Adapter for Enhanced Sea–Land Segmentation
AU - Ma, Dongliang
AU - Zhu, Likai
AU - Zhao, Fang
AU - Xie, Yichen
AU - Li, Ye
AU - Liu, Min
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Accurate sea-land segmentation (SLS) from satellite imagery is essential for monitoring coastline changes, which holds great significance for coastal regions. Recent advances in deep learning (DL), particularly convolutional neural networks (CNNs) and vision transformers (ViTs), have exhibited promising performance. However, these models struggle with the diverse characteristics of global coastlines and require extensive labeled data, which is often scarce. To overcome these challenges, we propose a novel approach leveraging foundation models for SLS. Our method proposes a parameter-efficient fine-tuning (PEFT) module called Freq-Adapter, which integrates frequency representation with minimal additional parameters into pretrained foundation models. Meanwhile, we introduce a parameter-efficient continual pretraining (PECP) with self-supervised learning (SSL) on unlabeled coastal remote sensing data, allowing the model to adapt to coastal image characteristics while preserving pretrained knowledge. Furthermore, we design a lightweight detail head (LDHead) to enhance image details and edges, improving the ability to detect irregular sea-land boundaries. Extensive experiments demonstrate the superior effectiveness and robust generalization of our method on the large-scale SLS datasets, highlighting its potential for accurate and efficient coastal monitoring.
AB - Accurate sea-land segmentation (SLS) from satellite imagery is essential for monitoring coastline changes, which holds great significance for coastal regions. Recent advances in deep learning (DL), particularly convolutional neural networks (CNNs) and vision transformers (ViTs), have exhibited promising performance. However, these models struggle with the diverse characteristics of global coastlines and require extensive labeled data, which is often scarce. To overcome these challenges, we propose a novel approach leveraging foundation models for SLS. Our method proposes a parameter-efficient fine-tuning (PEFT) module called Freq-Adapter, which integrates frequency representation with minimal additional parameters into pretrained foundation models. Meanwhile, we introduce a parameter-efficient continual pretraining (PECP) with self-supervised learning (SSL) on unlabeled coastal remote sensing data, allowing the model to adapt to coastal image characteristics while preserving pretrained knowledge. Furthermore, we design a lightweight detail head (LDHead) to enhance image details and edges, improving the ability to detect irregular sea-land boundaries. Extensive experiments demonstrate the superior effectiveness and robust generalization of our method on the large-scale SLS datasets, highlighting its potential for accurate and efficient coastal monitoring.
KW - Continual pretraining
KW - deep learning (DL)
KW - foundation models
KW - frequency representation
KW - satellite imagery
KW - sea–land segmentation (SLS)
UR - https://www.scopus.com/pages/publications/105006702417
U2 - 10.1109/TGRS.2025.3573159
DO - 10.1109/TGRS.2025.3573159
M3 - 文章
AN - SCOPUS:105006702417
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
ER -