TY - JOUR
T1 - Few-shot object segmentation with a new feature aggregation module
AU - Liu, Kaijun
AU - Lyu, Shujing
AU - Shivakumara, Palaiahnakote
AU - Lu, Yue
N1 - Publisher Copyright:
© 2023 Elsevier B.V.
PY - 2023/7
Y1 - 2023/7
N2 - The success of convolutional neural network for object segmentation depends on a large amount of training data and high-quality samples. But annotating such high-quality training data for pixel-wise segmentation is labor-intensive. To reduce the massive labor work, few-shot learning has been introduced to segment objects, which uses a few samples for training without compromising the performance. However, the current few-shot models are biased towards the seen classes rather than being class-irrelevant due to lack of global context prior attention. Therefore, this study aims at proposing a few-shot object segmentation model with a new feature aggregation module. Specifically, the proposed work develops a detail-aware module to enhance the discrimination of details with diversified attributes. To enhance the semantics of each pixel, we propose a global attention module to aggregate detailed features containing semantic information. Furthermore, to improve the performance of the proposed model, the model uses support samples that represents class-specific prototype obtained by respective category prototype block. Next, the proposed model predicts label of each pixel of query sample by estimating the distance between the pixel and prototypes. Experiments on standard datasets demonstrate significance of the proposed model over SOTA in terms of segmentation with a few training samples.
AB - The success of convolutional neural network for object segmentation depends on a large amount of training data and high-quality samples. But annotating such high-quality training data for pixel-wise segmentation is labor-intensive. To reduce the massive labor work, few-shot learning has been introduced to segment objects, which uses a few samples for training without compromising the performance. However, the current few-shot models are biased towards the seen classes rather than being class-irrelevant due to lack of global context prior attention. Therefore, this study aims at proposing a few-shot object segmentation model with a new feature aggregation module. Specifically, the proposed work develops a detail-aware module to enhance the discrimination of details with diversified attributes. To enhance the semantics of each pixel, we propose a global attention module to aggregate detailed features containing semantic information. Furthermore, to improve the performance of the proposed model, the model uses support samples that represents class-specific prototype obtained by respective category prototype block. Next, the proposed model predicts label of each pixel of query sample by estimating the distance between the pixel and prototypes. Experiments on standard datasets demonstrate significance of the proposed model over SOTA in terms of segmentation with a few training samples.
KW - Attention mechanism
KW - Feature aggregation
KW - Few-shot learning
KW - Object segmentation
UR - https://www.scopus.com/pages/publications/85163374024
U2 - 10.1016/j.displa.2023.102459
DO - 10.1016/j.displa.2023.102459
M3 - 文章
AN - SCOPUS:85163374024
SN - 0141-9382
VL - 78
JO - Displays
JF - Displays
M1 - 102459
ER -