TY - JOUR
T1 - Semi-supervised learning advances species recognition for aquatic biodiversity monitoring
AU - Ma, Dongliang
AU - Wei, Jine
AU - Zhu, Likai
AU - Zhao, Fang
AU - Wu, Hao
AU - Chen, Xi
AU - Li, Ye
AU - Liu, Min
N1 - Publisher Copyright:
Copyright © 2024 Ma, Wei, Zhu, Zhao, Wu, Chen, Li and Liu.
PY - 2024
Y1 - 2024
N2 - Aquatic biodiversity monitoring relies on species recognition from images. While deep learning (DL) streamlines the recognition process, the performance of these method is closely linked to the large-scale labeled datasets, necessitating manual processing with expert knowledge and consume substantial time, labor, and financial resources. Semi-supervised learning (SSL) offers a promising avenue to improve the performance of DL models by utilizing the extensive unlabeled samples. However, the complex collection environments and the long-tailed class imbalance of aquatic species make SSL difficult to implement effectively. To address these challenges in aquatic species recognition within the SSL scheme, we propose a Wavelet Fusion Network and the Consistency Equilibrium Loss function. The former mitigates the influence of data collection environment by fusing image information at different frequencies decomposed through wavelet transform. The latter improves the SSL scheme by refining the consistency loss function and adaptively adjusting the margin for each class. Extensive experiments are conducted on the large-scale FishNet dataset. As expected, our method improves the existing SSL scheme by up to 9.34% in overall classification accuracy. With the accumulation of image data, the improved SSL method with limited labeled data, shows the potential to advance species recognition for aquatic biodiversity monitoring and conservation.
AB - Aquatic biodiversity monitoring relies on species recognition from images. While deep learning (DL) streamlines the recognition process, the performance of these method is closely linked to the large-scale labeled datasets, necessitating manual processing with expert knowledge and consume substantial time, labor, and financial resources. Semi-supervised learning (SSL) offers a promising avenue to improve the performance of DL models by utilizing the extensive unlabeled samples. However, the complex collection environments and the long-tailed class imbalance of aquatic species make SSL difficult to implement effectively. To address these challenges in aquatic species recognition within the SSL scheme, we propose a Wavelet Fusion Network and the Consistency Equilibrium Loss function. The former mitigates the influence of data collection environment by fusing image information at different frequencies decomposed through wavelet transform. The latter improves the SSL scheme by refining the consistency loss function and adaptively adjusting the margin for each class. Extensive experiments are conducted on the large-scale FishNet dataset. As expected, our method improves the existing SSL scheme by up to 9.34% in overall classification accuracy. With the accumulation of image data, the improved SSL method with limited labeled data, shows the potential to advance species recognition for aquatic biodiversity monitoring and conservation.
KW - aquatic species recognition
KW - consistency loss
KW - deep learning
KW - semi-supervised learning
KW - wavelet transform
UR - https://www.scopus.com/pages/publications/85195456233
U2 - 10.3389/fmars.2024.1373755
DO - 10.3389/fmars.2024.1373755
M3 - 文章
AN - SCOPUS:85195456233
SN - 2296-7745
VL - 11
JO - Frontiers in Marine Science
JF - Frontiers in Marine Science
M1 - 1373755
ER -