TY - JOUR
T1 - EDMAE
T2 - An efficient decoupled masked autoencoder for standard view identification in pediatric echocardiography
AU - Liu, Yiman
AU - Han, Xiaoxiang
AU - Liang, Tongtong
AU - Dong, Bin
AU - Yuan, Jiajun
AU - Hu, Menghan
AU - Liu, Qiaohong
AU - Chen, Jiangang
AU - Li, Qingli
AU - Zhang, Yuqi
N1 - Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2023/9
Y1 - 2023/9
N2 - This paper introduces the Efficient Decoupled Masked Autoencoder (EDMAE), a novel self-supervised method for recognizing standard views in pediatric echocardiography. EDMAE introduces a new proxy task based on the encoder–decoder structure. The EDMAE encoder is composed of a teacher and a student encoder. The teacher encoder extracts the potential representation of the masked image blocks, while the student encoder extracts the potential representation of the visible image blocks. The loss is calculated between the feature maps output by the two encoders to ensure consistency in the latent representations they extract. EDMAE uses pure convolution operations instead of the ViT structure in the MAE encoder. This improves training efficiency and convergence speed. EDMAE is pre-trained on a large-scale private dataset of pediatric echocardiography using self-supervised learning, and then fine-tuned for standard view recognition. The proposed method achieves high classification accuracy in 27 standard views of pediatric echocardiography. To further verify the effectiveness of the proposed method, the authors perform another downstream task of cardiac ultrasound segmentation on the public dataset CAMUS. The experimental results demonstrate that the proposed method outperforms some popular supervised and recent self-supervised methods, and is more competitive on different downstream tasks.
AB - This paper introduces the Efficient Decoupled Masked Autoencoder (EDMAE), a novel self-supervised method for recognizing standard views in pediatric echocardiography. EDMAE introduces a new proxy task based on the encoder–decoder structure. The EDMAE encoder is composed of a teacher and a student encoder. The teacher encoder extracts the potential representation of the masked image blocks, while the student encoder extracts the potential representation of the visible image blocks. The loss is calculated between the feature maps output by the two encoders to ensure consistency in the latent representations they extract. EDMAE uses pure convolution operations instead of the ViT structure in the MAE encoder. This improves training efficiency and convergence speed. EDMAE is pre-trained on a large-scale private dataset of pediatric echocardiography using self-supervised learning, and then fine-tuned for standard view recognition. The proposed method achieves high classification accuracy in 27 standard views of pediatric echocardiography. To further verify the effectiveness of the proposed method, the authors perform another downstream task of cardiac ultrasound segmentation on the public dataset CAMUS. The experimental results demonstrate that the proposed method outperforms some popular supervised and recent self-supervised methods, and is more competitive on different downstream tasks.
KW - Efficient decoupled masked autoencoder
KW - Pediatric echocardiography
KW - Self-supervised learning
KW - Standard view identification
UR - https://www.scopus.com/pages/publications/85166637252
U2 - 10.1016/j.bspc.2023.105280
DO - 10.1016/j.bspc.2023.105280
M3 - 文章
AN - SCOPUS:85166637252
SN - 1746-8094
VL - 86
JO - Biomedical Signal Processing and Control
JF - Biomedical Signal Processing and Control
M1 - 105280
ER -