TY - GEN
T1 - A SOFT CONTRASTIVE LEARNING-BASED PROMPT MODEL FOR FEW-SHOT SENTIMENT ANALYSIS
AU - Zhou, Jingyi
AU - Zhou, Jie
AU - Zhao, Jiabao
AU - Wang, Siyin
AU - Shan, Haijun
AU - Gui, Tao
AU - Zhang, Qi
AU - Huang, Xuanjing
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Few-shot text classification has attracted great interest in both academia and industry due to the lack of labeled data in many fields. Different from general text classification (e.g., topic classification), few-shot sentiment classification is more challenging because the semantic distances among the classes are more subtle. For instance, the semantic distances between the sentiment labels in a positive or negative polarity (e.g., “love” and “joy”, “remorse” and “sadness”) are close, while the distances are large for the sentiment labels in two opposite polarities (e.g., “love” and “sadness”). To address this problem, we propose a Soft Contrastive learning-based Prompt (SCP) model for few-shot sentiment analysis. First, we design a sentiment-aware chain of thought prompt module to guide the model to predict the sentiment from coarse grain to fine grain via a series of intermediate reasoning steps. Then, we propose a soft contrastive learning algorithm to take the correlation of the labels into account. A series of experiments on several sentiment analysis datasets show the great advantages of SCP by comparing it with SOTA baselines (e.g., ChatGPT).
AB - Few-shot text classification has attracted great interest in both academia and industry due to the lack of labeled data in many fields. Different from general text classification (e.g., topic classification), few-shot sentiment classification is more challenging because the semantic distances among the classes are more subtle. For instance, the semantic distances between the sentiment labels in a positive or negative polarity (e.g., “love” and “joy”, “remorse” and “sadness”) are close, while the distances are large for the sentiment labels in two opposite polarities (e.g., “love” and “sadness”). To address this problem, we propose a Soft Contrastive learning-based Prompt (SCP) model for few-shot sentiment analysis. First, we design a sentiment-aware chain of thought prompt module to guide the model to predict the sentiment from coarse grain to fine grain via a series of intermediate reasoning steps. Then, we propose a soft contrastive learning algorithm to take the correlation of the labels into account. A series of experiments on several sentiment analysis datasets show the great advantages of SCP by comparing it with SOTA baselines (e.g., ChatGPT).
KW - Contrastive Learning
KW - Few-shot sentiment analysis
KW - Prompt
UR - https://www.scopus.com/pages/publications/85195423200
U2 - 10.1109/ICASSP48485.2024.10446983
DO - 10.1109/ICASSP48485.2024.10446983
M3 - 会议稿件
AN - SCOPUS:85195423200
T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
SP - 10016
EP - 10020
BT - 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024
Y2 - 14 April 2024 through 19 April 2024
ER -