Abstract: In recent years, with the vigorous development of deep learning, the pre-trained models such as Bert and GPT have been brilliant, and the sentiment analysis task has made increasingly ...