BERT-based regression model for micro-edit humor classification task

Yuancheng Chen; Yi Hou; Deqiang Ye; Yuehang Yu

doi:10.1117/12.2615160

15 October 2021 BERT-based regression model for micro-edit humor classification task

Yuancheng Chen, Yi Hou, Deqiang Ye, Yuehang Yu

Proceedings Volume 11933, 2021 International Conference on Neural Networks, Information and Communication Engineering; 119332E (2021) https://doi.org/10.1117/12.2615160
Event: 2021 International Conference on Neural Networks, Information and Communication Engineering, 2021, Qingdao, China

Abstract

Choosing the more humorous edited headline is a subfield of humor detection and generation tasks. This paper tries to deal with the second subtask of the SemEval-2020 shared task, “Assessing Humor in Edited News Headlines”. It aims to determine how machines can understand humor generated by an atomic edit to the original headline and automatically pick up the funnier version among two different edits. Given that both substitute words on the same original text are scored using crowdsourcing, we attempt not only classification but also the regression model on this special task. As for the training process, we first consider using two different embedding approaches, including GloVe and BERT, then further use different forms of neural network such as a fully connected layer, BiLSTM, and GRU. According to the experimental results, our BERT-based model gets a 64% accuracy performance, ranking second in the competition over 50 teams. Furthermore, by comparing the result and performance of the above models, we pick up some classic wrongly predicted samples and analyze the potential reasons for future study. The experimental results illustrate that mainly the revised sentence accounts for edit humor, whereas the original sentence does not have any effect. Besides, the combination of the revised and original sentence as input receives the best output, which shows that edit humor is probably produced from the edited sentence and the difference before and after modification.

Citation Download Citation

Yuancheng Chen, Yi Hou, Deqiang Ye, and Yuehang Yu "BERT-based regression model for micro-edit humor classification task", Proc. SPIE 11933, 2021 International Conference on Neural Networks, Information and Communication Engineering, 119332E (15 October 2021); https://doi.org/10.1117/12.2615160

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Performance modeling

Statistical modeling

Neural networks

Statistical analysis

Binary data

Computer programming

Show All Keywords

Keywords/Phrases

Search In:

Publication Years