A Study on News Headline Classification Based on BERT Modeling

DOI

10.2991/978-94-6463-540-9_35How to use a DOI?

Keywords

Deep Learning; BERT; News Headline; Categorization

Abstract

News is an important way to understand the information of contemporary society, and it is necessary to quickly categorize and identify a large amount of news information. In this report, a classification task was performed on Chinese news headlines based on the Bidirectional Encoder Representations from Transformers (BERT) model. Deep learning model transformers are used to compare the differences between Bert model and traditional methods in text categorization. Training and tuning were performed on the collected and organized dataset. From the experimental results, the model has a better classification effect on news headline classification, reflecting the advantages and performance of Bert in Chinese news headline text classification. Meanwhile, the performance differences of Bert model under different learning rate parameters, number of learning rounds and different dataset annotation accuracy settings are analyzed. The results of the experiment were 0.7 accuracy for 10 rounds of learning with a learning rate parameter of 5e-6, and 0.6 accuracy for 20 rounds of learning with a learning rate parameter of 1e-5.The analysis concludes that under the same learning rate parameter, the learning accuracy tends to stabilize with the increase in the number of learning rounds; under the same number of learning rounds, the learning rate is too high or too low will affect the learning accuracy.

Copyright

© 2024 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Yucheng Chen
PY  - 2024
DA  - 2024/10/16
TI  - A Study on News Headline Classification Based on BERT Modeling
BT  - Proceedings of the 2024 2nd International Conference on Image, Algorithms and Artificial Intelligence (ICIAAI 2024)
PB  - Atlantis Press
SP  - 345
EP  - 355
SN  - 2352-538X
UR  - https://doi.org/10.2991/978-94-6463-540-9_35
DO  - 10.2991/978-94-6463-540-9_35
ID  - Chen2024
ER  -