University of Oulu

Jahan, M. S., Oussalah, M., & Arhab, N. (2022). Finnish hate-speech detection on social media using CNN and FinBERT. In N. Calzolari et al. (Eds,), Language Resources and Evaluation Conference, LREC 2022, 20-25 June 2022, Palais du Pharo, Marseille, France : conference proceedings (pp. 876-882). European Language Resources Association (ELRA). http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.92.pdf

Finnish hate-speech detection on social media using CNN and FinBERT

Saved in:
Author: Jahan, Md Saroar1; Oussalah, Mourad1; Arhab, Nabil1
Organizations: 1University of Oulu, CMVS, BP 4500, 90014, Finland
Format: article
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 0.5 MB)
Persistent link: http://urn.fi/urn:nbn:fi-fe2022070651228
Language: English
Published: European Language Resources Association, 2022
Publish Date: 2022-07-06
Description:

Abstract

There has been a lot of research in identifying hate posts from social media because of their detrimental effects on both individuals and society. The majority of this research has concentrated on English, although one notices the emergence of multilingual detection tools such as multilingual-BERT (mBERT). However, there is a lack of hate speech datasets compared to English, and a multilingual pre-trained model often contains fewer tokens for other languages. This paper attempts to contribute to hate speech identification in Finnish by constructing a new hate speech dataset that is collected from a popular forum (Suomi24). Furthermore, we have experimented with FinBERT pre-trained model performance for Finnish hate speech detection compared to state-of-the-art mBERT and other practices. In addition, we tested the performance of FinBERT compared to fastText as embedding, which employed with Convolution Neural Network (CNN). Our results showed that FinBERT yields a 91.7% accuracy and 90.8% F1 score value, which outperforms all state-of-art models, including multilingual-BERT and CNN.

see all

ISBN: 979-10-95546-72-6
Pages: 876 - 882
Host publication: Language Resources and Evaluation Conference, LREC 2022, 20-25 June 2022, Palais du Pharo, Marseille, France : conference proceedings
Host publication editor: Calzolari, Nicoletta
Béchet, Frédéric
Blache, Philippe
Choukri, Khalid
Cieri, Christopher
Declerck, Thierry
Goggi, Sara
Isahara, Hitoshi
Maegaard, Bente
Mariani, Joseph
Mazo, Hélène
Odijk, Jan
Piperidis, Stelios
Conference: Language Resources and Evaluation Conference, LREC 2022
Type of Publication: B3 Article in conference proceedings
Field of Science: 113 Computer and information sciences
Subjects:
Funding: This work was partially supported by EU Project YougRes on youth polarization & radicalization (ID: 823701) and COST Action NexusLinguarum – ”European network for Web-centered linguistic data science” (CA18209), which are gratefully acknowledged.
Copyright information: © European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0
  https://creativecommons.org/licenses/by-nc/4.0/