Artificial intelligence for automatic moderation of textual content in online chats and social networks

Abstract

The article explores fundamental techniques for converting text into numerical data for machine learning algorithms. It meticulously examines various methods, including word vector representation via neural networks like Word2Vec, and explains the principles behind linear models such as logistic regression and support vector machines. Convolutional neural networks (CNN) and long short-term memory (LSTM) methods are also discussed, covering their components, mechanisms, and training processes. The research extends to developing and testing software for spam detection, hate speech identification, and recognizing offensive language. Using two datasets—one for labeled text messages and another for Twitter posts—the study analyzes data to address challenges like imbalanced data. A comparative analysis among linear models, deep neural networks, and single-layer models, using pre-trained bidirectional encoder representations from transformers (BERT) network, reveals promising results. The convolutional neural network stands out with a remarkable accuracy of 0.95. The study also adapts neural network architectures for hate speech and offensive language classification.