Akses terbuka Jurnal SINTA 1
WVisionBERT-VL: a multimodal model architecture for toxicity classification on social media platforms using large language models
IAES International Journal of Artificial Intelligence · Vol. 15 No. 4 (2026) · hlm. 3365–3375
- ISSN
- 2252-8938, 2089-4872
- Terbit
- 2026-08-01
- Penerbit
- Institute of Advanced Engineering and Science
- Bahasa
- eng
Abstrak
The increasing prevalence of toxic content on social media, conveyed through text, images, and videos, poses significant challenges for automated content moderation systems. Although prior studies have reported promising results in unimodal and bimodal settings, they often fail to capture implicit and contextual toxicity emerging from interactions across multiple modalities, particularly in non-English environments. This paper proposes WVisionBERT-VL, an end-to-end multimodal framework for toxicity detection that integrates text, image, and video modalities within a unified architecture. The proposed model incorporates modality-specific encoders, bidirectional multi-head cross attention (BMHCA) for cross-modal synchronization, and an adaptive fusion gate to dynamically balance modality contributions. A balanced multimodal dataset is constructed from social media platforms, including X, Instagram, and TikTok, and refined using a model-based labeling strategy with limited human-in-the-loop validation. Experimental results on a custom Indonesian dataset demonstrate strong in-domain performance, achieving an accuracy of 94.12%, a macro-F1 of 0.9407, and a receiver operating characteristic - area under the curve (ROC-AUC) of 0.9721, with robustness further validated through five-fold cross-validation. Cross-dataset evaluation highlights challenges related to domain shift, underscoring the need for future research on robust and domain-adaptive multimodal toxicity detection.
Kata kunci
Jaringan kolaborasi para penulis
30 penulis · 68 tautan kepenulisan bersama · 13 lintas organisasi
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- Gunadarma University
- Universitas Raharja
- Jamia Millia Islamia
- Saarland University
- Universitas Esa Unggul
- Afiliasi tidak diketahui
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Rina Refianti | Gunadarma University | 2 |
| Reni Diah Kusumawati | Afiliasi tidak diketahui | 1 |
| Irfan Humaini | Afiliasi tidak diketahui | 1 |
| Agung Wibowo | Gunadarma University | 1 |
| Himanshu Dutt | Jamia Millia Islamia | 1 |
| Radityo Hendratmojo Jati Notonegoro | Afiliasi tidak diketahui | 1 |
| Dewi Agushinta Rahayu | Afiliasi tidak diketahui | 1 |
| Rifki Kosasih | Afiliasi tidak diketahui | 1 |
| Asep Juarna | Gunadarma University | 1 |
| Adang Suhendra | Gunadarma University | 1 |
| Tubagus Maulana Kusuma | Gunadarma University | 1 |
| Rifiana Arief | Gunadarma University | 1 |
| Hustinawaty Hustinawaty | Gunadarma University | 1 |
| Untung Rahardja | Universitas Raharja | 1 |
| Prihandoko Prihandoko | Gunadarma University | 1 |
| Nur Azizah | Universitas Raharja | 1 |
| Po Abas Sunarya | Universitas Raharja | 1 |
| Charlotte Pasha | Afiliasi tidak diketahui | 1 |
| I Made Wiryana | Gunadarma University | 1 |
| Souza Nurafrianto Windiartono Putra | Saarland University | 1 |
| Nuryani Nuryani | Afiliasi tidak diketahui | 1 |
| Detty Purnamasari | Gunadarma University | 1 |
| Riya Widayanti | Universitas Esa Unggul | 1 |
| Avinanta Tarigan | Gunadarma University | 1 |
| Dewi Agushinta R | Gunadarma University | 1 |
| Rifki Kosasih | Gunadarma University | 1 |
| Radityo Hendratmojo Jati Notonegoro | Gunadarma University | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.