Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Leveraging multimodal deep learning for natural disaster event classification and its damage severity analysis through social media posts

IAES International Journal of Artificial Intelligence · Vol. 13 No. 4 (2024) · hlm. 4766–4777

DOI
10.11591/ijai.v13.i4.pp4766-4777
ISSN
2252-8938, 2089-4872
Terbit
2024-12-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Accurate and timely information is essential for coordinating an effective disaster response. Traditional methods have struggled to efficiently categorize disaster events and assess damage severity due to the variety and complexity of data sources. Previous research has focused on specific tasks, such as information gathering or humanitarian assistance, but has not adequately addressed the assessment of disaster damage severity. This paper proposes a hybrid learning model to improve disaster event classification and damage severity identification. The model combines image and text data in a cooperative way, using ResNet50 to extract features from images and a LSTM with attention mechanism to learn sequences from text. This combination allows for a more contextual and informative representation of the input data. Compared to existing approaches, the proposed multimodal approach achieves significantly better results in disaster event classification. Apart from the proposed model also shows promising outcome for damage severity of disaster. These advancements are especially important for real-world applications such as disaster management and response coordination, where accuracy and reliability are essential. The comprehensive methodology and empirical results presented in this paper demonstrate the effectiveness and potential of using hybrid learning models to leverage multimodal data for unique and sophisticated analytical tasks in disaster scenarios

Kata kunci

Jaringan kolaborasi para penulis

3 penulis · 3 tautan kepenulisan bersama · 3 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • PES University
  • KLE Academy of Higher Education and Research
  • University of Engineering & Management
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Leveraging multimodal deep learning for natural disaster event classification and its damage severity analysis through social media posts</dc:title>
	<dc:creator>Kasturi, Nivedita</dc:creator>
	<dc:creator>Guruputra Totad, Shashikumar</dc:creator>
	<dc:creator>Ghosh, Goldina</dc:creator>
	<dc:subject xml:lang="en-US">DEEP LEARNING</dc:subject>
	<dc:subject xml:lang="en-US">Damage severity identification; Disaster event classification; Hybrid deep learning; Multi-modality analytics; Social media posts</dc:subject>
	<dc:description xml:lang="en-US">Accurate and timely information is essential for coordinating an effective disaster response. Traditional methods have struggled to efficiently categorize disaster events and assess damage severity due to the variety and complexity of data sources. Previous research has focused on specific tasks, such as information gathering or humanitarian assistance, but has not adequately addressed the assessment of disaster damage severity. This paper proposes a hybrid learning model to improve disaster event classification and damage severity identification. The model combines image and text data in a cooperative way, using ResNet50 to extract features from images and a LSTM with attention mechanism to learn sequences from text. This combination allows for a more contextual and informative representation of the input data. Compared to existing approaches, the proposed multimodal approach achieves significantly better results in disaster event classification. Apart from the proposed model also shows promising outcome for damage severity of disaster. These advancements are especially important for real-world applications such as disaster management and response coordination, where accuracy and reliability are essential. The comprehensive methodology and empirical results presented in this paper demonstrate the effectiveness and potential of using hybrid learning models to leverage multimodal data for unique and sophisticated analytical tasks in disaster scenarios</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2024-12-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/24433</dc:identifier>
	<dc:identifier>10.11591/ijai.v13.i4.pp4766-4777</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 13, No 4: December 2024; 4766-4777</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v13.i4</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/24433/14306</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2024 Institute of Advanced Engineering and Science</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>