Melola Discovery

← Melola Discovery

Open access Jurnal SINTA 2

Analisis Citra Fitur Wajah Untuk Deteksi Dini Depresi Dengan Teknik Hibrida Berdasarkan GabunganFitur Convolutional Neural Network (CNN)

Jurnal Teknologi Informasi dan Ilmu Komputer (JTIIK) · Vol. 13 No. 4 (2026) · pp. 841–848

DOI
10.25126/jtiik.134
ISSN
2528-6579, 2355-7699
Published
2026-08-29
Publisher
Fakultas Ilmu Komputer, Universitas Brawijaya
Language
id
License
creativecommons.org/licenses/by-sa/4.0

Abstract

Bahasa Indonesia

Depresi merupakan salah satu masalah kesehatan mental yang umum dan menjadi penyebab utama disabilitas di seluruh dunia. Deteksi dini sangat penting karena gejala awal sering tidak dikenali atau diabaikan. Penelitian ini mengusulkan sistem deteksi dini depresi berbasis kecerdasan buatan melalui analisis citra wajah menggunakan pendekatan hibrida Convolutional Neural Network (CNN). Data diperoleh dari rekaman wawancara klinis pasien dengan diagnosis depresi dan individu normal. Ekstraksi fitur dilakukan menggunakan tiga arsitektur CNN, yaitu VGG16, ResNet101V2, dan MobileNetV3, yang kemudian digabungkan untuk membentuk representasi fitur gabungan. Selanjutnya, algoritma Random Forest digunakan sebagai klasifikator. Hasil eksperimen menunjukkan bahwa kombinasi VGG16 dan MobileNetV3 memberikan performa terbaik dengan akurasi 94.55%, presisi 98.04%, dan spesifisitas 98.18%. Temuan ini menunjukkan bahwa pendekatan hibrida CNN dengan Random Forest berpotensi menjadi metode efektif untuk mendukung deteksi dini depresi berbasis citra wajah. Abstract Depression is a major mental health disorder and one of the leading causes of disability worldwide. Early detection is crucial since initial symptoms are often overlooked or unrecognized. This study proposes an artificial intelligence–based early detection system for depression through facial image analysis using a hybrid Convolutional Neural Network (CNN) approach. Facial data were obtained from clinical interview recordings of patients diagnosed with depression and healthy individuals. Feature extraction was carried out using three CNN architectures VGG16, ResNet101V2, and MobileNetV3 whose features were then combined into a joint representation. A Random Forest algorithm was employed for classification. Experimental results indicate that the hybrid model combining VGG16 and MobileNetV3 achieved the best performance, with 94.55% accuracy, 98.04% precision, and 98.18% specificity. These findings demonstrate that the proposed CNN Random Forest hybrid approach is a promising method for supporting early depression detection based on facial features.

English

Depresi merupakan salah satu masalah kesehatan mental yang umum dan menjadi penyebab utama disabilitas di seluruh dunia. Deteksi dini sangat penting karena gejala awal sering tidak dikenali atau diabaikan. Penelitian ini mengusulkan sistem deteksi dini depresi berbasis kecerdasan buatan melalui analisis citra wajah menggunakan pendekatan hibrida Convolutional Neural Network (CNN). Data diperoleh dari rekaman wawancara klinis pasien dengan diagnosis depresi dan individu normal. Ekstraksi fitur dilakukan menggunakan tiga arsitektur CNN, yaitu VGG16, ResNet101V2, dan MobileNetV3, yang kemudian digabungkan untuk membentuk representasi fitur gabungan. Selanjutnya, algoritma Random Forest digunakan sebagai klasifikator. Hasil eksperimen menunjukkan bahwa kombinasi VGG16 dan MobileNetV3 memberikan performa terbaik dengan akurasi 94.55%, presisi 98.04%, dan spesifisitas 98.18%. Temuan ini menunjukkan bahwa pendekatan hibrida CNN dengan Random Forest berpotensi menjadi metode efektif untuk mendukung deteksi dini depresi berbasis citra wajah. Abstract Depression is a major mental health disorder and one of the leading causes of disability worldwide. Early detection is crucial since initial symptoms are often overlooked or unrecognized. This study proposes an artificial intelligence–based early detection system for depression through facial image analysis using a hybrid Convolutional Neural Network (CNN) approach. Facial data were obtained from clinical interview recordings of patients diagnosed with depression and healthy individuals. Feature extraction was carried out using three CNN architectures VGG16, ResNet101V2, and MobileNetV3 whose features were then combined into a joint representation. A Random Forest algorithm was employed for classification. Experimental results indicate that the hybrid model combining VGG16 and MobileNetV3 achieved the best performance, with 94.55% accuracy, 98.04% precision, and 98.18% specificity. These findings demonstrate that the proposed CNN Random Forest hybrid approach is a promising method for supporting early depression detection based on facial features.

Keywords

Collaboration network of the authors

7 authors · 16 co-authorship links · 1 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • State University of Medan
  • Universitas Gadjah Mada
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Agus HarjokoUniversitas Gadjah Mada1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://jtiik.ub.ac.id/index.php/jtiik/en/oai, first harvested 27 Okt 2026, last seen 27 Okt 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="id">Analisis Citra Fitur Wajah Untuk Deteksi Dini Depresi  Dengan Teknik Hibrida Berdasarkan GabunganFitur Convolutional Neural Network (CNN)</dc:title>
	<dc:title xml:lang="en">Analisis Citra Fitur Wajah Untuk Deteksi Dini Depresi  Dengan Teknik Hibrida Berdasarkan GabunganFitur Convolutional Neural Network (CNN)</dc:title>
	<dc:creator xml:lang="en">Syahputra, Hermawan</dc:creator>
	<dc:creator xml:lang="en">Gultom, Syawal</dc:creator>
	<dc:creator xml:lang="en">Arnita</dc:creator>
	<dc:creator xml:lang="en">Kiswanto, Dedy</dc:creator>
	<dc:creator xml:lang="en">Batubara, Saatira Hilma</dc:creator>
	<dc:creator xml:lang="en">Manurung, Jeremia</dc:creator>
	<dc:creator xml:lang="id">Syahputra, Hermawan</dc:creator>
	<dc:creator xml:lang="id">Gultom, Syawal</dc:creator>
	<dc:creator xml:lang="id">Arnita</dc:creator>
	<dc:creator xml:lang="id">Kiswanto, Dedy</dc:creator>
	<dc:creator xml:lang="id">Batubara, Saatira Hilma</dc:creator>
	<dc:creator xml:lang="id">Manurung, Jeremia</dc:creator>
	<dc:subject xml:lang="en">Depression</dc:subject>
	<dc:subject xml:lang="en">Facial Expression</dc:subject>
	<dc:subject xml:lang="en">CNN</dc:subject>
	<dc:subject xml:lang="en">VGG16</dc:subject>
	<dc:subject xml:lang="en">ResNet101V2</dc:subject>
	<dc:subject xml:lang="en">MobileNetV3</dc:subject>
	<dc:subject xml:lang="en">Random Forest</dc:subject>
	<dc:subject xml:lang="id">Depresi</dc:subject>
	<dc:subject xml:lang="id">Ekspresi wajah</dc:subject>
	<dc:subject xml:lang="id">CNN</dc:subject>
	<dc:subject xml:lang="id">VGG16</dc:subject>
	<dc:subject xml:lang="id">ResNet101V2</dc:subject>
	<dc:subject xml:lang="id">MobileNetV3</dc:subject>
	<dc:subject xml:lang="id">Random Forest</dc:subject>
	<dc:description xml:lang="id">Depresi merupakan salah satu masalah kesehatan mental yang umum dan menjadi penyebab utama disabilitas di seluruh dunia. Deteksi dini sangat penting karena gejala awal sering tidak dikenali atau diabaikan. Penelitian ini mengusulkan sistem deteksi dini depresi berbasis kecerdasan buatan melalui analisis citra wajah menggunakan pendekatan hibrida Convolutional Neural Network (CNN). Data diperoleh dari rekaman wawancara klinis pasien dengan diagnosis depresi dan individu normal. Ekstraksi fitur dilakukan menggunakan tiga arsitektur CNN, yaitu VGG16, ResNet101V2, dan MobileNetV3, yang kemudian digabungkan untuk membentuk representasi fitur gabungan. Selanjutnya, algoritma Random Forest digunakan sebagai klasifikator. Hasil eksperimen menunjukkan bahwa kombinasi VGG16 dan MobileNetV3 memberikan performa terbaik dengan akurasi 94.55%, presisi 98.04%, dan spesifisitas 98.18%. Temuan ini menunjukkan bahwa pendekatan hibrida CNN dengan Random Forest berpotensi menjadi metode efektif untuk mendukung deteksi dini depresi berbasis citra wajah.
 
Abstract
Depression is a major mental health disorder and one of the leading causes of disability worldwide. Early detection is crucial since initial symptoms are often overlooked or unrecognized. This study proposes an artificial intelligence–based early detection system for depression through facial image analysis using a hybrid Convolutional Neural Network (CNN) approach. Facial data were obtained from clinical interview recordings of patients diagnosed with depression and healthy individuals. Feature extraction was carried out using three CNN architectures VGG16, ResNet101V2, and MobileNetV3 whose features were then combined into a joint representation. A Random Forest algorithm was employed for classification. Experimental results indicate that the hybrid model combining VGG16 and MobileNetV3 achieved the best performance, with 94.55% accuracy, 98.04% precision, and 98.18% specificity. These findings demonstrate that the proposed CNN Random Forest hybrid approach is a promising method for supporting early depression detection based on facial features.</dc:description>
	<dc:description xml:lang="en">Depresi merupakan salah satu masalah kesehatan mental yang umum dan menjadi penyebab utama disabilitas di seluruh dunia. Deteksi dini sangat penting karena gejala awal sering tidak dikenali atau diabaikan. Penelitian ini mengusulkan sistem deteksi dini depresi berbasis kecerdasan buatan melalui analisis citra wajah menggunakan pendekatan hibrida Convolutional Neural Network (CNN). Data diperoleh dari rekaman wawancara klinis pasien dengan diagnosis depresi dan individu normal. Ekstraksi fitur dilakukan menggunakan tiga arsitektur CNN, yaitu VGG16, ResNet101V2, dan MobileNetV3, yang kemudian digabungkan untuk membentuk representasi fitur gabungan. Selanjutnya, algoritma Random Forest digunakan sebagai klasifikator. Hasil eksperimen menunjukkan bahwa kombinasi VGG16 dan MobileNetV3 memberikan performa terbaik dengan akurasi 94.55%, presisi 98.04%, dan spesifisitas 98.18%. Temuan ini menunjukkan bahwa pendekatan hibrida CNN dengan Random Forest berpotensi menjadi metode efektif untuk mendukung deteksi dini depresi berbasis citra wajah.
 
Abstract
Depression is a major mental health disorder and one of the leading causes of disability worldwide. Early detection is crucial since initial symptoms are often overlooked or unrecognized. This study proposes an artificial intelligence–based early detection system for depression through facial image analysis using a hybrid Convolutional Neural Network (CNN) approach. Facial data were obtained from clinical interview recordings of patients diagnosed with depression and healthy individuals. Feature extraction was carried out using three CNN architectures VGG16, ResNet101V2, and MobileNetV3 whose features were then combined into a joint representation. A Random Forest algorithm was employed for classification. Experimental results indicate that the hybrid model combining VGG16 and MobileNetV3 achieved the best performance, with 94.55% accuracy, 98.04% precision, and 98.18% specificity. These findings demonstrate that the proposed CNN Random Forest hybrid approach is a promising method for supporting early depression detection based on facial features.</dc:description>
	<dc:publisher xml:lang="en">Fakultas Ilmu Komputer, Universitas Brawijaya</dc:publisher>
	<dc:date>2026-08-29</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://jtiik.ub.ac.id/index.php/jtiik/article/view/10807</dc:identifier>
	<dc:identifier>10.25126/jtiik.134</dc:identifier>
	<dc:source xml:lang="id">Jurnal Teknologi Informasi dan Ilmu Komputer; Vol 13 No 4: Agustus 2026; 841-848</dc:source>
	<dc:source xml:lang="en">Jurnal Teknologi Informasi dan Ilmu Komputer; Vol. 13 No. 4: Agustus 2026; 841-848</dc:source>
	<dc:source>2528-6579</dc:source>
	<dc:source>2355-7699</dc:source>
	<dc:source>10.25126/jtiik.134</dc:source>
	<dc:language>id</dc:language>
	<dc:relation>https://jtiik.ub.ac.id/index.php/jtiik/article/view/10807/1616</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2026 Hermawan Syahputra, Syawal Gultom, arnita, Dedy Kiswanto, Saatira Hilma Batubara, Jeremia Manurung</dc:rights>
	<dc:rights xml:lang="en">https://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>