Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

CodeBERT-SENet: Adaptive Syntax-Semantic Fusion via Gated Attention for Python Bug Detection and Localization

CommIT (Communication and Information Technology) Journal · Vol. 20 No. 2 (2026) · hlm. 247–262

DOI
10.21512/commit.v20i2.14377
ISSN
2460-7010, 1979-2484
Terbit
2026-07-29
Penerbit
Bina Nusantara University
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Syntax error detection is a critical step in software development to ensure code quality and reliability. The research proposes the first end-to-end multitask architecture that jointly detects Python syntax errors and localizes their exact line position by adaptively fusing CodeBERT’s semantic embeddings with handcrafted syntactic features via a lightweight gating mechanism, without relying on Abstract Syntax Trees (AST). The model is trained and evaluated on a structured Python code dataset (testing set: 342 files, 30% of total data) using consistent data splits and standardized evaluation metrics. The results demonstrate that CodeBERT-SENet achieves state-of-the-art performance with 99.71% accuracy, an F1-score of 0.9969, and a Mean Absolute Error (MAE) of 0.1157 in line-level error prediction, outperforming all baselines, including Vanilla CodeBERT, GraphCodeBERT, RoBERTa, Random Forest, and the rule-based approach. The confusion matrix confirms zero false negatives (all 160 buggy files detected) and only one false positive (181 non-bugged files, 180 correctly identified). Training converges stably within five epochs without signs of overfitting, underscoring the effectiveness of the architectural design and optimization strategy. However, limitations remain, including high inference latency (six seconds per file), lack of deep structural code representation (e.g., AST), regression-based line prediction instead of classification, and unverified generalization on real-world production code. Nevertheless, CodeBERTSENet conclusively demonstrates that adaptive fusion of semantic and syntactic features significantly enhances code diagnostic capability. Future research will focus on optimizing inference speed, integrating AST-based representations, and transitioning to per-line classification, transforming CodeBERT-SENet from a mere bug detector into a next-generation, context-aware code diagnostic assistant.

Kata kunci

Jaringan kolaborasi para penulis

15 penulis · 38 tautan kepenulisan bersama · 11 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • University of Mataram
  • Institut Pemerintahan Dalam Negeri
  • Binus University
  • Universitas Banten
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Selamet RiadiUniversity of Mataram2
Zumratul MuahidinUniversity of Mataram2
Surni ErniwatiUniversity of Mataram2
Wenty Ayu WahyuniUniversity of Mataram2
Suharjito SuharjitoBinus University1
Abba Suganda GirsangBinus University1
Muhammad Rijal AlfianUniversity of Mataram1
Lalu Delsi SamsumarUniversity of Mataram1
Ahmad SubkiUniversity of Mataram1
Zaeniah ZaeniahUniversity of Mataram1
Salman SalmanUniversity of Mataram1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.binus.ac.id/index.php/commit/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">CodeBERT-SENet: Adaptive Syntax-Semantic Fusion via Gated Attention for Python Bug Detection and Localization</dc:title>
	<dc:creator>Ilham, Rozali</dc:creator>
	<dc:creator>Imran, Bahtiar</dc:creator>
	<dc:creator>Basri, Hasan</dc:creator>
	<dc:creator>Wahyudi, Erfan</dc:creator>
	<dc:subject xml:lang="en-US">CodeBERT-SENet</dc:subject>
	<dc:subject xml:lang="en-US">Syntax Error Detection</dc:subject>
	<dc:subject xml:lang="en-US">Adaptive Gating</dc:subject>
	<dc:subject xml:lang="en-US">Multi-Task Learning</dc:subject>
	<dc:description xml:lang="en-US">Syntax error detection is a critical step in software development to ensure code quality and reliability. The research proposes the first end-to-end multitask architecture that jointly detects Python syntax errors and localizes their exact line position by adaptively fusing CodeBERT’s semantic embeddings with handcrafted syntactic features via a lightweight gating mechanism, without relying on Abstract Syntax Trees (AST). The model is trained and evaluated on a structured Python code dataset (testing set: 342 files, 30% of total data) using consistent data splits and standardized evaluation metrics. The results demonstrate that CodeBERT-SENet achieves state-of-the-art performance with 99.71% accuracy, an F1-score of 0.9969, and a Mean Absolute Error (MAE) of 0.1157 in line-level error prediction, outperforming all baselines, including Vanilla CodeBERT, GraphCodeBERT, RoBERTa, Random Forest, and the rule-based approach. The confusion matrix confirms zero false negatives (all 160 buggy files detected) and only one false positive (181 non-bugged files, 180 correctly identified). Training converges stably within five epochs without signs of overfitting, underscoring the effectiveness of the architectural design and optimization strategy. However, limitations remain, including high inference latency (six seconds per file), lack of deep structural code representation (e.g., AST), regression-based line prediction instead of classification, and unverified generalization on real-world production code. Nevertheless, CodeBERTSENet conclusively demonstrates that adaptive fusion of semantic and syntactic features significantly enhances code diagnostic capability. Future research will focus on optimizing inference speed, integrating AST-based representations, and transitioning to per-line classification, transforming CodeBERT-SENet from a mere bug detector into a next-generation, context-aware code diagnostic assistant.
</dc:description>
	<dc:publisher xml:lang="en-US">Bina Nusantara University</dc:publisher>
	<dc:date>2026-07-29</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.binus.ac.id/index.php/commit/article/view/14377</dc:identifier>
	<dc:identifier>10.21512/commit.v20i2.14377</dc:identifier>
	<dc:source xml:lang="en-US">CommIT (Communication and Information Technology) Journal; Vol. 20 No. 2 (2026): CommIT Journal ; 247-262</dc:source>
	<dc:source>2460-7010</dc:source>
	<dc:source>1979-2484</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.binus.ac.id/index.php/commit/article/view/14377/5809</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2026 Rozali Ilham, Bahtiar Imran, Hasan Basri, Erfan Wahyudi</dc:rights>
	<dc:rights xml:lang="en-US">https://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>