Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

A Hybrid Transformer-MLP Approach for Short-Term Electric Load Forecasting

Journal of Robotics and Control (JRC) · Vol. 6 No. 4 (2025) · hlm. 2033–2044

DOI
10.18196/jrc.v6i4.26960
ISSN
2715-5072, 2715-5056
Terbit
2025-08-02
Penerbit
Universitas Muhammadiyah Yogyakarta
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Short-term electric load forecasting plays a vital role in ensuring the stability and efficiency of smart grid operations. However, accurately predicting demand remains challenging due to nonlinearity, volatility, and long-term temporal dependencies in consumption patterns. The research proposes a lightweight hybrid deep learning model that integrates a Transformer encoder with a multi-layer perceptron (MLP) to enhance prediction accuracy and robustness for short-term load forecasting. The proposed model employs a Transformer to extract long-range temporal features through self-attention mechanisms, while the MLP captures complex nonlinear mappings at the output stage. A real-world electricity load dataset collected from three Australian states (NSW, QLD, VIC) between 2009 and 2014 is used for evaluation. To assess model performance, mean absolute percentage error (MAPE), mean squared error (MSE), and Root Mean Squared Error (RMSE) are used. Experimental results demonstrate that the proposed transformer-MLP model consistently achieves the lowest forecasting error across all regions. MAPE ranges from 0.69% to 0.95%, outperforming standard deep learning models, including LSTM, CNN, and MLP. Despite its shallow architecture and reduced computational complexity, the hybrid model effectively captures both temporal dependencies and nonlinear variations. This study provides a practical, deployable forecasting solution for smart grids. Future work will extend the model to multi-step forecasting, incorporate exogenous variables such as weather and calendar effects, and explore deeper Transformer variants further to enhance prediction accuracy and generalization across diverse load conditions.

Kata kunci

Jaringan kolaborasi para penulis

3 penulis · 2 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Industrial University of Ho Chi Minh City
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Chi Kien HaIndustrial University of Ho Chi Minh City3

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.umy.ac.id/index.php/jrc/oai, pertama di-harvest 9 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">A Hybrid Transformer-MLP Approach for Short-Term Electric Load Forecasting</dc:title>
	<dc:creator>Nguyen, Tuan Anh</dc:creator>
	<dc:creator>Tran, Thanh Ngoc</dc:creator>
	<dc:subject xml:lang="en-US">Short-Term Load Forecasting</dc:subject>
	<dc:subject xml:lang="en-US">Hybrid Deep Learning Model</dc:subject>
	<dc:subject xml:lang="en-US">Transformer</dc:subject>
	<dc:subject xml:lang="en-US">MLP</dc:subject>
	<dc:description xml:lang="en-US">Short-term electric load forecasting plays a vital role in ensuring the stability and efficiency of smart grid operations. However, accurately predicting demand remains challenging due to nonlinearity, volatility, and long-term temporal dependencies in consumption patterns. The research proposes a lightweight hybrid deep learning model that integrates a Transformer encoder with a multi-layer perceptron (MLP) to enhance prediction accuracy and robustness for short-term load forecasting. The proposed model employs a Transformer to extract long-range temporal features through self-attention mechanisms, while the MLP captures complex nonlinear mappings at the output stage. A real-world electricity load dataset collected from three Australian states (NSW, QLD, VIC) between 2009 and 2014 is used for evaluation. To assess model performance, mean absolute percentage error (MAPE), mean squared error (MSE), and Root Mean Squared Error (RMSE) are used. Experimental results demonstrate that the proposed transformer-MLP model consistently achieves the lowest forecasting error across all regions. MAPE ranges from 0.69% to 0.95%, outperforming standard deep learning models, including LSTM, CNN, and MLP. Despite its shallow architecture and reduced computational complexity, the hybrid model effectively captures both temporal dependencies and nonlinear variations. This study provides a practical, deployable forecasting solution for smart grids. Future work will extend the model to multi-step forecasting, incorporate exogenous variables such as weather and calendar effects, and explore deeper Transformer variants further to enhance prediction accuracy and generalization across diverse load conditions.</dc:description>
	<dc:publisher xml:lang="en-US">Universitas Muhammadiyah Yogyakarta</dc:publisher>
	<dc:date>2025-08-02</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.umy.ac.id/index.php/jrc/article/view/26960</dc:identifier>
	<dc:identifier>10.18196/jrc.v6i4.26960</dc:identifier>
	<dc:source xml:lang="en-US">Journal of Robotics and Control (JRC); Vol. 6 No. 4 (2025); 2033-2044</dc:source>
	<dc:source>2715-5072</dc:source>
	<dc:source>2715-5056</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.umy.ac.id/index.php/jrc/article/view/26960/11772</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2025 Tuan Anh Nguyen, Thanh Ngoc Tran</dc:rights>
	<dc:rights xml:lang="en-US">https://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>