Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 2

The Effect of Gemini AI-enhanced E-portfolios on Students’ Speaking Performance: A Quantitative Analysis in ESP Context

Journal of Applied Studies in Language · Vol. 10 No. 1 (2026) · hlm. 16–25

DOI
10.31940/jasl.v10i1.16-25
ISSN
2615-4706, 2598-4101
Terbit
2026-06-29
Penerbit
Politeknik Negeri Bali
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

This study investigates the quantitative impact of Gemini AI-enhanced e-portfolio assessment on English speaking performance among ESP students in a vocational education context. Despite the growing integration of artificial intelligence in language education, empirical evidence examining the effectiveness of multimodal AI systems on speaking skill development remains limited, particularly within ESP contexts where students require targeted professional language competencies. Using a one-group pretest-posttest design, 30 second-semester International Business Management students at Politeknik Negeri Bali participated in a 14-week intervention utilizing Gemini AI-integrated e-portfolio assessment. Speaking performance was measured through comprehensive assessments based on the Complexity, Accuracy, and Fluency (CAF) framework, incorporating formal business presentations and structured role-play negotiation scenarios representative of authentic professional discourse demands. Results from paired samples t-test analysis revealed statistically significant improvements following the intervention (t (29) = 15.847, p < 0.001, Cohen's d = 2.89), with mean speaking scores increasing substantially from 62.45 (SD = 8.23) to 78.67 (SD = 6.45). Component-level analysis demonstrated differential yet consistently strong effects across all CAF dimensions: fluency (d = 2.52), complexity (d = 2.27), and accuracy (d = 1.87). The very large effect sizes indicate substantial practical significance, exceeding effect sizes reported in previous technology-enhanced speaking interventions by factors of four to eight. These findings contribute critical empirical evidence supporting AI integration in vocational language education and suggest that Gemini AI-enhanced e-portfolio assessment represents a paradigm shift in ESP pedagogy, with important implications for curriculum redesign and institutional technology adoption decisions in professional preparation programs.

Kata kunci

Jaringan kolaborasi para penulis

40 penulis · 98 tautan kepenulisan bersama · 43 lintas organisasi · menampilkan 40 yang paling banyak terhubung

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universitas Pendidikan Ganesha
  • Politeknik Negeri Bali
  • Universitas Muhammadiyah Kalimantan Timur
  • Samudra University
  • Windesheim University of Applied Sciences
  • State University of Jakarta
  • Universitas Negeri Padang
  • Organisasi lain
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Gary P. BoyceWindesheim University of Applied Sciences3
Dzul RachmanUniversitas Muhammadiyah Kalimantan Timur2
I Wayan Eka Dian RahmanuPoliteknik Negeri Bali2
Ilza MayuniState University of Jakarta1
Tara Mustikaning PalupiState University of Jakarta1
Muhammad ZaimUniversitas Negeri Padang1
Nurhasanah HalimUniversitas Bina Sarana Informatika1
Yinghuei ChenAsia University1
Fadlia FadliaSamudra University1
Surya AsraSamudra University1
Evi ZulidaSamudra University1
Gusti Nyoman Ayu SukertiPoliteknik Negeri Bali1
Luh Nyoman Chandra HandayaniPoliteknik Negeri Bali1
Ni Luh Diah Surya AdnyaniUniversitas Pendidikan Ganesha1
Gusti Ayu Putu TaharyantiUniversitas Pendidikan Ganesha1
Ni Wayan Surya MahayantiUniversitas Pendidikan Ganesha1
Rio Arif PratamaUniversitas Muhammadiyah Kalimantan Timur1
Ni Komang Arie SuwastiniUniversitas Pendidikan Ganesha1
Yogi SetyawanUniversitas Pendidikan Ganesha1
Khusnul KhatimahUniversitas Muhammadiyah Kalimantan Timur1
Marianus RoniWestern Michigan University1
Putu Ayu Prabawati SudanaAfiliasi tidak diketahui1
Ni Nyoman PadmadewiAfiliasi tidak diketahui1
Ni Luh Putu Sri AdnyaniAfiliasi tidak diketahui1
Ni Nyoman YuliantiniPoliteknik Negeri Bali1
Ni Ketut SucianiPoliteknik Negeri Bali1
I Putu Yoga PurandinaUniversitas Pendidikan Ganesha1
I Gusti Putu SutarmaPoliteknik Negeri Bali1
Ida Bagus Artha AdnyanaPoliteknik Negeri Bali1
Ni Putu SomawatiPoliteknik Negeri Bali1
I Made Riyan Adi NugrohoPoliteknik Negeri Bali1
I Nyoman Adi Jaya PutraUniversitas Pendidikan Ganesha1
Luh Gede Eka WahyuniUniversitas Pendidikan Ganesha1
Putu Kerti NitiasihUniversitas Pendidikan Ganesha1
Ni Putu Agustina Konita DewiAfiliasi tidak diketahui1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://ojs2.pnb.ac.id/index.php/JASL/oai, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">The Effect of Gemini AI-enhanced E-portfolios on Students’ Speaking Performance: A Quantitative Analysis in ESP Context</dc:title>
	<dc:creator>I Putu Yoga Laksana</dc:creator>
	<dc:creator>Ni Made Ratminingsih</dc:creator>
	<dc:creator>Made Hery Santosa</dc:creator>
	<dc:creator>I Putu Indra Kusuma</dc:creator>
	<dc:creator>Thijs Hemmer</dc:creator>
	<dc:subject xml:lang="en-US">CAF framework </dc:subject>
	<dc:subject xml:lang="en-US">E-portfolio assessment</dc:subject>
	<dc:subject xml:lang="en-US">English for Specific Purposes</dc:subject>
	<dc:subject xml:lang="en-US">Gemini AI</dc:subject>
	<dc:subject xml:lang="en-US">speaking performance</dc:subject>
	<dc:subject xml:lang="en-US">vocational education</dc:subject>
	<dc:description xml:lang="en-US">This study investigates the quantitative impact of Gemini AI-enhanced e-portfolio assessment on English speaking performance among ESP students in a vocational education context. Despite the growing integration of artificial intelligence in language education, empirical evidence examining the effectiveness of multimodal AI systems on speaking skill development remains limited, particularly within ESP contexts where students require targeted professional language competencies. Using a one-group pretest-posttest design, 30 second-semester International Business Management students at Politeknik Negeri Bali participated in a 14-week intervention utilizing Gemini AI-integrated e-portfolio assessment. Speaking performance was measured through comprehensive assessments based on the Complexity, Accuracy, and Fluency (CAF) framework, incorporating formal business presentations and structured role-play negotiation scenarios representative of authentic professional discourse demands. Results from paired samples t-test analysis revealed statistically significant improvements following the intervention (t (29) = 15.847, p &amp;lt; 0.001, Cohen's d = 2.89), with mean speaking scores increasing substantially from 62.45 (SD = 8.23) to 78.67 (SD = 6.45). Component-level analysis demonstrated differential yet consistently strong effects across all CAF dimensions: fluency (d = 2.52), complexity (d = 2.27), and accuracy (d = 1.87). The very large effect sizes indicate substantial practical significance, exceeding effect sizes reported in previous technology-enhanced speaking interventions by factors of four to eight. These findings contribute critical empirical evidence supporting AI integration in vocational language education and suggest that Gemini AI-enhanced e-portfolio assessment represents a paradigm shift in ESP pedagogy, with important implications for curriculum redesign and institutional technology adoption decisions in professional preparation programs.
 </dc:description>
	<dc:publisher xml:lang="en-US">Politeknik Negeri Bali</dc:publisher>
	<dc:date>2026-06-29</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ojs2.pnb.ac.id/index.php/JASL/article/view/3145</dc:identifier>
	<dc:identifier>10.31940/jasl.v10i1.16-25</dc:identifier>
	<dc:source xml:lang="en-US">Journal of Applied Studies in Language ; Vol. 10 No. 1 (2026): June 2026 ; 16-25</dc:source>
	<dc:source>2615-4706</dc:source>
	<dc:source>2598-4101</dc:source>
	<dc:source>10.31940/jasl.v10i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ojs2.pnb.ac.id/index.php/JASL/article/view/3145/1515</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2026 I Putu Yoga Laksana, Ni Made Ratminingsih, Made Hery Santosa, I Putu Indra Kusuma, Thijs Hemmer</dc:rights>
	<dc:rights xml:lang="en-US">https://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>