Melola Discovery

← Melola Discovery

Journal No SINTA rank

A comparability study of handwritten versus typed responses in high-stakes English language writing tests

ELT Forum: Journal of English Language Teaching · Vol. 12 No. 1 (2023) · pp. 36–43

DOI
10.15294/elt.v12i1.66354
ISSN
2721-4532, 2252-6706
Published
2023-03-31
Publisher
English Department, Faculty of Languages and Arts, Universitas Negeri Semarang
Language
eng

Abstract

This paper investigates fairness in writing test scores in terms of candidates who completed a writing test either by hand or typed, on a computer. The data for this large-scale comparability study comprise candidates taking English language writing tests at four CEFR levels – B1 to C2 in the period 2019–2022. The data were analysed via effect size differences and equivalence tests. Measured by effect size, a small amount of difference was apparent in scores obtained between the two production modes at B1, B2 and C1 levels. At C2 level, there was a medium effect size, indicative of a difference in favour of computer-produced scripts. Differences observed on equivalence tests – an adaptation of the standard t-test – were not found to be statistically significant. The contribution of the research to knowledge lies in the fact that (with the exception of C2 level) – whether writing tests are written by hand or on computer, while there is a slight skew towards higher scores with computer-processed texts, candidates generally receive similar scores in both modes. Practically, candidates may elect to write either on paper or on computer without fear of bias.

Collaboration network of the authors

3 authors · 3 co-authorship links

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/sju/index.php/elt/oai, first harvested 5 Nov 2026, last seen 8 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">A comparability study of handwritten versus typed responses in high-stakes English language writing tests</dc:title>
	<dc:creator>Stoukou, Irene</dc:creator>
	<dc:creator>Papargyris, Yiannis</dc:creator>
	<dc:creator>Coniam, David</dc:creator>
	<dc:description xml:lang="en-US">This paper investigates fairness in writing test scores in terms of candidates who completed a writing test either by hand or typed, on a computer. The data for this large-scale comparability study comprise candidates taking English language writing tests at four CEFR levels – B1 to C2 in the period 2019–2022. The data were analysed via effect size differences and equivalence tests. Measured by effect size, a small amount of difference was apparent in scores obtained between the two production modes at B1, B2 and C1 levels. At C2 level, there was a medium effect size, indicative of a difference in favour of computer-produced scripts. Differences observed on equivalence tests – an adaptation of the standard t-test – were not found to be statistically significant. The contribution of the research to knowledge lies in the fact that (with the exception of C2 level) – whether writing tests are written by hand or on computer, while there is a slight skew towards higher scores with computer-processed texts, candidates generally receive similar scores in both modes. Practically, candidates may elect to write either on paper or on computer without fear of bias.</dc:description>
	<dc:publisher xml:lang="en-US">English Department, Faculty of Languages and Arts, Universitas Negeri Semarang</dc:publisher>
	<dc:date>2023-03-31</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/sju/elt/article/view/66354</dc:identifier>
	<dc:identifier>10.15294/elt.v12i1.66354</dc:identifier>
	<dc:source xml:lang="en-US">ELT Forum: Journal of English Language Teaching; Vol 12 No 1 (2023): ELT Forum: Journal of English Language Teaching; 36-43</dc:source>
	<dc:source>2721-4532</dc:source>
	<dc:source>2252-6706</dc:source>
	<dc:source>10.15294/elt.v12i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/sju/elt/article/view/66354/24007</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2023 David Coniam</dc:rights>
</oai_dc:dc>