Are computer-based oral tests reliable and viable to test the speaking skill?

Abstract

The increasing importance of the Common European Framework of Reference for Languages (CEFR) as a universally recognized scale to measure language competences has brought with it the need to develop effective, reliable and standard methods of assessment and testing which do not place excessive strain on time and human resources. Given the large number of students enrolled on Spanish university language courses who need to be orally evaluated, this paper first analyzes the advantages and disadvantages of computer-based oral tests as a possible solution when assessing large groups of students as opposed to the face-to-face testing formats. In order to test the feasibility of computer-based oral tests, a perception study of the oral test, TOEFL iBT®, was carried out based on the performance and attitudes of forty-two Spanish university students. The results of this empirical study showed that, even though speededness, topic specificity, integrated skills, and the lack of interaction were the main challenges of this computer-based test format, there was a high degree of acceptance among informants. From these findings, we identified the strengths and weaknesses of the TOEFL iBT® to then propose a new computer-based test which overcomes many of the present drawbacks by incorporating the latest technologies such as gamification to assess English proficiency.