• Device Comparability

    Using digital devices and technology to conduct high stakes assessments in educational and workplace settings has become more prevalent in recent times. While desktops were once the most commonly used devices for online tests, the administration of these tests using mobile devices such as tablets and smartphones has increased significantly in recent times with such growth likely to continue. However, possible differences in performance due to the use of different devices for the same Technology Based Assessment (TBA) has received little emphasis in research. Devices with different screen sizes or input mechanisms can cause significant variations in test-taker experience which could impact on performance. Therefore, the comparability of scores produced by students taking the same TBA on different devices requires immediate attention from the testing community (DePascale et al., 2016). The question of device comparability is relevant to the larger measurement issues of validity, test standardisation and how valid inferences about achievement should be made when test variations are present. This presentation will provide an overview of current research in the area of device comparability drawing on findings from peer-reviewed academic journals within the realm of education and industrial ergonomics alongside the grey literature of unpublished manuscripts and technical reports from testing organisations. Implications for test developers and researchers will also be explored.

  • Share