Retest on Online Test: How Stable and Reliable?

Abstract

The study aims to determine (1) the stability of online test scores if used repeatedly, (2) changes in reliability or internal consistency in online tests if used repeatedly, and (3) the effect of the number of test-takers and the number of online test items on the reliability of the online test. The research uses a quantitative approach in November 2020-January 2021, involving 134 students of the Muhammadiyah University of Palangka Raya who took four different subjects. The research procedure is (1) Arranging several test kits on various topics and the number of items, (2) Carrying out theoretical validity tests by asking for reviews from several relevant experts, (3) Assigning test subjects, (4) Carrying out online tests with techniques testretest. With this technique, a group of test-takers is given the same or unidimensional set of tests several times. The test contents' differences in the 1st, 2nd, and 3rd tests are only in the items' serial number. The period between implementing one test and another test is two weeks, (5) Analyzing the test results to see changes in the test's reliability on several repetitions. Data analysis is performed using ANATES software version 409/2004. The results showed (1) The online test score used for three repetitions is relatively stable. At the 5% significance level, there is a significant positive correlation between test scores on the 1st, 2nd, and 3rd repetitions. It proves that the test result score is stable between repetitions, (2) The reliability or internal consistency of online tests tends to show an increase if used repeatedly. The online test's reliability reached a sufficient number in the 3rd repetition, (3) Descriptively, the number of test items or the test's length affects the online test's reliability. The more the number of items, the higher the reliability of the online test. Also, the number of test-takers does not affect the reliability of online tests. The research implies that it is advisable to repeat the test-retest technique three times to obtain adequate online test results. Using unidimensional online test items and changing the test serial number is also recommended to reduce the carry-over effect.