Guido Makransky, and Cees. A. W. Glas, both of the University of Twente in the Netherlands, published “Unproctored Internet Test Verification: Using Adaptive Confirmation Testing” in the October 2011 issue of Organizational Research Methods. Other articles in this new issue can be found here.
The Abstract:
Unproctored Internet testing (UIT) is commonly used in employment test administration. When the test is high stakes, the International Guidelines on Computer-Based and Internet-Delivered Testing recommend to follow-up the results with a confirmation test in a controlled setting. This article proposes and compares two methods for detecting whether a test taker’s original UIT responses are consistent with the responses from a follow-up confirmation test. The first method is a fixed length adaptive confirmation test using the likelihood ratio (LR) test to evaluate cheating and the second method is a variable length adaptive confirmation test using an extension of the stochastic curtailed truncated sequential probability ratio test (SCTSPRT) to evaluate cheating. Simulation studies indicated that the adaptive confirmation test using the SCTSPRT was almost four times shorter while maintaining the same detection power. The study also demonstrated that cheating can have a detrimental effect on the validity of a selection procedure and illustrated that the use of a confirmation test can remedy the negative effect of cheating on validity.
To learn more about Organizational Research Methods, please click here.
If you would like to receive an email alert whenever a new article or issue becomes available, please follow this link.
