A Simple confidence testing format

This paper presents the development of scoring functions for use in conjunction with standard multiple-choice items. In addition to the usual indication of the correct alternative, the examinee is to indicate his or her personal probability of the correctness of his or her response. Both linear and quadratic polynomial scoring functions are examined for suitability, and a unique scoring function is found such that a score of zero is assigned when complete uncertainty is indicated and such that the examinee can expect to do best if he or she reports his or her personal probability accurately. A table of simple integer approximations to the scoring function is supplied.