Methods to control exposure rates in computerized adaptive tests

Authors

  • Javier Revuelta Universidad Autónoma de Madrid
  • Vicente Ponsoda Universidad Autónoma de Madrid
  • Julio Olea Universidad Autónoma de Madrid

DOI:

https://doi.org/10.7203/relieve.4.2.7210

Keywords:

computerized adaptive tests

Abstract

Three new item exposure control methods for computerized adaptive tests are introduced. The first one is based on maximum information, and adds a random component to the information provided by each item. The second one directly controls the exposure of each item, and applies only the items with and exposure lower than some arbitrary value. The third method is a mixture of the other two.
The three methods, plus maximum information and the Sympson and Hetter method, are compared in a simulation study, with respect to test precision and exposure rate. Finally, we comment some future research lines.

References

Baker, F. B. 1992. Item Response Theory, Pa-rameter Estimation Techniques. Marcel Dekker. New York.

Davey, T., & Parshall, C.G. 1995. New algorithms for item selection and exposure control with computerized adaptive testing. Annual meeting of the American Educational Re-search Association. San Francisco.

Hambleton, R.K., & Swaminathan, H. 1985. Item Response Theory. Principles and Appli-cations. Boston: Kluwer-Nijhoff Pub. http://dx.doi.org/10.1007/978-94-017-1988-9

Hulin, C.L., Drasgow, F., & Parsons, C.K. 1983. Item Response Theory: Applications to Psychological Measurement. Homewood, IL.: Dow Jones-Irwin.

Kingsbury, G.G., & Zara, A.R. 1984. Proce-dures for selecting items for computerized adaptive tests. Applied Measurement in Edu-cation. Nº 2. Págs. 359-375.

Lewis, M.J., Subhiyah, R.G., & Morrison, C.A. 1995. A comparison of classification agreement between adaptive and full-length tests under the 1-PL and 2-PL models. Annual meeting of the American Educational Re-search Association. San Francisco.

McBride, J.R., & Martin, J.T. 1983. Reliability and validity of adaptive ability tests in a mili-tary setting. In D.J. Weiss (Ed.) New Horizons in Testing. Págs. 223-236. New York: Academic Press.

Morrison, C., Subhiyah, R., & Nungester, R. 1995. Item exposure rates for unconstrained and content-balanced computerized adaptive tests. Annual Meeting of the American Educational Research Association. San Francisco.

Revuelta, J. 1995. El control de la exposición de los items en tests adaptativos informatiza-dos. Memoria de licenciatura. Universidad Autónoma de Madrid.

Revuelta, J., y Ponsoda, V. 1996. Metodos sencillos para el control de las tasas de exposi-cion en tests adaptativos informatizados. Psicológica, 17, 161-172.

Stocking, M. 1993. Controlling item exposure rates in a realistic daptive testing paradigm. Technical Report (RR 93-2). Princeton, NJ: Educational Testing Service.

Stocking, M, & Lewis, C. 1995. A New Method of Controlling Item Exposure in Computerized Adaptive Testing. Technical Report (RR-95-25). Princeton, NJ: Educational Testing Service.

Sympson, J.B., & Hetter, R.D. 1985. Control-ling item exposure rates in computerized adaptive testing. Proceedings of the 27th Annual Meeting of the Military Testing Association. San Diego, CA: Navy Personnel Research and Development Center.

Wainer, H. 1990. Computerized adaptive test-ing: a primer. Hillsdale, New Jersey: LEA.

Downloads

Issue

Vol. 4 No. 2 (1998)

Section

Research Articles

License

The authors grant non-exclusive rights of exploitation of works published to RELIEVE and consent to be distributed under the Creative Commons Attribution-Noncommercial Use 4.0 International License (CC-BY-NC 4.0), which allows third parties to use the published material whenever the authorship of the work and the source of publication is mentioned, and it is used for non-commercial purposes. 

    The authors can reach other additional and independent contractual agreements, for the non-exclusive distribution of the version of the work published in this journal (for example, by including it in an institutional repository or publishing it in a book), as long as it is clearly stated that the Original source of publication is this magazine.  

    Authors are encouraged to disseminate their work after it has been published, through the internet (for example, in institutional archives online or on its website) which can generate interesting exchanges and increase work appointments. 

   The fact of sending your paper to RELIEVE implies that you accept these conditions.