Russell, M., Kavanaugh, M., Masters, J., Higgins, J., & Hoffmann, T. (2009). Computer-based signing accommodations: Comparing a recorded human with an avatar . Journal of Applied Testing Technology , 10 (3). https://jattjournal.net/

[no doi located]

The accommodation examined was American Sign Language (ASL) administration delivered via computer, utilizing two NimbleTools products—signed administration by recorded human and by avatar.

A convenience sample of 96 students, ranging from grade 8 to grade 11, who communicated in American Sign Language (ASL) participated in the study. These students' schools were located in Massachusetts and Connecticut (U.S.), and included middle schools and high schools for students who were deaf or hard-of-hearing.

Student scores on two mathematics tests, matched for content and difficulty level, served as the dependent variable. The math tests using different accommodation versions were developed with grade 8 level National Assessment of Educational Progress-released items. Students also provided their views of the accommodation through completing a survey, and participating in focus groups, about their test-taking experience.

There were no significant differences in performance between the two versions of the ASL accommodation, even when examining participants' scores at varying performance levels. Also, about 2/3 of the participants indicated a preference for the human recording and the other 1/3 for the avatar. The students provided additional comments about aspects of each version of the ASL accommodation. Further, students expressed positive reactions to the computer-based delivery of the items and the accommodations. Additional analyses checking for correlations between survey responses and test performance indicated no patterns based on the version of the accommodation.