Bennett, R. E., Braswell, J., Oranje, A., Sandene, B., Kaplan, B., & Yan, F. (2008). Does it matter if I take my mathematics test on computer? A second empirical study of mode effects in NAEP . The Journal of Technology, Learning, and Assessment , 6 (9). http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1639/1472

Journal Article

Bennett, R. E., Braswell, J., Oranje, A., Sandene, B., Kaplan, B., & Yan, F. (2008). Does it matter if I take my mathematics test on computer? A second empirical study of mode effects in NAEP. The Journal of Technology, Learning, and Assessment, 6(9). http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1639/1472

Notes

[no doi located]; Also downloadable from ERIC online database: https://eric.ed.gov/?id=EJ838621

Tags

Electronic administration; Electronic administration; Electronic administration; K-12; Math; Middle school; No disability; U.S. context

URL

http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1639/1472

Summary

Accommodation

This study investigated the comparability of scores from paper- and computer-based tests.

Participants

A nationally representative (U.S.) sample of eighth-grade students; 1,072 in the online test, and 954 in the paper-and-pencil sample. Disability status, and specific disabilities, were not reported.

Dependent Variable

Participants were administered a computer-based mathematics test, a paper-and-pencil test, and a test of computer facility, among other measures.

Findings

Results showed that the computer-based mathematics test was significantly harder statistically than the paper-based test. In addition, computer facility predicted online mathematics test performance after controlling for performance on a paper-based mathematics test, suggesting that degree of familiarity with computers may matter when taking a computer-based mathematics test in NAEP. Limitations of the study were reported, and future research possibilities were suggested.