Computer-based testing can be administered through various modalities. In a series of studies, we investigated the following testing modalities:
- Unproctored sync: Exams are completed remotely, synchronously, during lecture, without any proctoring.
- BYOD (Bring-Your-Own-Device) in-person sync: Exams are completed in the classroom, synchronously, during lecture time, with staff proctoring by actively walking around the room to monitor students.
- BYOD Zoom sync: Exams are completed remotely with Zoom proctoring, synchronously, during lecture time. Staff proctor a Zoom meeting consisting of approximately 20-30 students.
- CBTF (Computer-Based Testing Facility) sync: Exams are completed at a secure testing center, synchronously, during lecture time. The facility includes firewall-protected computers, surveillance cameras, and trained proctors.
- CBTF async: Exams are completed at a secure testing center, asynchronously, over a flexible three-day window. The facility includes firewall-protected computers, surveillance cameras, and trained proctors.
We conducted randomized crossover experiments to compare pairs of testing modalities during different semesters (see the table below). For instance, in Fall 2023, we compared CBTF async versus BYOD in-person sync.
Impact on performance
One of our goals was to determine if certain testing modalities provided a performance advantage. In each crossover study, students were divided into two groups (A and B) and alternated between the two modalities across six quizzes in a semester. Each student completed three quizzes in one modality and three in the other. We used regression analyses to assess the impact of exam modality on performance. The results of these studies are summarized in the table below.
| Semester | Group A | Group B | Performance advantage |
|---|---|---|---|
| Sp 2019 | CBTF async | CBTF sync | Small but significant advantage for students who take asynchronous exams |
| Fa 2021 | BYOD Zoom sync | Unproctored sync | Signifcant advantage for students who take exams unproctored |
| Sp 2022 | BYOD Zoom sync | BYOD in-person sync | No signifcant advantage for either modality |
| Sp 2023 | CBTF async | BYOD Zoom sync | No signifcant advantage for either modality |
| Fa 2023 | CBTF async | BYOD in-person sync | No signifcant advantage for either modality |
Emeka C., West M., Zilles C., Silva M., “A comparison of proctoring regimens for computer-based Computer Science exams” Proceedings of the 2024 Innovation and Technology in Computer Science Education (ITiCSE 2024), 2024.
Gulati R., West M., Zilles C., Silva M., “Comparing the security of three proctoring regimens for Bring-Your-Own-Device exams”, Proceedings of the 54th ACM Technical Symposium on Computer Science Education (SIGCSE 2024), 2024.
Silva M., Zilles C., West M., “Measuring the score advantage on asynchronous exams in an undergraduate CS course”, Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE 2020), https://doi.org/10.1145/3328778.3366859, 2020.
Impact on test anxiety
In a follow-up study, we compared student self-reported test anxiety between two modalities: CBTF asyn BYOD in-person sync. We found no statistically significant differences between testing modes on students’ test anxiety. We did replicate prior findings showing positive correlations between trait anxiety and test anxiety and inverse correlations between test anxiety and exam score. From a test anxiety perspective, our findings indicate that either a CBTF or BYOD configuration for computerized exams is an acceptable means for addressing large classes and/or a desire to permit computational elements.
Grant: “Test anxiety in the CBTF”, Strategic Instructional Innovations Program (SIIP) at UIUC. Research team: Mariana Silva, Matthew West, Geoffrey Herman, Craig Zilles, Julie Baker, Dave Mussulman, Jim Sosnowski, 2023-2025.
Emeka C., Herman G., Sosnowski J., West M., Zilles C., Silva M., “Measuring test anxiety of two computerized exam approaches”, Proceedings of the 55th ACM Technical Symposium on Computer Science Education (SIGCSE 2025), 2025.