Using 'AI-based software like Proctorio and ProctorU' to monitor online exams is a really bad idea, says uni panel

Academics find algorithmic surveillance just isn't worth it


Updated A committee at the University of Texas in Austin has advised against using AI software to oversee students' online tests, citing the psychological toll on students and the financial toll on academic institutions.

Acknowledging that some form of online proctoring is necessary to discourage academic misconduct, the committee concluded, "we strongly recommend against the use of AI-based software like Proctorio and ProctorU."

The Report of the Academic Integrity Committee about Online Testing and Assessment, spotted by Megan Menchaca, education reporter for the Austin-American Statesman, is said to have been included in a university official's recent message to faculty.

AI-based software to watch over remote students as they take online tests – "academic surveillance software" to detractors – has flourished during the COVID-19 pandemic. Large numbers of students have been studying remotely and schools believe they need a way to prevent cheating.

But the software that's been deployed has been widely criticized by students and privacy advocates. The concern centers around the inability to audit the software source code and the possibility that these systems rely on flawed algorithms and biased or arbitrary signals to label students cheaters.

Critics also worry that the software can't account for varied student living conditions and is vulnerable to racial bias – eg, motion tracking that produces different results with different skin tones – and cognitive bias such as gaze tracking that flags ADHD behaviors as suspicious.

Such criticism last year led UC Berkeley [PDF] and Baruch College in New York to stop using remote proctoring products. In February, the University of Illinois at Urbana-Champaign said it will drop Proctorio after this summer due to "significant accessibility concerns."

When in doubt, sue

Amid this backlash, proctoring software maker Proctorio sued critics, alleging last year that Ian Linkletter, a learning technology specialist at the University of British Columbia (UBC) in Vancouver, Canada, violated US copyright law by linking to the company's publicly viewable videos. That case remains ongoing in Canada, and has forced Linkletter to appeal for funds to defend himself through the costly legal process.

Proctorio also last year filed a Digital Millennium Copyright Act (DMCA) takedown complaint against Miami University computer science student Erik Johnson seeking the removal of posts on Twitter that were critical of the company. Twitter removed the posts and later restored them.

The firm's legal crusade prompted pushback from the Electronic Frontier Foundation, which said the company should not be able "to abuse copyright law to undermine their critics."

The UT Austin committee began working on its report after student councils in the spring of 2021 asked the university to get rid of AI proctoring software, which was used widely during the 2020-2021 academic year.

The committee asked student leaders and faculty to provide information about how the software was employed and decided that it just wasn't worth it.

"The invasive nature of the tools as well as the warnings that the tools may send to the screen during the exam cause high levels of anxiety," the report says.

"Although these tools were used extensively by faculty in academic year 2020-2021, only 27 cases were referred to the Student Conduct and Academic Integrity office as potential violations of academic integrity, and of these only 13 were upheld. Thus, the psychological (and financial) costs of the tool do not seem to be worth the small benefit of using it."

Trust the teachers

The report goes on to suggest alternative methods of watching over students during tests, such as Zoom for small groups, and other academic software like Canvas Quizzes, Gradescope, and Panopto. It also recommends that instructors consider rethinking how they assess student progress in order to reduce online test anxiety.

The University of Texas at Austin, Proctorio, and ProctorU did not respond to requests for comment.

In an email to The Register, Linkletter – still awaiting a ruling on his effort to dismiss Proctorio's copyright complaint under Canada's anti-SLAPP statute, the Protection of Public Participation Act – said what stands out to him from the UT Austin report is the finding that Proctorio just isn't worth it.

"Every institution should be taking a hard look at whether Proctorio is worth the 'psychological cost' mentioned in the report, let alone the expense," he said.

"Over half of the 27 students accused had their academic integrity cases tossed. Thousands of students were surveilled, at great expense, for what? How much faculty and staff time was wasted? How much unnecessary heartbreak caused?

"Students understand that surveillance is wrong. They know how the technology works. There is no technical explanation that will reduce the harm being done – it simply needs to stop.

"The only way institutions can demonstrate they are listening to students is to stop using academic surveillance software." ®

Updated to add

In a statement emailed to The Register Jarrod Morgan, Chief Strategy Officer of Meazure Learning, the parent company of ProctorU, took issue with the UT report and said that his firm gave up on AI proctoring several months ago.

“After our decision and announcement earlier this year to discontinue all Al-only exam monitoring, every single exam from every single test-taker using ProctorU is reviewed by a trained, live proctor,” said Morgan.

“As ProctorU announced at the time, it’s only proctoring if a human does it and, more importantly, it’s the only way to be sure the process is accurate, fair and consistent. Some exam monitoring companies may rely on AI software to monitor exams and score students, ProctorU is not one of them and it is important to understand the differences between true proctoring with a trained live proctor and the less-expensive and in our opinion, unacceptable option of ‘monitoring’ software such as that offered by Proctorio.”

Broader topics


Other stories you might like

  • Will this be one of the world's first RISC-V laptops?
    A sneak peek at a notebook that could be revealed this year

    Pic As Apple and Qualcomm push for more Arm adoption in the notebook space, we have come across a photo of what could become one of the world's first laptops to use the open-source RISC-V instruction set architecture.

    In an interview with The Register, Calista Redmond, CEO of RISC-V International, signaled we will see a RISC-V laptop revealed sometime this year as the ISA's governing body works to garner more financial and development support from large companies.

    It turns out Philipp Tomsich, chair of RISC-V International's software committee, dangled a photo of what could likely be the laptop in question earlier this month in front of RISC-V Week attendees in Paris.

    Continue reading
  • Did ID.me hoodwink Americans with IRS facial-recognition tech, senators ask
    Biz tells us: Won't someone please think of the ... fraud we've stopped

    Democrat senators want the FTC to investigate "evidence of deceptive statements" made by ID.me regarding the facial-recognition technology it controversially built for Uncle Sam.

    ID.me made headlines this year when the IRS said US taxpayers would have to enroll in the startup's facial-recognition system to access their tax records in the future. After a public backlash, the IRS reconsidered its plans, and said taxpayers could choose non-biometric methods to verify their identity with the agency online.

    Just before the IRS controversy, ID.me said it uses one-to-one face comparisons. "Our one-to-one face match is comparable to taking a selfie to unlock a smartphone. ID.me does not use one-to-many facial recognition, which is more complex and problematic. Further, privacy is core to our mission and we do not sell the personal information of our users," it said in January.

    Continue reading
  • Meet Wizard Spider, the multimillion-dollar gang behind Conti, Ryuk malware
    Russia-linked crime-as-a-service crew is rich, professional – and investing in R&D

    Analysis Wizard Spider, the Russia-linked crew behind high-profile malware Conti, Ryuk and Trickbot, has grown over the past five years into a multimillion-dollar organization that has built a corporate-like operating model, a year-long study has found.

    In a technical report this week, the folks at Prodaft, which has been tracking the cybercrime gang since 2021, outlined its own findings on Wizard Spider, supplemented by info that leaked about the Conti operation in February after the crooks publicly sided with Russia during the illegal invasion of Ukraine.

    What Prodaft found was a gang sitting on assets worth hundreds of millions of dollars funneled from multiple sophisticated malware variants. Wizard Spider, we're told, runs as a business with a complex network of subgroups and teams that target specific types of software, and has associations with other well-known miscreants, including those behind REvil and Qbot (also known as Qakbot or Pinkslipbot).

    Continue reading

Biting the hand that feeds IT © 1998–2022