A mural in Cheltenham, possibly by Banksy,is built around a phone booth, the glass shattered. Three men–one on the left and two on the right of the booth–wear tan trench coats and sunglasses. They spy on the phone booth with microphones and recording devices.
Why am I so fervently opposed to proctoring of online exams?
Because no matter how you do it–remote recorded surveillance, remote live surveillance, passive monitoring of software, or active locking down of browsers–if you are doing it for students who have been forced to transition from F2F classes to remote ones, you are making a demand on their privacy that they did not agree to when they registered for class. As long as they are not freely able to say no to it–which they can’t as long as you are holding their ability to earn credit in the class–then they cannot consent and so should not be asked to do this.
They have no reason to trust us. Eight percent of institutions that use remote proctoring for online exams conducted no accessibility review of the product they chose before they implemented it according to a poll from EDUCAUSE. Another 28% say that the products they are using do not meet their own standards for accessibility.In other words, we haven’t done our work to ensure that these are good products, so we should not demand that students accept that they are.
Even in an online-by-design course, such monitoring isn’t useful or necessary. It’s not useful because passive software monitoring and active locking down of browsers doesn’t prevent students from opening a second device to search for answers. In other words, if you are wealthy enough to have both a laptop and a smartphone, you can still easily cheat. The other two kinds of monitoring–recorded and live proctoring–are more effective, but they raise significant privacy concerns. Unless you understand and can clearly explain to students who records, views, stores, and deletes their data, you should not require students to use them. You also need to be prepared for the many kinds of exceptions you will be asked to consider. Can you ensure that students’ right to wear religious head coverings will be protected? If you are teaching during a stay-at-home order, how will you ensure that the privacy of people who share a home with your students is protected? In that situation, what will your policy be for other people who enter the space? If a student is called away by a household member in need (like a child who needs a diaper change)? In a typical semester, you can require that students take their exams in quiet spaces, but you can’t require that during a stay-at-home order without discriminating based on household composition
In other words: avoid these.
I regularly receive email from teachers who insist that they cannot teach without proctored exams. I understand their difficulty. Many of us have long taught in fields where our traditional assessments have been exams measuring students’ ability to quickly recall precise information without referencing an outside test.
Inbuilding an online-by-design course, you have an opportunity to question whether this is the most effective way to validly measure student learning or if other methods of assessment might better measure–or even produce–authentic learning.
(Hint: Yes, they will. Whatever we are preparing students to do with their degrees, it is likely not to recall information without referencing any other sources. They’re not professional Jeopardy! players.)
Non-proctored assessments (and why they discourage cheating) include things like:
- open-notes, open-book exams using large test banks that are timed so that students must come prepared to take them and do not have time to look up information
- collaborative exams, where students work with assigned group members to complete tasks (like write an essay)–and so where working together is not cheating at all
- recorded presentations, including poster presentations and mini-TED Talk style presentations, where students must record their own faces delivering information
- recorded presentations, like pecha kucha presentations and podcasts, where students must submit drafts of their work in advance of the due date and receive feedback that they incorporate (from peers or their professor)
- projects where they work with real-life clients and must deliver a product to them (like a proposal for researching a problem within their firm using the resources the client actually has, a website or flyer, or something else)
- recordings of interviews, plus drafts of interview questions, transcripts of the interviews, and reflections on them
- final papers, which, again, can be assigned in stages so that students must turn in bibliographies, annotations of sources, outlines, abstracts, and first drafts
- timed final papers that require students to use information located only within the LMS, such as comments that their peers have made on discussion board or to revise a previous paper to incorporate more recently-read texts
- timed essays based on novel case studies
- photo diaries or photo essays using images that students produce
- performances on simulations
- recorded demonstrations of a skill
- evaluations of service-learning that incorporate feedback from the site supervisor
- posters and infographics that demonstrate visual literacy
- corrections of errors in sample work (such as locating and explaining the error in a proof in geometry or correcting errors in the translation of a newspaper article)
- written explanations of how to solve a problem
What do all of these have in common?
They are a lot harder to grade.
This is a reason to embrace them.
I am wary of arguments that online learning will replace F2F education. For starters, our students don’t want it to. But I am concerned that administrators will seek cost savings within online programs by allowing enrollment that is too big to allow instructors to provide valuable and timely feedback. It doesn’t have to be the case that online courses are MOOCs, but they do allow the infrastructure to pass students through them without authentic assessment (watch a video, read a chapter, take an exam, and never get any feedback or engagement). So we must fight against that.
One way to prevent that is to set the standard that all online courses must include a signature assignment that can be assessed without proctoring and that requires synthesis of content from across the course and from the specific section (so students in section A will write different papers than students in section B because they had different conversations), the production of new knowledge or application of knowledge to a novel situation, or multiple steps with the opportunity for feedback. All of these are ways to curb cheating that don’t require proctoring.
A final thought to those who insist on proctoring: If proctoring wasn’t an option, what would you do? Like, if we did not have the technology to proctor, how would you assess learning? Would you just say that math or engineering or chemistry cannot be taught? No–you’d find a way to assess student knowledge and skill without proctoring.
So do that.
And if you really, really, really can’t (like, no one in your discipline in the whole world has figured this out), allow students to schedule live proctoring at a testing center if they prefer it to online testing.
While some of the suggestions above work to address the issue of ringers–students who take the course on behalf of another–not all do. A future blog post will discuss the problem of ringers.
Like what you read? Support it.