The biggest problem in education right now is that old tests don’t work

Key Concepts

• Traditional Assessment: Paper-based exams as a measure of knowledge.
• Generative AI Impact: The ability of AI tools (like ChatGPT) to generate plausible written work.
• Alternative Assessment: Methods beyond traditional written exams, specifically oral exams.
• Authentic Assessment: Evaluating learning through demonstration of understanding and communication skills.
• Humanity & Communication Skills: The importance of developing skills beyond factual recall, such as articulation and interpersonal understanding.

The Challenge of Assessment in the Age of AI

The primary issue facing the education sector is the increasing complexity of assessment due to the advent of readily available generative Artificial Intelligence (AI) tools. Historically, assessment revolved around written papers – a direct expression of a student’s knowledge state. Teachers could evaluate these papers to determine comprehension. However, the speaker highlights that these AI tools can now generate convincingly well-written papers, effectively bypassing the intended assessment of a student’s actual understanding. This isn’t dismissed as a trivial concern; it’s acknowledged as a “real problem.”

The Solvability of the Problem & Alternative Approaches

Despite the challenge, the speaker expresses optimism that the problem is “solvable,” emphasizing the need for careful reconsideration of assessment methodologies. The traditional method of silent, written exams – described as “terrorizing” with the image of students writing in “blue books” – is presented as the “easiest assessment possible,” but not necessarily the best.

A key alternative proposed is the implementation of oral exams. The speaker advocates for a shift towards direct conversation as a means of assessment. This isn’t framed as simply a replacement, but as a method that cultivates a different, and valuable, skillset.

The Benefits of Oral Exams & Authentic Learning

Oral exams are positioned as more engaging and, crucially, as a means of developing “humanity.” The argument is that the ability to articulate thoughts and engage in discussion – skills honed through oral assessment – are transferable to real-world scenarios. Specifically, the speaker uses the example of performing well on a podcast, linking the ability to explain one’s understanding of a literary work like Catcher in the Rye to broader success in “the human world.” This highlights a move towards authentic assessment – evaluating not just what a student knows, but how they can apply and communicate that knowledge.

Logical Connections & Synthesis

The argument progresses logically from identifying a problem (AI-generated content undermining traditional assessment) to proposing a solution (alternative assessment methods, particularly oral exams). The connection is strengthened by framing oral exams not merely as a workaround, but as a superior method for developing crucial communication and interpersonal skills. The speaker doesn’t suggest abandoning written work entirely, but rather re-evaluating its role as the sole determinant of learning.

The core takeaway is that the emergence of AI necessitates a fundamental shift in how we assess learning, moving beyond rote memorization and written reproduction towards demonstrable understanding and effective communication. The emphasis is on cultivating skills that are uniquely human and valuable in a world increasingly shaped by technology.