Discussion summary

An Ivy League professor ordered an in-person final exam after suspicions of AI cheating, resulting in a 50% score drop. Discussions highlighted the intelligence of Ivy League students and the challenges of remote proctoring.

What the discussion says

  • Many believe Ivy League students are highly intelligent.
  • Some argue AI cheating is difficult to prevent remotely.
  • Concerns about the effectiveness of at-home proctored exams.
  • Debate on whether intelligence can be accurately measured.
At-home testing is dead.
protocolture
I have met many Ivy League students and grads; they are all intelligent.
cm2012

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • > Ivy League college students are, by definition, intelligent.

    I stopped reading after the first sentence.

  • Ars Technica has gotten very bad over the years. IMHO not worth reading for many, many years now.
  • “Rich”
  • Hey, a typical person should be intelligent because we human have used ourselves as a de-facto definition of intelligence anyway. That sentence probably means something like "no intellectually disabled person here". Even though we don't normally feel so because higher educations seem "typical" to us.
  • technically, they invented the IQ to test their IQs so, this mighe be strictly correcg.
  • Why jump on the opportunity to prune reading by rejecting the lot as soon an unrelated premise you disagree with is presented?

    Perhaps at that point if you stop reading after the first sentence, you could churn the entire article through AI to summarize it into a single sentence, and see if the invalid premise is core to the message?

  • I agree that they are intelligent, just don't know about the "definition" part. A typical Ivy Leaguer isn't a dumbass. What's wrong with calling one intelligent?

    Try visiting a Walmart and interacting with literally anyone. That's the average. Let's not allow our egos to gatekeep who we consider intelligent, fellow HNians.

  • I’m not sure why that’s controversial - I have met many Ivy League students and grads; they are all intelligent, at least in an academic way. The only other common characteristic is that they almost always had some form of privilege. Either rich parents, or adults around them who worked very hard to get them to that level.
  • It's laughable to be surprised by cheating on take-home exams. Does the professor have a comparative assessment before AI? Do you think the cheating didn't happen on them before AI? It always happened. It's structural, in the same ways that speeding on the highway is structural, and evading taxes on cash income is structural. And the structural fix is in-class exams.
  • ' “56 percent of undergraduate respondents [at Brown] and 67 percent of graduate and medical student respondents reported intentionally using GenAI tools daily or weekly,” '

    and the rest are lying.

    (With apologies to the original example of anomalous self-reporting)

  • Me: How could he not have seen this coming?

    Oh.. he’s blind.

  • Disallowing the use of AI is basically the modern equivalent of testing based on memorization. It is a laziness to find something more useful to evaluate on or an inability to distinguish real understanding in a field from first level understanding.

    Professors need to step up and teach value beyond what LLMs know (very possible with or without LLMS). Or get out of the way from those building on the field with LLMs.

    If you’re teaching students something that LLMs can score 100 on you are not adequately teaching them something useful for them in the future.

    by tmsh
  • LLMs don't know anything.
  • The article clearly lays out that the take-home test was not a test of memorization, but a test of students' understanding of the class material and ability to reason about how different assumptions affect its conclusions.
    by drtz
  • If your score falls 50% from not using AI, that's not testing memorization. That's testing learning anything on the topic being tested. The quantity of information on college exams is not that much to memorize. At least, personally, failing to remember something was rarely a reason why I failed to answer a question. Almost always it was because I did not fully understand the topic, so I tried to fall back on remembering if I answered the same question before.
  • I like the quote at the end

    "we cannot choose to become idiots"

  • The article, the teacher, and the general academic community skips the hard question when it comes to AI and that's whether these exams are testing knowledge that is still worth internalizing in the same way?

    Academia has a long history of lagging behind acceptance of new cognitive tools where they claim to want to defend the students, but instead defend the assignments of the past at the expense of the students. Calculators were treated as threats to learning, even though they ultimately freed students to focus on higher-level math and provably improved their abilities across many different studies. Internet sources were dismissed as less legitimate than books, as if “published in an outdated book from the 70s” magically made it more trustworthy than the most scrutinized reference sources online.

    It is not clear from the article exactly how much of this course falls into that category, but if the answers can be produced trivially with a prompt and chatgpt, then maybe memorizing that material is no longer the right educational target. Academia desperately needs to redesign itself around AI as a cognitive tool students should be trained to leverage. If a question is trivially answered by a prompt with it, then you need harder questions that actually require students to push beyond that. Simply removing AI from the equation, calling it cheating, and pretending that it isn't an ever-present asset people are expected to leverage in real life is naive and just repeats the mistakes of the past.

  • > Calculators were treated as threats to learning, even though they ultimately freed students to focus on higher-level math and provably improved their abilities across many different studies.

    Oh fuck that bullshit. I was a dumbass to believed shit like that in school, and it didn't fucking free me. What happened was I was always calculator-dependent, which made higher-level math harder, because I was always distracting myself by operating the goddamn thing, and I never developed a very good intuition for arithmetic.

    I fucking hate calculators in math classes.

  • I have a few thoughts related to this, and maybe I can get them out and ties them back together at the end.

    1a. Yes, college isn’t right for everyone, and testing the traditional way with paper and pencil certainly disadvantages some students who would be star performers in a real world setting but are not a good fit for college classes. Think “Good Will Hunting” type people. They do exist.

    1b. However, there are certainly more people who only imagine themselves as Will Hunting type people and that they are just too smart for college, but the reality is that they are dumb, or didn’t learn the material. For every person who fails a test because they’re a genius who is a bad fit in the system, there are at least 10 idiots who imagine themselves geniuses, and they would have passed the class if only that PhD professor with all his book smarts had actually written the right kind of exam. Traditional schooling and testing doesn’t work for the extreme upper tail of intelligence, but it exists because it did quite well at educating and sorting the masses to support the Industrial Revolution.

    1c. If college were only about the knowledge, you could learn most of it with internet access and a library card for much cheaper. The vast majority of people are in college for the credential, and the institution has to protect the signal of the credential.

    2a. Most college assignments and exams are not a good reflection of full time employment. College credentials serve mainly as a networking aid and a signal to employers that you are compliant and competent enough to follow a professor’s instructions, and will likely be a compliant and competent employee, although the instructions might be different. If it is the AI who is the one who followed the professor’s instructions you water the signal down, and employers don’t want that. It is irrelevant that a student can copy and paste things into ChatGPT, and that ChatGPT can get the answer right on this test. That isn’t what college is supposed to signal.

    2b. A problem is that I literally can’t write a test in most subjects now that I would expect a student to complete that can’t be completed by ChatGPT better and faster. I teach undergraduate math and a while ago we thought that since GPT-4o could get a C in calculus that we’d just raise the standard. Now Fable and GPT-5.5 can cruise to an A in literally every math course in our catalog, and they can also catch every tiny issue in an exam written by a human. But I have to teach these undergraduate subjects so that some students can go on to PhD studies so they can contribute to the field. If we just stop teaching undergraduate subjects then PhD production and novel research grinds to a halt and only a few fields will progress where an AI is capable of self improvement.

    2c. I’ve seen that my best students know how to do do something by hand and use a computer to complement/increase their capabilities, not to cover over entire gaps. When you have literally zero skill in an area, you can’t spot when you got a totally bad output from the AI (these days usually because of a lack of context or bad prompting because the student didn’t understand the material, not because the AI wasn’t capable). Somehow I have to incentivize students to learn the material on their own, so that they can be a better user of AI in the future. And a really effective way to do that is a graded test in which AI is not available to help them.

    So to try to tie it together, is that there is still some value to a college degree, at least until something better comes along. But that college degree is only useful when it is a signal about the person and not some other tool. And although AI is getting very capable, somehow we have to teach the lower stuff to build up to the higher stuff, so we do need to restrict the use of AI in some educational settings so that we can build a good foundation for future learning.

    As to the point about old paper sources being considered more reliable than an internet site, I agree. I am of the generation that wasn’t allowed to cite Wikipedia and it frustrated me. We’ll eventually figure out how to permit proper AI use, much like how many professors now allow you to use Wikipedia to start researching a topic.

  • Why bother learning anything when you can just use AI?
  • I don't think there's anything wrong with asking for things that can be prompted. You still need to understand the why behind things, being able to reason about them and choose between options. How will you teach this level of understanding or certify them without exams?

    Of course, not all testing is good, but the written exam has survived and proven useful despite the internet age, I'm not sure an even better search engine really changes that.

  • > whether these exams are testing knowledge that is still worth internalizing ... It is not clear from the article exactly how much of this course falls into that category

    It's very clear from the (excellent) article linked by dang [1] what the exams required:

    > This year, the economist decided that both the midterm and the final exams for his course would be of the take-home, closed-book type (there is a certain tradition of this at Ivy League schools). “It’s a very nice kind of exam, because as you’re giving students practically unlimited time to complete it, it lets you make it harder than normal, to see how far they can go.” In this case, Serrano changed some of the model assumptions they had seen in class, and asked students to demonstrate whether certain statements were true or false under the new assumptions.

    [1] https://english.elpais.com/education/2026-06-28/ai-fraud-at-...

  • At-home testing is dead.
  • How is this even a debate? Before Covid most tests were in person right? Sure some classes had final projects that were take home, but in person tests were very norma. So what’s all the hand wringing about? Just do in person tests and move on?
  • Have you never had a home proctored test before?

    You cant even sneak paper on to your desk, where do you plan to hide the LLM?

  • Just wait a few decades until brain-machine interfaces will become a mass-market thing.
  • It is. I think the professor here was being naive, but I appreciate his optimism. When I was in college (in the 90s), take home exams allowed a knowledgeable student to really shine. I’m not saying that they weren’t eminently cheatable back then—they were—but they also had the odd side-effect that, if it was a class you cared about, the test itself could be a learning experience.

    For context, I am also a faculty member at a highly selective college. I had a similar shocking realization last year that it was likely that there was widespread cheating on homework assignments, which I used to favor heavily toward their grades. To verify my suspicions, I generated custom tests for every student in the class: the exam included code from students’ own programming assignment submissions. All I asked them to do was explain what they wrote.

    The class performed badly on this exam, and the results were strongly bimodal. Roughly half the class aced the exam. The other half could make neither heads nor tails out of the code. For the students who wrote things like “lol, i have no idea” (real response) I opened honor cases.

    I think many faculty right now are going through the stages of grief. We all knew that even at selective institutions, cheating existed, that many students were in it for the credentials. But as long as the numbers of known cases was low, we could convince ourselves that the few doing it were outliers. When a class does it en masse, it’s more than a slap in the face; it makes you feel like a chump. Have we been fooling ourselves this entire time? Was all the time I spent becoming a subject-matter expert a waste? Are the students just rolling their eyes when I turn my back? Those thoughts hurt. I personally chose to become a faculty member because it seemed like research and teaching were the best ways to maximize my impact.

    I still have some hope. After all, I still spend my days working and socializing with like-minded thinkers, some of whom are truly brilliant. And every year, a handful of students come out of the woodwork and surprise me. But it’s hard not to think that the group of people who find joy in learning and creating is shrinking.

  • What's even worse than so many students cheating with AI is that I suspect a substantial portion of them don't even think that's "cheating".
    by wrs
  • Seems like an application of Goodhart's law; measuring worth by degree or grades stopped measuring learning or ability.

    This was a lot harder to cheat before AI, but now the floodgates are open and grades and degrees earned post-AI are showing that they mean little.

    Cheating on college tests should be a jailable criminal offense (similar to computer fraud) so that there is dignity in the degree again. Considering the money involved, I don't see why not.

    But this probably won't happen, because many rich people are very happy to buy their degrees. See also [1]

    https://stanforddaily.com/2026/04/09/the-real-reason-student...