Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • I'm beginning to think that AI is just taking Dumbo's magic feather away,
    by Lerc
  • (2025)

    and here is a direct link to the pdf without all the rigamarole:

    https://www.microsoft.com/en-us/research/wp-content/uploads/...

    by djoldman
  • There's often a big gap between self perception and actual performance, I wonder if this actually tracks when measured.

    Regardless, confidence in oneself is hardly measured, self report is likely as good as it gets.

    by oceansky
  • I'm either not seeing something or I do not see the point of this study.

    Amount of "critical thinking" is basically amount of oversight, no? What's interesting is when the amount of oversight is inappropriate, leading to overconfidence in bad results (or, if too much oversight, lack of efficiency).

    This paper does not seem to discuss results and correctness at all, ONLY the amount of critical thinking.

    by kenferry
  • This is my takeaway:

    Authors analyzed ~300 workers doing ~1000 tasks. They collected self-reported measure of using critical thinking [yes/no], and estimate of cognitive effort of doing the task. Authors also measured workers' confidence in themselves doing the task or the AI doing the task.

    They found: if someone is confident that AI can do the task, they report using critical thinking less, even though they think the task is easy. When someone is confident in doing the task and in evaluating AI responses, they use critical thinking more, even though they think the task is harder.

    I think the paper is saying: low-domain expertise (read: confidence) + unrestricted AI tooling can eliminate the human from the loop. The fallout is better automation or unreliable systems. We need to resolve this ambiguity.

    The question is: should low-domain expertise be coupled with more restricted AI tooling as a critical thinking forcing function? Are schools/workplaces right in restricting AI so students/new workers can reach the point of high domain expertise?

    by hazrmard
  • People have always been bad at critical thinking, it's a high level cognitive skill that requires practice.

    Now that it can be outsourced,we will slowly lose this ability that we barely had.

    by hoppp
  • I think the bigger issue is skipping the process through which you learn. Personally I learn the most when I am stuck on something for hours trying to figure it out and I miss all of that when AI gives a solution right away.

    You get more done without realising you're learning less.

    by zomtorg

Explore Birbla archives