Birbla

Comments

Hacker News

The amount of times these LLMs randomly refuse to answer basic questions because "omg safety" only to turn around and do this f￭￭￭ing nonsense is obscene.

I'm not blaming the LLM because it's just a pile of math glued together with hubris and anxiety but why is its default response not "I am not a medical professional and you should see a doctor right away if you have any concerns"?

by lardosaurusrex

There are no bounds to human stupidity

by sharts

This was with GPT-4o (ancient now by AI standards). The reason OpenAI refuses to bring it back, despite all the demand, is that when the conversation gets long enough it starts doing weird things like this.

Subsequent models have almost entirely eliminated this kind of thing.

by heaney-555

Ironically, the given name "Claude" means "crippled" or "lame". Students of the Roman Empire may recall the disabled Emperor Claudius.

by ButlerianJihad

All the chat bots have a very discreet disclaimer at the bottom of the page. I want to say it should be bigger text and more strongly worded but like most people I would just mentally tune it out regardless.

by harvey9

The comments here are ridiculous. Do you know how much ChatGPT has helped families, esp. those without access to the top medical doctors and resources around the world? My own experience with it so far have been nothing but positive. It beat all the doctors in various hospitals that we have consulted so far on breadth and depth and the best thing is you can keep asking follow-up questions on anything and it gives you all the details you need without being rushed.

The fact that it is not 100% reliable shouldn't be basis for restrictions. Even top trained doctors are far from 100% reliable either.

by elisbce

Why are people even allowed to dress up ChatGPT... an autoregressive transformer... as a faith-based holistic doctor? Anybody could see this going wrong from a hundred miles away.

by arm32

I really hope the lawsuit does not end in OpenAI tightening the “safety” and “security” of their models into oblivion. I hope they understand that a lobotomized model is as good as my Casio watch.

I want my models to give it to me straight without patronizing me. I’m an adult and I take responsibility for my own actions.

by sheepscreek

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • The amount of times these LLMs randomly refuse to answer basic questions because "omg safety" only to turn around and do this f￭￭￭ing nonsense is obscene.

    I'm not blaming the LLM because it's just a pile of math glued together with hubris and anxiety but why is its default response not "I am not a medical professional and you should see a doctor right away if you have any concerns"?

    by lardosaurusrex
  • There are no bounds to human stupidity
    by sharts
  • This was with GPT-4o (ancient now by AI standards). The reason OpenAI refuses to bring it back, despite all the demand, is that when the conversation gets long enough it starts doing weird things like this.

    Subsequent models have almost entirely eliminated this kind of thing.

    by heaney-555
  • Ironically, the given name "Claude" means "crippled" or "lame". Students of the Roman Empire may recall the disabled Emperor Claudius.
    by ButlerianJihad
  • All the chat bots have a very discreet disclaimer at the bottom of the page. I want to say it should be bigger text and more strongly worded but like most people I would just mentally tune it out regardless.
    by harvey9
  • The comments here are ridiculous. Do you know how much ChatGPT has helped families, esp. those without access to the top medical doctors and resources around the world? My own experience with it so far have been nothing but positive. It beat all the doctors in various hospitals that we have consulted so far on breadth and depth and the best thing is you can keep asking follow-up questions on anything and it gives you all the details you need without being rushed.

    The fact that it is not 100% reliable shouldn't be basis for restrictions. Even top trained doctors are far from 100% reliable either.

    by elisbce
  • Why are people even allowed to dress up ChatGPT... an autoregressive transformer... as a faith-based holistic doctor? Anybody could see this going wrong from a hundred miles away.
    by arm32
  • I really hope the lawsuit does not end in OpenAI tightening the “safety” and “security” of their models into oblivion. I hope they understand that a lobotomized model is as good as my Casio watch.

    I want my models to give it to me straight without patronizing me. I’m an adult and I take responsibility for my own actions.

    by sheepscreek