Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Does this actually modify the weights?

    It submits prompts that get refused, then detects and modifies the weights responsible?

    Like brain surgery?

    by FrustratedMonky
  • Looks like a well engineered, automated abliteration pipeline. The claims seem a bit overstated though, since the metrics mentioned are cherrypicking refusal count and KL divergence, both of which make the outcome seem the most dramatic.
    by N_Lens
  • I have attempted to use an agent to try to unlock the boot loader of an old xiaomi phone to install lineage OS. It managed to brick and unbrick the device, but there boot loader is still locked.
    by erremerre
  • Can the load-bearing gaps that are worth being flagged for pinning down be abliterated out of a model?
    by phoronixrly
  • I'll wait for Hexen, thanks.
    by _0xdd
  • Keep a close eye on abliterated and "heretic" open weight models. They will be outlawed first.
    by Tepix
  • Two problems with modifying models like these, which you should be aware of.

    First, the training sets of these models are usually shaped around the refusal, too. They might not have enough of the knowledge to answer correctly even if you stop it from going down the refusal path. If the model was trained on data that gives a refusal to that topic, the real information might not be encoded in the model at all. You’re trying to force it to go down a path that produces an answer, which asking for hallucinations.

    Second, the quality can drop on unrelated questions. Depending on the question this may or may not happen. I know they post KL divergence charts but those tell you very little for a focused topic like this.

    So if you expect a model that will start correctly telling you info that its local government didn’t want included, this changes nothing.

    The best argument for these models is if you are trying to do a general purpose task but the model triggers a refusal based on vague reasons, like not wanting to reverse engineer something.

    by Aurornis
  • I have a chinese IP camera. From superficial research I know it has some CVEs to take control of it. Unfortunately, I don't have the technical knowledge to perform an attack and run some software to extend the camera's functionalities. No model from a provider accepts my RE and hacking requests, so these abliterated ones have been vital to reclaim possession over my stuff
    by Almondsetat

Explore Birbla archives