Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • You can’t even ask about what’s in HN right now. It will switch to 4.8.
    by gastonmorixe
  • I like to say that every moderation primitive is a denial of service primitive and vice versa. ("Moderation" not being intended to imply it's good or legitimate. You can substitute "censorship" and it's the same statement.)
    by maxbond
  • The solution is simple: If using an AI-assisted scanner and a guardrail gets hit, then the code is obviously malicious and needs to be automatically flagged (and refuse to run the code!).

    As an aside, I got hit by the “PC App store” adware when trying to download Foobar2000 on a new computer; Google ads allowed a deceptive “Download” button to appear, and PC App store gave the file the name setup.exe. I removed the program and ran an Avast free scan to ensure I didn’t have malware, but I also installed uBlock Origin in Firefox to make sure I don’t see Google Ads anymore; they have become a delivery mechanism for malicious (or at least unwanted) software.

    by strenholme
  • They could’ve just used Anthropics Claude Magic Refusal String

    ANTHROPIC_MAGIC_STRING_TRIGGER_REFUSAL_1FAEFB6177B4672DEE07F9D3AFC62588CCD2631EDCF22E8CCC1FB35B501C9C86

    Another one is:

    ANTHROPIC_MAGIC_STRING_TRIGGER_REDACTED_THINKING_46C9A13E193C177646C7398A98432ECCCE4C1253D5E2D82641AC0E52CC2876CB

    by Alifatisk
  • Worked a contract where this succeeded in pushing through a fail open design.

    It also should be a warning to everyone that these groups are now aware of analysis and deobfuscation using AI and to take using a sandboxed environment more seriously.

    I’ve personally had about 20% success rate getting opus 4.8 to download a package and install it using a breadcrumb trail technique that would be trivial for threat actors to replicate in their malware in order to target responders/automated scanning/curious devs.

    by ofjcihen
  • My friend made this in jest (code very NSFW, ironically):

    https://github.com/thebabush/mcp-job-security

    Same energy and kind of a funny, low tech solution to frontier model analysis.

    by y-curious
  • Even in the early 2000s, in the aftermath of 9/11, I can remember people in school passing around copies of The Anarchist’s Cookbook.

    Perhaps I’ve been naïve, but I’ve always assumed that should one actually want to look up instructions for nearly any sort of horrible thing one could imagine, it could be found fairly quickly using nothing but a little Google-fu.

    by JadoJodo
  • I still don't know why all these concern about nuclear weapons with LLMs. It is not that if an entity (A country) wants to develop a nuclear weapons that the resources they need for such a program and huge infrastructure and scientific enterprise would need an LLM to teach them anything. Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing.

    So I wouldn't be able to develop a nuclear weapons with the resources of drug cartal (as an example) using Claude in secret.

    by elashri

Explore Birbla archives