Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • There is at least one very large derivatives marketplace that will require basic recent price information (OHLC) to be behind user registration by next year. Enjoy what you have done scrapers.

    "I'd sure hate if someone did this to my site, but at least the agent did it for me. I don't have to feel guilty now."

  • Im guessing more of the internet will be login walled from now on.
  • > I don’t know where this leads, but we’ll likely see more websites block Muse unless Meta prevents abuse.

    Multiply it by 1,000,000 access attempts - daily.

    It is question of time when even normal browsers would need some allowed fingerprint to go to sites otherwise caught by clouflare or similar wall.

  • their static ip's were initially good and didn't get flagged, but now most sites are recognizing their ip ranges and blocking.

    Muse's utility has significantly dropped with the blockages.

    To become truly useful again they will need to use residential proxies, but I can't see them use those due to the risks and reputational damage.

  • As someone having to fight Meta's bots everyday to keep websites accessible to actual customers, I'm not surprised to read that it can be seen as something positive on the other side of the fence.

    But I'm wondering: at what cost?

  • Muse ran into a captcha and asked me if I wanted it to solve it.

    So of course I clicked yes and it dutifully convinced the site that it was not a bot.

  • I built an AI "web harness" running on a sandboxed Chromium (using a custom side-loaded plugin that talks over websockets to a "driver") to basically do anything a normal user could do in a browser. It totally bypasses any and all bot measures and only gets the ones you yourself would get as well (and passes those successfully, e.g. Cloudflare checkbox or those annoying OCR puzzles).

    Not sure if I should release it, but I'm sure more people are catching onto the power of agentic browsing.

    by dvt

Explore Birbla archives