Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • Like all LLM related issues, it doesn't until it does. Or does until it doesn't.

    Either way, you get no visibility or predictability.

    Good luck.

  • Too deranged of an AI hater for me to even care to read this.

    Knowing he did an AI hate interview with Tante just solidifies this: https://pivot-to-ai.com/2026/08/21/tante-on-ai-when-this-thi...

    Just looking through his Mastodon reposts (neovim is "fascist software" if you didn't know already!) just leaves me shaking my head.

    Incredible how much of an audience you can get by just being anti "the latest hype".

  • I have no historical context (heh) for this person, but as someone who uses LLMs regularly, I feel like there are reasonable takeaways from the article. Namely:

    - Don't vibe you agents.md file, it won't capture any intuition about the project that the model doesn't already have.

    - Keep your agents.md file short. Long ones mostly bloat context for minimal difference in behavior.

    - Writing for a human audience is probably better. Any LLM can read docs made for humans anyways.

  • Incredible how much of an audience you can get by just being pro "the latest hype"
  • “Don’t start off by git diff, git status, or git show” saved me quite a few tokens.
  • I have in mine to not do any write operations with git, to only use the CLI to explore the history and the current state. I don't trust my agent to commit and push on my behalf. Using my agents.md has worked well for that kind of thing.
  • It does, it makes it obvious that I'm looking at a vibe slopped project
  • It mentions that a chatbot generated AGENTS.md does nothing, which makes sense.

    I added one when it kept making the same mistake and using things from the wrong library version making compiler errors, adding in the common mistakes pre emptively.

  • That's what I took away from this as well. Headline is clickbait but at the end of the day there are uses for these instructions.
  • My agents.md usually becomes do’s don’ts and shortcuts to get to where it needs to be in the code so it doesn’t waste time and context.
  • Just because it doesn't materially impact task success rates does not mean it's not useful. I use that file to give my agent information about the environment (operating system, architecture, command-line utilities I have installed), as well as how to do certain things (such as using `uv` for running Python when needed). I want my agent to work how I do, so I also tell it things like my preferred version control system (jj), my preferred implementation languages for things like shell scripts (zsh), and other things like that. I care more about how the work is done than the final result. It still slips up sometimes, but on the whole I think it works alright. It's not like it fixes tasks that wouldn't be completed at all, but it does help my satisfaction with how they were completed, as well as with the final result. Otherwise, I'd have to do a lot more manual cleanup.
  • I haven't really been doing this yet, but for what it's worth, I think explaining how to use tools doesn't really belong in your agents.md. I think it's better to use it to explain the what tools are available (information about the environment, like you said), and then provide details on the how in skills files. That way you're not bloating your context with how to use `uv` in a session where you're not doing anything Python related. At worst, you're just saying that `uv` exists on your system.
  • I just have it comment on scripts, I've now just started for an app super-run.sh consisting of this pipeline: dev, test, build, e2e, deploy.

    All the scripts are designed to bail quickly. They all create a log in the background instead of blocking. They're all annotated with the necessary comments to keep it on path and locate files, track pratfalls, etc.

    So any entrypoint to whatever I'm doing typically starts with one of these scripts. It's heavy handed but orientating your agent for the specific task is better than just dumping a whole set of context that will be ignored if it has nothing to do with your very next command.

    Telling it how to do a pull request isn't going to help if you're trying to debug a technical issue.

  • This guy – whose RSS feed I subscribe to – makes a living [0] by being anti-AI.

    That's fine. Do what you do. But don't read this article as any sort of science. It's massively opinionated rage-bait.

    [0]: https://www.patreon.com/davidgerard

  • Yeah, something immediately felt wrong about the entire framing of the article.

    I work on several projects on the side, and they all have agents files that give the context about what the project is, what the elements of it are, and what things we're typically working on. This allows my initial prompt to reference things that would otherwise not be in the context at all.

    I mean, they're not magic, they're just some automatic context that's supplied. I feel like the study is trying to say that context with an LLM doesn't matter, which is obviously not a tractable position to hold.

    The fact that they generated all the agents files instead of curating them with a human is probably part of the problem.

  • really scandalous. imagine, getting paid for writing things.
  • Someone having share options in a company means they have skin in the game, which means you can trust their opinions more.

    Someone betting—sorry, investing in a prediction market—means you can have even more confidence in their convictions.

    But someone having a Patreon account for people to voluntarily donate money to them means they can't be trusted.

  • The science is the source linked in the second paragraph.
  • Why articles of people who make living by being pro-AI never get comments like this?
  • On my last project, it kept trying to use the system python instead of the project's virtual environment. It also kept using the wrong build tool. Both things wasted considerable tokens because the agent got sidetracked trying to understand why it could not run the tests - and that repeated on each new session.

    A simple instruction in AGENTS.md fixed that.

    by xg15
  • Can you share which model and harness created this situation?
  • I generally set up the rules of engagement for a project in the AGENTS.md file and if it starts to get large break out to more specific files referenced from AGENTS.md to keep the constant per-request token overhead lower.

    For Python, I have the agent use `uv` (even for direct script invocations) so that the agent doesn't need to burn tokens concerning itself with the details that `uv` is managing behind the scenes.

  • This is what the majority of mine look like as well. Just simple instructions for things I need to do repeatedly.

    I have not even really needed a formal memory system. If I see an error happen more than once, I just say "hey add a note on this to agents.md". Tends to be verbose but overall works quite well for the projects I am doing.

  • Yeah, I feel like what these files do is not that difficult to understand; it's just context that the agent will pick up and use pretty much the same as any other context it has. No, it won't deterministically prevent things with a static check, but it will work about as well as just manually telling the agent "don't do X" as part of the prompt. The fact that it's a "mostly works" mechanism rather than a "guaranteed to always work" mechanism is pretty much the same experience that using an LLM gives in general, and while that requires a bit of thought about how to use it, it's still good enough to be useful for a lot of things.

    Before LLMs, I found "mostly works" systems like this to be incredibly sketchy and not worth using. The main thing I've had to learn in this past year is that what I thought was an ironclad rule turned out to be only a heuristic that was useful before but not always helpful, because empircally as much as I might find the lack of determinism jarring, in practice these tools are genuinely good enough at what they do to be worthwhile to use, as long as you're making sure not to use them in ways that the occasional failure costs more than just some wasted time.