Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Gemma 4 when?
    by sjakati98
  • I’m actually working on a small project that’s exactly this! Less quant so it’s only 150M parameters but this is amazing.
    by matthewfcarlson
  • Seriously though, what are the low cost chips that can usefully run LLMs? Is a Mac Mini the lowest we can go? Are there iGPUs on mini-itx that can do it, or are there dedicated AI chips that one could turn into a pi HAT?
    by sneak
  • I'm curious how this would handle grammar checking on a basic word processor. Or maybe generate worlds for small text based games. I have no idea what the capabilities are of a cluster like this.
    by NDlurker
  • haha … this is precisely the kind of project that https://bil-lang.org is aimed at: Go for parallel (ie in this case pipeline processing).

    don’t get too excited until we get the TinyGo backend built though ;-)

    by librasteve
  • It is a bit of a bummer to see that the degree of 'compression' makes it a fancy llm noise-maker. It is still charming.
    by cameron_b
  • Soon ai in every lightbulb running Kubernetes
    by tdhz77
  • This is something I've been fantasizing about for long.

    Let's say we took Rust, a language that makes parallelization easier than others (as it helps you avoid some common footguns). How difficult would it be to have a massively parallel computer system made out of many tiny, simple microcontroller-like chips? Let's say we picked many little Risc-V's. Surely this would be an interesting experiment (though I'm not sure whether it'd make economic sense or not...)

    by ladyanita22

Explore Birbla archives