Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • re: "Apple’s unified memory architecture lets the M5 Ultra's integrated GPU use up to 512 GB per Mac Studio, so two machines can hold an entire model. And the chip’s 1.2 TB/s of memory bandwidth is fast enough to read the small slice each token needs. The result is two Mac Studios behave like one supercomputer with a terabyte of unified memory."

    At the current market price of Apple Mac Studio Ultra, 30-core CPU + 64-core GPU w/ 256GB RAM is already reaching at around $10k. Keep in mind that computers are appreciating assets recently.

    The 512GB RAM option is not even for sales yet (they said late October availability). Based on typical Apple pricing, it's likely to be around $14k apiece. So we are looking at least $28k - $30k for the setup Muse team is advertising. That's essentially the Nvidia H100 GPU w/ 96GB VRAM/HBM3 at up to 3.94 TB/second memory bandwidth, 3x+ than Mac Studio's Unified Memory speed.

    Also, how did Meta get access to Apple's unreleased M5 Ultra w/512GB RAM Mac Studio? Or is that simply a marketing piece that they wrote purely on specs?

    by devy
  • The model license requires large inference providers to contact Meta separately to obtain a license to serve the model. I know we've seen this before with other large models, but it's still a bit irritating.

    The usual effect of separate licensing is decreased price competition from public providers (like we saw with Kimi K3). I guess it's better for the providers if the price is fixed: any efficiency improvements directly improve margin rather than driving prices down over time. Still, to provide my own anecdata, the main thing keeping me on a paid subscription is token costs for the more capable models.

  • Pelicans for low, medium, high, and xhigh: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    I had to run them via OpenRouter - I don't have access to a machine that can handle this size of model.

    For comparison:

    Muse Wonder: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    Muse 1.3: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    And this one from Meta AI's previous open weight model, Muse Glimmer, which DID run on my laptop: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

  • They've done considerable effort in making sure this model can run on basically every model runner, from Unsloth to MLX, https://dev.meta.ai/docs/muse-spark-open/deploy
  • I find it interesting how companies doing open weight models are shifting from advertising them as "the best" to "the best in the US/EU". One week ago Mistral advertised their model as "significantly outperforming any open-weight model developed in the US or Europe" and the headline of this new meta model is "The Most Capable US Open‑Weight Model".

    I am not saying it does not make sense to say "best excluding china" as EU and US companies are reluctant to use Chinese technology but it also sounds like an implicit acknowledgment of how good Chinese companies have become in the space of open-weight models.

  • Like I said last week. I think zucks original llama thesis is proving more correct by the week. The rent market on intelligence never materialized, if you have THE frontier model, you can charge rent (for a few weeks, maybe month). But after a certain capability level it's price that drives the decision.

    Zuck is doing the thing he's really good at, and building a moat around the network (Muse is VERY sticky), and now that we're all going to standardize on Meta's model, we're going to optimize the heck out of the infra to run the model making it cheaper for him to scale, thus bringing in more participants to his network, and thus making his network more valuable.

    Meta is going to win consumer AI.

  • Since there are many comments here arguing that this is not open weight, I looked at the license. Basically, you're free to use this except this clause:

    > If the Licensee or any of its affiliates provide a third party with access to artificial intelligence models as a product or service, via API or a similar interface, where the third party receives outputs of such models (“Model as a Service”), and the aggregate gross revenue of the Licensee and its affiliates exceeds twenty (20) million US dollars (or the equivalent in other currencies) during any consecutive twelve (12) month period, the Licensee must notify Meta and enter into a separate written agreement with Meta before offering the Software or any Derivatives as part of that Model as a Service business. This Section 3 does not apply to (a) internal use, research, or any commercial activity that is not Model as a Service, or (b) the Licensee's use of the Software as a component to power features of the Licensee's own product or service that is not a Model as a Service.

    They're allowing the use of this in commercial products, just not selling the model directly.

  • Artificial analysis shows this: underperforming Qwen3.8 Flash Next and GLM 5.3 Flash, both of which you can run on a single B300 . I think Meta has a bit of catching up to do in the open-weight space.

    As an aside, it's really unfortunate that artificial analysis only provides comparison at the highest reasoning level, which is mostly unusable for high-volume production use cases. I would really like them to start providing comparisons at low and medium reasoning levels across these models because those tend to be the ones that actually get used in production.

    by a11r

Explore Birbla archives