Birbla

Comments

Hacker News

Looking forward to giving this a try. I have tried MLX using Rapid MLX however the LLM (Qwen) would always have hiccups and get stuck repeating itself.

Moving onto llama.cpp I was able to get faster tokens with MTP and a more reliable llm.

I wonder what other people's experiences are using MLX vs llama.cpp

by shitcoder

Is Gemma 4 E2B actually "usable"? I've been running Gemma 4 12B and it handles everything very well! But the second I've moved down to E4B it's been unable to perform the simplest of tasks. So I can't even imagine how E2B would do... Or am I doing something wrong?

by Daunk

Genuinely curious: what are people using these smaller local models for? They are getting decently capable, but they are still small enough that I don't trust them for "real" work outside of a handful of fun toy projects.

Are people actually using them in coding agents? Or are they mostly using them for other things?

by JosNun

I really don't like the marketing texts. "Why we’re open source when nobody else is." I'm using oMLX which is open source and seems to be doing everything Nativ offers. I'd rather see the comparison with existing "non-existing" open source competitors.

by Nekorosu

I'm surprised that their home page basically acts as if LM Studio and others don't already do this. It's not clear what the difference is from a glance.

It also omits Open WebUI. I've been running Deepseek V4 Flash locally on my Macbook Pro for weeks using Open WebUI + DS4.

by D13Fd

Is „frontier“ overused? I thought frontier models were the best-of-the-best such as Fable right now. I assume you can’t host these models yourself since you would need many GB of RAM and expensive GPU of is my thinking of „frontier models“ wrong?

by moontear

To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library (https://github.com/Blaizzy/mlx-vlm). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new models, particularly in models with modalities beyond text-in, text-out (vision, STT, TTS, video gen). See also (https://github.com/Blaizzy/mlx-audio-swift). Would be totally unsurprised if those modalities and models get integrated into this UI.

Possibly vibe-coded landing page notwithstanding, the app is mostly written in Swift language. That suggests it will be easy to port this inference stack to iPad and iPhone.

by erikkahler

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • I'm a bit curious why not running DeepSeek V4 on top of https://github.com/antirez/ds4. I think the results could be really good.
    by c4pt0r
  • Looking forward to giving this a try. I have tried MLX using Rapid MLX however the LLM (Qwen) would always have hiccups and get stuck repeating itself.

    Moving onto llama.cpp I was able to get faster tokens with MTP and a more reliable llm.

    I wonder what other people's experiences are using MLX vs llama.cpp

    by shitcoder
  • Is Gemma 4 E2B actually "usable"? I've been running Gemma 4 12B and it handles everything very well! But the second I've moved down to E4B it's been unable to perform the simplest of tasks. So I can't even imagine how E2B would do... Or am I doing something wrong?
    by Daunk
  • Genuinely curious: what are people using these smaller local models for? They are getting decently capable, but they are still small enough that I don't trust them for "real" work outside of a handful of fun toy projects.

    Are people actually using them in coding agents? Or are they mostly using them for other things?

    by JosNun
  • I really don't like the marketing texts. "Why we’re open source when nobody else is." I'm using oMLX which is open source and seems to be doing everything Nativ offers. I'd rather see the comparison with existing "non-existing" open source competitors.
    by Nekorosu
  • I'm surprised that their home page basically acts as if LM Studio and others don't already do this. It's not clear what the difference is from a glance.

    It also omits Open WebUI. I've been running Deepseek V4 Flash locally on my Macbook Pro for weeks using Open WebUI + DS4.

    by D13Fd
  • Is „frontier“ overused? I thought frontier models were the best-of-the-best such as Fable right now. I assume you can’t host these models yourself since you would need many GB of RAM and expensive GPU of is my thinking of „frontier models“ wrong?
    by moontear
  • To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library (https://github.com/Blaizzy/mlx-vlm). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new models, particularly in models with modalities beyond text-in, text-out (vision, STT, TTS, video gen). See also (https://github.com/Blaizzy/mlx-audio-swift). Would be totally unsurprised if those modalities and models get integrated into this UI.

    Possibly vibe-coded landing page notwithstanding, the app is mostly written in Swift language. That suggests it will be easy to port this inference stack to iPad and iPhone.

    by erikkahler