Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- I am still rocking Sequoia and this targets Tahoe purely from UI constraints, no like.by diimdeep
- Looks like my call [0] for more competitors to Ollama has been answered.
We need more like this as well as llama.app, which also has a native mac app.
by rvz - my thing is kind of an Ollama competitor (surrogate?) too. more for prose/text planning, not so much for coding, at least the harness, but i'm sure someone could set it up to do that: github.com/0gsd/enoughby 0gs
- Agreed. Just based on this not being Ollama, so I will give it a try.
- The word "frontier" is like "load-bearing" at this point (Claude Code users will know what I mean). I wish we could stop using it. Especially as this does not, in fact, run the leading/top models locally on your Mac.by jwr
- Only interesting thing about this vibe coded runner is the MLX support, as that's still annoying to use in other ones, most still use GGUFs. Unsloth Studio which is an OSS runner I use is still in progress with MLX support although it's still a ways away.by satvikpendem
- I'm a bit curious why not running DeepSeek V4 on top of https://github.com/antirez/ds4. I think the results could be really good.by c4pt0r
- I assume Nativ doesn't support SSD streaming like DwarfStar.by Archit3ch
- Looking forward to giving this a try. I have tried MLX using Rapid MLX however the LLM (Qwen) would always have hiccups and get stuck repeating itself.
Moving onto llama.cpp I was able to get faster tokens with MTP and a more reliable llm.
I wonder what other people's experiences are using MLX vs llama.cpp
by shitcoder - Same here. Tried MLX twice at different times after reading the claims here but it always does considerably worse for me than llamacpp.by regexorcist
- FWIW on my M1 Max I have not really seen any advantage at all from MLX.
I am fully prepared to believe the benefits accrue more to the M3 and up (because of changes to the Apple Neural Engine).
But with the models I've tested, unless I am missing something, the performance of GGUFs in llama.cpp has been better in some cases.
I still have not had results from Gemma 4's MTP be really worth it, to be honest; but with the Qwen 3.6 MoE it is measurable. Maybe with newer kit it is more meaningful.
(There is every chance that the above is not the experience of anyone who really deeply knows what they are doing; it feels like I am a perpetual novice at this stuff)
by dofm - Is Gemma 4 E2B actually "usable"? I've been running Gemma 4 12B and it handles everything very well! But the second I've moved down to E4B it's been unable to perform the simplest of tasks. So I can't even imagine how E2B would do... Or am I doing something wrong?by Daunk
- I really don't like the marketing texts. "Why we’re open source when nobody else is." I'm using oMLX which is open source and seems to be doing everything Nativ offers. I'd rather see the comparison with existing "non-existing" open source competitors.by Nekorosu
- What they likely mean is, why options like LM Studio are not open source.
- Genuinely curious: what are people using these smaller local models for? They are getting decently capable, but they are still small enough that I don't trust them for "real" work outside of a handful of fun toy projects.
Are people actually using them in coding agents? Or are they mostly using them for other things?
by JosNun - Qwen35ba3b can do a huge amount of data cleaning work on pretty modest hardware. Already have run about 100 billion tokens on it using 2x3090 gpus.by mips_avatar
- I use a gemma4 model locally to extract content from messages to a personal agent I'm building for its memory graph (to break the message up into the topic, source (assistant or owner), facts, entities, etc. in the message content (all getting thrown into a magma-esque graph using NLEmbeddings for memory search). This is for a custom personal agent that targets deepseek-v4 flash. The local model is too slow in my setup for a chat agent, but for memory extraction it works pretty well, saving API usage on every chat turn.by efficax
- They're great at helping me look up web dev stuff when I don't have internet access.
- there is plenty of grunt work these smaller models can do. update dependencies, fix merge conflicts, write --help, markdown, or readme files for existing code. etc.
sometimes they fail but undo is just a "git restore" or if automated, rejecting a PR and having a better model take a crack at it.
by jiqiren - I don't use them as coding agents, but they can be very useful for things like text transformation, summarizing, or text extraction.
That said, if you have a subscription to a paid model already, you're not necessarily winning out on anything except perhaps privacy, which isn't nothing.
by netghost - We've shipped some code generated by Qwen3.6 27B to production (under OpenCode). It lacks the breadth of knowledge of models like Opus, but if a change is fully inferable from the prompt and the surrounding code, it works very well. It won't be able to write something from scratch that requires niche knowledge (say, a performant inference engine tailored to Blackwell GPUs), but if it's just a PR adding a new use case to an existing project (which is usually just "load from the DB, do some invariant checks, modify the entities, store them back"), it works as well as Sonnet (provided you have the correct configuration, like recommended temperature and top-p settings, the model isn't over-quantized, you have at least 150k tokens of context available, etc.).by kgeist
- I'm surprised that their home page basically acts as if LM Studio and others don't already do this. It's not clear what the difference is from a glance.
It also omits Open WebUI. I've been running Deepseek V4 Flash locally on my Macbook Pro for weeks using Open WebUI + DS4.
by D13Fd - What spec is your macbook? I want to run Deepseek V4 Flash but its too slow for agents on my Strix Halo.by syntaxing
- I was wondering the same and assuming I'd overlooked something.by lylejohnson
- "The other “local AI” apps you’ve heard of? They’re proprietary shells built on top of open-source engines they don’t own."
This is a roundabout way of addressing LM Studio.
by wmf - LM Studio seems to do the same thing, except that LM Studio is not open source. So they have a point, they do something more.by kzrdude
- LM studio is closed source software built ON TOP OF code released by the author of Nativ.by moostii
- Is „frontier“ overused? I thought frontier models were the best-of-the-best such as Fable right now. I assume you can’t host these models yourself since you would need many GB of RAM and expensive GPU of is my thinking of „frontier models“ wrong?by moontear
- +1 came here to say this, I opened the link expecting some technical breakthrough. Misleading click bait title.by 44za12
- No, your thinking is 100% correct. It's called clickbait.