Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- The claim that these models "run on almost any phone" as well as the in-app indicator of performance that says it may "run comfortably" are some serious exaggeration. Tried running Qwen 0.5B on mine [1]. It took five minutes to produce "I am a large language model created by Anthropic" (lmao) and then stopped outputting anything at all. I am not expecting you to somehow make the models perform better or whatnot, I just believe that the performance claims need review.
[1]: https://m.gsmarena.com/xiaomi_redmi_note_13_pro-12581.php
by andOlga - This is very interesting. I have not tested it (yet) but I believe this is what will come next when talking about "AI will be everywhere".
The self-contained disconnected mode is very convenient, though it could be useful to have an "online access" mode to allow it to access the Internet and perform lookup.
by simon84 - "Download the apk from my website. Android will warn you because it did not come from the Play Store - that is normal for a direct download."
mmmh not the best presentation.
Established alternatives:
- Google AI Edge Gallery
- MLC Chat
- PocketPal AI
by mdrzn