Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Anyone know how hot an iPhone gets running the Neural Engine flat out for 10 minutes?by spacecoder2
- Not Qwen, Bonsai. Although it is based on Qwen, and achieves similar scores, it is not the "full" Qwen.
Last I remember, when trying to run a model above 1-2 GB on iOS, it would refuse to do so, at least from Locally AI. iOS only allows apps to use about 1-2 GB of RAM before being killed. Though using their Neural APIs might bypass this.
by createful - Hi. Could anyone share any recommendations (hopefully with actual links) for App Store apps to try running such local models? I’m not really interested in side-loading since it currently seems (to me) more of an hassle than it’s worth.
App Store search is broken in a sense that there might be so many apps claiming to be local but once you read reviews, it’s just another scam where it’s it’s usually sending your query to remote server.
by analog_daddy - OP, asking for upvotes is against the HN guidelines: https://x.com/anemll/status/2111531629529456771by Retr0id