Birbla

Comments

Hacker News

may I ask why you named it Arda? haha

by ardatasci

That's kinda neat. Do you do any decoding tricks to handle varying processing capabilities across device models and ipads? Like shortening ctx length or maybe looking into the LFM models that have MoEs with like 1b active?

by sango_ta

Right now I am just restricting it to devices with 8GB RAM. I plan to start testing older phones soon to see if I can get it running well on them. MoE with low active params is interesting. I wonder if there is smaller models based on specific pairs (En/Es, ect.)

by cjjuice

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • may I ask why you named it Arda? haha
    by ardatasci
  • That's kinda neat. Do you do any decoding tricks to handle varying processing capabilities across device models and ipads? Like shortening ctx length or maybe looking into the LFM models that have MoEs with like 1b active?
    by sango_ta
  • Right now I am just restricting it to devices with 8GB RAM. I plan to start testing older phones soon to see if I can get it running well on them. MoE with low active params is interesting. I wonder if there is smaller models based on specific pairs (En/Es, ect.)
    by cjjuice

Related stories

Microsoft Can Track Users via a Windows Device ID

pcmag.com · 337 points · 150 comments

GitLost: We Tricked GitHub's AI Agent into Leaking Private Repos

noma.security · 161 points · 57 comments

OpenBSD has a use-after-free allowing local privilege escalation to root

nvd.nist.gov · 137 points · 65 comments

Free Mermaid Diagram Editor

moxiedocs.com · 41 points · 11 comments

EU now one step away from reviving private message scanning rules

cyberinsider.com · 11 points · 1 comments

Decoding the obfuscated bash script on a Uniqlo t-shirt

tris.sherliker.net · 1072 points · 181 comments