Birbla

Comments

Hacker News

Wow this is a cool prototype and looks amazing. I am surprised some level of baseline intelligence survives this kind of aggro quantization. Do you think 300mb initial download is ok for something like quick website where I want to ask quick support question? Are you planning to have hosted fallback to answer q while download is happening?

by debdattabasu

Thank you :) Currently I am not planning to have hosted fallback Q&A but it's a nice idea. It should only download the ~300mb initially once and then use the cached model.

by stfurkan

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Wow this is a cool prototype and looks amazing. I am surprised some level of baseline intelligence survives this kind of aggro quantization. Do you think 300mb initial download is ok for something like quick website where I want to ask quick support question? Are you planning to have hosted fallback to answer q while download is happening?
    by debdattabasu
  • Thank you :) Currently I am not planning to have hosted fallback Q&A but it's a nice idea. It should only download the ~300mb initially once and then use the cached model.
    by stfurkan

Related stories

l: A new runtime for k and q

lv1.sh · 142 points · 84 comments

Halo – open-source, tamper-evident runtime evidence for AI agents

github.com · 35 points · 20 comments

Decoding the obfuscated bash script on a Uniqlo t-shirt

tris.sherliker.net · 1063 points · 181 comments

StreetComplete: Fixing OpenStreetMap, one tiny quest at a time

streetcomplete.app · 761 points · 182 comments

Every new car sold in the European Union must include a driver monitoring camera

allaboutcookies.org · 737 points · 969 comments

Chat Control 1.0 and 2.0 Explained

fightchatcontrol.eu · 645 points · 238 comments