Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

    I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp · Birbla