HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc)

HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc)

7 pointsby LozzKappa0 comments

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.