Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- this is super interesting. Looking forward to trying this out!
- How long was it trained for? How many tokens?by ericb
- Amazing, i’ll try to learn from your code. Thanks!by memezed
- I'm genuinely curious how much of this is LLM generated?by isatty
- Mentioning neural ODE doesn't make sense here, as this is unrelated. Basically any implementation of transformer uses residuals, but you're not really training a neural ODE here.
Also consider getting rid of the em-dashes. I don't know if you mostly vibe-coded this or not, but the README is pretty clearly AI generated.
by tdesilva - Wow that's really cool i'll definitely check it out! have played around with machine learning algorithms built from scratch in c / cuda too, but once i hit the cuda part of it i kinda just left it to the side. i'm curious how did you use CUDA to optimize the matrix multiplications? how optimized is training, does it take much longer then using pytorch?by AndReics