Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Does Anthropic/OpenAI use PyTorch to train?
    by brcmthrowaway
  • https://idlemachines.co.uk/courses/foundations doesn't render correctly on mobile
    by Synthetic7346
  • even the submitted page doesn't, huge margin if you zoom out on mobile (Firefox)
    by moelf
  • The host website seems extremely interesting in general. Anyone here used it before?
    by vovavili
  • I think the methodology is interesting, but you can probably design a similar, and probably better loop for "diving" into a topic and going through examples than is presented.

    I have to imagine they just asked Claude to dive into a topic and generate example problems along the way.

    As for the content... a lot feels like knowledge overload and concepts are introduced without explanation or "why". It basically says "here is a training loop" and never answers my immediate question of "...for what?" It also introduces random concepts like setting the seed that don't look like they're even in the final training loop it provides.

    As a comparison, Pytorch itself has docs that go over the entire training loop as well. And it explains why you're loading the data its loading. With examples that run instead of being scattered on.

    by blharr
  • The design is similar to what Claude generates. Makes me skeptical that all the content is AI-generated.
    by f3408fh
  • PyTorch already does a huge job at keeping DL not verbose. It captures the complexity to allow you to make a whole GPT model with it, running on your GPU, and keep the code readable. Yes, there are a lot of breaking points, but at some point, DL is supposed to be non trivial, it handles math concepts most people don’t understand. That is why Data Scientists have a job ;)
    by GL26
  • I mean partial derivatives aren't that complicated if you know normal derivatives, which most people do. And backpropagation isn't too difficult either.

    The value of PyTorch lies more in utilizing accelerators like GPUs while offering a nice abstraction. But you can build your own (inefficient) tensor library without too much effort as e.g. Andrej Karpathy has shown in his "NN zero to hero" youtube series.

    by sva_