What's the best hands-on path to learn ML inference infrastructure?

What's the best hands-on path to learn ML inference infrastructure?

5 pointsby censor52 comments

Comments

Hacker News

Since Anthropic trains on Sagemaker on AWS, what about some Cloud Certifications?

by tcp_handshaker

Following this. my plan has been to start simple and eventually build out the inference stack piece by piece, however simple. Take some open weights model and from first principles build kernels and a harness for it.

Given that AI is already so good at swe at this point, it feels harder to get a callback because they're probably super AI pilled and I have no idea how good AI is at writing the things that these guys need for performance (I mean, judging from my local work, they seem pretty good at what I'm trying to learn, but I am a beginner in the field). I've received no callbacks either though so I don't know.

by sigbottle

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • Since Anthropic trains on Sagemaker on AWS, what about some Cloud Certifications?
  • Following this. my plan has been to start simple and eventually build out the inference stack piece by piece, however simple. Take some open weights model and from first principles build kernels and a harness for it.

    Given that AI is already so good at swe at this point, it feels harder to get a callback because they're probably super AI pilled and I have no idea how good AI is at writing the things that these guys need for performance (I mean, judging from my local work, they seem pretty good at what I'm trying to learn, but I am a beginner in the field). I've received no callbacks either though so I don't know.

What's the best hands-on path to learn ML inference infrastructure? · Birbla