Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • Interesting. Will it be able to run on Macbook M4 with 16gb ram. I wanna try it
  • You may need to select a smaller model, but an M4 with 16GB ram should work!
  • Once trained and fine tuned, can the model be uploaded or transferred to a lower spec server somewhere (eg a cheap cloud server) to use as an on-demand service, or does inference carry the same fairly beefy hardware requirements?