Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • I'm building something that is only pointed at Claude, and I don't anticipate moving away from the Anthropic ecosystem. Does RubyLLM offer me an advantage over directly using Anthropic's Ruby SDK?

    To put it differently, is this more like choosing between Fog and aws-sdk-s3, or choosing between Active Storage and aws-sdk-s3?

    by aaronbrethorst
  • We use RubyLLM in production too, the most elegant library in this space I've seen so far.

    I also liked how they run the issue tracker. If you select "Feature Request", it makes you explain how you explored workarounds, why you believe it belongs in RubyLLM etc to prevent scope creep.

    by rohitpaulk
  • We've used RubyLLM for ~6+ months and it's been mostly OK. The API/Dev UX is good but we have seen little success with engaging the maintainer on PRs, and have noticed a lot of vibe coded PRs being merged (including some rewrites of PRs we submitted) - I suspect an minimal API compatible gem with similar heuristics would do well.
    by qrush
  • RubyLLM is very easy to use. Made extensive use of it for a project last year. Drawbacks are it was difficult to instrument for true trace observability and it has a pattern where retries will delete the underlying models so the history you see is clean but not necessarily great for seeing exactly what the sequence of API calls was.
    by Finbarr
  • We use and love RubyLLM! A wonderful and easy to use framework.

    Agreed with another commenter on the frustration with the responses API not being naively supported; that seems like a huge miss. There is a connector from another dev, but it's buggy and not as high quality as the main gem.

    Really looking forward to future development and especially 2.0!

    Edit: Just saw that responses API is now native? I will definitely check that out.

    by MitziMoto
  • I have an open source gem called Raix that builds on top of RubyLLM's abstractions and is quite popular. https://github.com/OlympiaAI/raix
    by obiefernandez
  • Congrats Carmine on being featured!

    I am using RubyLLM for quite some time and I am in love with the API design. If someone wants to see how this looks in a real project including custom tools, you can have a look at the SerpTrail project on GitHub.

    The Chat model still is just:

      class Chat < ApplicationRecord
    acts_as_chat model: :llm_model
  end
    More: https://github.com/serpapi/serptrail

    I am quite excited for RubyLLM 2.0 and beyond.

    by strzibny
  • I found Ruby LLM to be surprisingly good - in terms of usability it's close to Vercel's AI framework.

    It tries to strike a balance between working out of the box and being flexible... which has its challenges, still nice overall.

    One big real-life pain I experienced is that caches don't always work, e.g. for xAI, since it only supports completions API and thought signatures are returned wrong.

    by swe_dima

Explore Birbla archives