Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • First off, cool project! It's always great to see derivatives that question the efficiency of the established product.

    I think the main thing the readme is missing is the core benefits. Reducing LOC and dependencies is cool, but it would be great to understand if this provides some additional benefits like lower latency or memory requirements.

    by freshtake
  • I like the API, and since this is open source I will copy the design with attribution: I have been organically hacking little bits of LLM client code for most providers in Common Lisp for about 3 1/2 years and it is time to clean up all my old code. I probably need to do the same sort of refactoring for my search API wrappers.

    Thanks for the cool project.

    by mark_l_watson
  • It would be great if there were a plugin/extension infrastructure. For example, to write the cache and costs however and whenever I see fit
    by dlojudice
  • I imagine many people code their own LLM client after getting fed up with the bad options out there. It’s very easy with ai coding tools.

    I’m biased but I think mine is coded to a higher standard than litelm. https://github.com/s-banach/langchaint

    by hopfenspergerj
  • Funny, everything you pruned away is the reason I’m deploying LiteLLM in our platform. Having a reliable way to track token spend per customer across different services is important to us, and LiteLLM handles this well
    by 9dev
  • One of the 2 dependencies, httpx, isn't really maintained anymore. Pydantic picked it up as httpx2: https://pydantic.dev/docs/httpx2
    by clickety_clack
  • I strongly recommend the authors rewrite the readme by hand. It’s kind of a snif test for how much care someone put into this project.
    by khalic
  • This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept.

    The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.

    by Centigonal

Explore Birbla archives