Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Would be good to see how it compares to the embedding models from https://www.voyageai.com/ for text. I have used these a few times in the past and have found them superior to the Qwen models compared to here.
    by dcl
  • The JetBrains post from a few days ago introduced to me the idea of using binary quantization rather than MRL. Would that work with EmbeddingGemma2 or is there some reason why the approach might be fundamentally incompatible? https://news.ycombinator.com/item?id=49956148

    *summons a minimaxir*

    by kaycebasques
  • I think I caused this release because I just embedded a sizable corpus with the previous model two days ago! You’re welcome everyone.
    by teaearlgraycold
  • Note that unlike prior on device embedding models, this seems to be trained with MRL, not MatFormers, meaning you don’t get to shrink the model weights alongside the lower dimensional embeddings, unfortunately. Likely there’s not good research for how to do MatFormers for multimodal yet?
    by aabhay
  • Hats off to google for offering OSS (or at least open weights + license) a model that would be probably pretty closed to what they would ship in their Android phones.
    by flockonus
  • Finally. I was getting annoyed that there's been an inflection point in how LLMs/agents work but there hasn't been a good moderate-size embeddings model, and this one is multimodal too! 270M for text only is great compared to older embedding models, and a total 440M for text + vision is also fair.

    I also may or may not have a tool for much faster local embedding creation that I calibrated for EmbeddingGemma but didn't want to release until a better embedding model came along.

    by minimaxir
  • It's also very neat that this can be used for "Jev"-like tasks with text and image.

    https://developers.google.com/edge/mediapipe/solutions/decis...

    by Nautman
  • I really appreciate that EmbeddingGemma 2 is under the Apache 2.0 license.

    For embedding models in particular, I don't think it makes sense to use a closed, proprietary, hosted-only model.

    Most applications of embedding models involve calculating thousands or even millions of embedding vectors and storing them for later comparison.

    If your model is proprietary, the vendor is likely someday going to decide to stop offering that model. They'll have a better model to replace it, but you still need to pay to re-calculate those millions of stored existing vectors.

    (In April 2024 OpenAI offered to "cover the financial cost of users re-embedding content with these new models" - https://openai.com/index/gpt-4-api-general-availability/ - but I don't think that's something we can rely on from every provider.)

    Notably, I don't want to host the model myself. I'd much rather pay a provider for a hosted model while knowing that if they ever stop hosting it I can run the open weights version myself - or find another vendor who can do that for me.

    by simonw

Explore Birbla archives