Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Recently I tied OCR with Opus 4.8. (I know, not technically right tool for the job). All I needed to do was extract dates from receipts. It got about 20% of the dates wrong yet rated all as “high confidence”.

    Should have probably tried a more OCR specific model

    by Insanity
  • Tested with Malayalam, normal handwriting got accurate but a slight different style got detected as kannada. Have samples if required, which sarvam got done with 99% accuracy leaving one text error.
    by sreekanth850
  • Little on differences other than bounding boxes and double the price compared to their previous OCR v3 model from December - https://mistral.ai/news/mistral-ocr-3/ - other benchmarks were used back then.
    by mcbetz
  • All AI labs really need to stop using truncated y-axes for benchmark bar charts...

    https://mistral.ai/_astro/cm-engish_ZhlvoT.webp?dpl=6a3a94bd...

    by beklein
  • It's cheap at $4/1k, but I'm hesitant to even benchmark this one again since the previous versions were all "98% accurate based on internal benchmarks of 4 pdfs" and ended up falling short of almost everything else on the market [1].

    Even in this one, they just report that OlmOCRBench and OmniDocBench have "known limitations" and that's why they report flagship numbers from their internal benchmark.

    https://getomni.ai/blog/benchmarking-open-source-models-for-...

    by themanmaran
  • It'll be interesting to see how this ranks against https://github.com/baidu/Unlimited-OCR
    by mdrzn
  • I’ve always thought the US Postal Service is such a technological marvel. They somehow manage to identify and route billions of pieces of mail and I have to imagine their tech is significantly more primitive than this. Not only that but US addresses are absurdly non-standardized, you can often write the same address multiple ways and have it deliver to the same location. I’m sure there’s plenty of published knowledge in this area, but whenever I see announcements about OCR it feels like this should be a solved problem if it’s been accomplished at the scale of USPS for many years.
    by ericyd
  • A tangential observation: the video on the linked page wasn't what I expected. I thought Mistral was a european AI company, so I didnt expect the video to be filmed in San Francisco featuring three people who don't seem to be european.

    I'm not against them being a global organization, that's wonderful. I was just surprised. I expected a parisian office and european accents.

    by andrewmutz

Explore Birbla archives