Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Hmm. What would be really helpful for me would be an enhancement of the TypeWhisper app for dictation that would be able to get the context of what I am dictating into and send it along with the prompt to an LLM.

    Probably much simpler and much less of a privacy problem (I run my own local LLM for that purpose so that nothing leaves the machine).

    by jwr
  • > reads the text of your focused window every few seconds through the Accessibility API

    > It writes plain markdown

    Where are the formatting decisions coming from?

    by zahlman
  • Update: I've added a prompt to process the raw output into something more useful: https://github.com/dragthelake/ambient-context/blob/main/doc...

    This is pretty magical tbh

    Also added MIT license and added some more pruning to reduce initial capture by around 10%.

    by Dramatize
  • Nice constraint. I've been building in this space for a while now and the lossiness question is a real one. The accessibility tree works for a lot of things but the more I worked on it the more stuff I found needed pixels.

    YMMV.

    by jv22222
  • The per-app breakage is the real problem with text extraction, not accuracy, like etchalon pointed out. Screenshots dodge that since they look the same no matter what is rendering. Cropping to the window and marking it up before it goes anywhere also skips the full screen recording and the orange icon. https://slimsnap.ai already works that way.
    by bickov
  • A cool project, but feels like fundamentally the wrong approach when what you do most likely leaves a string of structured digital footprints anyway. I’ve got an agent that fills out my timesheets by looking at git commits, agent history, Slack messages, emails, and time-tracker tickets. I guess I could add relevant web-browsing?
    by petesergeant
  • I've released the v 1.0.0 with a bunch of improvements + a signed app. It's the first time I've done this, so still working out exactly what's required: https://github.com/dragthelake/ambient-context or ambientcontext.app
    by Dramatize
  • One app that's using this technique (not exactly sure if it's the same) is Littlebird: https://littlebird.ai/

    I also saw that HeyClicky started doing something similar but end up removing from the product.

    by Dramatize

Explore Birbla archives