Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • The best desktop automation system would take HDMI input and output USB keystrokes and mouse movements so that it can be plugged into any computer transparently, including work computers.
    by xnx
  • Really interesting idea! The demo made me realize I just assumed screenshot-based control was the only option.
    by hithere12
  • I presume this only works if you use native OS interfaces like MFC in Windows, Cocoa in macOS or GTK in Linux.

    It would be nice if it could work if you use GUI libraries that talk directly to hardware like Capy for Zig, egui for Rust or Dear ImGui for C++.

    by DeathArrow
  • Looks very interesting. Especially like that language environment is abstracted away, through cli, such that one are not stuck with for example python to write your UI logic (or create your own cli wrapper around PyAutoGUI).

    How can one help with implementing Linux and Windows support?

    by someone654
  • I actually built nearly the same tool under the same name: https://agent-desktop.dev And I've seen a couple other similar projects since then too! Seems like a lot of us are thinking in the same direction.

    One wrinkle I found is that there wasn't a cross-platform library for accessibility APIs, and each platform is a bit different. I made an a11y library that supports Mac, Windows, and X11 and Wayland on Linux with consistent interface: https://xa11y.dev

    by _crowecawcaw
  • I've long thought about why the tools we have operate on screenshots, and not the accessibility tree. To me the latter would have seemed like the obvious choice from the beginning (structured data), but yet, here we are with pixels. Happy to see progress being made here.
    by TheFragenTaken
  • Looks interesting but like every single one of these computer use apps I've seen, it's macOS only.

    Does anyone know of a linux one?

    by esperent
  • lahfir, I vouched your (currently still dead) comment because it was interesting to me.

    I expect the reason it is dead is that it seems LLM-generated (you "quietly" launched it on github? Who says that?).

    Also, your comment claims that the tool is cross-platform and implies that it works on Mac, Windows, and Linux, but the graphic on the github README says it only works on Mac.

    by jstanley

Explore Birbla archives