Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • It's cute that someone at GitHub had time to make their hamburger menu pancakes to promote stacked PRs, but nobody has time to make the platform stable.
    by cebert
  • Dealing with an incident on prod is extra difficult when your pipelines are not running.
    by buzzwords
  • yepsies
    by SwiftyBug
  • Incident number 6 for the month of August, notably on August 6th. This pattern does not bode well.
    by KyleTheDev
  • Four of them were regarding AI/Copilot. So that's really just one long running incident and will probably continue to be 50/50 chance of being down.
    by paularmstrong
  • Given the recent history of outages, I wonder how many are seriously considering moving off GitHub for anything other than code hosting. I mean actions / workflows.
    by opiniateddev
  • how hard could it be these days for a mid to large size eng company to have their own gitlab/hub type solution hosted in aws
    by steve-atx-7600
  • Forgejo selfhosted for a few months now. Its all good and cost nothing.
    by wilburx3
  • What would you guys recommend as an alternative? Both hosted and/or self hosted
    by Isaackoz
  • Mitchell Hashimoto had a blog post a few months ago talking about him moving off of GitHub: https://mitchellh.com/writing/ghostty-leaving-github

    This is a man who's spent a significant portion of every day for the last 15 years on GitHub.

    by jjice
  • Our deployments are triggered by GitHub Actions, and it is a pain to deploy without it (specifically collecting the credentials and putting them into variables the shell will read).

    This is multiple times this month that this has been a problem.

    Has GitHub completed it's internal migration to Azure yet? Or is it still ongoing? None of our devs want to switch away from GH, but we will have to at this point.

    by exac
  • We've been working on this at Depot[0]. We built the internals of Depot CI as a general-purpose workflow engine that understands GitHub Actions as an input (with plans to extend) - we've been working to make Actions runners more performant and more reliable for a while, but eventually you hit a ceiling if you don't also control the control plane.

    [0] https://depot.dev

    by jacobwg
  • GHA still beats Circle CI or trying to run your own Jenkins - even with all the downtime. I'd move in a heartbeat if there were good alternatives.
    by avree
  • To offer a data point (not a tribalist argument): GitHub Actions being down this often is still less expensive than the cost of switching everything somewhere else. Would rather have my team walk away from the PRs and do other tasks than have engineering effort, meetings, design pages, scheduling, etc. for switching over.

    This is annoying and I'm here because it's down. But it would have to be far worse to come close to actually being worth changing.

    by Waterluvian
  • Can't wait for the Graphite/Cursor alternative (Origin) to become available. Actions being down for an hour in the middle of the US East workday is crazy. It's super frustrating to be an enterprise customer of Github, seems like we don't get any dedicated resources or additional stability. At this point our only option is self-host github enterprise or move away.
    by peterldowns
  • Would you move hosting/CI before Origin is available, or are you basically stuck on GitHub until then?
    by stephenway
  • jenkins running on an old Dell under a desk from someone who left the company 18 months ago looks more reliable these days haha
    by alamsterdam
  • It would seem like GitHub is in a precarious situation.

    We have many agents per employee working in parallel pushing way more commits than was humanly possible before AI, triggering GitHub actions a lot more than the workflows were built for, causing Actions costs to escalate (they really aren't cheap if you compare to hosting it yourself), meanwhile working with YAML workflows is just a pain, and just writing code would be so much more fun and AI compatible[1].

    At the same time, GitHub has about ~3 different PR review UIs? And they're all half-bad? Any decently sized PR triggers their "optimized for large PRs" UI which jumps around randomly in my experience. If you don't get that UI and keep the scrolling one (there's an old and a new one btw) then god forbid you click a line number because at some point your browser will randomly scroll back to that line and it won't unstick. Now Linear[2] (and others) is replacing the PR review experience for the agentic era.

    I'd love to see a solid AI first Git + CI + reviews.

    [1] Cloudflare CI https://blog.cloudflare.com/ci-workflows/

    [2] Linear PR reviews https://linear.app/changelog/2025-01-23-pull-request-reviews

    by blixt
  • Sounds like https://entire.io/ ?
    by qznc
  • It's been hours :(

    I have sympathy for the on-call team trying to resolve it, most of us have been there done that.

    But seems something is systematically going wrong at GH

    by alamsterdam
  • Time to touch some grass. Better use of my time and energy than twisting the remaining things on my todo list today to make more progress on them than I have managed. I should have taken a long lunch but I rebased the hell out of a PR instead.
    by hinkley
  • They're one rewrite in Rust away from fixing everything. (jk)
    by tempaccount420
  • "most of us have been there done that" - so true. That feeling in your gut when you realize something you just did caused an outage is pretty unique.
    by niwtsol
  • It's honestly insane how terrible their reliability is. Over the past 4 weeks, 8 days with GitHub Actions outages, many of them multi-hour outages: >3 hours on each of July 9th, July 20th and today, and 1.5 hrs on July 23rd.

    Outages happen, but this many outages so close together, and so many of them so major/long lasting, something is systematically wrong for sure. It's been seriously hamstringing our ability to ship code at my company.

    by yashap
  • > But seems something is systematically going wrong at GH

    Yes, we call it: Microslop.

    by mococa
  • At this point maybe they should consider sending out announcements when it is working instead
    by m132
  • #0-nines
    by steve-atx-7600
  • I once saw a sign at a railway station in the UK that actually did say "normal service will be operating between the 12th of July and 18th of August" (or something like that). Made me laugh. At the time Anglia Railways had a rail replacement bus literally every weekend.

    I thought they should rename to Anglia Busways and have bus replacement trains instead.

    by IshKebab
  • I love how even self hosted workers don't work during these outages - running jobs on their infrastructure being flakey is marginally acceptable, but the API to simply schedule workflows having this availability is mind boggling. Github just doesn't seem like a serious company anymore.
    by arandomhuman
  • gitlab-ce can run all the integration tests in docker et al.

    Sitting on Github these days is the same as sticking to twitter a decade ago, expect next mecha hitler, I suppose.

    by cyanydeez