Tell HN: Azure outage

Tell HN: Azure outage

885 pointsby tartieret806 comments

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • Ouch, and login.microsoftonline.com too - i.e. SSO using MS accounts. We'd just rolled that out across most (all?) of our internal systems...

    And microsoft.com too - that's gotta hurt

  • Currently standing in a half closed supermarket because the tills are down and they cant take payments
  • For some reason an Azure outage does not faze me in the same way that an AWS outage does.

    I have never had much confidence in Azure as a cloud provider. The vertical integration of all the things for a Microsoft shop was initially very compelling. I was ready to fight that battle. But, this fantasy was quickly ruined by poor execution on Microsoft's part. They were able to convince me to move back to AWS by simply making it difficult to provision compute resources. Their quota system & availability issues are a nightmare to deal with compared to EC2.

    At this point I'd rather use GCP over Azure and I have zero seconds of experience with it. The number of things Microsoft gets right in 2025 can be counted single-handedly. The things they do get right are quite good, but everything else tends to be extremely awful.

  • Google cloud run or cloudflare workers it is.

    Personally I am thinking more and more about hetzner, yes I know its not an apples to orange comparison. But its honestly so good

    Someone had created a video where they showed the underlying hardware etc., I am wondering if there is something like https://vpspricetracker.com/ but with geek-benchmarks as well.

    This video was affiliated with scalahosting but still I don't think that there was too much bias of them and they showed at around 3:37 a graph comparison with prices https://www.youtube.com/watch?v=9dvuBH2Pc1g

    Now it shows how contabo has better hardware but I am pretty sure that there might be some other issues, and honestly I feel a sense of trust with hetzner I am not sure about others.

    Either hetzner or self hosting stuff personally or just having a very cheap vps and going to hetzner if need be but hetzner already is pretty cheap or I might use some free service that I know of are good as well.

  • It still surprises me how much essential services like public transport are completely reliant on cloud providers, and don't seem to have backups in place.

    Here in The Netherlands, almost all trains were first delayed significantly, and then cancelled for a few hours because of this, which had real impact because today is also the day we got to vote for the next parlement (I know some who can't get home in time before the polls close, and they left for work before they opened).

  • I noticed that Starbucks mobile ordering was down and thought “welp, I guess I’ll order a bagel and coffee on Grubhub”, then GrubHub was down. My next stop was HN to find the common denominator, and y’all did not disappoint.
  • Update 16:57 UTC:

    Azure Portal Access Issues

    Starting at approximately 16:00 UTC, we began experiencing Azure Front Door issues resulting in a loss of availability of some services. In addition. customers may experience issues accessing the Azure Portal. Customers can attempt to use programmatic methods (PowerShell, CLI, etc.) to access/utilize resources if they are unable to access the portal directly. We have failed the portal away from Azure Front Door (AFD) to attempt to mitigate the portal access issues and are continuing to assess the situation.

    We are actively assessing failover options of internal services from our AFD infrastructure. Our investigation into the contributing factors and additional recovery workstreams continues. More information will be provided within 60 minutes or sooner.

    This message was last updated at 16:57 UTC on 29 October 2025

    ---

    Update: 16:35 UTC:

    Azure Portal Access Issues

    Starting at approximately 16:00 UTC, we began experiencing DNS issues resulting in availability degradation of some services. Customers may experience issues accessing the Azure Portal. We have taken action that is expected to address the portal access issues here shortly. We are actively investigating the underlying issue and additional mitigation actions. More information will be provided within 60 minutes or sooner.

    This message was last updated at 16:35 UTC on 29 October 2025

    ---

    Azure Portal Access Issues

    We are investigating an issue with the Azure Portal where customers may be experiencing issues accessing the portal. More information will be provided shortly.

    This message was last updated at 16:18 UTC on 29 October 2025

    ---

    Message from the Azure Status Page: https://azure.status.microsoft/en-gb/status

  • Preliminary post incident review: https://azure.status.microsoft/en-gb/status/history/

    Timeline

    15:45 UTC on 29 October 2025 – Customer impact began.

    16:04 UTC on 29 October 2025 – Investigation commenced following monitoring alerts being triggered.

    16:15 UTC on 29 October 2025 – We began the investigation and started to examine configuration changes within AFD.

    16:18 UTC on 29 October 2025 – Initial communication posted to our public status page.

    16:20 UTC on 29 October 2025 – Targeted communications to impacted customers sent to Azure Service Health.

    17:26 UTC on 29 October 2025 – Azure portal failed away from Azure Front Door.

    17:30 UTC on 29 October 2025 – We blocked all new customer configuration changes to prevent further impact.

    17:40 UTC on 29 October 2025 – We initiated the deployment of our ‘last known good’ configuration.

    18:30 UTC on 29 October 2025 – We started to push the fixed configuration globally.

    18:45 UTC on 29 October 2025 – Manual recovery of nodes commenced while gradual routing of traffic to healthy nodes began after the fixed configuration was pushed globally.

    23:15 UTC on 29 October 2025 - PowerApps mitigation of dependency, and customers confirm mitigation.

    00:05 UTC on 30 October 2025 – AFD impact confirmed mitigated for customers.

Explore Birbla archives

Tell HN: Azure outage · Birbla