GitHub Partial Outage

https://www.githubstatus.com/incidents/1jw8ltnr1qrj

63•danfritz•1h ago

Comments

danfritz•1h ago

Related to the recent announcement they are moving to Azure?

the_af•1h ago

Wow. It wasn't already running on Azure? What was it (or is it) running on?

noir_lord•58m ago

iirc it's been a while they where on rackspace when Microsoft bought them out - there was an article a few months ago saying they where moving to Azure and freezing new features while they do the move[1].

[1] https://thenewstack.io/github-will-prioritize-migrating-to-a...

Honestly I don't know half the features they have added because the surface is huge at this point everyone seems to be using a (different) subset of them anyway.

So a feature freeze isn't likely to have much impact on me.

EDIT: went and checked - https://github.blog/news-insights/github-is-moving-to-racksp... not sure if they moved again before the MS acquisition though.

le_stoph•56m ago

In the Pragmatic Engineer podcast episode with the former CEO of Github, the latter mentioned that they had their own infra for everything. If I remember correctly, this was due to the fact that Github is quite old and at the time when Github Actions became a thing, cloud providers were not really offering the kind of infra that was necessary to support the feature.

saghm•54m ago

I can't read the entirety of this article[1] because it's paywalled, but it looks like they ran their own servers:

> GitHub is currently hosted on the company’s own hardware, centrally located in Virginia

I imagine this predates their acquisition from Microsoft. Honestly, given how often Github seems to be down compared to the level of dependency people have on it, this might be one of the few cases where I might have understood if Microsoft embraced and extended a bit harder.

[1]: https://www.theverge.com/tech/796119/microsoft-github-azure-...

loloquwowndueo•52m ago

Well… https://www.reuters.com/technology/microsoft-azure-down-thou...

saghm•13m ago

Fair enough, my Azure experience is minimal enough that maybe I shouldn't make assumptions about whether this would improve things. That being said, I do think there's merit in the idea that if Microsoft is going to be able to solve this problem, they probably should try to solve it just once, and in a general way, rather than just for Github?

balamatom•5m ago

>Microsoft

>solve it just once, and in a general way

drcongo•51m ago

Oh no. I look forward to watching my browser redirect 40 times on every attempted page load.

bob1029•48m ago

https://news.ycombinator.com/item?id=45517173

stackskipton•3m ago

Doubt it. I'm Ops person on Azure, while they just had terrible outage recently, they tend to be as stable as any other cloud provider and I haven't had many issues with Azure itself compared to whatever slop the devs are chucking into production.

Fokamul•2m ago

Not Sharepoint? What a bummer.

arccy•1h ago

Your weekly reminder to take a break

theletterf•1h ago

I was getting crazy thinking that there was something wrong with my SSH keys all of a sudden. Thanks $DEITY it's just GitHub.

no_wizard•1h ago

Same. I reflex replaced mine thinking it needed to be. Glad its working now though

rvz•1h ago

Looking forward to the postmortem.

Are they using AI agents this time to resolve the outage? Probably not.

But this time, there is no CEO of GitHub to contact and good luck contacting Satya to solve the outage.

stuffn•16m ago

The postmortem will be simple since Github goes down so consistently every week you can almost use it as an alternative timekeeping system.

gunalx•1h ago

Yep. Was using github for oauth on a petproject of mine. Got the unicorn, and was considering takingthe break, or just etting up something else. Seems to be running again for me now though.

nkzd•1h ago

I thought my SSH keys were revoked, whew.

coffeebeqn•59m ago

Just started to replace mine when I saw someone post a message about GitHub

JLCarveth•43m ago

This sure does seem to happen a lot

fishgoesblub•38m ago

Must be a day ending in Y.

numbsafari•37m ago

Anyone using GitLab have any insight on how well their operations are running these days?

We originally left GitLab for GitHub after being bit by a major outage that resulted in data loss. Our code was saved, but we lost everything else.

But that was almost 10 years ago at this point.

colesantiago•35m ago

No issues on GitLab.

Haven't seen any outage from GitLab in like, ever.

boilerupnc•31m ago

Not sure what specific operational services are of interest - but here's a link to their historical service status [0]

[0] https://status.gitlab.com/pages/history/5b36dc6502d06804c083...

kaishiro•17m ago

We use GitLab on the daily. Roughly 200 repos pushing to ~20 on any given day. There have been a few small, unpublished outages that we determined were server side since we have a geo-distributed team, but as a platform seems far more stable than 5-6 years ago.

My only real current complaint is that the webhooks that are supposed to fire in repo activity have been a little flaky for us over the past 6-8 months. We have a pretty robust chatops system in play, so these things are highly noticeable to our team. It’s generally consistent, but we’ve had hooks fail to post to our systems on a few different occasions which forced us to chase up threads until we determined our operator ingestion service never even received the hooks.

That aside, we’re relatively happy customers.

contravariant•34m ago

Ah that was why. Oh well, I just needed to get the code to the server, so I didn't really need Github anyway.

ecshafer•32m ago

Github is owned by Microsoft, so this is a pretty small time indie operation, you need to give them a break.

cube00•28m ago

Not replacing the CEO suggests they aren't focusing on it as much as they were.

lysace•14m ago

Just your casual $3.8T company.

There were so many Github Actions outages (10+ ?) in the past year. Cause: Migration to the disaster zone also known as Azure, I assume. Most of them happened during CET working hours, as to not inconvenience the americans.

arnvald•24m ago

I’m old enough to remember when GitHub was on main page due to a cool feature they added, now they just end up here when it stops working

Britain's railway privatization was an abject failure

Launch HN: Tweeks (YC W25) – Browser extension to de-enshittify the web

GitHub Partial Outage

Zed Is Our Office

Checkout.com hacked, refuses ransom payment, donates to security labs

Blender Lab

Android developer verification: Early access starts

Denx (a.k.a. U-Boot) Retires

Kratos - Cloud native Auth0 open-source alternative (self-hosted)

SIMA 2: An Agent That Plays, Reasons, and Learns with You in Virtual 3D Worlds

We cut our Mongo DB costs by 90% by moving to Hetzner

European Nations Decide Against Acquiring Boeing E-7 Awacs Aircraft

Tesla Is Recalling Cybertrucks Again. Yep, More Pieces Are Falling Off

COBOL to Kotlin via Formal Models (IR and Alloy and Golden Master)

Heartbeats in Distributed Systems

Switching from GPG to Age

Human Fovea Detector

Android 16 QPR1 is being pushed to the Android Open Source Project

Steam Machine

Telli (Voice AI – YC F24) is hiring engineers in Berlin

A Challenge to Roboticists: My Humanoid Olympics

Seed. LINE's Custom Typeface

Shader Glass

Homebrew no longer allows bypassing Gatekeeper for unsigned/unnotarized software

Reverse Engineering Yaesu FT-70D Firmware Encryption

Continuous Autoregressive Language Models

GPT-5.1: A smarter, more conversational ChatGPT

Steam Frame

Randomness Testing Guide

Transpiler, a Meaningless Word (2023)

GitHub Partial Outage

Comments

Britain's railway privatization was an abject failure

Launch HN: Tweeks (YC W25) – Browser extension to de-enshittify the web

GitHub Partial Outage

Zed Is Our Office

Checkout.com hacked, refuses ransom payment, donates to security labs

Blender Lab

Android developer verification: Early access starts

Denx (a.k.a. U-Boot) Retires

Kratos - Cloud native Auth0 open-source alternative (self-hosted)

SIMA 2: An Agent That Plays, Reasons, and Learns with You in Virtual 3D Worlds

We cut our Mongo DB costs by 90% by moving to Hetzner

European Nations Decide Against Acquiring Boeing E-7 Awacs Aircraft

Tesla Is Recalling Cybertrucks Again. Yep, More Pieces Are Falling Off

COBOL to Kotlin via Formal Models (IR and Alloy and Golden Master)

Heartbeats in Distributed Systems

Switching from GPG to Age

Human Fovea Detector

Android 16 QPR1 is being pushed to the Android Open Source Project

Steam Machine

Telli (Voice AI – YC F24) is hiring engineers in Berlin

A Challenge to Roboticists: My Humanoid Olympics

Seed. LINE's Custom Typeface

Shader Glass

Homebrew no longer allows bypassing Gatekeeper for unsigned/unnotarized software

Reverse Engineering Yaesu FT-70D Firmware Encryption

Continuous Autoregressive Language Models

GPT-5.1: A smarter, more conversational ChatGPT

Steam Frame

Randomness Testing Guide

Transpiler, a Meaningless Word (2023)