Tailscale Down

https://status.tailscale.com/incidents/01KAF1H8V7EGFKVG5KGZBB2RJC

102•fasz•2mo ago

Comments

tapppi•2mo ago

Both the web interface and connections are down now. Was just fiddling with my private DNS serving both my local network and tailnet, when I lost access to the device listing around 20 minutes ago. Now I also cannot connect through tailnet IPs anymore. EDIT: took me a good minute to realise this too, as I thought I'd just screwed up something in my Pi's ipv6 configuration for the 3rd time in an hour.

P.S. you beat me to posting by 1 minute! Happy to see there was an option to hide my submission, never needed that before.

tapppi•2mo ago

Connections through tailnet are back, website is still down

tapppi•2mo ago

Website is also back, nice recovery speed by tailscale

gnabgib•2mo ago

hide just removes the submission from your page/new, it doesn't remove it from HN.. delete does that.

tapppi•2mo ago

Good to know, but then again, I don't see such an option for my submission. Guess I'll just have to live with it.

jsheard•2mo ago

You can only delete a submission in the first 10 minutes and only if nobody has commented yet.

clarkmoody•2mo ago

Massive outages of core Internet services popping up shortly after corps firing devs and bragging about AI writing more of their code.

timenotwasted•2mo ago

I could be mistaken but I don't recall Tailscale being one of these?

jakebasile•2mo ago

Tailscale is definitely not one of that crowd. Their CEO had some very reasonable takes on AI and developers on LinkedIn / their blog (linked in a sibling comment).

colesantiago•2mo ago

But Tailscale IS VC funded which means an exit is imminent and around the corner.

Not good.

waterTanuki•2mo ago

Tailscale isn't a massive corp, more like a Series B startup. And the CEO's take on LLMs is a sober one, not based on hype.

https://tailscale.com/blog/ai-changes-developers

bnjms•2mo ago

I’m sorry, Apenwarr is the Tailscale ceo?

Weird how you notice a few names on a message board then they disappear to do something new.

poly2it•2mo ago

I was going crazy trying to figure out why I couldn't connect to our supercomputer an hour ago. Relieved to know it was a global outage!

para_parolu•2mo ago

As someone pointed out recently here: no one gets fired for AWS outage

poly2it•2mo ago

Are you replying to me?

sureglymop•2mo ago

Nothing personal against tailscale but I hope it drives the point home that leaving the hosting of the key exchange server for your mesh network to an external entity is a little bit ridiculous.

creddit•2mo ago

Are self-hosted solutions impervious to outages? I wasn't aware.

the_gipsy•2mo ago

Who said that

LeoPanthera•2mo ago

"sureglymop" certainly implied it, otherwise I don't know what the point of that comment was.

sureglymop•2mo ago

In my comment I didn't specify this but I was thinking more about security than operations when I wrote it.

creddit•2mo ago

As LeoPanthera said, it is clearly implied.

the_gipsy•2mo ago

I read the implication as: being at the mercy of a third party. You can do nothing.

creddit•2mo ago

Surely we aren't meant to believe that having some critical part of our lives or businesses dependent on a third party is "a little bit ridiculous"?

I don't imagine I should be expected to launch my own bank or semiconductor fab.

the_gipsy•2mo ago

In the context of software

creddit•2mo ago

So we are all expected to build our own payment processors in order to not be ridiculous?

mbesto•2mo ago

If your key exchange server is on us-east-1 are you also ridiculous?

bithavoc•2mo ago

with Tailscale Lock you have a lot more control, you can also self-host your coordinator server which is an alternative even mentioned in the service docs[0]

[0] https://tailscale.com/kb/1226/tailnet-lock

mikeocool•2mo ago

My self hosted stuff has outages too. The even more annoying part is that it stays broken until I get around to fixing it.

petcat•2mo ago

Imagine if stays broken until somebody else gets around to fixing it

ksenzee•2mo ago

There are more somebody elses than there are mes.

derefr•2mo ago

And for some specific somebody, fixing the problem is their whole job. It’s definitely not my whole job. Maybe not even my job at all (if it’s something I just use as part of a personal hobby.)

halJordan•2mo ago

Sure would be a shame if they all got together and decided some things for you. But that would never happen. Right?

pfannkuchen•2mo ago

Craftsman guilds don’t scale, alas.

nntwozz•2mo ago

I heat my house with a wood stove, I'm not part of the energy grid.

I run my own WireGuard because I like to be the one responsible.

To each their own, no need for snark comments.

javier2•2mo ago

I ran my own Wireguard for years, but its too clunky and difficult to put all my devices on it. And if the power at my house goes out, the net is fully down. I suppose its a trade-off for using Tailscale now, with a great command line tool and a great UI so I have actually onboarded the rest of my family here. It was too much of a hassle with plain Wireguard nodes.

UltraSane•2mo ago

Cloud providers have enormous economic incentive to recover from outages as fast as possible and can bring many more people to help, often ones who wrote the code and designed the system. I once worked for a state government where the exchange server was down for two weeks.

briffle•2mo ago

I had to deal with a state Medicaid system that would go down often. If it crashed after 5pm, it was down until the next morning when someone rebooted the SunOS box. (Yes, they just rebooted the box, and no, in 2014 it was still sunos, not Solaris). Meanwhile, it’s messing up pharmacy authorization for thousand of elderly and low income people in the state ….

myko•2mo ago

For me tailscale being down just means I can't access things I'm not comfortable exposing publicly outside my home. It isn't a huge deal as I rarely have that need.

brewdad•2mo ago

And if I am at home, the box is upstairs. I can connect a keyboard and monitor and continue about my business.

seemaze•2mo ago

Just arrived from perusing the headscale repo for the nth time. I really should deploy one of these days...

https://github.com/juanfont/headscale

pepemon•2mo ago

AFAIK, only new connections can't be established, the already connected clients will continue to work.

PrairieFire•2mo ago

Pretty sure that was the case. I heavily use Tailscale at work and have been working steady on multiple VNC connected clients over Tailscale Wireguard tunnels without issue. Just wrapped it up for the day and hit the ‘ol watering hole (hackernews) to see this. I didn’t connect/disconnect or have to use the portal during that time period, but my in place connections were fine.

nirav72•2mo ago

Lemme guess - us-east-1?

arthurcolle•2mo ago

Thought this was for a product release called Down. Might be time to go outside for me

seemaze•2mo ago

Tailscale Down® - Unscheduled network downtime to engage in the immediate needs of your meat sack existence. Eat food, speak with other meat sacks, expel food, touch grass!

arthurcolle•2mo ago

Tailscale Down™ - What goes up must come...

fade out

Uncertainty as a Service®

incanus77•2mo ago

Totally appropriate if your Tailnet name is goose-rappel.

arthurcolle•2mo ago

I'll have to tell my ducks about this one

antiloper•2mo ago

Had to have a double take when they released Tailscale Drive. Almost thought I could add my car to my tailnet now.

metadat•2mo ago

Magic DNS has been broken on Android for weeks, ever since One UI 8.0 was released. No monitoring dashboard for features AFAICT. Bummer.

metadat•2mo ago

For example, see: https://old.reddit.com/r/Tailscale/comments/1onqe58/android_...

I'm surprised TS Team doesn't monitor it for issues.

arjie•2mo ago

Oh this is unlucky. I'm not affected because I use headscale (for my home network), but this is one of those companies I root for because the product is so good. We used to have manually managed Wireguard (one end terminating at Router) to create the similar effect and for my home, this is way nicer.

theshrike79•2mo ago

It's getting to a point where I _want_ to pay for it so I can demand better service from them :)

Just having tailscale ssh is so damn useful when you've got a bunch of servers virtual and physical and co-located. Just get them to the tailnet and ssh via Tailscale. No need to open SSH ports.

LouisvilleGeek•2mo ago

Self host with Headscale.

LorenDB•2mo ago

My Headscale instance is working perfectly. Glad I didn't just use Tailscale for my homelab.

itsdrewmiller•2mo ago

Good luck tailscale, I love how much value I get out of your free tier for my home servers!

rvz•2mo ago

Looking forward to the post-mortem.

deskamess•2mo ago

Yep... cant wait for them 'unwrap' the reason.

apitman•2mo ago

Would love to see something like Tailscale but local-first, where your devices use Bluetooth, mDNS, NFC, QR codes, etc for signaling and only fall back to STUN/TURN as a last resort.

Velocifyer•2mo ago

Tailscale is amazing.

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

The Waymo World Model

How we made geo joins 400× faster with H3 indexes

A century of hair samples proves leaded gas ban worked

Monty: A minimal, secure Python interpreter written in Rust for use by AI

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Show HN: I spent 4 years building a UI design tool with only the features I use

Dark Alley Mathematics

Microsoft open-sources LiteBox, a security-focused library OS

Show HN: If you lose your memory, how to regain access to your computer?

Sheldon Brown's Bicycle Technical Info

Hackers (1995) Animated Experience

PC Floppy Copy Protection: Vault Prolok

Show HN: ARM64 Android Dev Kit

An Update on Heroku

Why I Joined OpenAI

Female Asian Elephant Calf Born at the Smithsonian National Zoo

Show HN: R3forth, a ColorForth-inspired language with a tiny VM

Delimited Continuations vs. Lwt for Threads

How to effectively write quality code with AI

Introducing the Developer Knowledge API and MCP Server

I spent 5 years in DevOps – Solutions engineering gave me what I was missing

Learning from context is harder than we thought

Understanding Neural Network, Visually

I now assume that all ads on Apple news are scams

FORTH? Really!?

I'm going to cure my girlfriend's brain tumor

Evaluating and mitigating the growing risk of LLM-discovered 0-days

WebView performance significantly slower than PWA

Show HN: Smooth CLI – Token-efficient browser for AI agents

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

The Waymo World Model

How we made geo joins 400× faster with H3 indexes

A century of hair samples proves leaded gas ban worked

Monty: A minimal, secure Python interpreter written in Rust for use by AI

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Show HN: I spent 4 years building a UI design tool with only the features I use

Dark Alley Mathematics

Microsoft open-sources LiteBox, a security-focused library OS

Show HN: If you lose your memory, how to regain access to your computer?

Sheldon Brown's Bicycle Technical Info

Hackers (1995) Animated Experience

PC Floppy Copy Protection: Vault Prolok

Show HN: ARM64 Android Dev Kit

An Update on Heroku

Why I Joined OpenAI

Female Asian Elephant Calf Born at the Smithsonian National Zoo

Show HN: R3forth, a ColorForth-inspired language with a tiny VM

Delimited Continuations vs. Lwt for Threads

How to effectively write quality code with AI

Introducing the Developer Knowledge API and MCP Server

I spent 5 years in DevOps – Solutions engineering gave me what I was missing

Learning from context is harder than we thought

Understanding Neural Network, Visually

I now assume that all ads on Apple news are scams

FORTH? Really!?

I'm going to cure my girlfriend's brain tumor

Evaluating and mitigating the growing risk of LLM-discovered 0-days

WebView performance significantly slower than PWA

Show HN: Smooth CLI – Token-efficient browser for AI agents

Tailscale Down

Comments