Matrix.org service offline: corrupted database

https://status.matrix.org

60•joecool1029•5mo ago

Comments

7bit•5mo ago

Matrix is an interesting technology I would love to use on a daily basis. Then I start Element and it feels slow, sluggish, terrible overall.

I turn it off and use Discord again. I know they are fundamentally distinct, but I am not willing to trade in ease of use (which is really REALLY awful) for privacy, and certainly not trading anything for having a distributed system.

You can't even do direct file transfer. There's a feature request open for YEARS... Yet nobody bothers to push it through.

unbolted3032•5mo ago

It’s a shame. There was a brief moment where there was lots of velocity on the “MSC”s as they call them - protocol features. The reference server implementations would be updated quickly, and Element would follow suit. It was exciting to follow and I would look forward to the new features hitting the clients every month or so.

I feel like that’s completely stopped.

For example, I’m still waiting for reasonable documentation to be published about how to deploy and use Element Call, which has apparently been generally available for over a year.

ekianjo•5mo ago

They had to fire a lot of devs and now they are busy re-building a new Element X client for mobile that has a 10th of the features of the older one. If you want to look for mismanagement this is a good case study.

Arathorn•5mo ago

Thanks for all the positive vibes & hugops folks :D

Fwiw, the DB isn't corrupted - the database 2ndary dropped its RAID array on having new disks added (the hw raid controller incorrectly added them into the array, breaking it)... and a few hours later we lost the primary db too. The outage is caused by the time taken to restore & rebuild a 55T db from nightly snapshot.

In terms of lack of documentation for running Element Call: i published a tutorial & video run-through myself back in November: https://element.io/blog/experimenting-with-matrix-2-0-using-... and https://github.com/element-hq/element-docker-demo and https://youtu.be/6iMi5BiQcoI. Or you could just run it via Element Server Suite: https://element.io/server-suite/community

In terms of "Element X has a 10th of the functionality of classic Element" - with respect, this is bullshit. The only features folks complain about missing are Threads & Spaces, both of which are have implementations behind feature flags and will land shortly. In all other respects Element X is a wild improvement over classic Element.

Fwiw, there's another HN thread on this over at https://news.ycombinator.com/item?id=45107696

q3k•5mo ago

> hw raid controller

... oof.

ThePowerOfFuet•5mo ago

Yep, that was my reaction too.

ThePowerOfFuet•5mo ago

>the database 2ndary dropped its RAID array on having new disks added (the hw raid controller incorrectly added them into the array, breaking it)

You really, truly should look at ZFS.

ducktective•5mo ago

Keep up the good work! There are satisfied but silent, Matrix users too.

wind12•5mo ago

> They had to fire a lot of devs

What happened and why? Any pointers to read more on this?

Arathorn•5mo ago

https://m.youtube.com/watch?v=lkCKhP1jxdk&t=741 is firsthand info

uyzstvqs•5mo ago

The idea of a federated messenger is great, but there's no good implementation. Matrix only ever looked good because its only competition is XMPP, which is good but ancient compared to what we expect from messaging apps today (e.g. Discord + Signal).

Okawari•5mo ago

I had the same experience with matrix.org, then I set up my own homeserver and it it became a LOT more snappy. Its not perfect, but its been an adequate replacement for me and my few friends who are interested in self-hosting our own services.

eric-p7•5mo ago

Can we have a federated service that's resilient against outages such as this, where Element would automatically use another server with my same account?

Perhaps the network of servers could even have some redundancy for the last two weeks history of chat messages, minus images.

dzaima•5mo ago

Matrix's federation already does result in redundancy of the entire chat history; users not on @matrix.org can currently communicate between each other just fine even on :matrix.org rooms despite matrix.org being down.

It's entirely just user accounts that are tied to a homeserver currently. There's a proposal to make it possible for clients to fully manage their account identity (https://github.com/matrix-org/matrix-spec-proposals/pull/408...) but that doesn't look particularly active.

UnAutomating the Economy: More Labor but at What Cost?

Show HN: Gettorr – Stream magnet links in the browser via WebRTC (no install)

Statin drugs safer than previously thought

Handy when you just want to distract yourself for a moment

More States Are Taking Aim at a Controversial Early Reading Method

AI will not save developer productivity

How I do and don't use agents

BTDUex Safe? The Back End Withdrawal Anomalies

Show HN: Compile-Time Vibe Coding

Show HN: Ensemble – macOS App to Manage Claude Code Skills, MCPs, and Claude.md

PR to support XMPP channels in OpenClaw

Twenty: A Modern Alternative to Salesforce

Raspberry Pi: More memory-driven price rises

Level Up Your Gaming

Di.day is a movement to encourage people to ditch Big Tech

Show HN: AI generated personal affirmations playing when your phone is locked

Show HN: GTM MCP Server- Let AI Manage Your Google Tag Manager Containers

Launch of X (Twitter) API Pay-per-Use Pricing

Facebook seemingly randomly bans tons of users

Global Bird Count Event

What Is Ruliology?

Jon Stewart – One of My Favorite People – What Now? with Trevor Noah Podcast [video]

P2P crypto exchange development company

Vocal Guide – belt sing without killing yourself

Write for Your Readers Even If They Are Agents

Knowledge-Creating LLMs

Maple Mono: Smooth your coding flow

Sid Meier's System for Real-Time Music Composition and Synthesis

Show HN: Slop News – HN front page now, but it's all slop

Show HN: Empusa – Visual debugger to catch and resume AI agent retry loops