If the company also works in-office then you're probably missing out on organic communication. You'll be lucky to have people that spread news of changes that happen in person to you. In many cases you're the easiest lay-off too. If someone has to lay you off in person, they might not want to. The remotes will be first.

If the entire company is remote, there is a lot of disorganization, missed opportunities to keep things in sync. And the organization may sometimes also become flatter (less hierarchy). While less hierarchy sounds good, it also comes with the balance that you're more responsible for a bad decision (because often you have to make more decisions).

The best thing, obviously, is earning potentially a million in 3-8 years (depending on your comp) without having to drive to an office.