I did exactly this yesterday and it worked great. Not super critical systems, but almost 10 devices, so it saved me a lot of time. I use a small connector that gives my local claude or codex access to the whole fleet (only when I ask for it), no SSH, firewalls or VPNs needed.