For small vps Kubernetes might be overkill indeed. But: the API and ecosystem is really an enabler besides the built in infrastructure.

For the single vps-with-containers use case I recommend checking out watchtower instead of relying on systemd scripting.