After digging found fork+exec through sh -c is ~14.6 ms and computing the actual segments was 2.6 ms on my device.
Plus had ~1.5k lines of zsh scripts.
Now one deamon process, caches in memory, unix socket and one #() for the whole right side. From 153.77 ms/s → 18.43 ms/s.
Made that into a tmux plugin. You can try it without installing/configuring:
docker run --rm -it lonkarorg/tmux-companion:playground
yogeshlor•1d ago