I'm a tad confused about this - because I don't know what OS / Linux distro is used at a AI data centre level.
I'd like this to be authentic, but I can't find a lot of information about what is used.
Main question:
I am assuming at the data centre level, one would use Linux? Is that correct?
More questions:
1. So - what about CUDA on Linux? Does CUDA run really well on linux, or do they somehow run the models autonomously from the OS layer when they are running these huge AI models?
2. So if they're deploying a new model, do they use the linux terminal or something else, some sort of nvidia terminal layer, or even custom tools?
3. Is there a preferred distro for an AI data centre, or is this the case that each AI lab makes their own distro or chooses their own?
4. Also, should I assume is this is CLI only, or would they have a distro that has a GUI?
I couldn't easily find answers to these questions, I hope it's ok to ask these on HN here.
This would be a video/multimodal model. The company is a fictional version of Youtube.