I was wondering if something like AI/LLM distros exist, in the sense of bundled models, interfaces, prompts, and tools (as in tools called by the LLM) tested to work well together and ready to run on modest hardware.

Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source. Everything bundled and ready to run. GNUbot? GPTKnoppix? Geminibuntu? :)