Interesting idea and cool demo.

For this to really be practical you'd need a way to run networks many times faster and more efficiently than today's GPUs. This is too slow to work even with cloud GPUs powering it.

Maybe someday.

Cool project, but just a side thought I was having about how do people have resources and the money to make things like this and make it avl for public, I mean it's fair to say they have their own GPUs or if they are using api keys for gpt or Gemini with enterprise subsidized inference

But still coming from a frugal background I still cannot wrap my head around this

This is one of the more unique ideas i've encountered in a long time