Ask HN: What kind of local on-device AI do you find useful?
4•NullCascade•2h ago
Something that fits in 12GB VRAM or less.
Comments
onion2k•2h ago
I've been making a point'n'click game recently, and generating the art using Flux.1 Dev and Flux.Konnect locally on a Mac Mini M1 with 8GB of RAM. It isn't quick (20m+ per image) but once I had the settings dialled in for the style I want it works really well.
jjice•14m ago
Very neat use! Do you have anything public currently? Curious to see how they look. Or if you can't share at the moment, what's the art style you're going for?
firefax•8m ago
Can flux also do code? This sounds interesting (I've got a new-ish Macbook with much more RAM than you.)
I know people don't like "vibe coding", but I think one use case is design -- especially the small, static sites that individuals or small businesses use. I know I myself would often get frustrated/bored and fall back to a very basic black text on white background 90s bare bone html style of design whenever I've ventured into web design.
But I do not like the idea of sending my design process off to some 3rd party server, both for security and privacy reasons as well as just practical ones -- if I can work offline, that opens up the menu of locations to work from.
onion2k•2h ago
jjice•14m ago
firefax•8m ago
I know people don't like "vibe coding", but I think one use case is design -- especially the small, static sites that individuals or small businesses use. I know I myself would often get frustrated/bored and fall back to a very basic black text on white background 90s bare bone html style of design whenever I've ventured into web design.
But I do not like the idea of sending my design process off to some 3rd party server, both for security and privacy reasons as well as just practical ones -- if I can work offline, that opens up the menu of locations to work from.