I have been trying to get something like this working in one form or another for close to a year. The latest image models finally make it possible.
It's still early, but I'm really interested in this approach to AI UI - using image models before coding models for front end development. The challenges are; 1 - How do we get image models to generate decent UI 2 - How do we convert those images into code But I think I've got something which tackles this well enough to be useful, at least in my workflows.
Would love feedback and if this is worth continuing to explore!