Building an agentic image generator that improves itself

https://simulate.trybezel.com/research/image_agent

67•palashshah•12mo ago

Hey HN! We recently graduated from YC, and have been building customer personas for large e-commerce companies. We recently expanded into the image generation space, and have been working on research about how to automatically improve the quality of generated images.

Comments

average_r_user•12mo ago

Quite interesting, do you have some documentation of your platform and capabilities? Your landing page is quite synthetic

palashshah•12mo ago

hey! we're working with an initial set of customers, and plan to launch full capabilities soon. stay tuned :)

ramesh31•12mo ago

This is a wonderful writeup of building a simple agentic system in general. What OP describes is more or less the bare minimum you should be doing at this point to get good (consistent) results from an LLM; single-shot prompting is a thing of the past.

palashshah•12mo ago

appreciate the compliment! yep, it's definitely necessary and is the bare minimum for building image generation systems in production.

shmoogy•12mo ago

I'm surprised you landed on using o3 as the judge - we found it way too expensive. I use llm as a judge for generating color variations of products, definitely hoping for some improvements - it can be brutal to get non hallucinated features along with proper final rendering.

omneity•12mo ago

Have you tried open weights vision models such as Qwen VL, MiniCPM, PaliGemma...?

I'm also curious how usable are simpler vision models such as Florence in case you explored this direction.

palashshah•12mo ago

we're currently in the process of doing this. i think something that could potentially work is to iterate upon the initial image composition / structure using cheaper models, and then upscale at the end. this way you're saving on that iteration cost, but eventually land on a higher-scale image.

shmoogy•11mo ago

I actually haven't but nova from Amazon was surprisingly good at things like bounding boxes compared to some others You kind of have to test and measure so many different aspects to get the best at specific tasks Thanks for the idea

elif•12mo ago

This is great and provides a good starting point for any similar efforts.

However I think the temptation to lean all tasks on AI is perhaps a little naive if not lazy.

For mask generation, there is really not much reason to use AI. In this example, simple stochastic blob detection, a trivial function you could get from openCV or ask a college sophomore to write would generate much better quality masks.

palashshah•12mo ago

totally agreed here. i think my goal primarily with the mask generation was to test out how effective openai's capabilities were.

we're currently working on pipelines that limit the the involvement of AI to various tasks. for example, when generating an ad there's usually logo, some banner text, and background image.

we can use gpt-image-1 to generate the background image, another LLM to identify the coordinates of where we place the logo, and just add the logo onto the image. this is just one example!

jackphilson•12mo ago

Why do you agree? I think we should outsource as much as we can to abstraction. We've been doing it forever.

dandelany•11mo ago

"Simple stochastic blob detection" is an abstraction. You write (or import) a function where the the gnarly logic lives and call `detectBlobs()`. "Use an abstraction" doesn't mean you should use the same abstraction for every task, you should use the right tool for the job.

mentalgear•12mo ago

Again another example of "the unreasonable effectiveness of LLMs in a loop". At with time, the tasks for loop become bigger and more complex, until we find ourselves "outlooped" at least job wise.

ramoz•12mo ago

Nice retrospective but I guess this process is no longer needed as model's get better; esp as they start enabling features like consistent subjects. Seems like a lot of overhead to correct text for inspirational images, but I can imagine you need to always present some form of _quality_ to your clients.

Feel like control nets and some minimal photoshop work would've been better.

palashshah•12mo ago

totally. it got to a point where most of the text generated in our images was incorrect, and so it wasn't a great look showing that to our clients.

we're actually working on some form of what you described where we take images generated from LLMs + add consistent logos discretely rather than generatively.

abshkbh•12mo ago

Palash this is a great post, I learnt a lot as an image gen noob! Keep writing more :)

palashshah•12mo ago

this is incredible to hear! i plan to keep writing on a weekly basis, and will be posting them on twitter.

t_mann•12mo ago

I was kind of hoping this would be in the 'Dreambooth mold' of finetuning open weights models. I have used that with some success some ~2 years ago, does anyone know what improvements there have been in that direction since Dreambooth?

zahlman•12mo ago

It's frankly amazing to me that "ask another LLM to evaluate the image" actually produces useful feedback that results in actual improvement from the first LLM.

But then, I guess it's not much different of an idea from the earlier use of GANs, or of telling LLMs to "stop hallucinating", etc.

palashshah•12mo ago

totally. the way i think about it (purely based on intuition) is that asking an LLM to do understanding + image generation is too complex for it to be effective. if we separate out the tasks into discrete steps, the evaluation becomes better, and the generation simply becomes instruction following.

jacob019•11mo ago

This is all edited with gpt-image-1? The revised images are amazing. Were example logos provided or is it just working off of it's knowledge of a well known brand?

Kioxia and Dell cram 10 PB into slim 2RU server

Windows 9x Subsystem for Linux

SANA-WM, a 2.6B open-source world model for 1-minute 720p video

Accelerando (2005)

A molecule with half-Möbius topology

Moving away from Tailwind, and learning to structure my CSS

Δ-Mem: Efficient Online Memory for Large Language Models

Fame! A Misunderstanding: A new translation of Albert Camus's complete notebooks

Frontier AI has broken the open CTF format

Halt and Catch Fire

Project Gutenberg – keeps getting better

Show HN: Rocksky – Music scrobbling and discovery on the AT Protocol

Japan’s robot wolf sells out as record bear attacks drive demand

HTML Lists

Greek Alphabet Cards

We've made the world too complicated

Clusters become personal (like PCs did)

3D Gaussian Splatting in a Weekend

Recreation of the 1956 IPL-I version of the Logic Theorist theorem prover

DeepSeek-V4-Flash means LLM steering is interesting again

Futhark by example

Accelerate – Embedded language for high-performance array computations

Nearly 50 Years Later, WKRP in Cincinnati Becomes a Real Radio Station

Kyber (YC W23) Is Hiring a Founding Marketer

After 8 years, I rewrote my open-source PyTorch curvature library

I believe there are entire companies right now under AI psychosis

PART Telescopes – Bringing radio astronomy within reach of rural schools

Fecal transplants for autism deliver success in clinical trials (2019)

Points are a weird and inconsistent unit of measure

The bird eye was pushed to an evolutionary extreme

Kioxia and Dell cram 10 PB into slim 2RU server

Windows 9x Subsystem for Linux

SANA-WM, a 2.6B open-source world model for 1-minute 720p video

Accelerando (2005)

A molecule with half-Möbius topology

Moving away from Tailwind, and learning to structure my CSS

Δ-Mem: Efficient Online Memory for Large Language Models

Fame! A Misunderstanding: A new translation of Albert Camus's complete notebooks

Frontier AI has broken the open CTF format

Halt and Catch Fire

Project Gutenberg – keeps getting better

Show HN: Rocksky – Music scrobbling and discovery on the AT Protocol

Japan’s robot wolf sells out as record bear attacks drive demand

HTML Lists

Greek Alphabet Cards

We've made the world too complicated

Clusters become personal (like PCs did)

3D Gaussian Splatting in a Weekend

Recreation of the 1956 IPL-I version of the Logic Theorist theorem prover

DeepSeek-V4-Flash means LLM steering is interesting again

Futhark by example

Accelerate – Embedded language for high-performance array computations

Nearly 50 Years Later, WKRP in Cincinnati Becomes a Real Radio Station

Kyber (YC W23) Is Hiring a Founding Marketer

After 8 years, I rewrote my open-source PyTorch curvature library

I believe there are entire companies right now under AI psychosis

PART Telescopes – Bringing radio astronomy within reach of rural schools

Fecal transplants for autism deliver success in clinical trials (2019)

Points are a weird and inconsistent unit of measure

The bird eye was pushed to an evolutionary extreme

Building an agentic image generator that improves itself

Comments