Show HN: I left Figma to build a diffusion-based UI design tool

12•jjcm•2h ago

Hey hn, this has been something I've been working on for the last few months and is finally robust enough to really show off.

I've been pretty tired with the design outputs of LLMs for a while, and I've always thought diffusion offered much more creative / on brand design outputs, even before they were able to render text.

I had enough conviction for this to leave my role over at Figma to build Diffui. The goal is to allow for you to design your full web app as quickly as possible, in a figma-like interface, and then hand that off to an agent to build. The page shows some interactive examples. Happy to be an open book here and chat about the approach, the process, etc!

Comments

dbreunig•2h ago

I got an early tip on this and used it to build a brand mood board and it crushed previous attempts with Claude. Highly recommend.

grahac•2h ago

The Tarot card example on here is so sick.

jjcm•2h ago

Thank you! That effect is easier than you'd think. Normal maps/depth maps are actually fairly easy to generate via diffusion models. Once I had the designs for the tarot site in diffui, I just copied the build plan, pasted it into claude, and asked it to "generate normal/depth/roughness maps for each of the card designs and dynamically light and displace them based on the mouse position."

The build plan has tooling built in to generate these. Under the hood the model I'm routing to is Fal.ai's Patina model, which does a fantastic job at creating maps.

File is here btw if you want to explore: https://diffui.ai/app/canvas/be49d1a3-df57-4c61-9305-4aef472...

lurkyniko•1h ago

I had this redesign my new landing page. Excited to see how this develops

cacio-e-pepe•1h ago

Okay so the diffusion model generates image assets, and you iterate on those, and then another model turns your favorites into code, is that right?

jjcm•1h ago

Exactly right. You design with the diffusion model, then hand those designs off to an agent to implement.

It's a lot like having an architect create plans for you before handing it off to a builder. In my (obv biased) experience, you end up getting better/more creative results with this approach. You're using the best model for the job at each specific task, ie a diffusion model as the designer, and a LLM as the engineer.

capnjngl•1h ago

Something that's not mentioned here is that for design agencies who work as multiple clients, the app has the ability to save and work with multiple brand profiles. You can upload a bunch of screenshots of examples of the brand's design language - from their app or website or ads or whatever - and have Diffui make a brand guide just based on that, and then any future designs are influenced by that brand guide. Pretty neat little trick.

OpenAI and Hugging Face partner to address security incident

UK Government Report Shows Imminent Threat from Biodiversity Loss

Show HN: TunD. Make friends' PCs appear on the same VLAN

The Software Engineer to Metalhead Pipeline

I built SciStudio to organize my chaos multimodal data analysis pipelines

Make No Assumptions

I don't want to hear your elevator pitch

It was OpenAI that accidentally breached Hugging Face

AI Thinks the Internet Is Reddit. We Have 8,616 Answers Proving It

The Danielson-Lanczos FFT method and bit-reversal

From Seed Scripts to Desired-State Reference Data in PostgreSQL

Show HN: MindCache – An open-source agentic memory system for LLMs

Show HN: Datalevin – a simple, fast, and versatile Datalog database

From Payroll to Pyongyang: The DPRK IT Worker Money Trail

A Brief Deep History of Literacy

Airbus to test folding wings for next generation of bestselling planes

Everything Is an Energy Source: The Potential of Micropower Collection

Amazon SES introduces pricing plans

The agent principal-agent problem

If You Lack Inspiration, Talk to People

Show HN: Rememori – agent memory in pure TypeScript, zero dependencies

VGMaps: The Video Game Atlas

Ambykit

I Vibe Coded an Inflation-Resistant Currency

I trained a 30M-param LLM from scratch and the scaling "floor" was a mirage

Where Did All the Computer-Science Professors Go?

Show HN: TokenPath – token-level citations for LLM output, read from attention

Ramble Sessions with LLM's

'VPNs are lawful technical tools,' says EU Court in landmark copyright ruling

N.J. MVC error registered 6,600 undocumented immigrants to vote