frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Show HN: LightSwitch: Multi-View Relighting with Material-Guided Diffusion

https://yehonathanlitman.github.io/light_switch/
4•indigoomega•4h ago
To those who are interested in 3D, you probably know how 3D gaussian splatting or NeRF can reconstruct very well but bake in all the details from the captured environment - this makes it impractical to import reconstructed assets into new environments.

Our approach enables fast relighting with an HDR environment map condition with a custom diffusion model (1-2 mins with a 3DGS) that takes in any number of input images, making it especially suitable for photogrammetry. Even though we originally intended for it to relight simpler objects it seems to generalize well to much more diverse scenarios like cars.

Comments

ayahua•4h ago
good to see that this model works well for real and synthetic data! this model would be useful for simulation