Show HN: Text to 3D simulation on a map (does history pretty well)

72•lukehollis•8mo ago

Simulate anything on a map from a text prompt -- and conduct risk analysis against LiveUA map's global realtime data points from social media and news sources. I trained a GPT-2-size model on historical incident data used to predict things that will go wrong.

As historian Benjamin Breen mentions, the leading language models are good historians, so the application will simulate historical events pretty well also.

I include a Multi-Agent RL Urban Mobility model in progress displayed on the map as small white cubes representing traffic and pedestrians. Around SF, it uses real census data and other sources for semantically meaningful day plans, etc. It will populate where you move the map, albeit a little slowly. This is based on previous work on my GitHub--I hope to connect it to Unreal's city samples project soon.

The simulations are pretty simple so far but will grow in complexity soon.

I won the AGI House World Models Hackathon with this and the MARL model.

Many thanks to Shota Matsuda and Garrett Johnson for the cloud and atmospheric effects libraries on Github at takram-design-engineering/three-geospatial

Glad for feedback, and thanks for trying it out!

Comments

WalterGR•8mo ago

The prompt… er, well, prompt doesn’t appear in portrait orientation on iOS 18.

tetris11•8mo ago

I like the idea, but it's really glitchy and borderline epilepsy-inducing

lukehollis•8mo ago

Updated -- the geocoding was moving the map around too quickly

tetris11•8mo ago

much better this time around

lukehollis•8mo ago

Thanks!

meindnoch•8mo ago

I don't know what this is supposed to do, but it doesn't seem to work.

lukehollis•8mo ago

Sorry, hit a quota on the 3d map tiles - here's video https://www.youtube.com/watch?v=zXS9sNcDLJU

And requested increase, should be back soon!

mkoryak•8mo ago

it seems to work, but i dont know what i should be doing with it or what i am looking at

folli•8mo ago

I can't get it to work, but it sounds interesting. Does anyone have a screen recording to share?

stevage•8mo ago

Mostly I seem to be looking at some pretty great looking clouds and some (fake?) satellite imagery, but not seeing any people or armies or anything. And then every now and then it sort of glitches out and resets everything.

I'd love to see a video or something of it in action.

...

Oh, it seems to work much better in 2D. Now I see markers and stuff.

lukehollis•8mo ago

3d version exhausted quota -- will be back shortly! Video of the 3d version https://www.youtube.com/watch?v=zXS9sNcDLJU

rafram•8mo ago

I don't totally understand this, but it has the potential to be very, very cool.

(The satellite imagery doesn't work in Firefox. Just clouds.)

spuz•8mo ago

The map imagery doesn't seem to work in Edge either.

dr_dshiv•8mo ago

If this was just a post about generated clouds I would have upvoted anyway. They were cool. Love the vision!

lukehollis•8mo ago

Sorry, exhausted quota on the 3d tiles from Google Maps Platform -- should have workaround up shortly

conception•8mo ago

This is magic. I just did volcano and it simulated lava flow, emergency responders, blast zones. Pretty cool stuff.

lukehollis•8mo ago

Thanks!

taneq•8mo ago

I asked for a large asteroid impacting the Pacific ocean. Interestingly the resultant tidal wave apparently heads directly to Honolulu, then to Terminal Island, then reverses course and visits Sydney before traveling overland through New South Wales and Queensland, causing some earthquakes in Papua New Guinea, and coming to rest in Tokyo Harbour.

Also I just realised I can talk to the asteroid. It understandably seems a little traumatized.

    me: Hi! What brings you to this particular part of the ocean?
    
    asteroid: *hurtling through the atmosphere at tremendous speed, trailing
        fire* AAARRRRRGGGHHHHH! NOT BY CHOICE! Gravity's got me in its grip! 
        Been floating peacefully through space for millions of years until your 
        planet's pull caught me! CAN'T STOP NOW! *glowing brighter* Ocean impact 
        in approximately 17 seconds! Nothing personal against this particular 
        patch of water! BRACE FOR TSUNAMI! *increasing in brightness and 
        velocity*

https://mused.com/map/sim/2225/asteroid-impact-event

lukehollis•8mo ago

This is the best thing that anyone has simulated yet hahah

walthamstow•8mo ago

Couldn't help but start humming Queen's Don't Stop Me Now after reading what the asteroid said

patrick4urcloud•8mo ago

interesting

solardev•8mo ago

I don't understand what it's supposed to do. I see clouds and a prompt entry. I type something in and it just gives me a text response about New York urban tourism...?

caseyy•8mo ago

I think it's a 3D visualization of Earth with simulated clouds. You can ask an AI to generate a GIS layer to visualize an event. Then, you can talk to parts of the event in chat.

lukehollis•8mo ago

Here's a video -- the 3d map tiles quota was hit https://www.youtube.com/watch?v=zXS9sNcDLJU

Should be back shortly!

solardev•8mo ago

Ah, thanks, that video looks pretty cool!

thenthenthen•8mo ago

The scaling is off on mobile, the prompt box is hidden from view etc.

eluttmann•8mo ago

mobile coming soon. focus is desktop

tomaytotomato•8mo ago

This might be being unfair, but I asked it to simulate the Battle of Goose Green, during the Falklands war of 1982.

Its just a blank screen - https://mused.com/map/sim/2993/battle-of-goose-green

I am excited to see it working though!

yreg•8mo ago

The sim on your link is not blank anymore. I can see a map, some entities and some simple paths they take.

moontear•8mo ago

Doesn't work in Chrome (no map), doesn't work in Firefox. This sounds really interesting and I would love a video of it working its magic.

mdrzn•8mo ago

Seems very interesting tho. Maybe pre-generate the three "prompts" that you show when I open the page, and load them from cache when I select them? At least I can see how it should work.

edit: in 2d the map loads, in 3d it doesn't load. But when it works in 2d it's VERY COOL!

Here's my example: https://mused.com/map/sim/3129/roman-civil-wars-of-the-1st-c...

mkbehbehani•8mo ago

Cool idea, can only use 2D at the moment. Looks like the 3D tile quota is exhausted: "message": "Quota exceeded for quota metric '3D Tiles root requests' and limit '3D Tiles root requests per day' of service 'tile.googleapis.com' for consumer 'project_number:1016378558728'."

https://tile.googleapis.com/v1/3dtiles/root.json?key=AIzaSyB...

lukehollis•8mo ago

Asking for a quota increase with support! Will build in bring-your-own-key

mkbehbehani•8mo ago

Random thing worth I ran into once, you may have already handled this but sharing just in case:

May want to confirm the map renderer is making its requests using the URL with both the session and API key instead of only the API key. If your API requests are base key only, every refresh client-side might be unexpectedly consuming one of your root quota units, rather than each user getting a session of unlimited tile loads for 3 hours. If you're seeing network traffic in the console from your renderer out to the API without the session token in the query string along with the API token, or if you see the session token is totally different after refreshing, that might be a sign of something wonky causing quota depletion.

Example URL for a tile fetch with both params:

  https://tile.googleapis.com/v1/3dtiles/datasets/CgA/files/UlRPVEYuYnVs.json?session=SESSION_TOKEN&key=YOUR_API_KEY

Examples:

  https://developers.google.com/maps/documentation/tile/create-renderer#requests-and-responses

A quick check would be to see how far apart your google analytics for unique users are vs. your API console usage data. If way less than 10,000 unique users depleted the 10,000 unit quota it may be another indicator of something in token/session setup.

lukehollis•8mo ago

Okay back online in 3d too!

lukehollis•8mo ago

Update: sorry google maps 3d tiles aren't displaying!

Video: https://www.youtube.com/watch?v=zXS9sNcDLJU

The Google Maps 3d Photorealistic Tiles are returning 429 Error too many requests Looks like will need to build in the ability for people to bring their own Google Maps API key. Fix up shortly

lukehollis•8mo ago

Hey defaulting to 2D map temporarily! 3d will work shortly

lukehollis•8mo ago

Okay back online in 3d

don-bright•8mo ago

Dating myself, typed in "Global Thermonuclear War". Watching various cities of the world have their map flash on the screen for a few seconds at a time was certainly nightmare inducing. But fascinating.

ElijahLynn•8mo ago

Prompt box does not show on mobile. I'm using brave on Android. Even when I request the desktop site it does not show it. But when I use brave on Mac it does show it.

This was a confusing landing for me on a mobile device.

lukehollis•8mo ago

Thanks, this should be updated for a better landing on mobile

LargeWu•8mo ago

Incredibly brave of you to post something like this here. How are you monitoring and managing cost/token usage?

lukehollis•8mo ago

Thanks! The worst is the elevation API -- but yes, I monitored costs throughout today, it's not prohibitively expensive.

pedalpete•8mo ago

We used to do 3D virtual world work, and though I like where you're going with this, I think loading hi-res tiles, for your use-case, is not the right approach.

The direction we were trying to move with https://ayvri.com back in 2018 was to model the world from low-res imagery, and render higher-resolution views. At the time, the AI tech wasn't ready, but I think you can do this now. You don't need a prefect replica of the world, you want a convincing replica, so when you're drawing Tokyo, the architecture and elements in the scene match what would be expected.

lukehollis•8mo ago

Ayvri is impressive, and thanks for the feedback - I hear what you're saying about the convincing replica

deadbabe•8mo ago

I tried to simulate peace on Earth.

lukehollis•8mo ago

you're the best of us. How'd it do? Can you share it?

deadbabe•8mo ago

it was beautiful

Could ionospheric disturbances influence earthquakes?

SpaceX's next astronaut launch for NASA is officially on for Feb. 11 as FAA clea

Show HN: One-click AI employee with its own cloud desktop

Show HN: Poddley – Search podcasts by who's speaking

Same Surface, Different Weight

The Rise of Spec Driven Development

The first good Raspberry Pi Laptop

Seas to Rise Around the World – But Not in Greenland

Will Future Generations Think We're Gross?

State Department will delete Xitter posts from before Trump returned to office

Show HN: Verifiable server roundtrip demo for a decision interruption system

Impl Rust – Avro IDL Tool in Rust via Antlr

Stories from 25 Years of Software Development

minikeyvalue

Neomacs: GPU-accelerated Emacs with inline video, WebKit, and terminal via wgpu

Show HN: Moli P2P – An ephemeral, serverless image gallery (Rust and WebRTC)

How I grow my X presence?

What's the cost of the most expensive Super Bowl ad slot?

What if you just did a startup instead?

Hacking up your own shell completion (2020)

Show HN: Gorse 0.5 – Open-source recommender system with visual workflow editor

GLM-OCR: Accurate × Fast × Comprehensive

Local Agent Bench: Test 11 small LLMs on tool-calling judgment, on CPU, no GPU

Show HN: AboutMyProject – A public log for developer proof-of-work

Expertise, AI and Work of Future [video]

So Long to Cheap Books You Could Fit in Your Pocket

PID Controller

SpaceX Rocket Generates 100GW of Power, or 20% of US Electricity

Kubernetes MCP Server

I Built a Movie Recommendation Agent to Solve Movie Nights with My Wife

Could ionospheric disturbances influence earthquakes?

SpaceX's next astronaut launch for NASA is officially on for Feb. 11 as FAA clea

Show HN: One-click AI employee with its own cloud desktop

Show HN: Poddley – Search podcasts by who's speaking

Same Surface, Different Weight

The Rise of Spec Driven Development

The first good Raspberry Pi Laptop

Seas to Rise Around the World – But Not in Greenland

Will Future Generations Think We're Gross?

State Department will delete Xitter posts from before Trump returned to office

Show HN: Verifiable server roundtrip demo for a decision interruption system

Impl Rust – Avro IDL Tool in Rust via Antlr

Stories from 25 Years of Software Development

minikeyvalue

Neomacs: GPU-accelerated Emacs with inline video, WebKit, and terminal via wgpu

Show HN: Moli P2P – An ephemeral, serverless image gallery (Rust and WebRTC)

How I grow my X presence?

What's the cost of the most expensive Super Bowl ad slot?

What if you just did a startup instead?

Hacking up your own shell completion (2020)

Show HN: Gorse 0.5 – Open-source recommender system with visual workflow editor

GLM-OCR: Accurate × Fast × Comprehensive

Local Agent Bench: Test 11 small LLMs on tool-calling judgment, on CPU, no GPU

Show HN: AboutMyProject – A public log for developer proof-of-work

Expertise, AI and Work of Future [video]

So Long to Cheap Books You Could Fit in Your Pocket

PID Controller

SpaceX Rocket Generates 100GW of Power, or 20% of US Electricity

Kubernetes MCP Server

I Built a Movie Recommendation Agent to Solve Movie Nights with My Wife

Show HN: Text to 3D simulation on a map (does history pretty well)

Comments