I modified the OpenAI Realtime API Console Demo App to add a map to it, and I connected the map events to the Realtime API.

Result... Im able to move around the map and talk to it! Its fascinating how its able to reverse geocode out of memory, Ideally I should add tools to reverse Geocode the locations. Im planning to add more tools to it like internet speed locations and maybe weather

https://github.com/milind-soni/realtime-map-chat

Check out here if you would like to use the code