Hi HN,

I wanted to see how AI Agents could be used for home automation and everyday household tasks, so I wrote a simulator MCP Server that has tools for things like home appliances, grocery shopping, banking and more.

Testing it with Claude Desktop and so far it's surprisingly smooth. An example from today:

  Prompt: Please restock grocery if needed.
  Agent:
  - Call: refrigerator_get_internal_picture
  Sees shelves aren’t full, decides to restock.
  - Call: grocery_get_past_orders
  Checks past orders to identify what's missing.
  - Call: bank_get_creditcard_full_info
  Grocery order requires payment info. Retrieves it.
  - Call: gorcery_place_order
  Places the order and displays a summary.

This worked on the first try, the workflow is automatically discovered by the agent. Other than the prompt, only other input was MCP tool descriptions it received automatically when initializing the MCP Server. In an other example, if you say you're going to bed it closes the blinds, sets temperature around the house, locks the door and stops the music. Both examples are pretty much doable with available technology (though a fridge that takes internal photos might be a slight stretch).

If you'd like to try it out, the code is here: https://github.com/altinoren/Utopia