This is released by the Anthropic engineer who developed Claude Plays Pokemon.
Comments
minimaxir•8mo ago
This is released by the Anthropic engineer who developed Claude Plays Pokemon.
CSMastermind•7mo ago
It's interesting to me that they're extracting game state from memory instead of just passing the video into the LLM.
_--__--__•7mo ago
Every agent step takes both a visual snapshot and a memory read, the memory gives more consistent tileset and location parsing and also has some stuff like party state/status conditions that isn't usually visible.
CSMastermind•7mo ago
Shouldn't the goal be to compare it against a human player that would need to menu for that information?
_--__--__•7mo ago
that's probably fair but I imagine that without memory access Claude would have been opening and searching the (completely unordered!) bag to check for progress critical items like the pokeflute every 5 minutes
minimaxir•8mo ago