so Google will be monitoring whatever on the screen continuously or only when the user say the magic words (this, that, here, there)?
EdgeExplorer•4m ago
Indeed. "AI-enabled pointer" is misdirection. This isn't an AI-enabled pointer; it's sending screen to AI, which yes, includes pointer position. The AI doesn't live in the pointer. The AI lives, apparently, so thoroughly in the system that it can see and do anything, and the pointer is just a way of giving it context.
strgrd•25m ago
No thanks
loaderchips•25m ago
It's beautiful how the human mind can take something very obvious but overlooked and make it into this fantastic innovation. Fab stuff.
SirFatty•21m ago
It only took Google and their AI offering to come up with Graffiti.
themafia•19m ago
> We’ve been exploring new AI-powered capabilities to help the pointer not only understand what it’s pointing at, but also why it matters to the user.
We couldn't quite track you well enough before. So we're fixing that under the guise of "AI powered capabilities."
iridione•9m ago
Interesting! I wonder how UI will evolve in the long-term? If there are browser-use/computer-use and clicky-clones automating pointer actions, do we really need complex UI anymore? If yes, when?
mvdtnz•9m ago
Both of the text based demos would have been simpler and faster with traditional mouse and keyboard interactions. What is the AI adding?
slopinthebag•4m ago
It feels like everything modern is like this. No value added, just the appearance of it.
AbuAssar•30m ago
EdgeExplorer•4m ago