This kind of interaction with your desktop is, honestly, quite amazing. I have been using it with Claude and Codex for a variety of different tasks, like understanding a website or testing some of the code that I have built (with AI help, of course). When I watch AI interact with my computer, it is both creepy and mind-blowing.
Google has now joined the ranks of other public AIs that can interact with your work and play environments. I’m just wondering when it will start to be able to get high scores on gaming platforms or help you get through difficult levels.
I still recommend that, if you use this feature, you check all of the work. AI wants to do a good job and may take whatever path it can find to do it.