Researchers at The University of Tokyo linked a humanoid robot, Alter3, with GPT-4. Through prompts, they instructed the robot to perform various human actions like playing guitar, taking a selfie, pretending to be a ghost, or eating someone else’s popcorn at the movies.

This interaction resembled a game of charades, where a language model translated written instructions into code, enabling the robot to execute diverse human-like actions.

Here are some experiments conducted on Alter3.