The ultimate goal in robotics is the ability to train a machine to perform general tasks after it learns from a few examples. OpenAI is a step closer to achieving this by applying a new algorithm called one-shot imitation learning to a robot arm.
In the demonstration, a human wears a virtual reality headset to stack a series of colored blocks in an imaginary world. The robot then copies what the person did in the VR simulation after seeing it once, creating a tower of blocks in the same order. The software that the robot learns from is split into two neural networks: one for vision and the other for imitation.
First, the vision component takes an input from the robot’s camera to gauge the positions of the different objects.