Machine learning does exactly what you tell it to

This list of published machine learning fails is pretty entertaining. There are a few classes of errors:

• agents exploiting bugs in physics simulations;
• underspecified objective function results in a useless result;
• in one terrifying case, overcoming a physical limitation: "A robot arm with a purposely disabled gripper found a way to hit the box in a way that would force the gripper open"