Visual perception of facial expressions of emotion.

•To interpret facial expressions of emotion, the human visual system solves the inverse problem of production.•The task of the visual system is to identify muscle actions, that is, Action Units (AUs).•Second-order configural features are a primary mechanism to identify AUs in images.•A brain region with computations consistent with those of the proposed model is identified.