Redundant features can hurt robustness to distributions shift

In this work, we borrow tools from the field of adversarial robustness, and propose a new framework that permits to relate dataset features to the distance of samples to the decision boundary. Using this framework we identify the subspace of features used by CNNs to classify largescale vision benchmarks, and reveal some intriguing aspects...More