We establish codimension 4 regularity of noncollapsed sequences of metrics with bounds on natural generalizations of the Ricci tensor. We obtain a priori L^2 curvature estimates on such spaces, with diffeomorphism finiteness results and rigidity theorems as corollaries.