We give an 'arithmetic regularity lemma' for groups definable in finite fields, analogous to Tao's 'algebraic regularity lemma' for graphs definable in finite fields. More specifically, we show that, for any M>0, any finite field 𝐅, and any definable group (G,·) in 𝐅 and definable subset D⊆ G, each of complexity at most M, there is a normal definable subgroup H⩽ G, of index and complexity O_M(1), such that the following holds: for any cosets V,W of H, the bipartite graph (V,W,xy^-1∈ D) is O_M(|𝐅|^-1/2)-quasirandom. Various analogous regularity conditions follow; for example, for any g∈ G, the Fourier coefficient ||1_H∩ Dg(π)||_op is O_M(|𝐅|^-1/8) for every non-trivial irreducible representation π of H.