We give a combinatorial criterion for the tangent bundle on a smooth toric variety to be stable with respect to a given polarisation in terms of the corresponding lattice polytope. Furthermore, we show that for a smooth toric surface and a smooth toric variety of Picard rank 2, there exists an ample line bundle with respect to which the tangent bundle is stable if and only if it is an iterated blow-up of projective space.