Understanding the effect of time delays on rumor spreading is of special importance to curbing the spread of rumors. This article proposes a rumor-spreading model with three identical time delays: a delay associated with the negative influence of a spreader on an exposed ignorant individual, a delay associated with the natural change from a spreader to a stifler, and a delay associated with the positive influence of a stifler on an exposed spreader. The basic reproduction number for the model is determined. A criterion for the existence of rumor-endemic equilibrium is provided. Interestingly, the model undergoes a conditional forward bifurcation. A collection of criteria for the asymptotic stability of the rumor-free equilibrium is derived. In the absence of a time delay, a criterion for the asymptotic stability of the rumor-endemic equilibrium is presented. By developing a novel technique for dealing with small time delays, a criterion for the asymptotic stability of the rumor-endemic equilibrium is established. Finally, the effect of some factors on the existence of rumor-endemic equilibrium is investigated. In particular, the effect of the time delay on rumor spreading is revealed. This work facilitates a deep understanding of the dynamics of rumor-spreading models with time delays.