Recurrent prediction model for partially observable MDPs

•Temporal information is effectively integrated into the representation model.•A new prediction model is proposed to gain temporal information.•The memory capacity of the replay buffer is smaller than the existing methods.•The policy lag is proven to be decreased quickly in maximum-entropy reinforcement learning.