Backpropagation through time and the brain

•BPTT is the canonical algorithm for TCA in recurrent networks.•BPTT requires perfect sequence recall and so is biologically problematic.•Successes with new artificial memory architectures may shed light on TCA in the brain.•BPTT remains a normative guide for TCA.