Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections.

international conference on machine learning, (2017)

Cited by: 52|Views14
EI

Abstract:

The problem of learning long-term dependencies in sequences using Recurrent Neural Networks (RNNs) is still a major challenge. Recent methods have been suggested to solve this problem by constraining the transition matrix to be unitary during training which ensures that its norm is equal to one and prevents exploding gradients. These meth...More

Code:

Data:

ZH
Your rating :
0

 

Tags
Comments