Hyperbolic Attention Networks
ICLR, Volume abs/1805.09786, 2019.
We introduce hyperbolic attention networks to endow neural networks with enough capacity to match the complexity of data with hierarchical and power-law structure. A few recent approaches have successfully demonstrated the benefits of imposing hyperbolic geometry on the parameters of shallow networks. We extend this line of work by impo...More
PPT (Upload PPT)