Why and when should you pool? Analyzing Pooling in Recurrent Architectures
EMNLP, pp. 4568-4586, 2020.
Pooling-based recurrent neural architectures consistently outperform their counterparts without pooling. However, the reasons for their enhanced performance are largely unexamined. In this work, we examine three commonly used pooling techniques (mean-pooling, max-pooling, and attention), and propose max-attention, a novel variant that e...More
PPT (Upload PPT)