Why and when should you pool? Analyzing Pooling in Recurrent Architectures

Maini Pratyush
Maini Pratyush
Kolluru Keshav
Kolluru Keshav

EMNLP, pp. 4568-4586, 2020.

EI
Other Links: arxiv.org|dblp.uni-trier.de|academic.microsoft.com

Abstract:

Pooling-based recurrent neural architectures consistently outperform their counterparts without pooling. However, the reasons for their enhanced performance are largely unexamined. In this work, we examine three commonly used pooling techniques (mean-pooling, max-pooling, and attention), and propose max-attention, a novel variant that e...More

Code:

Data:

Full Text
Your rating :
0

 

Tags
Comments