Reply to Huszár: The elastic weight consolidation penalty is empirically valid
Proceedings of the National Academy of Sciences of the United States of America, 2018.
In our recent work on elastic weight consolidation (EWC) (1) we show that forgetting in neural networks can be alleviated by using a quadratic penalty whose derivation was inspired by Bayesian evidence accumulation. In his letter (2), Dr. Huszar provides an alternative form for this penalty by following the standard work on expectation pr...More
Full Text (Upload PDF)
PPT (Upload PPT)