AdaSwarm: Augmenting Gradient-Based Optimizers in Deep Learning With Swarm Intelligence

Rohan Mohapatra,Snehanshu Saha,Carlos A. Coello Coello,Anwesh Bhattacharya,Soma S. Dhavala,Sriparna Saha

IEEE Transactions on Emerging Topics in Computational Intelligence（2022）

引用 15|浏览5

暂无评分

摘要

This paper introduces AdaSwarm, a novel gradient-free optimizer which has similar or even better performance than the Adam optimizer adopted in neural networks. In order to support our proposed AdaSwarm, a novel Exponentially weighted Momentum Particle Swarm Optimizer (EMPSO), is proposed. The ability of AdaSwarm to tackle optimization problems is attributed to its capability to perform good gradi...

查看译文

关键词

Optimization,Particle swarm optimization,Artificial neural networks,Training,Search problems,Mathematical model,Deep learning

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要