Slimmed optical neural networks with multiplexed neuron sets and a corresponding backpropagation training algorithm
Intelligent Computing(2023)
摘要
Due to their intrinsic capabilities on parallel signal processing, optical
neural networks (ONNs) have attracted extensive interests recently as a
potential alternative to electronic artificial neural networks (ANNs) with
reduced power consumption and low latency. Preliminary confirmation of the
parallelism in optical computing has been widely done by applying the
technology of wavelength division multiplexing (WDM) in the linear
transformation part of neural networks. However, inter-channel crosstalk has
obstructed WDM technologies to be deployed in nonlinear activation in ONNs.
Here, we propose a universal WDM structure called multiplexed neuron sets (MNS)
which apply WDM technologies to optical neurons and enable ONNs to be further
compressed. A corresponding back-propagation (BP) training algorithm is
proposed to alleviate or even cancel the influence of inter-channel crosstalk
on MNS-based WDM-ONNs. For simplicity, semiconductor optical amplifiers (SOAs)
are employed as an example of MNS to construct a WDM-ONN trained with the new
algorithm. The result shows that the combination of MNS and the corresponding
BP training algorithm significantly downsize the system and improve the energy
efficiency to tens of times while giving similar performance to traditional
ONNs.
更多查看译文
关键词
optical neural networks,multiplexed neuron sets,neural networks
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要