Training threshold neural networks by extreme learning machine and adaptive stochastic resonance - Université d'Angers Accéder directement au contenu
Article Dans Une Revue Physics Letters A Année : 2022

Training threshold neural networks by extreme learning machine and adaptive stochastic resonance

Zejia Chen
  • Fonction : Auteur
Fabing Duan
Derek Abbott

Résumé

Threshold neural networks are highly useful in engineering applications due to their ease of hardware implementation and low computational complexity. However, such threshold networks have non-differentiable activation functions and therefore cannot be trained by standard gradient-based algorithms. To circumvent this limitation, here we propose a hybrid training algorithm for threshold neural networks. The proposed hybrid training algorithm has two distinguishing features: the structural transformation of the hidden layer enables threshold networks to benefit from a noise-boosted learning capability via adaptive stochastic resonance (ASR), and by using the fast learning algorithm of the extreme learning machine (ELM) suitable generalization performance ensues for the threshold networks. Experimental results on regression and on multiclass classification demonstrate the realizability and practical efficiency of the proposed hybrid training algorithm, thereby demonstrating the beneficial role of artificial noise injection in threshold neural networks.
Fichier non déposé

Dates et versions

hal-03585968 , version 1 (23-02-2022)

Identifiants

Citer

François Chapeau-Blondeau, Zejia Chen, Fabing Duan, Derek Abbott. Training threshold neural networks by extreme learning machine and adaptive stochastic resonance. Physics Letters A, 2022, 432, pp.128008,1-7. ⟨10.1016/j.physleta.2022.128008⟩. ⟨hal-03585968⟩
11 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More