Skip to Main content Skip to Navigation
Conference papers

Weight identification through global optimization in a new hysteretic neural network model

Abstract : Unlike their biological counterparts, simple artificial neural networks are unable to retain information from their past state to influence their behavior. In this contribution, we propose to consider new nonlinear activation functions, whose outputs depend both from the current and past inputs through a hysteresis effect. This hysteresis model is developed in the framework of convolutional neural networks. We then show that, by choosing the nonlinearity in the vast class of rational functions, the identification of the weights amounts to solving a rational optimization problem. For the latter, recent methods are applicable that come with global optimality guarantee, contrary to most optimization methods used in the neural network community. Finally, simulations show that such hysteresis nonlinear activation functions cannot be approximated by traditional ones and illustrate the effectiveness of our weight identification method.
Document type :
Conference papers
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03227078
Contributor : Arthur Marmin <>
Submitted on : Sunday, May 16, 2021 - 7:07:35 PM
Last modification on : Friday, June 18, 2021 - 4:02:02 PM

File

article_icassp2021.pdf
Files produced by the author(s)

Identifiers

Citation

Elie Leroy, Arthur Marmin, Marc Castella, Laurent Duval. Weight identification through global optimization in a new hysteretic neural network model. ICASSP 2021: 46th International Conference on Acoustics, Speech and Signal Processing, Jun 2021, Toronto (online), Canada. pp.5315-5319, ⟨10.1109/ICASSP39728.2021.9413383⟩. ⟨hal-03227078⟩

Share

Metrics

Record views

100

Files downloads

58