|
|
具有一类不连续非单调激活函数的时滞递归神经网络的多稳定性分析
|
Abstract:
本文提出了一类不连续非单调激活函数，研究了具有这类激活函数的时滞递归神经网络的多稳定性。根据激活函数的几何特性和不动点定理，给出充分条件确保n维神经网络至少存在7n个平衡点，其中4n个是局部指数稳定的。然后，我们将结果推广到更一般的情况。在不增加充分条件的情况下，本文通过增加激活函数峰值点的数量k，得到n维神经网络可以具有 (2k+3)n 平衡点，其中是 (k+2)n 局部指数稳定的。与之前文献相比，总平衡点和稳定平衡点的数量大大地增加了，从而提高了递归神经网络的存储容量。最后，给出了一个例子来证明我们的理论结果。
This paper proposes a class of discontinuous and non-monotonic activation functions and studies the multistability of delayed recurrent neural network with these activation functions. By the geometrical properties of activation function and fixed point theorem, some sufficient conditions are presented to ensure that n-dimensional neural networks can have at least 7n equilibria, where 4n equilibria are locally exponentially stable. Then, the obtained results are extended to a more general case. Without adding sufficient conditions, this paper increases the number of peak points (k) of the activation function and finds that the n-dimensional neural networks can have (2k+3)n equilibria, where (k+2)n equilibria of them are locally exponentially stable. Compared with the previous literature, the numbers of total equilibria and stable equilibria are enormously increased, thus enhancing the memory storage capacity of DRNN. Finally, one example is presented to demonstrate our theoretical results.
| [1] | Cao, J. and Zhou, D. (1998) Stability Analysis of Delayed Cellular Neural Networks. Neural Networks, 11, 1601-1605.
https://doi.org/10.1016/S0893-6080(98)00080-X |
| [2] | Faydasicok, O. and Arik, S. (2012) Robust Stability Analysis of a Class of Neural Networks with Discrete Time Delays. Neural Networks, 29, 52-59. https://doi.org/10.1016/j.neunet.2012.02.001 |
| [3] | Di Marco, M., Forti, M. and Pancioni, L. (2017) New Conditions for Global Asymptotic Stability of Memristor Neural Networks. IEEE Transactions on Neural Networks and Learning Systems, 29, 1822-1834.
https://doi.org/10.1109/TNNLS.2017.2688404 |
| [4] | Zeng, Z. and Zheng, W.X. (2012) Multistability of Neural Networks with Time-Varying Delays and Concave-Convex Characteristics. IEEE Transactions on Neural Networks and Learning Systems, 23, 293-305.
https://doi.org/10.1109/TNNLS.2011.2179311 |
| [5] | Hu, B., Guan, Z.H., Chen, G., et al. (2018) Multistability of Delayed Hybrid Impulsive Neural Networks with Application to Associative Memories. IEEE Transactions on Neural Networks and Learning Systems, 30, 1537-1551.
https://doi.org/10.1109/TNNLS.2018.2870553 |
| [6] | Zeng, Z., Wang, J. and Liao, X. (2004) Stability Analysis of Delayed Cellular Neural Networks Described Using Cloning Templates. IEEE Transactions on Circuits and Systems I: Regular Papers, 51, 2313-2324.
https://doi.org/10.1109/TCSI.2004.836855 |
| [7] | Cheng, C.Y., Lin, K.H. and Shih, C.W. (2006) Multistability in Recurrent Neural Networks. SIAM Journal on Applied Mathematics, 66, 1301-1320. https://doi.org/10.1137/050632440 |
| [8] | Zeng, Z. and Zheng, W.X. (2013) Multistability of Two Kinds of Recurrent Neural Networks with Activation Functions Symmetrical about the Origin on the Phase Plane. IEEE Transactions on Neural Networks and Learning Systems, 24, 1749-1762. https://doi.org/10.1109/TNNLS.2013.2262638 |
| [9] | Liu, P., Zeng, Z. and Wang, J. (2017) Complete Stability of Delayed Recurrent Neural Networks with Gaussian Activation Functions. Neural Networks, 85, 21-32. https://doi.org/10.1016/j.neunet.2016.09.006 |
| [10] | Wang, L. and Chen, T. (2012) Multistability of Neural Networks with Mexican-Hat-Type Activation Functions. IEEE Transactions on Neural Networks and Learning Systems, 23, 1816-1826.
https://doi.org/10.1109/TNNLS.2012.2210732 |
| [11] | Nie, X. and Zheng, W.X. (2015) Multistability of Neural Networks with Discontinuous Non-Monotonic Piecewise Linear Activation Functions and Time-Varying Delays. Neural Networks, 65, 65-79.
https://doi.org/10.1016/j.neunet.2015.01.007 |
| [12] | Shen, Y., Zhu, S., Liu, X., et al. (2021) Multistability and Associative Memory of Neural Networks with Morita-Like Activation Functions. Neural Networks, 142, 162-170. https://doi.org/10.1016/j.neunet.2021.04.035 |
