Training Multi-Layer Perceptron with Enhanced Brain Storm Optimization Metaheuristics
Training Multi-Layer Perceptron with Enhanced Brain Storm Optimization Metaheuristics
Autori:
Časopis: CMC-Computers, Materials & Continua
Volume, no: 70 , 2
ISSN: 1546-2226
Stranice: 4199-4215
Apstrakt:
In the domain of artificial neural networks, the learning process represents one of the most challenging tasks. Since the classification accuracy highly depends on the weights and biases, it is crucial to find its optimal or suboptimal values for the problem at hand. However, to a very large search space, it is very difficult to find the proper values of connection weights and biases. Employing traditional optimization algorithms for this issue leads to slow convergence and it is prone to get stuck in the local optima. Most commonly, back-propagation is used for multi-layer-perceptron training and it can lead to vanishing gradient issue. As an alternative approach, stochastic optimization algorithms, such as nature-inspired metaheuristics are more reliable for complex optimization tax, such as finding the proper values of weights and biases for neural network training. In this work, we propose an enhanced brain storm optimization-based algorithm for training neural networks. In the simulations, ten binary classification benchmark datasets with different difficulty levels are used to evaluate the efficiency of the proposed enhanced brain storm optimization algorithm. The results show that the proposed approach is very promising in this domain and it achieved better results than other state-of-the-art approaches on the majority of datasets in terms of classification accuracy and convergence speed, due to the capability of balancing the intensification and diversification and avoiding the local minima. The proposed approach obtained the best accuracy on eight out of ten observed dataset, outperforming all other algorithms by 1–2% on average. When mean accuracy is observed, the proposed algorithm dominated on nine out of ten datasets.
Ključne reči: Artificial neural network; optimization; metaheuristics; algorithm hybridization; brain storm optimization
Priložene datoteke:
- Nebojsa Bacanin Dzakula, Khaled Alhazmi, Miodrag Zivkovic, K Venkatachalam, Timea Bezdan, Jamel Nebhen. 2022 [8458].pdf ( veličina: 904,68 KB, broj pregleda: 226 )
Kategorije objave:
Bibliografske reference nastavnika Univerziteta Singidunum
Zahvaljujemo se što ste preuzeli publikaciju sa portala Singipedia.
Ukoliko želite da se prijavite za obaveštenja o sadržajima iz oblasti ove publikacije, možete nam ostaviti adresu svoje elektronske pošte.